-- Logs begin at Tue 2022-10-25 02:18:40 UTC, end at Tue 2022-10-25 04:45:52 UTC. -- Oct 25 02:49:46.606178 n-d-862355-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 25 02:49:46.614886 n-d-862355-1 devstack@n-api.service[104551]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 25 02:49:46 2022] *** Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: nodename: n-d-862355-1 Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: machine: x86_64 Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: clock source: unix Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: pcre jit disabled Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: detected number of CPU cores: 4 Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: current working directory: / Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: detected binary path: /usr/bin/uwsgi-core Oct 25 02:49:46.616858 n-d-862355-1 devstack@n-api.service[104551]: your processes number limit is 47680 Oct 25 02:49:46.617633 n-d-862355-1 devstack@n-api.service[104551]: your memory page size is 4096 bytes Oct 25 02:49:46.617633 n-d-862355-1 devstack@n-api.service[104551]: detected max file descriptor number: 2048 Oct 25 02:49:46.617633 n-d-862355-1 devstack@n-api.service[104551]: lock engine: pthread robust mutexes Oct 25 02:49:46.617633 n-d-862355-1 devstack@n-api.service[104551]: thunder lock: enabled Oct 25 02:49:46.617633 n-d-862355-1 devstack@n-api.service[104551]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 25 02:49:46.617633 n-d-862355-1 devstack@n-api.service[104551]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 25 02:49:46.656092 n-d-862355-1 devstack@n-api.service[104551]: Python main interpreter initialized at 0x555be6c919c0 Oct 25 02:49:46.656092 n-d-862355-1 devstack@n-api.service[104551]: python threads support enabled Oct 25 02:49:46.656092 n-d-862355-1 devstack@n-api.service[104551]: your server socket listen backlog is limited to 100 connections Oct 25 02:49:46.656092 n-d-862355-1 devstack@n-api.service[104551]: your mercy for graceful operations on workers is 90 seconds Oct 25 02:49:46.656421 n-d-862355-1 devstack@n-api.service[104551]: mapped 403077 bytes (393 KB) for 2 cores Oct 25 02:49:46.656502 n-d-862355-1 devstack@n-api.service[104551]: *** Operational MODE: preforking *** Oct 25 02:49:46.656739 n-d-862355-1 devstack@n-api.service[104551]: *** uWSGI is running in multiple interpreter mode *** Oct 25 02:49:46.656739 n-d-862355-1 devstack@n-api.service[104551]: spawned uWSGI master process (pid: 104551) Oct 25 02:49:46.656921 n-d-862355-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 25 02:49:46.657499 n-d-862355-1 devstack@n-api.service[104551]: spawned uWSGI worker 1 (pid: 104552, cores: 1) Oct 25 02:49:46.657857 n-d-862355-1 devstack@n-api.service[104551]: spawned uWSGI worker 2 (pid: 104553, cores: 1) Oct 25 02:49:46.658390 n-d-862355-1 devstack@n-api.service[104551]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 25 02:49:47.322813 n-d-862355-1 devstack@n-api.service[104552]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 25 02:49:47.323699 n-d-862355-1 devstack@n-api.service[104553]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 25 02:49:48.402060 n-d-862355-1 devstack@n-api.service[104553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:49:48.402060 n-d-862355-1 devstack@n-api.service[104553]: from cryptography.utils import int_from_bytes Oct 25 02:49:48.402780 n-d-862355-1 devstack@n-api.service[104552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:49:48.402780 n-d-862355-1 devstack@n-api.service[104552]: from cryptography.utils import int_from_bytes Oct 25 02:49:48.402780 n-d-862355-1 devstack@n-api.service[104552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:49:48.402780 n-d-862355-1 devstack@n-api.service[104552]: from cryptography.utils import int_from_bytes Oct 25 02:49:48.403250 n-d-862355-1 devstack@n-api.service[104553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:49:48.403250 n-d-862355-1 devstack@n-api.service[104553]: from cryptography.utils import int_from_bytes Oct 25 02:49:50.946601 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 02:49:50.947158 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 02:49:50.947372 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 02:49:50.947732 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 02:49:50.947987 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 02:49:50.948370 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.948696 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.949019 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.949339 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.949667 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.950014 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.950209 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 02:49:50.950584 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.950668 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 02:49:50.950745 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.950958 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.951044 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 02:49:50.951219 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.951313 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 02:49:50.951536 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.951620 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 02:49:50.951866 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862355-1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.951969 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.952191 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.952286 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.952499 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.952638 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.952807 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.952944 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.953125 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.953252 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.953428 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.953561 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.953765 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.953910 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.954083 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.954218 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.954404 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.954579 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.955016 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.955016 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.955295 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.955407 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862355-1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.955519 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.955776 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.956115 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.956232 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.956431 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.956567 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.956741 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.956874 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.957062 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.957204 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.957370 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.957496 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.957704 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.957832 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.958009 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.958147 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.958401 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862355-1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.958545 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.958720 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.958847 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.959033 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.959220 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.959347 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.959480 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.959701 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.959826 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.960009 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.960141 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.960316 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.960451 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.960627 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.960755 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.960929 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.961055 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.961246 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.961374 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.961549 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.961727 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.961915 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.962055 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862355-1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.962237 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.962364 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.962554 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.962689 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.962855 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.962981 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.963159 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.963286 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.963462 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.963590 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.963784 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.963918 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.964091 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.964218 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.964400 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.964528 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.964660 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.964790 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.964947 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.965083 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.965268 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.965394 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.965589 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.965752 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.965982 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.966124 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.966259 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.966382 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.966504 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.966628 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.966792 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.966932 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.967115 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.967243 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.967426 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.967553 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.967736 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.967870 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.967993 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.968114 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.968275 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.968402 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.968592 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.968721 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.968908 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.969041 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.969223 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.969347 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.969480 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.969604 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.969746 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.969883 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.970038 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.970247 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.970372 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.970495 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.970645 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.971322 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.971641 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.971978 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.972122 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.972247 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.972368 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.972546 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.972683 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.972887 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.973016 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.973194 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.973327 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.973500 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.973641 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.973831 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.973962 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.974150 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.974287 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.974458 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.974591 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.974767 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.974902 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.975067 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.975193 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.975385 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.975524 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.975719 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.975845 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976011 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976144 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976275 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976397 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976551 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976677 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976858 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.976991 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.977181 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.977308 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.977488 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.977614 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.977819 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.977946 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.978130 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.978259 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.978432 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.978559 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.978739 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.978863 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.979043 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.979170 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.979351 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.979476 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.979657 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.979790 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.979913 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.980034 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.980190 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.980325 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.980492 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.980633 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.980805 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.980933 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.981107 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.981233 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.981408 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.981543 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.981730 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.981862 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.982027 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.982164 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.982331 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.982468 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.982632 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.982758 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.982934 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.983071 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.983234 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.983375 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.983534 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.983660 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.983833 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.983960 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.984134 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.984269 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.984437 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.984564 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.984738 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.984864 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.985038 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.985174 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.985351 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.985486 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.985657 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.985854 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.985988 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.986101 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.986270 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.986416 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.987181 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.987498 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.987700 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.987829 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.988024 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.988151 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.988350 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.988476 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.988660 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.988796 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.988970 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.989096 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.989282 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.989408 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.989590 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.989764 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.989919 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.990046 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.990225 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.990359 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.990528 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.990662 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.990831 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.990969 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.991148 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.991283 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.991446 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.991573 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.991749 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.991877 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.992055 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.992189 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.992356 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.992484 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.992657 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.992769 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.995473 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.995658 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.995793 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.995927 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.996053 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.996175 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.996304 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.996436 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.996560 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.996682 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.996803 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.996926 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.997057 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.997182 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.997303 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.997424 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.997545 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.997667 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.997855 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.997987 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.998110 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.998238 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.998367 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.998489 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.998619 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:49:50.998741 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.998861 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.998982 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.999104 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.999225 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.999354 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.999476 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.999603 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.999726 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:50.999847 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000047 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000173 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000295 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000417 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000559 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000689 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000812 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.000941 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001064 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001186 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001314 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001436 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001566 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001703 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001703 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.001937 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002077 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002202 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002333 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002456 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002578 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002699 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002820 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.002941 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003071 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003194 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003194 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003194 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003544 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003666 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003795 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.003917 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004046 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004168 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004289 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004433 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004557 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004679 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004800 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.004922 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005043 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005173 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005295 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005425 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005547 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005668 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005818 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.005950 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.006072 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.006195 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.006306 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.006514 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.006628 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.006840 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.006953 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.007158 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.007279 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.007474 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.007588 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.007784 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.007896 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.008096 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.008220 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.008403 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.008524 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.008708 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.008883 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.009018 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.009142 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.009306 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.009447 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.009611 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.009771 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.009946 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.010081 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.010249 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.010389 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.010571 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.010697 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.010884 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.011008 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.011198 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.011335 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.011982 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012109 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012232 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012367 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012499 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012623 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012746 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012867 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.012989 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.013120 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.013243 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.013372 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.013495 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.013617 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.013763 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.013901 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014026 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014148 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014270 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014391 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014519 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014651 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014772 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.014895 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.015043 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.015171 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.015346 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.015483 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.015673 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.015802 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.015973 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.016100 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.016279 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.016407 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.016586 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.016713 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.016890 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.017026 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.017191 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.017319 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.017497 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.017625 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.017880 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.018198 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.018401 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.018533 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.018655 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.018847 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.018975 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.019154 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.019290 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.019479 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.019606 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.019805 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.019940 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.020112 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.020249 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.020414 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.020561 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.020724 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.020849 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.021056 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.021182 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.021310 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.021433 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.021615 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.021780 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.021949 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.022076 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.022258 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.022385 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.022564 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.022699 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.022870 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.022996 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.023176 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.023303 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.023482 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.023617 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.023792 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.023908 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.024102 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.024226 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.024407 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.024542 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.024715 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.024841 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.025015 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.025148 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.025322 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.025458 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.025624 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.025780 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.025994 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.026208 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.026347 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.026488 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.026612 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.026741 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.026870 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.026992 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.027122 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.027245 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.027411 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.027560 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.027693 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.027876 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.028012 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.028192 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.028336 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.028510 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.028635 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.028826 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.028961 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.029151 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.029277 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.029454 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.029580 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.029801 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.029938 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.030158 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.030289 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.030420 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.030543 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.030734 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.030862 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.031059 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.031185 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.031368 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.031496 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.031681 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.031815 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.031995 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.032098 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.032303 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.032400 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.032612 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.032710 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.032919 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.033016 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.033227 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.033869 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.034142 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.034457 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.034633 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.034773 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.034954 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.035087 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.035279 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.035402 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.035594 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.035724 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.035918 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.036273 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.036483 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.036595 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.036803 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.036903 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.037107 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.037204 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.037422 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.037512 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.037784 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.037877 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.038119 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.038225 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.038437 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.038529 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.038758 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.038845 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.039068 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.039164 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.039382 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.039469 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.039692 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.039777 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.040002 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.040089 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.040310 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.040410 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.040620 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.040706 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.040933 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.041029 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.041239 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.041325 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.041545 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.041630 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.041884 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.041984 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.042200 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.042288 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.042508 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.042595 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.042824 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.042911 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.043128 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.043223 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.043441 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.043536 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.043751 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.043837 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.044057 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.044166 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.044365 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.044471 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.044675 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.044761 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.044991 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.045084 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.045298 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.045394 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.045605 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.045717 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.045938 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.046033 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.046244 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.046341 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.046547 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.046635 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.046854 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.046940 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.047165 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.047252 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.047469 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.047554 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.047774 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.047860 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.048075 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.048163 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.048398 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.048502 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.048686 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.048774 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.049606 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.049790 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.050074 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.050162 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.050390 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.050478 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.050714 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.050804 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.051027 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.051114 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.051340 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.051509 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.051656 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.051744 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.051960 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.052059 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.052263 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.052360 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.052581 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.052667 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.052885 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.052975 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.053188 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.053285 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.053491 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.053587 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.053819 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.053923 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.054143 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.054243 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.054455 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.054545 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.054757 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.054844 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.055069 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.055157 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.055378 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.055465 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.055685 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.055784 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.055997 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.056085 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.056303 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.056569 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.056656 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.056907 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.057008 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.057213 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.057299 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.057519 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.057606 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.057864 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.057970 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.058174 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.058271 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.058486 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.058598 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.058793 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.058889 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.059112 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.059214 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.059423 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.059514 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.059730 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.059821 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.060035 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.060124 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.060333 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.060422 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.060638 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.060738 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.060944 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.061046 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.061252 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.061500 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.061592 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.061855 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.061948 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.062197 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.062265 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.062462 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.062552 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.062769 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.062860 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.063075 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.063199 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.063389 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.063538 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.063697 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.063849 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.064011 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.064163 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.064299 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.064470 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.064667 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.064850 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.065143 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.065436 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.065581 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.065773 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.065919 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.066068 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.066207 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.066381 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.066524 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.066687 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.066844 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.066992 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.067130 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.067280 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.067428 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.067564 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.067708 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.067846 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.067981 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.068150 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.068295 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.068452 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.068614 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.068759 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.068896 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.069039 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.069183 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.069339 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.069476 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.069641 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.069813 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.069984 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.070128 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.070275 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.070413 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.070579 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.070724 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.070884 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.071028 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.071173 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.071326 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.071508 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.071661 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.071798 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.071934 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.072169 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.072322 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.072467 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.072606 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.072742 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.072887 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.073025 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.073171 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.073308 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.073445 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.073612 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.073795 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.073935 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.074071 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.074242 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.074385 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.074548 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.074701 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.074839 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.074980 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.075127 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.075263 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.075430 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.075657 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.075799 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.075943 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.076083 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.076225 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.076374 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.076518 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.076660 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.076797 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.076933 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.077082 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.077226 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.077362 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.077497 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.077647 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.077876 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.078020 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.078173 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.078310 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.078476 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.078620 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.078778 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.078922 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.079076 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.079212 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.079355 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.079491 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.079667 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.079820 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.079958 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.080092 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.080281 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.080425 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.080719 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.081033 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.081185 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.081343 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.081486 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.081650 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.081819 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.081968 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.082106 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.082259 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.082400 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.082567 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.082710 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.082865 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.083011 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.083157 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.083293 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.083460 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.083613 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.083750 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.083885 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.084072 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.084215 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.084379 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.084531 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.084675 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.084826 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.084962 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.085108 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.085244 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.085389 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.085561 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.085756 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.085902 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.086039 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.086176 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.086328 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.086471 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.086607 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.086763 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.086908 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.087062 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.087200 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.087335 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.087479 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.087641 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.087792 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.087937 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.088074 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.088218 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.088362 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.088498 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.088633 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.088780 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.088926 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.089062 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.089234 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.089378 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.089521 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.089666 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.089837 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.089974 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.090164 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.090309 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.090478 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.090642 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.090791 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.090935 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.091100 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.091245 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.091424 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.091568 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.091749 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.091900 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.092057 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.092201 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.092371 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.092516 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.092684 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.092836 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.092995 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.093139 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.093306 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.093458 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.093595 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.093793 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.093937 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.094073 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.094218 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.094354 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.094522 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.094673 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.094820 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.094965 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.095103 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.095246 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.095389 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.095530 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.095701 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.096367 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.096587 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.096899 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.097050 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.097227 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.097371 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.097528 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.097694 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.097841 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.097988 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.098133 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.098276 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.098444 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.098589 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.098756 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.098906 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.099050 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.099199 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.099411 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.099553 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.099721 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.099864 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.100034 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.100187 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.100325 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.100467 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.100639 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.100782 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.100946 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.101101 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.101238 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.101391 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.101528 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.101663 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.101862 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.102008 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.102145 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.102280 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.102447 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.102591 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.102770 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.102915 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.103058 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.103194 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.103364 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.103515 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.103660 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.103797 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.103961 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.104104 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.104269 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.104420 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.104630 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.104769 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.104946 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.105088 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.105234 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.105371 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.105562 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.105734 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.105879 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.106014 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.106185 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.106339 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.106477 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.106611 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.106792 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.106950 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.107098 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.107253 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.107396 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.107590 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.107787 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.107930 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.108096 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.108251 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.108388 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.108524 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.108694 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.108842 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.109020 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.109170 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.109318 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.109454 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.109589 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.109776 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.109932 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.110069 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.110204 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.110340 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.110481 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.110661 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.110814 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.110971 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.111119 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.111266 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.111473 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.112167 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.112430 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.112738 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.112899 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.113139 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.113288 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.113465 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.113614 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.113795 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.113949 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.114204 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.114357 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.114500 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.114649 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.114813 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.114972 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.115116 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.115259 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.115434 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.115583 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.115804 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.115950 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.116093 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.116247 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.116389 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.116551 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.116704 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.116847 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.116990 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.117132 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.117280 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.117422 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.117584 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.117795 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.117946 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.118089 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.118243 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.118386 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.118545 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.118690 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.118833 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.118982 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.119202 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.119360 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.119504 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.119646 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.119790 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.119933 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.120086 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.120238 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.120382 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.120532 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.120675 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.120819 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.120961 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.121112 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.121262 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.121405 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.121553 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.121715 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.121867 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.122031 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.122182 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.122324 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.122475 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.122619 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.122770 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.122921 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.123072 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.123214 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.123357 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.123500 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.123650 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.123793 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.123949 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.124092 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.124234 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.124389 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.124540 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.124683 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.124826 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.124969 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.125117 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.125260 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.125411 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.125555 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.125735 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.125914 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.126116 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.126274 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.126427 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.126577 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.126720 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.126870 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.127121 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.127380 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.127553 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.127698 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.127698 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.127977 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.128131 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.128283 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.128426 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.128576 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.128718 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.128860 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.129002 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.129154 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.129298 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.129440 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.129582 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.129758 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.129930 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.130074 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.130217 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.130359 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.130501 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.130643 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.130793 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.130937 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.131078 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.131232 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.131374 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.131516 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.131666 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.131826 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.131969 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.132117 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.132260 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.132402 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.132552 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.132701 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.132844 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.133027 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.133179 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.133331 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.133474 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.133656 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.133871 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.134029 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.134172 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.134321 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.134465 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.134607 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.134749 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.134891 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.135032 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.135182 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.135326 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.135469 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.135628 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.135779 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.135922 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.136072 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.136216 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.136357 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.136604 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.136756 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.136911 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.137053 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.137201 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.137351 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.137501 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.137658 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.137849 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.138002 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.138145 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.138287 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.138428 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.138607 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.138767 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.138911 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.139090 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.139239 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.139381 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.139532 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.139693 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.139836 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.139979 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.140120 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.140262 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.140413 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.140564 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.140714 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.140864 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.141007 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.141149 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.141299 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.141452 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.141595 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.141793 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.141940 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.142083 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.142237 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.142488 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.142670 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.142823 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.143137 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.143300 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.143454 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.143607 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.143750 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.143927 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.144077 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.144295 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.144441 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.144584 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.144725 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.144875 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.145027 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.145170 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.145311 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.145464 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.145607 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.145784 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.145942 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.146086 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.146229 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.146371 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.146512 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.146677 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.146838 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.146994 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.147138 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.147321 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.147553 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.147729 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.147878 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.148022 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.148165 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.148307 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.148449 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.148599 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.148810 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.148960 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.149134 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.149298 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.149451 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.149594 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.149791 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.149938 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.150082 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.150224 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.150377 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.150521 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.150664 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.150806 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.150948 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.151090 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.151257 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.151402 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.151550 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.151700 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.151843 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.151986 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.152136 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.152281 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.152422 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.152564 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.152730 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.152898 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.153052 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.153196 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.153362 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.153519 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.153663 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.153853 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.153998 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.154140 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.154284 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.154579 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.154730 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.154929 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.155081 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.155248 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.155393 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.155566 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.155717 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.155895 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.156048 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.156216 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.156368 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.156511 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.156662 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.156838 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.156989 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.157132 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.157285 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.157428 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.157578 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.157758 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.157908 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.158062 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.158205 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.158917 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.159237 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.159388 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.159637 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.159788 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.159941 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.160093 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.160237 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.160380 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.160550 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.160700 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.160843 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.161242 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.161424 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.161583 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.161766 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.161977 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.162128 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.162323 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.162477 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.162641 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.162791 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.162933 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.163075 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.163226 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.163369 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.163511 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.163661 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.163805 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.163955 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.164120 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.164281 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.164424 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.164566 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.164709 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.164864 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.165008 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.165150 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.165292 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.165435 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.165638 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.165843 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.165989 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.166132 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.166286 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.166436 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.166579 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.166729 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.166873 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.167015 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.167156 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.167298 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.167453 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.167597 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.167739 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.167882 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.168024 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.168177 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.168328 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.168471 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.168619 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.168792 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.168946 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.169088 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.169239 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.169383 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.169531 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.169762 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.169924 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.170088 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.170245 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.170389 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.170538 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.170681 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.170823 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.170972 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.171117 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.171258 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.171407 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.171556 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.171699 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.171854 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.172013 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.172158 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.172299 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.172441 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.172615 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.172774 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.172932 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.173076 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.173218 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.173361 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.173524 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.173808 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.174039 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.174204 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.174349 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.174776 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.175202 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.175397 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.175547 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.175722 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.175873 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.176038 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.176197 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.176384 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.176534 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.176705 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.176856 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.177000 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.177222 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.177375 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.177558 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.177734 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.177895 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.178053 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.178225 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.178383 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.178555 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.178705 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.178858 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.179010 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.179164 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.179308 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.179452 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.179600 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.179747 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.179899 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.180049 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.180192 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.180334 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.180477 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.180629 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.180780 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.180933 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.181076 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.181225 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.181368 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.181518 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.181843 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.181999 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.182153 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.182298 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.182450 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.182608 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.182763 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.182907 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.183049 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.183220 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.183370 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.183549 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.183708 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.183880 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.184027 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.184169 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.184321 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.184492 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.184652 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.184798 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.184949 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.185115 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.185275 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.185426 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.185569 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.185739 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.185891 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.186035 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.186189 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.186333 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.186485 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.186629 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.186772 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.186927 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.187070 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.187212 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.187362 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.187504 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.187648 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.187799 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.187943 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.188085 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.188227 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.188478 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.188746 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.188905 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.189050 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.189192 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.189357 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.189513 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.189513 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.190717 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.190865 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.191060 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.191212 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.191388 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.191548 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.191717 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.191868 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.192047 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.192200 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.192363 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.192522 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.192676 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.192826 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.192969 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.193111 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.193253 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.193418 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.193562 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.193734 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.193926 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.194076 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.194232 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.194375 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.194525 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.194668 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.194848 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.194999 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.195155 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.195305 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.195458 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.195601 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.195744 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.195885 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.196135 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.196290 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.196434 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.196655 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.196810 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.197034 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.197195 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.197340 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.197496 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.197647 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.197842 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.198004 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.198149 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.198291 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.198442 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.198585 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.198763 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.198924 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.199068 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.199219 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.199364 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.199517 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.199670 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.199822 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.199966 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.200107 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.200250 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.200399 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.200544 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.200694 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.200838 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.200995 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.201151 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.201295 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.201457 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.201600 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.201776 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.201923 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.202067 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.202210 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.202364 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.202509 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.202652 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.202794 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.202936 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.203087 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.203249 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.203393 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.203536 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.203679 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.203822 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.204043 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.204190 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.204332 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.204475 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.204619 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.204770 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.204922 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.205075 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.205810 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.206134 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.206293 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.206530 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.206789 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.206941 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.207109 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.207259 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.207427 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.207591 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.207736 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.207881 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.208043 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.208188 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.208337 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.208493 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.208644 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.208795 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.208939 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.209123 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.209271 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.209428 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.209572 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.209771 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.209924 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.210091 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.210244 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.210398 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.210548 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.210692 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.210835 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.210985 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.211139 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.211356 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 02:49:51.211508 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.211788 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.212098 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.212406 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.212716 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.213025 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.213338 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.213647 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.213977 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.214291 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.214602 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.214927 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.215250 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.215557 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.215881 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.216203 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.216573 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.216850 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.217191 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.217515 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.217852 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.218164 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.218466 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:49:51.218709 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 02:49:51.365987 n-d-862355-1 devstack@n-api.service[104552]: INFO dbcounter [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Registered counter for database nova_api Oct 25 02:49:51.376866 n-d-862355-1 devstack@n-api.service[104553]: INFO dbcounter [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Registered counter for database nova_api Oct 25 02:49:51.388828 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.395759 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writer thread running {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.397889 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_db.sqlalchemy.engines [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.404323 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writer thread running {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.453507 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.context [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=104552) load_cells /opt/stack/nova/nova/context.py:464}} Oct 25 02:49:51.457600 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:49:51.458107 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:49:51.459703 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:49:51.460411 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:49:51.460855 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:49:51.460963 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.context [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=104553) load_cells /opt/stack/nova/nova/context.py:464}} Oct 25 02:49:51.462871 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:49:51.464742 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_concurrency.lockutils [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:49:51.464862 n-d-862355-1 devstack@n-api.service[104552]: INFO dbcounter [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Registered counter for database nova_cell0 Oct 25 02:49:51.465209 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_concurrency.lockutils [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:49:51.466842 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_concurrency.lockutils [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:49:51.467554 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_concurrency.lockutils [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:49:51.467994 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_concurrency.lockutils [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:49:51.468949 n-d-862355-1 devstack@n-api.service[104552]: INFO dbcounter [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Registered counter for database nova_cell1 Oct 25 02:49:51.470003 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_concurrency.lockutils [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:49:51.472118 n-d-862355-1 devstack@n-api.service[104553]: INFO dbcounter [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Registered counter for database nova_cell0 Oct 25 02:49:51.476158 n-d-862355-1 devstack@n-api.service[104553]: INFO dbcounter [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Registered counter for database nova_cell1 Oct 25 02:49:51.477326 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.478679 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.483416 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_db.sqlalchemy.engines [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.486384 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writer thread running {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.487325 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writer thread running {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.487558 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_db.sqlalchemy.engines [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.489598 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writer thread running {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.629859 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writer thread running {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.632278 n-d-862355-1 devstack@n-api.service[104552]: INFO dbcounter [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Registered counter for database nova_cell0 Oct 25 02:49:51.638611 n-d-862355-1 devstack@n-api.service[104553]: INFO dbcounter [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Registered counter for database nova_cell0 Oct 25 02:49:51.641243 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.645587 n-d-862355-1 devstack@n-api.service[104553]: DEBUG oslo_db.sqlalchemy.engines [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:49:51.646322 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writer thread running {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.650282 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writer thread running {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:49:51.984616 n-d-862355-1 devstack@n-api.service[104552]: WARNING keystonemiddleware.auth_token [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:49:51.985165 n-d-862355-1 devstack@n-api.service[104553]: WARNING keystonemiddleware.auth_token [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:49:51.992419 n-d-862355-1 devstack@n-api.service[104552]: WARNING keystonemiddleware.auth_token [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:49:51.992711 n-d-862355-1 devstack@n-api.service[104553]: WARNING keystonemiddleware.auth_token [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:49:52.334051 n-d-862355-1 devstack@n-api.service[104553]: WARNING keystonemiddleware.auth_token [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:49:52.335072 n-d-862355-1 devstack@n-api.service[104552]: WARNING keystonemiddleware.auth_token [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:49:52.339896 n-d-862355-1 devstack@n-api.service[104553]: WARNING keystonemiddleware.auth_token [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:49:52.341007 n-d-862355-1 devstack@n-api.service[104552]: WARNING keystonemiddleware.auth_token [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:49:52.345113 n-d-862355-1 devstack@n-api.service[104553]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555be6c919c0 pid: 104553 (default app) Oct 25 02:49:52.346974 n-d-862355-1 devstack@n-api.service[104552]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555be6c919c0 pid: 104552 (default app) Oct 25 02:49:52.347935 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:49:52.349112 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-2df22466-cec8-4285-a9dc-145cdf57abe4 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001898 Oct 25 02:49:52.349511 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Oct 25 02:49:52 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:14.574292 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:14.576492 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002950 Oct 25 02:51:14.580834 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:14 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:14.589655 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_api:SELECT=3 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:14.590697 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_cell0:SELECT=3 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:14.592908 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_cell1:SELECT=3 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:14.593940 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:15.464136 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-0bf76294-535e-4004-8404-9a427da1af8f admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:15.498282 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-0bf76294-535e-4004-8404-9a427da1af8f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913268 Oct 25 02:51:15.501723 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 02:51:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:18.156210 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:18.157226 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-d5b31101-7f99-43d6-a712-16fa037ce562 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 25 02:51:18.157803 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:18.630069 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-b3084abc-3778-4c0c-85ab-7915e8ccf4a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:18.678659 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-b3084abc-3778-4c0c-85ab-7915e8ccf4a9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.514251 Oct 25 02:51:18.679423 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 02:51:18.692925 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writing DB stats nova_api:SELECT=3 {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:18.693733 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writing DB stats nova_cell1:SELECT=3 {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:18.695666 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writing DB stats nova_cell0:SELECT=3 {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:18.696526 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:18.900060 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-87195d0e-d804-43a5-9033-1eac56fe0345 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:18.970712 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-87195d0e-d804-43a5-9033-1eac56fe0345 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283046 Oct 25 02:51:18.971316 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 25 02:51:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:21.617022 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-b3084abc-3778-4c0c-85ab-7915e8ccf4a9 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:21.618653 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-b3084abc-3778-4c0c-85ab-7915e8ccf4a9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002215 Oct 25 02:51:21.619263 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:22.472193 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-2071dc4d-7813-495b-b9d3-06ebdb0fe3fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:22.523932 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-2071dc4d-7813-495b-b9d3-06ebdb0fe3fd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.897116 Oct 25 02:51:22.525393 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:51:22.538144 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-3bf6468b-6040-4d5f-8866-f997680a2922 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:22.595764 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-3bf6468b-6040-4d5f-8866-f997680a2922 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061820 Oct 25 02:51:22.597056 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 25 02:51:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 02:51:25.408522 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-2071dc4d-7813-495b-b9d3-06ebdb0fe3fd admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:25.412985 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-2071dc4d-7813-495b-b9d3-06ebdb0fe3fd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004492 Oct 25 02:51:25.427066 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:26.078948 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-0d225861-c696-4c50-bdf3-87eea67226b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G"}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:26.099572 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-0d225861-c696-4c50-bdf3-87eea67226b7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676876 Oct 25 02:51:26.100231 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:51:26.112868 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-b9e3d82b-2c8d-43da-adb1-7329b744af69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:26.142089 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-b9e3d82b-2c8d-43da-adb1-7329b744af69 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033008 Oct 25 02:51:26.143110 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 25 02:51:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:28.829316 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-0d225861-c696-4c50-bdf3-87eea67226b7 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:28.830514 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-0d225861-c696-4c50-bdf3-87eea67226b7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Oct 25 02:51:28.831154 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:29.289297 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-9f372251-0eb2-407a-afdd-6afb6635f37f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:29.315812 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-9f372251-0eb2-407a-afdd-6afb6635f37f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478061 Oct 25 02:51:29.316496 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:51:29.328924 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-fc1d9265-3de6-4002-aad8-e1e6409e4d25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:29.367811 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-fc1d9265-3de6-4002-aad8-e1e6409e4d25 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042544 Oct 25 02:51:29.368683 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 25 02:51:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:32.133210 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-9f372251-0eb2-407a-afdd-6afb6635f37f admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:32.134973 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-9f372251-0eb2-407a-afdd-6afb6635f37f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Oct 25 02:51:32.135881 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:32.636876 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-f8598827-8f94-499e-9cb1-4197066b3492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "id": "d4", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:32.657564 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-f8598827-8f94-499e-9cb1-4197066b3492 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515594 Oct 25 02:51:32.658153 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 02:51:32.671742 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-dd9b36cd-627c-4ba2-b791-aff06b60ec7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:32.696272 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-dd9b36cd-627c-4ba2-b791-aff06b60ec7a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028438 Oct 25 02:51:32.696912 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1336 bytes} [Tue Oct 25 02:51:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 02:51:35.404477 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-f8598827-8f94-499e-9cb1-4197066b3492 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:35.405658 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-f8598827-8f94-499e-9cb1-4197066b3492 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Oct 25 02:51:35.406096 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:35.812227 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-fd783f14-33ea-41f7-917a-487a0de21d87 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:35.838703 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-fd783f14-33ea-41f7-917a-487a0de21d87 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.425760 Oct 25 02:51:35.839250 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 02:51:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 02:51:38.470725 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-f8598827-8f94-499e-9cb1-4197066b3492 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:38.471746 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-f8598827-8f94-499e-9cb1-4197066b3492 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 25 02:51:38.472716 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:38.903523 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-149a04b3-7abc-4c24-952e-30065e63e6d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:38.923852 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-149a04b3-7abc-4c24-952e-30065e63e6d2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444643 Oct 25 02:51:38.924395 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:51:38.936934 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-ba2ec4e8-22be-46c1-a8a8-2ac4f6596dfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:38.964497 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-ba2ec4e8-22be-46c1-a8a8-2ac4f6596dfc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031564 Oct 25 02:51:38.965083 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 25 02:51:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:41.674830 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-149a04b3-7abc-4c24-952e-30065e63e6d2 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:41.676323 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-149a04b3-7abc-4c24-952e-30065e63e6d2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 25 02:51:41.676717 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 02:51:42.107625 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-9bfa36f6-6f55-41a5-b37a-a5ae06c524ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:42.129969 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-9bfa36f6-6f55-41a5-b37a-a5ae06c524ba admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445765 Oct 25 02:51:42.130587 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 02:51:42.142640 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-ce56427b-64ff-477b-95e2-178a3e8273af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:42.166275 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-ce56427b-64ff-477b-95e2-178a3e8273af admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027309 Oct 25 02:51:42.166840 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 25 02:51:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:44.829822 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-9bfa36f6-6f55-41a5-b37a-a5ae06c524ba admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:44.830834 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-9bfa36f6-6f55-41a5-b37a-a5ae06c524ba admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 25 02:51:44.831250 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:45.262879 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-9ac241f8-3472-4ff2-8fc5-a78f15a9b6fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:45.284027 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-9ac241f8-3472-4ff2-8fc5-a78f15a9b6fa admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445448 Oct 25 02:51:45.284693 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 02:51:45.297009 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-5a6a840a-6dbf-4544-84d7-3cdbd728f8dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:45.303308 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:45.325943 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-5a6a840a-6dbf-4544-84d7-3cdbd728f8dc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032469 Oct 25 02:51:45.326716 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 25 02:51:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:48.049056 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-9ac241f8-3472-4ff2-8fc5-a78f15a9b6fa admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:48.050463 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-9ac241f8-3472-4ff2-8fc5-a78f15a9b6fa admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002223 Oct 25 02:51:48.051160 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:48.487307 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-e50a3a99-0b15-47a5-a7d4-ea3d5b22ca56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:48.510724 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-e50a3a99-0b15-47a5-a7d4-ea3d5b22ca56 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453009 Oct 25 02:51:48.511521 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 02:51:48.523680 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-b5b5e5e7-dfb8-4e6b-9bd8-00fe65c79ee9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:48.549196 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-b5b5e5e7-dfb8-4e6b-9bd8-00fe65c79ee9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029298 Oct 25 02:51:48.549813 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 25 02:51:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:51:51.251713 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-e50a3a99-0b15-47a5-a7d4-ea3d5b22ca56 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:51:51.252839 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-e50a3a99-0b15-47a5-a7d4-ea3d5b22ca56 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 25 02:51:51.253296 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:51:51.684197 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-0f10d90a-4e09-45fd-af7b-2581effbe44a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "swap": 0, "name": "m1.xlarge"}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:51.690789 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:51:51.706196 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-0f10d90a-4e09-45fd-af7b-2581effbe44a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.446544 Oct 25 02:51:51.707437 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1283 bytes} [Tue Oct 25 02:51:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:51:51.719451 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-d30142be-21cb-4680-bb35-ef6c9922df17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:51:51.744573 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-d30142be-21cb-4680-bb35-ef6c9922df17 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028748 Oct 25 02:51:51.745406 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1333 bytes} [Tue Oct 25 02:51:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:52:12.904621 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-0f10d90a-4e09-45fd-af7b-2581effbe44a admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:12.905648 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-0f10d90a-4e09-45fd-af7b-2581effbe44a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 25 02:52:12.906075 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:12.917113 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:52:13.299259 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-ad9786c0-30a7-4453-840e-62f7802e615f admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:13.318962 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-ad9786c0-30a7-4453-840e-62f7802e615f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406494 Oct 25 02:52:13.319487 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 02:52:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:52:14.632903 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-0f10d90a-4e09-45fd-af7b-2581effbe44a admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:14.633952 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-0f10d90a-4e09-45fd-af7b-2581effbe44a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 25 02:52:14.634351 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:15.174558 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-9ee0b82b-6d63-4926-98b6-54cdc92b0ae8 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:15.179877 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.wsgi [None req-9ee0b82b-6d63-4926-98b6-54cdc92b0ae8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-9ee0b82b-6d63-4926-98b6-54cdc92b0ae8 admin admin] Request method failure captured: Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: Accept: application/json Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: Accept-Encoding: gzip, deflate Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: Connection: keep-alive Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: Content-Length: 0 Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: Host: 10.222.0.36 Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: Openstack-Api-Version: compute 2.92 Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: Openstack-System-Scope: None Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: User-Agent: python-novaclient Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Auth-Token: gAAAAABjV09edZhJ8OrfLkRvcyf5jr-jpe9kVMR4aPFX_6QYgZZ73GmIUvr7gVScDgQgGPe04qIrjQLUIaemnwPngDpdfNL32w2EpmoJNcwCRvWsHDghkh2oKDQX1B94mtRqhVWmv-0X6LCtNuHyL4rtMay6Ntq6f_qisgv-cf3DugfLiazC9rU Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Domain-Id: None Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Domain-Name: None Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Identity-Status: Confirmed Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Is-Admin-Project: True Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Openstack-Nova-Api-Version: 2.92 Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Domain-Id: default Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Domain-Name: Default Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Name: admin Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Role: admin,reader,member Oct 25 02:52:15.183082 n-d-862355-1 devstack@n-api.service[104553]: X-Roles: admin,reader,member Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b709b344da914adc83d1a1d1b6efa0b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b709b344da914adc83d1a1d1b6efa0b0"}]}] Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant: admin Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant-Name: admin Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-User: admin Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-User-Domain-Id: default Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-User-Domain-Name: Default Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-User-Id: 2af238ecd8b94238a2afed93f810f904 Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: X-User-Name: admin Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: method: > Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: exception: Flavor 42 could not be found. Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: action_args: {'id': '42'} Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 02:52:15.184549 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:15.185467 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.186936 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-9ee0b82b-6d63-4926-98b6-54cdc92b0ae8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 02:52:15.188745 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-9ee0b82b-6d63-4926-98b6-54cdc92b0ae8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397160 Oct 25 02:52:15.188745 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 25 02:52:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 25 02:52:15.194903 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-763eae25-ec88-48f0-a3f4-ec3f6a1d0051 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:15.217282 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-763eae25-ec88-48f0-a3f4-ec3f6a1d0051 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026657 Oct 25 02:52:15.217856 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 25 02:52:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 02:52:15.237459 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-1fc9e280-63c8-4632-8a35-caf15a069134 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:15.259232 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-1fc9e280-63c8-4632-8a35-caf15a069134 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026175 Oct 25 02:52:15.259763 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 25 02:52:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:52:15.268814 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-cb58e196-836a-4481-a9a4-e26b752115a3 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:15.274804 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.wsgi [None req-cb58e196-836a-4481-a9a4-e26b752115a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-cb58e196-836a-4481-a9a4-e26b752115a3 admin admin] Request method failure captured: Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: Accept: application/json Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: Accept-Encoding: gzip, deflate Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: Connection: keep-alive Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: Content-Length: 0 Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: Host: 10.222.0.36 Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: Openstack-Api-Version: compute 2.92 Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: Openstack-System-Scope: None Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: User-Agent: python-novaclient Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Auth-Token: gAAAAABjV09edZhJ8OrfLkRvcyf5jr-jpe9kVMR4aPFX_6QYgZZ73GmIUvr7gVScDgQgGPe04qIrjQLUIaemnwPngDpdfNL32w2EpmoJNcwCRvWsHDghkh2oKDQX1B94mtRqhVWmv-0X6LCtNuHyL4rtMay6Ntq6f_qisgv-cf3DugfLiazC9rU Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Domain-Id: None Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Domain-Name: None Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Identity-Status: Confirmed Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Is-Admin-Project: True Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Openstack-Nova-Api-Version: 2.92 Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Domain-Id: default Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Domain-Name: Default Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Name: admin Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Role: admin,reader,member Oct 25 02:52:15.278074 n-d-862355-1 devstack@n-api.service[104552]: X-Roles: admin,reader,member Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b709b344da914adc83d1a1d1b6efa0b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b709b344da914adc83d1a1d1b6efa0b0"}]}] Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant: admin Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant-Name: admin Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-User: admin Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-User-Domain-Id: default Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-User-Domain-Name: Default Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-User-Id: 2af238ecd8b94238a2afed93f810f904 Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: X-User-Name: admin Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: method: > Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: exception: Flavor 42 could not be found. Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: action_args: {'id': '42'} Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 02:52:15.279508 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:15.280448 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:15.281825 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-cb58e196-836a-4481-a9a4-e26b752115a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 02:52:15.283045 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-cb58e196-836a-4481-a9a4-e26b752115a3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014198 Oct 25 02:52:15.283045 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 25 02:52:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 25 02:52:16.492887 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-1fc9e280-63c8-4632-8a35-caf15a069134 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:16.493956 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-1fc9e280-63c8-4632-8a35-caf15a069134 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 25 02:52:16.494369 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:17.019486 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-79552bea-305f-4265-8244-ddd12bf95cad admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:17.024535 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.wsgi [None req-79552bea-305f-4265-8244-ddd12bf95cad admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-79552bea-305f-4265-8244-ddd12bf95cad admin admin] Request method failure captured: Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: Accept: application/json Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: Accept-Encoding: gzip, deflate Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: Connection: keep-alive Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: Content-Length: 0 Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: Host: 10.222.0.36 Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: Openstack-Api-Version: compute 2.92 Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: Openstack-System-Scope: None Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: User-Agent: python-novaclient Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Auth-Token: gAAAAABjV09gPnz4F2kdaMMh6fBR0x4cNRDHWknbNQ8kup-f3CZbDkSvdkLFMHCz9xlqEPqhC_tiPYbaP30j93P--hRuCe7t_EJml3skRh0JSO7crnGRG-s8d35TJdbuxr85H6mdx3uKBCUkp_GSXyyFvYfUhsGKMEp9n3a5I9UST30R4Upifi0 Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Domain-Id: None Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Domain-Name: None Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Identity-Status: Confirmed Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Is-Admin-Project: True Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Openstack-Nova-Api-Version: 2.92 Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Domain-Id: default Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Domain-Name: Default Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Name: admin Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Role: admin,reader,member Oct 25 02:52:17.026073 n-d-862355-1 devstack@n-api.service[104552]: X-Roles: admin,reader,member Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b709b344da914adc83d1a1d1b6efa0b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b709b344da914adc83d1a1d1b6efa0b0"}]}] Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant: admin Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant-Name: admin Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-User: admin Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-User-Domain-Id: default Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-User-Domain-Name: Default Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-User-Id: 2af238ecd8b94238a2afed93f810f904 Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: X-User-Name: admin Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: method: > Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: exception: Flavor 84 could not be found. Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: action_args: {'id': '84'} Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 02:52:17.027561 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:17.028497 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.029895 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-79552bea-305f-4265-8244-ddd12bf95cad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 02:52:17.031192 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-79552bea-305f-4265-8244-ddd12bf95cad admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393527 Oct 25 02:52:17.031192 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 25 02:52:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 25 02:52:17.038278 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c1d132fd-a6cc-4b52-8149-f8dafebc91e3 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:17.054031 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c1d132fd-a6cc-4b52-8149-f8dafebc91e3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020341 Oct 25 02:52:17.054547 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 25 02:52:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:52:17.063752 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-b8f9fca8-437f-4e93-a688-bb838a7c844d admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:17.078909 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-b8f9fca8-437f-4e93-a688-bb838a7c844d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018641 Oct 25 02:52:17.079460 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 25 02:52:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:52:17.088532 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-075d5a4b-52fd-4441-8dec-6e7bd82c6ac5 admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:17.093448 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.wsgi [None req-075d5a4b-52fd-4441-8dec-6e7bd82c6ac5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-075d5a4b-52fd-4441-8dec-6e7bd82c6ac5 admin admin] Request method failure captured: Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: Accept: application/json Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: Accept-Encoding: gzip, deflate Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: Connection: keep-alive Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: Content-Length: 0 Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: Host: 10.222.0.36 Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: Openstack-Api-Version: compute 2.92 Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: Openstack-System-Scope: None Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: User-Agent: python-novaclient Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Auth-Token: gAAAAABjV09gPnz4F2kdaMMh6fBR0x4cNRDHWknbNQ8kup-f3CZbDkSvdkLFMHCz9xlqEPqhC_tiPYbaP30j93P--hRuCe7t_EJml3skRh0JSO7crnGRG-s8d35TJdbuxr85H6mdx3uKBCUkp_GSXyyFvYfUhsGKMEp9n3a5I9UST30R4Upifi0 Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Domain-Id: None Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Domain-Name: None Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Identity-Status: Confirmed Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Is-Admin-Project: True Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Openstack-Nova-Api-Version: 2.92 Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Domain-Id: default Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Domain-Name: Default Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Name: admin Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Role: admin,reader,member Oct 25 02:52:17.095039 n-d-862355-1 devstack@n-api.service[104553]: X-Roles: admin,reader,member Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b709b344da914adc83d1a1d1b6efa0b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b709b344da914adc83d1a1d1b6efa0b0"}]}] Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant: admin Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant-Name: admin Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-User: admin Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-User-Domain-Id: default Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-User-Domain-Name: Default Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-User-Id: 2af238ecd8b94238a2afed93f810f904 Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: X-User-Name: admin Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: method: > Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: exception: Flavor 84 could not be found. Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: action_args: {'id': '84'} Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 02:52:17.096532 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:17.098554 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:17.099849 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-075d5a4b-52fd-4441-8dec-6e7bd82c6ac5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 02:52:17.101041 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-075d5a4b-52fd-4441-8dec-6e7bd82c6ac5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011382 Oct 25 02:52:17.101041 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 25 02:52:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 25 02:52:18.305323 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-b8f9fca8-437f-4e93-a688-bb838a7c844d admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:18.306367 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-b8f9fca8-437f-4e93-a688-bb838a7c844d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 25 02:52:18.306758 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:18.829509 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-84a8841d-12a5-48b0-a07a-8d7db56353ff admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:18.835610 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.wsgi [None req-84a8841d-12a5-48b0-a07a-8d7db56353ff admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-84a8841d-12a5-48b0-a07a-8d7db56353ff admin admin] Request method failure captured: Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: Accept: application/json Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: Accept-Encoding: gzip, deflate Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: Connection: keep-alive Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: Content-Length: 0 Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: Host: 10.222.0.36 Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: Openstack-Api-Version: compute 2.92 Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: Openstack-System-Scope: None Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: User-Agent: python-novaclient Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Auth-Token: gAAAAABjV09ijE1abcZJkRJ4zZD2T910baKPnW_QsFfSL7EVW9nxnRnr8C3Kv-DfKbr6qrIaEo2ZTC3EZ3fBE5Z5bSVhsZzvuPN00fR9JDOZGjMHq-AjTgao4l4LkmMkAcmQeXIN2oiaXQxGniNPWEWvXXkfSNMZB53-pZKE0dDX0MuMe4yI_IE Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Domain-Id: None Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Domain-Name: None Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Identity-Status: Confirmed Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Is-Admin-Project: True Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Openstack-Nova-Api-Version: 2.92 Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Domain-Id: default Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Domain-Name: Default Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Project-Name: admin Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Role: admin,reader,member Oct 25 02:52:18.837111 n-d-862355-1 devstack@n-api.service[104553]: X-Roles: admin,reader,member Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b709b344da914adc83d1a1d1b6efa0b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b709b344da914adc83d1a1d1b6efa0b0"}]}] Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant: admin Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-Tenant-Name: admin Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-User: admin Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-User-Domain-Id: default Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-User-Domain-Name: Default Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-User-Id: 2af238ecd8b94238a2afed93f810f904 Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: X-User-Name: admin Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: method: > Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: exception: Flavor 451 could not be found. Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: action_args: {'id': '451'} Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 02:52:18.838650 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:18.839608 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.840962 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-84a8841d-12a5-48b0-a07a-8d7db56353ff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 02:52:18.842256 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-84a8841d-12a5-48b0-a07a-8d7db56353ff admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394763 Oct 25 02:52:18.842256 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 25 02:52:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 25 02:52:18.849364 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-63b68696-1dab-4f70-9bc2-71497cd42552 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:18.864995 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-63b68696-1dab-4f70-9bc2-71497cd42552 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019875 Oct 25 02:52:18.865595 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 25 02:52:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:52:18.874826 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:18.889404 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018096 Oct 25 02:52:18.889950 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Oct 25 02:52:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:52:18.899295 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-c213b6f9-e5ae-4398-96dd-57445a89f55f admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:18.904212 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.wsgi [None req-c213b6f9-e5ae-4398-96dd-57445a89f55f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-c213b6f9-e5ae-4398-96dd-57445a89f55f admin admin] Request method failure captured: Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: Accept: application/json Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: Accept-Encoding: gzip, deflate Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: Connection: keep-alive Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: Content-Length: 0 Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: Host: 10.222.0.36 Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: Openstack-Api-Version: compute 2.92 Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: Openstack-System-Scope: None Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: User-Agent: python-novaclient Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Auth-Token: gAAAAABjV09ijE1abcZJkRJ4zZD2T910baKPnW_QsFfSL7EVW9nxnRnr8C3Kv-DfKbr6qrIaEo2ZTC3EZ3fBE5Z5bSVhsZzvuPN00fR9JDOZGjMHq-AjTgao4l4LkmMkAcmQeXIN2oiaXQxGniNPWEWvXXkfSNMZB53-pZKE0dDX0MuMe4yI_IE Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Domain-Id: None Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Domain-Name: None Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Identity-Status: Confirmed Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Is-Admin-Project: True Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Openstack-Nova-Api-Version: 2.92 Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Domain-Id: default Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Domain-Name: Default Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Project-Name: admin Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Role: admin,reader,member Oct 25 02:52:18.905831 n-d-862355-1 devstack@n-api.service[104552]: X-Roles: admin,reader,member Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b709b344da914adc83d1a1d1b6efa0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b709b344da914adc83d1a1d1b6efa0b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b709b344da914adc83d1a1d1b6efa0b0"}]}] Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant: admin Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant-Id: b709b344da914adc83d1a1d1b6efa0b0 Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-Tenant-Name: admin Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-User: admin Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-User-Domain-Id: default Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-User-Domain-Name: Default Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-User-Id: 2af238ecd8b94238a2afed93f810f904 Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: X-User-Name: admin Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: method: > Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: exception: Flavor 451 could not be found. Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: action_args: {'id': '451'} Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 02:52:18.907315 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:18.908258 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: ERROR nova.api.openstack.wsgi Oct 25 02:52:18.909505 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-c213b6f9-e5ae-4398-96dd-57445a89f55f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 02:52:18.911838 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-c213b6f9-e5ae-4398-96dd-57445a89f55f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011501 Oct 25 02:52:18.911838 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 25 02:52:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 25 02:52:20.135009 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:20.136003 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 25 02:52:20.136397 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:20.665973 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-75ed23a0-5174-467e-bb2f-3305834a1251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:52:20.685571 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-75ed23a0-5174-467e-bb2f-3305834a1251 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401357 Oct 25 02:52:20.686147 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 25 02:52:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 02:52:21.908216 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:21.909225 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 25 02:52:21.909622 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:22.433922 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-d79d55cd-5f5b-4534-b1ba-0df9a329fe6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:52:22.453692 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-d79d55cd-5f5b-4534-b1ba-0df9a329fe6d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405843 Oct 25 02:52:22.454239 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 25 02:52:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:52:23.661010 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:23.662042 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Oct 25 02:52:23.662436 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:24.184169 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-5384b0ff-67ee-4ddb-aaba-ff0c0c1c3aac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:52:24.203086 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-5384b0ff-67ee-4ddb-aaba-ff0c0c1c3aac admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402859 Oct 25 02:52:24.203631 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 25 02:52:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:52:25.423396 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:25.424402 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 25 02:52:25.424793 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:25.957275 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-f95cec44-25d1-420b-ad0a-f52edd2babff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 02:52:25.977267 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-f95cec44-25d1-420b-ad0a-f52edd2babff admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.410000 Oct 25 02:52:25.977864 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Oct 25 02:52:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 02:52:27.208332 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:27.209347 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002712 Oct 25 02:52:27.209767 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:52:27.728862 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-a8c0f88a-a3ee-46e8-ad9a-7a52302defdd admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:52:27.749077 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-a8c0f88a-a3ee-46e8-ad9a-7a52302defdd admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403109 Oct 25 02:52:27.749606 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Oct 25 02:52:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:53:24.913206 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:53:24.914297 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-c83a8a8e-f8a4-4ef3-86c5-a19cae1790fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 25 02:53:24.914694 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 931 bytes} [Tue Oct 25 02:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:53:24.926090 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:53:25.311441 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-79c115e5-86d5-46fb-a3f4-cb5b4bd81a26 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:53:25.332254 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-79c115e5-86d5-46fb-a3f4-cb5b4bd81a26 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411060 Oct 25 02:53:25.332800 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 02:53:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 02:53:25.354625 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_api:SELECT=14 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:53:25.358384 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-377927a5-fc75-4a3e-b34b-de62aa8c8bec admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:53:25.366222 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-377927a5-fc75-4a3e-b34b-de62aa8c8bec admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013048 Oct 25 02:53:25.366740 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1283 bytes} [Tue Oct 25 02:53:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:53:25.378247 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-d6fd567e-5ed2-44fd-849a-95ef42163a8a admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:53:25.386013 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-d6fd567e-5ed2-44fd-849a-95ef42163a8a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011349 Oct 25 02:53:25.386534 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1286 bytes} [Tue Oct 25 02:53:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:53:25.397589 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-2b03aa4d-0d34-48b5-ac47-718be07798fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:53:25.404720 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-2b03aa4d-0d34-48b5-ac47-718be07798fc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010687 Oct 25 02:53:25.405225 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1286 bytes} [Tue Oct 25 02:53:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 02:53:25.416240 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-9e6d5ebe-5f7f-4ea3-932f-debb080b2949 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:53:25.423460 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-9e6d5ebe-5f7f-4ea3-932f-debb080b2949 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010651 Oct 25 02:53:25.423967 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1283 bytes} [Tue Oct 25 02:53:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 02:58:50.641503 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-2b03aa4d-0d34-48b5-ac47-718be07798fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:58:50.642535 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-2b03aa4d-0d34-48b5-ac47-718be07798fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 25 02:58:50.642922 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:58:50.784935 n-d-862355-1 devstack@n-api.service[104552]: DEBUG dbcounter [-] [104552] Writing DB stats nova_api:SELECT=6 {{(pid=104552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:58:50.927943 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:58:50.932785 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:58:50.933263 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:58:50.933663 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:58:50.934382 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:58:50.935502 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:58:50.935856 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:58:50.973458 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-21257919-4e6f-4f71-bf68-fd07233106ec admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189760 Oct 25 02:58:50.974043 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 25 02:58:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:58:52.048275 n-d-862355-1 devstack@n-api.service[104553]: DEBUG nova.api.openstack.wsgi [None req-2b03aa4d-0d34-48b5-ac47-718be07798fc admin admin] Calling method '>' {{(pid=104553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:58:52.049268 n-d-862355-1 devstack@n-api.service[104553]: INFO nova.api.openstack.requestlog [None req-2b03aa4d-0d34-48b5-ac47-718be07798fc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Oct 25 02:58:52.049664 n-d-862355-1 devstack@n-api.service[104553]: [pid: 104553|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Oct 25 02:58:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 02:58:52.242669 n-d-862355-1 devstack@n-api.service[104552]: DEBUG nova.api.openstack.wsgi [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] Calling method '>' {{(pid=104552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 02:58:52.246076 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:58:52.246556 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:58:52.247013 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:58:52.247919 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:58:52.248367 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:58:52.248785 n-d-862355-1 devstack@n-api.service[104552]: DEBUG oslo_concurrency.lockutils [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:58:52.271669 n-d-862355-1 devstack@n-api.service[104552]: INFO nova.api.openstack.requestlog [None req-2e0551ac-821c-4bb9-a6ba-a2dc51fdaea5 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.081693 Oct 25 02:58:52.272139 n-d-862355-1 devstack@n-api.service[104552]: [pid: 104552|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 25 02:58:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 02:59:37.501492 n-d-862355-1 devstack@n-api.service[104551]: Tue Oct 25 02:59:37 2022 - graceful shutdown triggered... Oct 25 02:59:37.502054 n-d-862355-1 devstack@n-api.service[104552]: Gracefully killing worker 1 (pid: 104552)... Oct 25 02:59:37.501772 n-d-862355-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 25 02:59:37.503224 n-d-862355-1 devstack@n-api.service[104553]: Gracefully killing worker 2 (pid: 104553)... Oct 25 02:59:37.630589 n-d-862355-1 devstack@n-api.service[104553]: DEBUG dbcounter [-] [104553] Writing DB stats nova_api:SELECT=4 {{(pid=104553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 02:59:38.501795 n-d-862355-1 devstack@n-api.service[104551]: worker 1 buried after 1 seconds Oct 25 02:59:38.502246 n-d-862355-1 devstack@n-api.service[104551]: worker 2 buried after 1 seconds Oct 25 02:59:38.502246 n-d-862355-1 devstack@n-api.service[104551]: goodbye to uWSGI. Oct 25 02:59:38.503326 n-d-862355-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 25 02:59:38.503891 n-d-862355-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 25 02:59:38.506671 n-d-862355-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 25 02:59:38.528960 n-d-862355-1 devstack@n-api.service[120545]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 25 02:59:38 2022] *** Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: nodename: n-d-862355-1 Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: machine: x86_64 Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: clock source: unix Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: pcre jit disabled Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: detected number of CPU cores: 4 Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: current working directory: / Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: detected binary path: /usr/bin/uwsgi-core Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: your processes number limit is 47680 Oct 25 02:59:38.549618 n-d-862355-1 devstack@n-api.service[120545]: your memory page size is 4096 bytes Oct 25 02:59:38.550578 n-d-862355-1 devstack@n-api.service[120545]: detected max file descriptor number: 2048 Oct 25 02:59:38.550578 n-d-862355-1 devstack@n-api.service[120545]: lock engine: pthread robust mutexes Oct 25 02:59:38.550578 n-d-862355-1 devstack@n-api.service[120545]: thunder lock: enabled Oct 25 02:59:38.550578 n-d-862355-1 devstack@n-api.service[120545]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 25 02:59:38.550578 n-d-862355-1 devstack@n-api.service[120545]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 25 02:59:38.596587 n-d-862355-1 devstack@n-api.service[120545]: Python main interpreter initialized at 0x56392668b9c0 Oct 25 02:59:38.596587 n-d-862355-1 devstack@n-api.service[120545]: python threads support enabled Oct 25 02:59:38.596587 n-d-862355-1 devstack@n-api.service[120545]: your server socket listen backlog is limited to 100 connections Oct 25 02:59:38.596587 n-d-862355-1 devstack@n-api.service[120545]: your mercy for graceful operations on workers is 90 seconds Oct 25 02:59:38.597041 n-d-862355-1 devstack@n-api.service[120545]: mapped 403077 bytes (393 KB) for 2 cores Oct 25 02:59:38.597041 n-d-862355-1 devstack@n-api.service[120545]: *** Operational MODE: preforking *** Oct 25 02:59:38.597292 n-d-862355-1 devstack@n-api.service[120545]: *** uWSGI is running in multiple interpreter mode *** Oct 25 02:59:38.597292 n-d-862355-1 devstack@n-api.service[120545]: spawned uWSGI master process (pid: 120545) Oct 25 02:59:38.597505 n-d-862355-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 25 02:59:38.598647 n-d-862355-1 devstack@n-api.service[120545]: spawned uWSGI worker 1 (pid: 120562, cores: 1) Oct 25 02:59:38.598992 n-d-862355-1 devstack@n-api.service[120545]: spawned uWSGI worker 2 (pid: 120563, cores: 1) Oct 25 02:59:38.599165 n-d-862355-1 devstack@n-api.service[120545]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 25 02:59:39.270691 n-d-862355-1 devstack@n-api.service[120563]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 25 02:59:39.275093 n-d-862355-1 devstack@n-api.service[120562]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 25 02:59:40.530066 n-d-862355-1 devstack@n-api.service[120563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:59:40.530066 n-d-862355-1 devstack@n-api.service[120563]: from cryptography.utils import int_from_bytes Oct 25 02:59:40.530714 n-d-862355-1 devstack@n-api.service[120563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:59:40.530714 n-d-862355-1 devstack@n-api.service[120563]: from cryptography.utils import int_from_bytes Oct 25 02:59:40.567194 n-d-862355-1 devstack@n-api.service[120562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:59:40.567194 n-d-862355-1 devstack@n-api.service[120562]: from cryptography.utils import int_from_bytes Oct 25 02:59:40.567791 n-d-862355-1 devstack@n-api.service[120562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 25 02:59:40.567791 n-d-862355-1 devstack@n-api.service[120562]: from cryptography.utils import int_from_bytes Oct 25 02:59:42.994151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 02:59:42.994694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 02:59:42.995008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 02:59:42.995310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 02:59:42.995569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 02:59:42.995964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.996296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.996621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.996944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.997279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.997595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.997956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.998354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.998600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.998865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.999194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.999524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862355-1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:42.999852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.000164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.000523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.000842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.001153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.001478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.001815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.002323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.002760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.003063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.003538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.003722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.004048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.004359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.004672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.004985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.005314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.005629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.006058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862355-1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.009300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.010027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.010027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.010027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.010027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.010297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.010542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.011019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.011141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.011403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.011714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.012029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.012268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.012586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.012901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.013227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.013554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.013835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.014470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.014470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.014707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.015019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.015330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.015641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.015983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.016290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.016599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.016909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.017218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.017539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.017885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.018213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.018522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.018846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.019260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.019517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.019830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.020174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.020499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.020812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.021137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.021465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.021805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.022118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.022428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.022751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.023089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.023398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.023653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.023956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.024266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.024589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.024898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.025209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.025518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.025849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.026338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.026663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.026967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.027281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.027594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.027907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.028220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.028533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.028844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.029160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.029485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.029856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.030166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.030476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.030788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.031098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.031424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.032537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.032934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.033266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.033580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.033921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.034247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.034561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.034872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.035198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.035506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.035817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.036139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.036451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.036747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 25 02:59:43.037767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.037938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 25 02:59:43.038086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.038086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.038375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 25 02:59:43.038528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.038673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 25 02:59:43.038915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.039659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 25 02:59:43.039835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.039994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.040137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.040137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.040422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.040569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.040724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.040865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.041005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.041152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.041291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.041430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.041710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.041821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.041910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.042780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.042884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.043131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.043242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.043242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.044218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.044327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.044428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.044604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862355-1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.044729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.044989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.045084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.045182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.045270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.045359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.045910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.046002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.046076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.046148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.046233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.046333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.046415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.046489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.046568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.046568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.046719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.046814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.046894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.046976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.047059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.047768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.052161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.052267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.052370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.052461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.052585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.052706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.052813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.052918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.053006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.053091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.053197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.053197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.053377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.053464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.053555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.053641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862355-1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.053759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.053857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.053944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.054035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.054121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.054206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.054307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.054400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.054494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.054588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.054680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.054766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.054860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.054946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.055038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.055124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.055209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.055306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.055401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.055492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.055584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.055675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.055760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.055852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.055946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.056038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.056123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.056215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.056302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.056399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.056491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.056584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.056676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.056761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.056845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.056939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.057025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.057109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.057109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.057255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.057341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.057427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.057500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.057585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.057671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.058146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.058253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.058344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.058439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.058527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.058619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.058716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.058812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.058906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.058992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.059085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.059171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.059269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.059355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.059712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.059811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.059904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.059990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.060092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.060185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.060284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.060370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.060454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.060549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.060644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.060743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.060836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.060929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.061015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.061115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.061202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.061299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.061385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.061479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.061574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.061688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.061794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.061889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.061975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.062067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.062159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.062261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.062347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.062438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.062597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.062750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.062948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.063059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.063264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.063566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.063660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.063898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.064004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.064209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.064310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.064522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.064615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.064830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.064935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.065145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.065239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.065468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.065562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.065809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.065922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.066066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.066167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.066371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.066480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.066683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.066790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.067009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.067111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.067429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.067548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.067631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.067716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.067929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.068078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.068235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.068367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.068838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.069156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.069425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.069593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.069878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.070043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.070199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.070356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.070508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.070662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.070815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.070958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.071115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.071276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.071433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.071586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.071891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.072179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.073325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.073325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.073597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.073752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.073894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.074023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.074137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.074249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.074369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.074489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.074610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.074724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.074836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.075157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.075298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.075433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.075433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.075831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.075969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.076109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.076240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.076381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.076525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.076657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.076788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.076919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.077058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.077206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.077339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.077474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.077607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.077755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.077902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.078045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.078184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.078362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.078565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.078717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.079188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.079336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.079469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.079609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.079750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.079882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.080022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.080163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.080302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.080442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.080574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.080713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.080859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.080992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.081123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.081255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.081386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.081517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.081657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.081827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.081959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.082090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.082222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.082353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.082503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 25 02:59:43.082637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.082769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.082907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.083046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.083192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.083324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.083464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.083603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.083735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.083867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.084014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.084157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.084289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.084420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.084560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.084691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.084837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.085010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.085154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.085347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.085493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.085667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.085839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.086009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.086146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.086323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.086465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.086644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.086790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.086957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.087092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.087283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.087427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.087600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.087747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.087918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.088054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.088231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.088365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.088543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.088687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.089174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.089323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.089454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.089583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.089824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.089968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.089968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.090223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.090223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.090476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.090607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.090747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.090893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.091977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.092115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.092278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.092421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.092594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.092737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.092916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.093060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.093230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.093365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.093547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.093709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.094470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.094622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.094806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.094948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.095145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.095292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.095435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.095702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.095838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.095970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.096109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.097429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.097566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.097826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.097965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.098931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.099392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.099531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.099654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.099767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.099878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.099989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.100182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.100304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.100423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.100541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.100655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.100790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.100933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.101990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.102206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.102206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.102434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.102434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.102657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.102778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.102889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.103954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.104984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.105106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.105352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.105491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.105605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.105767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.105935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.106066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.106250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.106383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.106573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.106705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.106930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.107166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.107295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.107509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.107630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.107836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.107972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.108165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.108286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.108485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.108607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.108801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.108935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.109469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.109670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.109670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.110980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.111099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.111212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.111363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.111493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.111677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.111806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.112540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.112716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.112868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.113008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.113139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.113272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.113402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.113539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.113744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.113879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.114971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.115217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.115360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.115580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.115714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.115843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.115980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.116119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.116119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.116365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.116505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.116642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.116772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.116911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.117042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.117171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.117308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.117439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.117567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.117770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.117908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.118046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.118187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.118315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.118445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.118585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.118742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.118878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.119007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.119143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.119639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.119791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.119924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.120967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.121096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.121234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.121366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.121504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.121643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.121857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.121988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.122135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.122275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.122413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.122544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.122671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.122798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.122911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.123046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.123225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.123372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.123539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.123692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.123848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.124012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.124140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.124327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.124456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.124707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.124874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.124993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.125105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.125861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.126126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.126286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.126418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.126548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.126687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.126820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.127030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.127183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.127327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.127467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.127606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.127738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.127884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.128159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.128302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.128472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.128608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.128794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.128941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.129107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.129241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.129787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.129938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.130086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.130230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.130362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.130501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.130633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.130771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.130918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.131052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.131184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.131315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.131453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.131603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.131754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.131888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.132937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.133099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.133253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.133410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.133577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.133771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.133907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.134096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.134232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.134410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.134539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.134723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.134845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.135044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.135180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.135374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.135497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.135695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.135817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.136023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.136157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.136305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.136426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.136617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.136752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.136937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.137071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.137264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.137391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.137578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.137727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.137915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.138062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.138228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.138541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.138693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.138893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.139025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.139211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.139332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.139728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.140976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.141667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.141913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.142059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.142198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.142338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.142487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.142609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.142740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.142863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.143010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.143130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.143329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.143462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.143647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.143777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.143965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.144109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.144293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.144437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.144595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.144737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.144907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.145048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.145221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.145355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.145752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.145902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.146062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.146284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.146428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.146560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.146692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.146824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.146824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.147088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.147221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.147352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.147490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.147676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.147814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.147983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.148118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.148300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.148437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.148614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.148760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.148925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.149061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.149255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.149404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.149571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.149956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.150245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.150387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.150520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.150665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.150805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.150947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.151102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.151317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.151473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.151652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.151652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.151909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.152057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.152301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.152459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.152592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.152724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.152851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.152970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.153997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.154122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.154312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.154445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.154688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.154817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.155021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.155144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.155336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.155465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.155648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.155769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.155958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.156098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.156315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.156476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.156683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.156929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.157276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.157404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.157613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.157770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.157983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.158120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.158300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.158422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.158614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.158736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.158946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.159145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.159261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.159381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.159553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.159674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.160007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.160301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.160435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.160557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.160678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.160792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.160918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.161067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.161188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.161380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.161584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.161818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.161969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.162109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.162250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.162535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.162679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.162827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.162956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.163979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.164092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.164239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.164371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.164559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.164682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.164880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.165011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.165193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.165324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.165524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.165648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.165889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.166026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.166199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.166336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.166568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.166714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.166847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.166978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.167124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.167256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.167395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.167564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.167701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.167911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.168053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.168209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.168330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.168522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.168649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.168835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.168959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.169153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.169274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.169459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.169578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.169791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.169928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.170291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.170566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.170566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.170798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.170923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.171909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.172032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.172243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.172508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.172778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.172929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.173072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.173210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.173342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.173473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.173593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.173780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.173910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.174037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.174158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.174347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.174470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.174662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.174783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.175029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.175234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.175351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.175462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.175630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.175752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.175938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.176066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.176287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.176416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.176626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.176766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.176924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.177061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.177264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.177386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.177601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.177756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.177950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.178098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.178269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.178405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.178589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.178732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.178902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.179053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.179223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.179360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.179540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.179675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.179860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.179996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.180335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.180639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.180795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.180946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.181079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.181211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.181344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.181475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.181620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.181826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.181962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.182093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.182224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.182355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.182496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.182627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.182765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.182903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.183930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.184066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.184189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.184369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.184741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.184935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.185066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.185245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.185367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.185589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.185745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.185931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.186069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.186241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.186364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.186557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.186704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.186899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.187048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.187164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.187277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.187480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.187603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.188316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.188608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.188739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.188863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.188976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.189087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.189247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.189371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.189567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.189732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.189912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.190068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.190228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.190557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.190857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.191005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.191145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.191277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.191421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.191566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.191735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.191873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.192056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.192191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.192378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.192521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.192699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.192842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.193021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.193170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.193340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.193468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.193659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.193804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.194096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.194233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.194417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.194549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.194731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.194854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.195043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.195186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.195402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.195550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.195679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.195801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.195981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.196105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.196291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.196413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.196601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.196724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.196951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.197094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.197238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.197362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.197565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.197731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.197936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.198051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.198229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.198354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.198552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.198682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.198874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.199004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.199196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.199326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.199515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.199646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.199832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.199961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.200154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.200284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.200611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.200768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.201920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.202087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.202246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.202410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.202567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.202722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.202869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.203016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.203170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.203384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.204117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.204275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.204462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.204829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.204985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.205144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.205300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.205485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.205730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.205903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.206069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.206228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.206387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.206544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.206785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.206939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.207201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.207365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.207514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.207670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.207820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.207975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.208133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.208288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.208443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.208602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.208756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.208911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.209067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.209215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.209361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.209516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.209664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.209856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.210012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.210159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.210306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.210460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.210860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.210860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.211356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.211513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.211661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.211817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.211965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.212127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.212283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.212438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.212621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.212781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.212941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.213103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.213252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.213400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.213555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.213748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.213917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.214066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.214213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.214360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.214516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.214671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.214671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.214978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.215132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.215280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.215426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.215581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.215744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.215900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.216057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.216212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.216368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.216529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.216676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.216822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.216822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.217125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.217378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.217540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.217716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.217871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.218029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.218177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.218323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.218482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.218638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.218822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.219009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.219163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.219310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.219465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.219614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.219768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.219924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.220071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.220226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.220380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.220534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.220689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.221060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.221395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.221566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.221744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.221899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.222046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.222203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.222353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.222515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.222663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.222818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.222971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.223118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.223264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.223431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.223580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.223726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.223872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.224026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.224172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.224329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.224482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.224637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.224809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.225065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.225241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.225401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.225565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.225565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.225975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.226236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.226419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.226577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.226726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.226873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.226873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.227159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.227319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.227566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.227729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.227877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.228024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.228179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.228340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.228495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.228643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.228790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.228944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.229173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.229323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.229470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.229619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.229809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.229809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.230114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.230263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.230418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.230574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.230730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.230877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.231254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.231578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.231743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.231892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.232047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.232226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.232383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.232531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.232685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.232841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.232989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.233146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.233301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.233301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.233581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.233800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.233955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.234122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.234279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.234433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.234605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.234760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.234919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.235075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.235222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.235368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.235514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.235660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.235821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.235990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.236147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.236294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.236451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.236607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.236754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.236901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.237056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.237203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.237349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.237505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.237769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.237946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.238097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.238253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.238410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.238567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.238715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.238868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.238868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.239155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.239309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.239471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.239627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.239792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.239948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.240096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.240252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.240400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.240554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.240701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.240847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.241006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.241397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.241777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.241936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.242084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.242251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.242407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.242563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.242721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.242721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.243008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.243164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.243321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.243476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.243630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.243777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.243931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.244100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.244304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.244510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.244666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.244821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.244974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.245129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.245287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.245436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.245581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.245763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.245926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.246088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.246253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.246402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.246548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.246695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.246840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.246996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.247150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.247296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.247443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.247597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.247763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.248942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.249220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.249367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.249514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.249715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.249881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.250029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.250194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.250877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.251033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.251195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.251551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.251865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.252021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.252170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.252460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.252648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.252809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.252958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.253104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.253262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.253409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.253409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.253731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.253887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.254048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.254195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.254350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.254497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.254658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.254806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.254960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.255115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.255280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.255430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.255575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.255721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.255868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.256941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.257246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.257393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.257539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.257799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.257992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.258217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.258378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.258527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.258681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.258836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.258994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.259141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.259298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.259453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.259600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.259746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.259974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.260125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.260281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.260429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.260575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.260722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.260877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.261026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.261181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.261347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.261719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.262044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.262207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.262355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.262510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.262658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.262805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.262965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.263114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.263262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.263415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.263415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.263415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.263854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.264010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.264010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.264296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.264442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.264597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.264742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.264742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.265024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.265178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.265335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.265500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.265655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.265856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.266535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.266699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.266699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.266987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.266987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.267282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.267431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.267577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.267723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.267889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 02:59:43.268892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.268892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.269455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.269615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.269905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.270541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.270769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.271103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.271427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.271812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.272136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.272367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.272718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.273477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.273477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.273824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.274015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.274537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.274864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.275192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.275500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.275827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.276174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.276498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.276950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.277395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.277737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.278067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.278485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.278714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.279044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.279374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.279691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.280021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.280337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.280673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.281021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.281357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.281993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.282486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.282725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.282977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.283237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.283497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.283778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.284094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.284561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.284900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.285213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.285525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.285881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.286205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.286521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.286889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.287170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.287482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.287794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.288161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.288480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.288821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.289134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.289445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.289784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.290097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.290406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.290745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.291084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.291406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.291737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.292119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.292379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.292689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.293017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.293344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.293686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.294009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.294351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.294830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.295155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.295547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.295910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.296237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.296554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.296890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.297285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.297593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.297952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.298276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.298604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.298925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.299242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.299578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.299894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.300209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.300525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.300842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.301160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.301481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.301820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.302223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.302492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.302768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.303106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.303840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.304161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.304521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.304970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.305332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.305654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.306029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.306372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.306698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.307017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.307331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 25 02:59:43.308212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 25 02:59:43.333627 n-d-862355-1 devstack@n-api.service[120563]: INFO dbcounter [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Registered counter for database nova_api Oct 25 02:59:43.356191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_db.sqlalchemy.engines [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.364565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writer thread running {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.374340 n-d-862355-1 devstack@n-api.service[120562]: INFO dbcounter [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Registered counter for database nova_api Oct 25 02:59:43.395564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_db.sqlalchemy.engines [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.402251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writer thread running {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.424727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.context [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=120563) load_cells /opt/stack/nova/nova/context.py:464}} Oct 25 02:59:43.428916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:59:43.429395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:59:43.431040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:59:43.431745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:59:43.432192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:59:43.434393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:59:43.436776 n-d-862355-1 devstack@n-api.service[120563]: INFO dbcounter [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Registered counter for database nova_cell0 Oct 25 02:59:43.441935 n-d-862355-1 devstack@n-api.service[120563]: INFO dbcounter [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Registered counter for database nova_cell1 Oct 25 02:59:43.449550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_db.sqlalchemy.engines [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.451750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_db.sqlalchemy.engines [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.457248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writer thread running {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.462817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.context [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=120562) load_cells /opt/stack/nova/nova/context.py:464}} Oct 25 02:59:43.467253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:59:43.467728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:59:43.469460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:59:43.470275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 02:59:43.470719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 02:59:43.472981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 02:59:43.475001 n-d-862355-1 devstack@n-api.service[120562]: INFO dbcounter [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Registered counter for database nova_cell0 Oct 25 02:59:43.479161 n-d-862355-1 devstack@n-api.service[120562]: INFO dbcounter [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Registered counter for database nova_cell1 Oct 25 02:59:43.496557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_db.sqlalchemy.engines [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.498516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_db.sqlalchemy.engines [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.505945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writer thread running {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.605864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writer thread running {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.615542 n-d-862355-1 devstack@n-api.service[120563]: INFO dbcounter [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Registered counter for database nova_cell0 Oct 25 02:59:43.622918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_db.sqlalchemy.engines [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.628454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writer thread running {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.660800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writer thread running {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.670955 n-d-862355-1 devstack@n-api.service[120562]: INFO dbcounter [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Registered counter for database nova_cell0 Oct 25 02:59:43.679348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_db.sqlalchemy.engines [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 25 02:59:43.685859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writer thread running {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 25 02:59:43.952497 n-d-862355-1 devstack@n-api.service[120563]: WARNING keystonemiddleware.auth_token [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:59:43.960363 n-d-862355-1 devstack@n-api.service[120563]: WARNING keystonemiddleware.auth_token [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:59:44.017305 n-d-862355-1 devstack@n-api.service[120562]: WARNING keystonemiddleware.auth_token [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:59:44.024763 n-d-862355-1 devstack@n-api.service[120562]: WARNING keystonemiddleware.auth_token [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:59:44.311373 n-d-862355-1 devstack@n-api.service[120563]: WARNING keystonemiddleware.auth_token [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:59:44.318164 n-d-862355-1 devstack@n-api.service[120563]: WARNING keystonemiddleware.auth_token [None req-097284f7-4435-46d2-b211-3be5c34c577c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:59:44.323468 n-d-862355-1 devstack@n-api.service[120563]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56392668b9c0 pid: 120563 (default app) Oct 25 02:59:44.379252 n-d-862355-1 devstack@n-api.service[120562]: WARNING keystonemiddleware.auth_token [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 25 02:59:44.385244 n-d-862355-1 devstack@n-api.service[120562]: WARNING keystonemiddleware.auth_token [None req-41666ef0-1241-4f3c-a629-dacd90456b60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 25 02:59:44.390668 n-d-862355-1 devstack@n-api.service[120562]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56392668b9c0 pid: 120562 (default app) Oct 25 03:00:24.214969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:24.216205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:24.217349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:24.218638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:25.712562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd39022f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:25.718047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:25.719073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:25.719670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:25.720519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:25.720974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:25.721659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:25.768750 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf6ab065-0617-4acb-a675-9fd6626a4aa2 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.566343 Oct 25 03:00:25.770068 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1/1] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 25 03:00:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:26.098286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd390708b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:26.107931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:26.108527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:26.109048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:26.109893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:26.111136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:26.111914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:26.112683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:26.116018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:26.117072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:26.121807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:26.242111 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-017b6349-04df-4352-9e41-cfdc2f11ce8b tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.461028 Oct 25 03:00:26.250485 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1/2] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Oct 25 03:00:25 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:26.501546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a7954f6-599a-40ed-8fc8-a070d1b223c4 tempest-AZAdminNegativeTestJSON-1768442043 tempest-AZAdminNegativeTestJSON-1768442043-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:26.503214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3a7954f6-599a-40ed-8fc8-a070d1b223c4 tempest-AZAdminNegativeTestJSON-1768442043 tempest-AZAdminNegativeTestJSON-1768442043-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '6dd44bf7c7864ef5bc7688b2dbe0531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eed533f42bf441ca9e0b4a86ae4e74c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a7954f6-599a-40ed-8fc8-a070d1b223c4 tempest-AZAdminNegativeTestJSON-1768442043 tempest-AZAdminNegativeTestJSON-1768442043-project] Request method failure captured: Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FHUXmc5IN2dQ65VNa0fdA3ioWBr7F8yvHp9AAYld0ZbzwCipWkD_wo_zaUrnvFAo-AXsD-S4CGhUXM03Hb8G7M0E8qiipwRnYrDgAKb_Ce7ZWPtpuvCeuVYNDGYE-BWaCoBHrqxfkNaUpFfaUDeCYZ3jUg1NYsz7Imwfoi__pF_x8 Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 9eed533f42bf441ca9e0b4a86ae4e74c Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1768442043 Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:26.509610 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9eed533f42bf441ca9e0b4a86ae4e74c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9eed533f42bf441ca9e0b4a86ae4e74c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9eed533f42bf441ca9e0b4a86ae4e74c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9eed533f42bf441ca9e0b4a86ae4e74c"}]}] Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AZAdminNegativeTestJSON-1768442043 Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 9eed533f42bf441ca9e0b4a86ae4e74c Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1768442043 Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AZAdminNegativeTestJSON-1768442043-project Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 6dd44bf7c7864ef5bc7688b2dbe0531d Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AZAdminNegativeTestJSON-1768442043-project Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 25 03:00:26.511059 n-d-862355-1 devstack@n-api.service[120563]: action_args: {} Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:26.511802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:26.512998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a7954f6-599a-40ed-8fc8-a070d1b223c4 tempest-AZAdminNegativeTestJSON-1768442043 tempest-AZAdminNegativeTestJSON-1768442043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:26.515344 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3a7954f6-599a-40ed-8fc8-a070d1b223c4 tempest-AZAdminNegativeTestJSON-1768442043 tempest-AZAdminNegativeTestJSON-1768442043-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.692377 Oct 25 03:00:26.515344 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 25 03:00:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 694 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:26.543674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd38eb6d30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:26.556036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:26.556548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:26.557068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:26.564049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:26.565913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:26.567184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:26.640397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-04edac10-81de-4aa3-abbe-3ca0a0e4b0fc tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.126494 Oct 25 03:00:26.642755 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Oct 25 03:00:26 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:27.206042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:27.211762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.212255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.212688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.213411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.213887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.214566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.247728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Calling method '.version_select at 0x7efd3908f670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:27.262957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=120562) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 25 03:00:27.263719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.264198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.269048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.278775 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a3f27299-3ad7-4039-aa96-8bf96a53eb0e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.634719 Oct 25 03:00:27.279392 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4/5] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:00:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:27.333892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.334314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.334757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.364530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.365319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.371289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.394630 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37170d7e-510e-4fa9-ad7d-e180d6d9f5df tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.138926 Oct 25 03:00:27.396044 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2/6] 10.222.0.36 () {60 vars in 1208 bytes} [Tue Oct 25 03:00:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:00:27.405764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd38f00af0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:27.416737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.417336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.417919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.419432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.419432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.425246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.473200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e6d517c-294d-43af-8e8c-7061aa3b51fe tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.075613 Oct 25 03:00:27.474357 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 25 03:00:27 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:27.550831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '.version_select at 0x7efd38ecfb80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:27.565082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=120563) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 25 03:00:27.566330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.566973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.567540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.624692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.627549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.629006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.655089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.655609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.656035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.673319 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d936d4c-1504-4498-9aa4-9793ad46e683 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.390054 Oct 25 03:00:27.673971 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 25 03:00:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:27.698273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd38eea8b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:27.703865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.704667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.705529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.706436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.707024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.707717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.734055 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96c06313-5383-4c59-a4b5-75f248280acb tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.042360 Oct 25 03:00:27.735725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 6/9] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:00:27 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:27.748465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d27619e-e2f1-40ee-b6a2-04680b7b600a tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1417674808"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:27.772534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-2d27619e-e2f1-40ee-b6a2-04680b7b600a tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid b8f8dd51-e436-4f2a-ace7-478f1748f723 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:27.865949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-039f25f5-2d78-47b4-bb50-3b19b6f19364 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2108148890", "id": 2004778635, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:27.897209 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d27619e-e2f1-40ee-b6a2-04680b7b600a tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.154040 Oct 25 03:00:27.898145 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 7/10] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:00:27.910491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd38ddc790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:27.924195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.924784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.927189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.928184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:27.930274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:27.932063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:27.978268 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1dfc95e1-ed82-4be7-84f2-933d048ed765 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.078780 Oct 25 03:00:27.985255 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 8/11] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 25 03:00:27 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:27.993261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06d8a5e3-4699-4995-b43c-ec89727c32ae tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:28.012441 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-039f25f5-2d78-47b4-bb50-3b19b6f19364 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.536844 Oct 25 03:00:28.013041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d8a5e3-4699-4995-b43c-ec89727c32ae tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:28.013651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d8a5e3-4699-4995-b43c-ec89727c32ae tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:28.014688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d8a5e3-4699-4995-b43c-ec89727c32ae tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:28.019992 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4/12] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:27 2022] POST /compute/v2.1/flavors => generated 430 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:28.036893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd3988e1f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:28.045554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:28.046756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:28.047468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:28.075953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:28.076763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:28.077435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:28.123375 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b536bff-fc4f-4695-a2b5-4d3e93830f31 tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-h1-862355-1" status: 200 len: 332 microversion: 2.1 time: 0.101808 Oct 25 03:00:28.124328 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 5/13] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 25 03:00:28 2022] GET /compute/v2.1/os-hosts/n-h1-862355-1 => generated 332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:28.153197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1aebb270-b3ca-4a02-99c3-f8b03cd8eba3 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:28.220760 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1aebb270-b3ca-4a02-99c3-f8b03cd8eba3 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2004778635" status: 202 len: 0 microversion: 2.1 time: 0.094367 Oct 25 03:00:28.225301 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 6/14] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:28 2022] DELETE /compute/v2.1/flavors/2004778635 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:28.233007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Calling method '.version_select at 0x7efd38e1cc10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:28.251568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:28.252216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:28.252602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:28.285303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:28.287597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:28.288204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:28.304341 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7915f241-25a2-4819-accb-105369614c9c tempest-HostsAdminTestJSON-2106110071 tempest-HostsAdminTestJSON-2106110071-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-h2-862355-1" status: 200 len: 332 microversion: 2.1 time: 0.077724 Oct 25 03:00:28.313889 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 7/15] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 25 03:00:28 2022] GET /compute/v2.1/os-hosts/n-h2-862355-1 => generated 332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:28.325970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff38928c-08ff-4538-9074-23a93b9b5a29 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:28.395921 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff38928c-08ff-4538-9074-23a93b9b5a29 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079945 Oct 25 03:00:28.410078 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:28.714191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6eb6645b-ce6f-46ac-b393-5f4fa260df99 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-298199260", "id": 1089409380, "os-flavor-access:is_public": "False"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:28.747509 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6eb6645b-ce6f-46ac-b393-5f4fa260df99 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.336041 Oct 25 03:00:28.751263 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 9/17] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:28 2022] POST /compute/v2.1/flavors => generated 438 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:28.770724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f65ee641-de21-48bc-8375-a692360bbf70 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1405122842", "id": 830342803, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:28.806822 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f65ee641-de21-48bc-8375-a692360bbf70 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053625 Oct 25 03:00:28.817021 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 10/18] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:28 2022] POST /compute/v2.1/flavors => generated 414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:28.821799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-351a1552-e503-432c-a73c-b052d71589f4 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:29.058828 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06d8a5e3-4699-4995-b43c-ec89727c32ae tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.071127 Oct 25 03:00:29.059435 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 9/19] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:00:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:29.079515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50e7ca59-bbff-4c34-8d21-08b0dc407b39 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:29.149122 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50e7ca59-bbff-4c34-8d21-08b0dc407b39 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.088434 Oct 25 03:00:29.150396 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 10/20] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:29 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:29.170411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:29.208415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:29.208415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:29.210512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:29.251427 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-862355-1. Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 39 Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:29.271126 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: {"add_host": {"host": "n-h1-862355-1"}} Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:29.272237 n-d-862355-1 devstack@n-api.service[120563]: exception: Aggregate 1 already has host n-h1-862355-1. Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-862355-1'}}} Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result.read() Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 03:00:29.272874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-862355-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi session.flush() Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 03:00:29.273774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 03:00:29.275213 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 03:00:29.276634 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result.read() Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-862355-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 25, 3, 0, 29, 236523), 'updated_at': None, 'host': 'n-h1-862355-1', 'aggregate_id': 1}] Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:29.278353 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-862355-1. Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.280510 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-862355-1. Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:29.282826 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:29.287188 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-862355-1. Oct 25 03:00:29.287188 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:29.287188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-862355-1. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:29.287188 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-163b4937-9203-47d9-9136-e3d9cbe4966d tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.121114 Oct 25 03:00:29.287188 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 11/21] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:00:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 25 03:00:29.287188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf2e540f-23a9-469a-9c06-f5006fdd5840 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:29.345193 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf2e540f-23a9-469a-9c06-f5006fdd5840 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/830342803" status: 202 len: 0 microversion: 2.1 time: 0.066391 Oct 25 03:00:29.347826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 12/22] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:29 2022] DELETE /compute/v2.1/flavors/830342803 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:29.357719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c46b1685-9f9d-4bf1-9e32-7a39e0bad596 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:29.379711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c46b1685-9f9d-4bf1-9e32-7a39e0bad596 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:29.381624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c46b1685-9f9d-4bf1-9e32-7a39e0bad596 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:29.382231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c46b1685-9f9d-4bf1-9e32-7a39e0bad596 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:29.571913 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c46b1685-9f9d-4bf1-9e32-7a39e0bad596 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.222136 Oct 25 03:00:29.572524 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 13/23] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:00:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:29.577857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-63f84fb3-62c0-47ac-85e1-d1dd08b52fd6 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:29.608485 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-63f84fb3-62c0-47ac-85e1-d1dd08b52fd6 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034842 Oct 25 03:00:29.609335 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 14/24] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:29.616351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-579f02f1-fd61-407d-a76f-24987e3c98f4 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:29.649339 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-579f02f1-fd61-407d-a76f-24987e3c98f4 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.039115 Oct 25 03:00:29.651437 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 15/25] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:29 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:00:29.659439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3689f45c-97cc-4e2c-86b7-c734b4279726 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-153000691", "id": 1430655518, "os-flavor-access:is_public": "True"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:29.700264 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3689f45c-97cc-4e2c-86b7-c734b4279726 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.046406 Oct 25 03:00:29.701239 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 16/26] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:29 2022] POST /compute/v2.1/flavors => generated 428 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:29.710371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6fb69ef3-f228-4f42-b790-6ae670ba573c tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1137554766"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:29.714373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-6fb69ef3-f228-4f42-b790-6ae670ba573c tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid d0b313ae-0bbf-4048-9fa5-5eb1b9bc021a for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:29.758040 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6fb69ef3-f228-4f42-b790-6ae670ba573c tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055380 Oct 25 03:00:29.759164 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 17/27] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:29.764685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-de96edbf-7fef-4f07-8ce6-07a92c23966e tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1939359678"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:29.770586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-de96edbf-7fef-4f07-8ce6-07a92c23966e tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Generated uuid 830c128e-3b6c-47bd-afe2-e2b7693acf65 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:29.800346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-de96edbf-7fef-4f07-8ce6-07a92c23966e tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.039663 Oct 25 03:00:29.808506 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 18/28] 10.222.0.36 () {62 vars in 1205 bytes} [Tue Oct 25 03:00:29 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:29.818751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-59c7d8af-6cdb-488b-bc0a-7e46eeb17e5c tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:29.832167 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-351a1552-e503-432c-a73c-b052d71589f4 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1089409380/action" status: 200 len: 97 microversion: 2.1 time: 1.013295 Oct 25 03:00:29.833239 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 11/29] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 25 03:00:28 2022] POST /compute/v2.1/flavors/1089409380/action => generated 97 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:29.860875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-59c7d8af-6cdb-488b-bc0a-7e46eeb17e5c tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1430655518" status: 202 len: 0 microversion: 2.1 time: 0.057071 Oct 25 03:00:29.862589 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 19/30] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:29 2022] DELETE /compute/v2.1/flavors/1430655518 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:29.881249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6d956d06-f1ef-4487-b124-12432e3b75e6 tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-124209280"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.085492 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6d956d06-f1ef-4487-b124-12432e3b75e6 tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.220159 Oct 25 03:00:30.086109 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 20/31] 10.222.0.36 () {62 vars in 1210 bytes} [Tue Oct 25 03:00:29 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:30.098192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55ee3c60-69e4-4b45-923a-4f0426e61378 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.200122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03754398-a3f6-4637-9c3d-a4752eaa2d42 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.205336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-03754398-a3f6-4637-9c3d-a4752eaa2d42 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '33d5743faa8a4bd2bcb6784105576631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc11ebd8be4a4cb76ea30f105c10b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03754398-a3f6-4637-9c3d-a4752eaa2d42 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Request method failure captured: Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 39 Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FHYAv5MZIawC6qYc1GXVtHa7V8EuDBslFUd20hcqlr0GnNn2NB2akWng-qqzBwBtXnJLGb8MY576BXzoORnS8EUKPLRF8zANeIh35mzfYOKN-9XSR_vwk0fS3ABhOT9KaE1XRr-w10eigXC12uiBTUtSKAp-9g9yPGB5YzAFsPftE Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:00:30.218172 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27dc11ebd8be4a4cb76ea30f105c10b9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27dc11ebd8be4a4cb76ea30f105c10b9"}]}] Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 33d5743faa8a4bd2bcb6784105576631 Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: {"add_host": {"host": "n-h1-862355-1"}} Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:00:30.219286 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-862355-1'}}} Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:30.220114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 25 03:00:30.221250 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.224797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03754398-a3f6-4637-9c3d-a4752eaa2d42 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:30.226047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03754398-a3f6-4637-9c3d-a4752eaa2d42 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.391819 Oct 25 03:00:30.242400 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 12/32] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:00:29 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 409 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:30.283476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-219dc26c-0e15-4918-b0dc-89446092902e tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:30.332634 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-219dc26c-0e15-4918-b0dc-89446092902e tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084095 Oct 25 03:00:30.336321 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 13/33] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:30.348275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9b67f28-81d1-4a14-9a2a-e0b29a436c5f tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:30.366387 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-55ee3c60-69e4-4b45-923a-4f0426e61378 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project eacc009b4eaf437ea6d550fa3eb79958 combination. Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55ee3c60-69e4-4b45-923a-4f0426e61378 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Request method failure captured: Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/flavors/1089409380/action HTTP/1.1 Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 67 Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKTqyqOWTd2xaQKE1wcXVgtPJQPzmXM9D5AcK98MQz4aF3-gIf8bYkIeIRnZOEOxFj-qsMIHHdzO2w0Qq8HgUcggGecGcDHDjbA7Hbf4gIwnnbIfJOIyciIZLIXISmMcebkhaAbplUODXB7MxYxd4HEt-aCtkegC-rjCf9pquRnRA Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bb4bf72866fa43d0998d58a1b47b8cef Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:30.374019 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb4bf72866fa43d0998d58a1b47b8cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb4bf72866fa43d0998d58a1b47b8cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb4bf72866fa43d0998d58a1b47b8cef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb4bf72866fa43d0998d58a1b47b8cef"}]}] Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bb4bf72866fa43d0998d58a1b47b8cef Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 80d26430c53b48c5bbbc9224e636af17 Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: {"addTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} Oct 25 03:00:30.375201 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: exception: Flavor access already exists for flavor 16 and project eacc009b4eaf437ea6d550fa3eb79958 combination. Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1089409380', 'body': {'addTenantAccess': {'tenant': 'eacc009b4eaf437ea6d550fa3eb79958'}}} Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result.read() Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 03:00:30.375829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-eacc009b4eaf437ea6d550fa3eb79958' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi session.flush() Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 03:00:30.376665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 03:00:30.378298 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 03:00:30.380694 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result.read() Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-eacc009b4eaf437ea6d550fa3eb79958' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 25, 3, 0, 30, 353450), 'updated_at': None, 'flavor_id': 16, 'project_id': 'eacc009b4eaf437ea6d550fa3eb79958'}] Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:30.382904 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project eacc009b4eaf437ea6d550fa3eb79958 combination. Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:30.385079 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project eacc009b4eaf437ea6d550fa3eb79958 combination. Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:30.387774 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:30.397813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project eacc009b4eaf437ea6d550fa3eb79958 combination. Oct 25 03:00:30.397813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:30.398482 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9b67f28-81d1-4a14-9a2a-e0b29a436c5f tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.052105 Oct 25 03:00:30.398556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55ee3c60-69e4-4b45-923a-4f0426e61378 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project eacc009b4eaf437ea6d550fa3eb79958 combination. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:30.398630 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 14/34] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Oct 25 03:00:30 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:30.398696 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55ee3c60-69e4-4b45-923a-4f0426e61378 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1089409380/action" status: 409 len: 152 microversion: 2.1 time: 0.302958 Oct 25 03:00:30.402760 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 21/35] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 25 03:00:30 2022] POST /compute/v2.1/flavors/1089409380/action => generated 152 bytes in 314 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:30.404503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d1fe287-173d-453f-9f07-f16d3f7514e5 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:30.432019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbc00ede-b846-46c6-a51f-2efbff9dc4c9 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1378914359", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.443631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:30.480727 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbc00ede-b846-46c6-a51f-2efbff9dc4c9 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.076270 Oct 25 03:00:30.482451 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 22/36] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:30 2022] POST /compute/v2.1/flavors => generated 507 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:30.489140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-245be3f8-1ede-4bd9-9987-b6ed40c22a5b tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.508070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-245be3f8-1ede-4bd9-9987-b6ed40c22a5b tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:30.508907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-245be3f8-1ede-4bd9-9987-b6ed40c22a5b tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:30.509591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-245be3f8-1ede-4bd9-9987-b6ed40c22a5b tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:30.531671 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d1fe287-173d-453f-9f07-f16d3f7514e5 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.136132 Oct 25 03:00:30.532543 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 15/37] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:30 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:00:30.544242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b17cb79-5a8b-4673-9e42-e16b44c90b9c tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.707839 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-245be3f8-1ede-4bd9-9987-b6ed40c22a5b tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.223868 Oct 25 03:00:30.709090 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 23/38] 10.222.0.36 () {62 vars in 1232 bytes} [Tue Oct 25 03:00:30 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:30.713635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86ee7ebc-f729-460a-86cd-ae31c0fc6a75 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:30.772403 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86ee7ebc-f729-460a-86cd-ae31c0fc6a75 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/e3492b82-e24c-48a2-b508-eb84c5689154" status: 202 len: 0 microversion: 2.1 time: 0.056009 Oct 25 03:00:30.772403 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 24/39] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:00:30 2022] DELETE /compute/v2.1/flavors/e3492b82-e24c-48a2-b508-eb84c5689154 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:30.772403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1d81bc7-f26c-46b3-a78e-af7ec3467223 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-58990890"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.780504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-c1d81bc7-f26c-46b3-a78e-af7ec3467223 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid c52a9f51-7ebc-450c-b53a-6ea4e117f9df for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:30.818611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1d81bc7-f26c-46b3-a78e-af7ec3467223 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.050507 Oct 25 03:00:30.822946 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 25/40] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:30 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:30.829947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11daf6d0-26c8-4842-97b3-ecd0ab3ea473 tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:30.841580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11daf6d0-26c8-4842-97b3-ecd0ab3ea473 tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:30.843317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11daf6d0-26c8-4842-97b3-ecd0ab3ea473 tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:30.843752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11daf6d0-26c8-4842-97b3-ecd0ab3ea473 tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:30.995262 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11daf6d0-26c8-4842-97b3-ecd0ab3ea473 tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.170858 Oct 25 03:00:30.996551 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 26/41] 10.222.0.36 () {62 vars in 1232 bytes} [Tue Oct 25 03:00:30 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:31.002748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a42db940-44e9-459d-889e-0c1a7c5a788e tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.023624 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a42db940-44e9-459d-889e-0c1a7c5a788e tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025758 Oct 25 03:00:31.024206 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 27/42] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:31.028759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1888534336"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.044909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:31.045404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:31.045931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:31.053355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:31.053894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:31.054338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:31.071146 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1888534336 could not be found. Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 58 Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:31.074158 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: {"add_host": {"host": "tempest-nonexist_host-1888534336"}} Oct 25 03:00:31.075298 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: exception: Compute host tempest-nonexist_host-1888534336 could not be found. Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1888534336'}}} Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1888534336' is not mapped to any cell Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.076069 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 25 03:00:31.082357 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1888534336 could not be found. Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1888534336 could not be found. Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.083742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1888534336 could not be found. Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1888534336 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e8a0c72-0a06-4b9f-8255-9864bd2e2b78 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.050262 Oct 25 03:00:31.084851 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 28/43] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:31.085357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-af9c43c7-df09-4044-bf3c-13d1ac13594c tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.093527 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b17cb79-5a8b-4673-9e42-e16b44c90b9c tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1089409380/action" status: 200 len: 21 microversion: 2.1 time: 0.559466 Oct 25 03:00:31.099697 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 16/44] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 25 03:00:30 2022] POST /compute/v2.1/flavors/1089409380/action => generated 21 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:31.104830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f8dce8e-1568-4723-8150-04fd19508202 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1212702951", "id": "bf98bfc0-9806-4424-b727-feca93b98ee4", "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.116094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-af9c43c7-df09-4044-bf3c-13d1ac13594c tempest-AggregatesAdminTestV241-875902730 tempest-AggregatesAdminTestV241-875902730-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.038153 Oct 25 03:00:31.116931 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 29/45] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 25 03:00:31 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.125640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c8f7f81-ec16-4517-b763-04d71a281393 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.127782 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f8dce8e-1568-4723-8150-04fd19508202 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.026717 Oct 25 03:00:31.128715 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 17/46] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/flavors => generated 507 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.144669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-59d94873-69b5-4a4a-8f82-31eea33ed8b3 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.168445 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c8f7f81-ec16-4517-b763-04d71a281393 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.048299 Oct 25 03:00:31.169537 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 30/47] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:31 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:00:31.174977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70a97bd4-d068-4f65-b00a-a44cb826ff78 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.176894 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-59d94873-69b5-4a4a-8f82-31eea33ed8b3 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1089409380" status: 202 len: 0 microversion: 2.1 time: 0.046659 Oct 25 03:00:31.181620 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 18/48] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:31 2022] DELETE /compute/v2.1/flavors/1089409380 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:31.190764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65207007-d417-487f-bad9-bfc662d0c8a2 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1360061391", "name": "tempest-test_aggregate-178935652"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.195139 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-70a97bd4-d068-4f65-b00a-a44cb826ff78 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/bf98bfc0-9806-4424-b727-feca93b98ee4" status: 202 len: 0 microversion: 2.1 time: 0.024441 Oct 25 03:00:31.195737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 31/49] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:00:31 2022] DELETE /compute/v2.1/flavors/bf98bfc0-9806-4424-b727-feca93b98ee4 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:31.203276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c7a6561-bdf1-429f-89a0-902396a17601 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c7a6561-bdf1-429f-89a0-902396a17601 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 283 Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:31.209080 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.210179 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:00:31.210671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:31.211180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.212554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.213354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:00:31.213354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:00:31.213354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:00:31.213354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.213354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c7a6561-bdf1-429f-89a0-902396a17601 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:31.213631 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4c7a6561-bdf1-429f-89a0-902396a17601 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013871 Oct 25 03:00:31.213631 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 32/50] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:00:31.221593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-663fd099-b825-4704-ba39-3109d089733e tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.231277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.aggregate [None req-65207007-d417-487f-bad9-bfc662d0c8a2 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid 042e9d6c-3724-49cc-b56d-b3329893b2ca for aggregate {{(pid=120562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:31.247222 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-663fd099-b825-4704-ba39-3109d089733e tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034770 Oct 25 03:00:31.248060 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 33/51] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:31.253260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4ec87d4-b141-455a-b2b0-9ce7e2e24fcb tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.277204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4ec87d4-b141-455a-b2b0-9ce7e2e24fcb tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027906 Oct 25 03:00:31.278251 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 34/52] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:31.283571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cd1b878-1035-49da-ac51-877ef89007af tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cd1b878-1035-49da-ac51-877ef89007af tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 27 Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:31.290123 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: {"aggregate": {"name": ""}} Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:31.291258 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi '' Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:31.291935 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:00:31.294178 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.295846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cd1b878-1035-49da-ac51-877ef89007af tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:31.295972 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65207007-d417-487f-bad9-bfc662d0c8a2 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.107525 Oct 25 03:00:31.296128 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cd1b878-1035-49da-ac51-877ef89007af tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.012124 Oct 25 03:00:31.296250 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 19/53] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.296369 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 35/54] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:00:31.313810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4581c543-7e4e-4369-9aa3-f4ce3958590b tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1568260064", "id": 806567436, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.320793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ef25976-458a-4244-bb4e-e2d66f0417f9 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1503077215"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.335230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ef25976-458a-4244-bb4e-e2d66f0417f9 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '33d5743faa8a4bd2bcb6784105576631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc11ebd8be4a4cb76ea30f105c10b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ef25976-458a-4244-bb4e-e2d66f0417f9 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Request method failure captured: Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 60 Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FHYAv5MZIawC6qYc1GXVtHa7V8EuDBslFUd20hcqlr0GnNn2NB2akWng-qqzBwBtXnJLGb8MY576BXzoORnS8EUKPLRF8zANeIh35mzfYOKN-9XSR_vwk0fS3ABhOT9KaE1XRr-w10eigXC12uiBTUtSKAp-9g9yPGB5YzAFsPftE Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:31.337602 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27dc11ebd8be4a4cb76ea30f105c10b9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27dc11ebd8be4a4cb76ea30f105c10b9"}]}] Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 33d5743faa8a4bd2bcb6784105576631 Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: {"aggregate": {"name": "tempest-test_aggregate-1503077215"}} Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:31.338768 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1503077215'}}} Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:31.339406 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:31.340305 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 25 03:00:31.341306 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.341306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ef25976-458a-4244-bb4e-e2d66f0417f9 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:31.341306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ef25976-458a-4244-bb4e-e2d66f0417f9 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.037569 Oct 25 03:00:31.341306 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 36/55] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:31.353368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-62565a6a-0250-4cc4-b48e-6ae12c3ffdc9 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-38305974", "id": 1322881874, "os-flavor-access:is_public": "True"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.355074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4581c543-7e4e-4369-9aa3-f4ce3958590b tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.062409 Oct 25 03:00:31.355964 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 20/56] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/flavors => generated 435 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.369438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3dffdbf1-2f3f-4a04-ad05-60a666fc72bf tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.388365 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-62565a6a-0250-4cc4-b48e-6ae12c3ffdc9 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.047865 Oct 25 03:00:31.398899 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3dffdbf1-2f3f-4a04-ad05-60a666fc72bf tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.040339 Oct 25 03:00:31.399338 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 37/57] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/flavors => generated 412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.405742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ea73d9b-5765-4c34-9fb1-f8e7520edfdd tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1312044654"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.406893 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 21/58] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:00:31 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.411655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7cc114b-abcf-4edb-a20c-7aab17d4b9da tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.419056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-5ea73d9b-5765-4c34-9fb1-f8e7520edfdd tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid 2c2f8813-c099-44f8-a99c-144e1257c727 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:31.419775 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e7cc114b-abcf-4edb-a20c-7aab17d4b9da tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7cc114b-abcf-4edb-a20c-7aab17d4b9da tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Request method failure captured: Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/flavors/806567436/os-flavor-access HTTP/1.1 Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FKTqyqOWTd2xaQKE1wcXVgtPJQPzmXM9D5AcK98MQz4aF3-gIf8bYkIeIRnZOEOxFj-qsMIHHdzO2w0Qq8HgUcggGecGcDHDjbA7Hbf4gIwnnbIfJOIyciIZLIXISmMcebkhaAbplUODXB7MxYxd4HEt-aCtkegC-rjCf9pquRnRA Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bb4bf72866fa43d0998d58a1b47b8cef Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:00:31.421512 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb4bf72866fa43d0998d58a1b47b8cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb4bf72866fa43d0998d58a1b47b8cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb4bf72866fa43d0998d58a1b47b8cef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb4bf72866fa43d0998d58a1b47b8cef"}]}] Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bb4bf72866fa43d0998d58a1b47b8cef Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 80d26430c53b48c5bbbc9224e636af17 Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: exception: Access list not available for public flavors. Oct 25 03:00:31.423642 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'flavor_id': '806567436'} Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 25 03:00:31.424248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.426477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7cc114b-abcf-4edb-a20c-7aab17d4b9da tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:31.427613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7cc114b-abcf-4edb-a20c-7aab17d4b9da tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/806567436/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.019601 Oct 25 03:00:31.428278 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 22/59] 10.222.0.36 () {58 vars in 1206 bytes} [Tue Oct 25 03:00:31 2022] GET /compute/v2.1/flavors/806567436/os-flavor-access => generated 91 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:31.442277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08522748-fe80-49cf-aeaa-2fba26107e75 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.458391 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08522748-fe80-49cf-aeaa-2fba26107e75 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/1322881874" status: 200 len: 412 microversion: 2.1 time: 0.028832 Oct 25 03:00:31.459493 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 23/60] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:31 2022] GET /compute/v2.1/flavors/1322881874 => generated 412 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.464260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd4919f5-6836-4982-b27b-e7db8b946c9b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.474227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ea73d9b-5765-4c34-9fb1-f8e7520edfdd tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073386 Oct 25 03:00:31.480483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4919f5-6836-4982-b27b-e7db8b946c9b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:31.481075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4919f5-6836-4982-b27b-e7db8b946c9b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:31.481704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4919f5-6836-4982-b27b-e7db8b946c9b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:31.482449 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 38/61] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:31.488781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9766a833-74dd-4c7e-a6a1-177257b74728 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.515390 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9766a833-74dd-4c7e-a6a1-177257b74728 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/806567436" status: 202 len: 0 microversion: 2.1 time: 0.031693 Oct 25 03:00:31.516207 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 39/62] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:31 2022] DELETE /compute/v2.1/flavors/806567436 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:31.533397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:31.851821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5cb0edaf-2e07-48f0-a882-7ad22c7a11be tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.889636 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5cb0edaf-2e07-48f0-a882-7ad22c7a11be tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.370912 Oct 25 03:00:31.892350 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 40/63] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:31 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:31.899071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b687a30-0671-4d62-a71c-adc985a120e2 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1312044654"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:31.903222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-5b687a30-0671-4d62-a71c-adc985a120e2 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid cdac490b-fd2b-4dd2-b7f0-3805b6a9530b for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:31.915288 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5b687a30-0671-4d62-a71c-adc985a120e2 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1312044654 already exists. Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b687a30-0671-4d62-a71c-adc985a120e2 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 60 Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:31.917052 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: {"aggregate": {"name": "tempest-test_aggregate-1312044654"}} Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:31.918269 n-d-862355-1 devstack@n-api.service[120563]: exception: Aggregate tempest-test_aggregate-1312044654 already exists. Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1312044654'}}} Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 25 03:00:31.919165 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1312044654 already exists. Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:31.920063 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1312044654 already exists. Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1312044654 already exists. Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b687a30-0671-4d62-a71c-adc985a120e2 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1312044654 already exists. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:31.921162 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b687a30-0671-4d62-a71c-adc985a120e2 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.025923 Oct 25 03:00:31.923352 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 41/64] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 30 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:31.930069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1b5f177-31fc-4367-ace7-8b232bccbf75 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.957034 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1b5f177-31fc-4367-ace7-8b232bccbf75 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.028966 Oct 25 03:00:31.958949 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 42/65] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:31 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:31.964356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aadf0f36-635d-4e10-9483-d902fd345a87 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:31.986222 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aadf0f36-635d-4e10-9483-d902fd345a87 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1322881874" status: 202 len: 0 microversion: 2.1 time: 0.025778 Oct 25 03:00:31.988254 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 43/66] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:31 2022] DELETE /compute/v2.1/flavors/1322881874 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:31.995254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c696f9e-b9cb-4b6d-b1e6-ff1995d251e3 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.035365 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c696f9e-b9cb-4b6d-b1e6-ff1995d251e3 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.044978 Oct 25 03:00:32.038177 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 44/67] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:31 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:00:32.044105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d07fac0-313d-4d80-b2ee-195f6496ec40 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1473571554", "id": 1075363656, "os-flavor-access:is_public": "False"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:32.074330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d07fac0-313d-4d80-b2ee-195f6496ec40 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.033839 Oct 25 03:00:32.084495 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 45/68] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:32 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:32.085215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7373f222-ed39-498d-96ae-a2e907c27a11 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.122086 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7373f222-ed39-498d-96ae-a2e907c27a11 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040725 Oct 25 03:00:32.133700 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 46/69] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:32.133700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-560b7926-0bf7-424d-9d46-a649df4c0308 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1147460863"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:32.133700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-560b7926-0bf7-424d-9d46-a649df4c0308 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid 912a4d30-d9d2-4c4d-85bc-ebd18ea9a381 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:32.159373 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-560b7926-0bf7-424d-9d46-a649df4c0308 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034702 Oct 25 03:00:32.167035 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 47/70] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:32.680534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d3b87d9f-2bdb-416d-8812-9465fa28a858 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:32.683993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d3b87d9f-2bdb-416d-8812-9465fa28a858 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f13ab6b271cf41299c3eefef541aa79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc009b4eaf437ea6d550fa3eb79958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d3b87d9f-2bdb-416d-8812-9465fa28a858 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Request method failure captured: Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/flavors/1075363656/action HTTP/1.1 Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 67 Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FIvo4Nfxb-CF7UHDJUzWc0_97ejQfueJj5-lnpZF6vpMHAOYisxeq6S7rY6JiCvClHZaVnQ-OMEp0T45jnyVeTpkqDocvKPLKRJWkwwRg24fhCw-rjPT_OTYqgYhvwKabvscHyvqucmvPzs4YAtEOesfS9eyuFaeV6R7h_wV0xAUg Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: eacc009b4eaf437ea6d550fa3eb79958 Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1964602631 Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:32.686311 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eacc009b4eaf437ea6d550fa3eb79958"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eacc009b4eaf437ea6d550fa3eb79958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eacc009b4eaf437ea6d550fa3eb79958", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eacc009b4eaf437ea6d550fa3eb79958"}]}] Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1964602631 Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: eacc009b4eaf437ea6d550fa3eb79958 Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1964602631 Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsAccessNegativeTestJSON-1964602631-project Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: f13ab6b271cf41299c3eefef541aa79e Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1964602631-project Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: {"addTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} Oct 25 03:00:32.687806 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1075363656', 'body': {'addTenantAccess': {'tenant': 'eacc009b4eaf437ea6d550fa3eb79958'}}} Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:32.689885 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 25 03:00:32.691302 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.693754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d3b87d9f-2bdb-416d-8812-9465fa28a858 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:32.694908 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d3b87d9f-2bdb-416d-8812-9465fa28a858 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] 10.222.0.36 "POST /compute/v2.1/flavors/1075363656/action" status: 403 len: 130 microversion: 2.1 time: 0.526308 Oct 25 03:00:32.695632 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 48/71] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 25 03:00:32 2022] POST /compute/v2.1/flavors/1075363656/action => generated 130 bytes in 528 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:32.702891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d158cdba-1668-4e0b-b04c-52d914fb2c8f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-419148703", "id": 2108810624, "os-flavor-access:is_public": "False"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:32.714932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=74,nova_api:DELETE=19 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:32.731781 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d158cdba-1668-4e0b-b04c-52d914fb2c8f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.033982 Oct 25 03:00:32.733025 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 49/72] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:32 2022] POST /compute/v2.1/flavors => generated 429 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:32.742495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95fb082b-db7b-4e5a-a3fa-d1ac0e277f22 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.744187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-95fb082b-db7b-4e5a-a3fa-d1ac0e277f22 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '33d5743faa8a4bd2bcb6784105576631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc11ebd8be4a4cb76ea30f105c10b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95fb082b-db7b-4e5a-a3fa-d1ac0e277f22 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Request method failure captured: Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FHYAv5MZIawC6qYc1GXVtHa7V8EuDBslFUd20hcqlr0GnNn2NB2akWng-qqzBwBtXnJLGb8MY576BXzoORnS8EUKPLRF8zANeIh35mzfYOKN-9XSR_vwk0fS3ABhOT9KaE1XRr-w10eigXC12uiBTUtSKAp-9g9yPGB5YzAFsPftE Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:32.746406 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27dc11ebd8be4a4cb76ea30f105c10b9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27dc11ebd8be4a4cb76ea30f105c10b9"}]}] Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 33d5743faa8a4bd2bcb6784105576631 Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 25 03:00:32.747672 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '7'} Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:32.748414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 25 03:00:32.749497 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.751963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95fb082b-db7b-4e5a-a3fa-d1ac0e277f22 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:32.752954 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95fb082b-db7b-4e5a-a3fa-d1ac0e277f22 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.014511 Oct 25 03:00:32.755347 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 50/73] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:32 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:32.761365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b02c6b1-b901-41e7-a35e-af665b5f823e tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.789084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b02c6b1-b901-41e7-a35e-af665b5f823e tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1075363656" status: 202 len: 0 microversion: 2.1 time: 0.032496 Oct 25 03:00:32.794623 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 51/74] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:32 2022] DELETE /compute/v2.1/flavors/1075363656 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:32.799549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e33fc71-143f-4f92-8639-ff2e2ee82077 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "2108810624"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:32.820915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-4e33fc71-143f-4f92-8639-ff2e2ee82077 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] HTTP exception thrown: Flavor 2108810624 could not be found. Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e33fc71-143f-4f92-8639-ff2e2ee82077 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] Request method failure captured: Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 107 Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FHyuG70hpxDdhkq3htz0J2jUuYk1LVX9f1yUA33U-3Sg_iMlw-zZmKChV02mBT1RyurufQ5Fir__uwmo1hgVAexmPG2NHMOUOtx4ZD_FRkQ7hd4GiF9hbDeDHKzFUOuuEVqXtoq9Xz6lmOY-BQfKpK7xiuCjqz42t5nlOM39cAzFo Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 64b5e7bed66345e1a9489033663ed02e Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsAdminTestJSON-30685785 Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:32.824396 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/64b5e7bed66345e1a9489033663ed02e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/64b5e7bed66345e1a9489033663ed02e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_64b5e7bed66345e1a9489033663ed02e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/64b5e7bed66345e1a9489033663ed02e"}]}] Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsAdminTestJSON-30685785 Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 64b5e7bed66345e1a9489033663ed02e Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-30685785 Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsAdminTestJSON-30685785-project Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0c82d653c16949f788795aadbf180868 Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsAdminTestJSON-30685785-project Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "test", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "2108810624"}} Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:32.825663 n-d-862355-1 devstack@n-api.service[120563]: exception: Flavor 2108810624 could not be found. Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '2108810624'}}} Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2108810624 could not be found. Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.826368 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2108810624 could not be found. Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.827324 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.828332 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.828332 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:32.828332 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:32.828332 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2108810624 could not be found. Oct 25 03:00:32.828332 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.830887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e33fc71-143f-4f92-8639-ff2e2ee82077 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] Returning 400 to user: Flavor 2108810624 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:32.831958 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e33fc71-143f-4f92-8639-ff2e2ee82077 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.036371 Oct 25 03:00:32.833247 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 52/75] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:32 2022] POST /compute/v2.1/servers => generated 81 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:00:32.838491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b835d707-78a7-49a1-bb94-0487b87ac9e4 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.871269 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b835d707-78a7-49a1-bb94-0487b87ac9e4 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036037 Oct 25 03:00:32.874458 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 53/76] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:32 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:00:32.880957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f27bba5b-db1e-436f-9398-a238b1f29aeb tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.904476 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f27bba5b-db1e-436f-9398-a238b1f29aeb tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028660 Oct 25 03:00:32.905032 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 54/77] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:32.910548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-587cb4b9-661d-4f3f-bf5c-3ae826744b9a tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.945627 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-587cb4b9-661d-4f3f-bf5c-3ae826744b9a tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2108810624" status: 202 len: 0 microversion: 2.1 time: 0.039526 Oct 25 03:00:32.946874 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 55/78] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:32 2022] DELETE /compute/v2.1/flavors/2108810624 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:32.953268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93c797e2-0466-4adc-9b44-4863ed3c74eb tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:32.966129 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-93c797e2-0466-4adc-9b44-4863ed3c74eb tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93c797e2-0466-4adc-9b44-4863ed3c74eb tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:32.967699 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: exception: Aggregate -1 could not be found. Oct 25 03:00:32.968884 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '-1'} Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 25 03:00:32.969470 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.971118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93c797e2-0466-4adc-9b44-4863ed3c74eb tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93c797e2-0466-4adc-9b44-4863ed3c74eb tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021068 Oct 25 03:00:32.972351 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 56/79] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:00:32 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:32.975683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f11214d0-24ed-4007-b500-2cfdea4d4f91 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1029375075", "id": 1182194987, "os-flavor-access:is_public": "False"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:33.014839 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f11214d0-24ed-4007-b500-2cfdea4d4f91 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.042490 Oct 25 03:00:33.015530 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 57/80] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:32 2022] POST /compute/v2.1/flavors => generated 439 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:33.020041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be80821d-5715-4f1a-8353-527f6d68e097 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.041579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-be80821d-5715-4f1a-8353-527f6d68e097 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024901 Oct 25 03:00:33.055604 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 58/81] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:33.066618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-777620c1-a025-409f-a19d-69a5aba94d21 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1589084467"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:33.080919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-777620c1-a025-409f-a19d-69a5aba94d21 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid 514e5279-8edd-448b-8737-f826736b128f for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:00:33.114377 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-777620c1-a025-409f-a19d-69a5aba94d21 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057290 Oct 25 03:00:33.115854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 59/82] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:00:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:33.121633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d664830-57ed-4f1b-8b1d-996d58a42fae tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:33.434317 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd4919f5-6836-4982-b27b-e7db8b946c9b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 314 microversion: 2.1 time: 1.973474 Oct 25 03:00:33.450123 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 24/83] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:00:31 2022] POST /compute/v2.1/os-aggregates/5/action => generated 314 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:33.457932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12d1ec64-9f98-49ed-9717-f19086e7fd9f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-195964174", "id": 862993921, "os-flavor-access:is_public": "False"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:33.497301 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12d1ec64-9f98-49ed-9717-f19086e7fd9f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.045713 Oct 25 03:00:33.497933 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 25/84] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:33 2022] POST /compute/v2.1/flavors => generated 411 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:33.510612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89fce161-0478-421e-8e17-04cd8950c642 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.515509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89fce161-0478-421e-8e17-04cd8950c642 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '33d5743faa8a4bd2bcb6784105576631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc11ebd8be4a4cb76ea30f105c10b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89fce161-0478-421e-8e17-04cd8950c642 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Request method failure captured: Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FHYAv5MZIawC6qYc1GXVtHa7V8EuDBslFUd20hcqlr0GnNn2NB2akWng-qqzBwBtXnJLGb8MY576BXzoORnS8EUKPLRF8zANeIh35mzfYOKN-9XSR_vwk0fS3ABhOT9KaE1XRr-w10eigXC12uiBTUtSKAp-9g9yPGB5YzAFsPftE Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:00:33.520402 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27dc11ebd8be4a4cb76ea30f105c10b9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27dc11ebd8be4a4cb76ea30f105c10b9"}]}] Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 33d5743faa8a4bd2bcb6784105576631 Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 25 03:00:33.521506 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8'} Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:33.522502 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 25 03:00:33.523600 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.527648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89fce161-0478-421e-8e17-04cd8950c642 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:33.529868 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89fce161-0478-421e-8e17-04cd8950c642 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.027261 Oct 25 03:00:33.530698 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 26/85] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:00:33 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:33.537986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f394c09a-0ad9-4c71-a6c2-3a7f9cab4ee0 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1567294273", "id": 411523934, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:33.571298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f394c09a-0ad9-4c71-a6c2-3a7f9cab4ee0 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.039182 Oct 25 03:00:33.572487 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 27/86] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:33 2022] POST /compute/v2.1/flavors => generated 411 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:33.587182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7deaefe5-1466-48aa-9019-31fdf73e42ac tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.650133 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7deaefe5-1466-48aa-9019-31fdf73e42ac tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.076348 Oct 25 03:00:33.651022 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 28/87] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:33 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:00:33.660844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d0c8a9f9-30b0-4bd5-8b7a-c7a88fa6faf1 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.700082 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d0c8a9f9-30b0-4bd5-8b7a-c7a88fa6faf1 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 843 microversion: 2.1 time: 0.047822 Oct 25 03:00:33.702508 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 29/88] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 25 03:00:33 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 843 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:33.720845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f53e832a-515a-47de-9032-019b17014361 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.738169 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f53e832a-515a-47de-9032-019b17014361 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f53e832a-515a-47de-9032-019b17014361 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:00:33.754066 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: exception: Aggregate -1 could not be found. Oct 25 03:00:33.755705 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '-1'} Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:33.756470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 25 03:00:33.758374 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.770140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f53e832a-515a-47de-9032-019b17014361 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:33.779079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f53e832a-515a-47de-9032-019b17014361 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.066083 Oct 25 03:00:33.781585 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 30/89] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:33 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:33.794574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8802cf90-8752-4d0d-9035-7d9b69394592 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.837934 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8802cf90-8752-4d0d-9035-7d9b69394592 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 843 microversion: 2.1 time: 0.052265 Oct 25 03:00:33.839241 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 31/90] 10.222.0.36 () {58 vars in 1177 bytes} [Tue Oct 25 03:00:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 843 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:33.859060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5fa68d7-037b-4541-b23d-c9f94c11c196 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.862398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b5fa68d7-037b-4541-b23d-c9f94c11c196 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '33d5743faa8a4bd2bcb6784105576631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc11ebd8be4a4cb76ea30f105c10b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5fa68d7-037b-4541-b23d-c9f94c11c196 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Request method failure captured: Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FHYAv5MZIawC6qYc1GXVtHa7V8EuDBslFUd20hcqlr0GnNn2NB2akWng-qqzBwBtXnJLGb8MY576BXzoORnS8EUKPLRF8zANeIh35mzfYOKN-9XSR_vwk0fS3ABhOT9KaE1XRr-w10eigXC12uiBTUtSKAp-9g9yPGB5YzAFsPftE Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:00:33.864331 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27dc11ebd8be4a4cb76ea30f105c10b9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27dc11ebd8be4a4cb76ea30f105c10b9"}]}] Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 33d5743faa8a4bd2bcb6784105576631 Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 25 03:00:33.865654 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:33.866451 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:33.867566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5fa68d7-037b-4541-b23d-c9f94c11c196 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:33.868663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b5fa68d7-037b-4541-b23d-c9f94c11c196 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.024461 Oct 25 03:00:33.874114 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 32/91] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:00:33 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:33.895165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4024656-041e-4cde-9cc7-fa873debe367 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:33.915556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4024656-041e-4cde-9cc7-fa873debe367 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 843 microversion: 2.1 time: 0.038293 Oct 25 03:00:33.916543 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 33/92] 10.222.0.36 () {58 vars in 1171 bytes} [Tue Oct 25 03:00:33 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 843 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:34.144148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-505878071", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "availability_zone": "tempest-test_az-1360061391"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:34.180159 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d664830-57ed-4f1b-8b1d-996d58a42fae tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1182194987/action" status: 200 len: 97 microversion: 2.1 time: 1.059042 Oct 25 03:00:34.182699 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 60/93] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 25 03:00:33 2022] POST /compute/v2.1/flavors/1182194987/action => generated 97 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:34.185516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:34.186051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:34.186759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:34.187504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:34.187969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:34.188936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:34.195639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7675184c-f46d-4073-b975-c62bfc3ea1c0 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:34.235579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7675184c-f46d-4073-b975-c62bfc3ea1c0 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 843 microversion: 2.1 time: 0.051588 Oct 25 03:00:34.236518 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 61/94] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 25 03:00:34 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 843 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:34.242382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b9760ff-3a88-4648-8d1e-0cdccfe186d6 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:34.256964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b9760ff-3a88-4648-8d1e-0cdccfe186d6 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f13ab6b271cf41299c3eefef541aa79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc009b4eaf437ea6d550fa3eb79958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b9760ff-3a88-4648-8d1e-0cdccfe186d6 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Request method failure captured: Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/flavors/1182194987/action HTTP/1.1 Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 70 Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FIvo4Nfxb-CF7UHDJUzWc0_97ejQfueJj5-lnpZF6vpMHAOYisxeq6S7rY6JiCvClHZaVnQ-OMEp0T45jnyVeTpkqDocvKPLKRJWkwwRg24fhCw-rjPT_OTYqgYhvwKabvscHyvqucmvPzs4YAtEOesfS9eyuFaeV6R7h_wV0xAUg Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: eacc009b4eaf437ea6d550fa3eb79958 Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1964602631 Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:34.259363 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eacc009b4eaf437ea6d550fa3eb79958"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eacc009b4eaf437ea6d550fa3eb79958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eacc009b4eaf437ea6d550fa3eb79958", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eacc009b4eaf437ea6d550fa3eb79958"}]}] Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1964602631 Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: eacc009b4eaf437ea6d550fa3eb79958 Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1964602631 Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsAccessNegativeTestJSON-1964602631-project Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: f13ab6b271cf41299c3eefef541aa79e Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1964602631-project Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: {"removeTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} Oct 25 03:00:34.260473 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1182194987', 'body': {'removeTenantAccess': {'tenant': 'eacc009b4eaf437ea6d550fa3eb79958'}}} Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can( Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:34.261066 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 25 03:00:34.263565 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:34.265360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b9760ff-3a88-4648-8d1e-0cdccfe186d6 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:34.270094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b9760ff-3a88-4648-8d1e-0cdccfe186d6 tempest-FlavorsAccessNegativeTestJSON-1964602631 tempest-FlavorsAccessNegativeTestJSON-1964602631-project] 10.222.0.36 "POST /compute/v2.1/flavors/1182194987/action" status: 403 len: 133 microversion: 2.1 time: 0.032210 Oct 25 03:00:34.271282 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 62/95] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 25 03:00:34 2022] POST /compute/v2.1/flavors/1182194987/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:34.277461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c71f3a6a-4808-4155-ab4d-7000d1d225dc tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:34.303062 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c71f3a6a-4808-4155-ab4d-7000d1d225dc tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.030218 Oct 25 03:00:34.303762 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 63/96] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 25 03:00:34 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:34.311419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6da922e9-3e82-4f0b-831b-e89d80539a7f tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eacc009b4eaf437ea6d550fa3eb79958"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:35.119046 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6da922e9-3e82-4f0b-831b-e89d80539a7f tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1182194987/action" status: 200 len: 21 microversion: 2.1 time: 0.813443 Oct 25 03:00:35.119780 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 64/97] 10.222.0.36 () {60 vars in 1200 bytes} [Tue Oct 25 03:00:34 2022] POST /compute/v2.1/flavors/1182194987/action => generated 21 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:35.129165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34083810-0e77-4f65-926b-858ef8dfae7f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:35.176489 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34083810-0e77-4f65-926b-858ef8dfae7f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.053945 Oct 25 03:00:35.179259 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 65/98] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Oct 25 03:00:35 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:35.184972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b4bda99e-17cb-48ec-9c03-1b2fda2df0fc tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:35.227915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b4bda99e-17cb-48ec-9c03-1b2fda2df0fc tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1182194987" status: 202 len: 0 microversion: 2.1 time: 0.047239 Oct 25 03:00:35.229149 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 66/99] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:35 2022] DELETE /compute/v2.1/flavors/1182194987 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:35.234593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14ef2435-2d5e-40a7-bef8-cd7bdc485498 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:35.283337 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14ef2435-2d5e-40a7-bef8-cd7bdc485498 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.052513 Oct 25 03:00:35.285224 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 67/100] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 25 03:00:35 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:35.289960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f1a6791-f631-4c25-b3ec-6d26a9540d9a tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:35.327938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:00:35.336105 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f1a6791-f631-4c25-b3ec-6d26a9540d9a tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.049661 Oct 25 03:00:35.337232 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 68/101] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:35 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:35.342434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc534a7d-f46e-40bc-aec7-9cfc66931337 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:35.389809 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc534a7d-f46e-40bc-aec7-9cfc66931337 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.051195 Oct 25 03:00:35.391086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 69/102] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 25 03:00:35 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:35.399699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bcd21aaf-3e6f-4946-aed6-6dcf867bd45b tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1331805611", "id": 884911406, "os-flavor-access:is_public": "False"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:35.450099 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bcd21aaf-3e6f-4946-aed6-6dcf867bd45b tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.052843 Oct 25 03:00:35.452468 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 70/103] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:35 2022] POST /compute/v2.1/flavors => generated 436 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:35.465834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86b0ecfd-c1ba-4465-9157-c864d4caba0c tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:35.513622 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86b0ecfd-c1ba-4465-9157-c864d4caba0c tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/411523934" status: 202 len: 0 microversion: 2.1 time: 0.059824 Oct 25 03:00:35.517259 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 71/104] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:35 2022] DELETE /compute/v2.1/flavors/411523934 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:35.528909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c453a1ab-8264-47f5-b3d3-aceca62cb64d tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "23b55a4199a0439987e379030104531b"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:35.886484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:00:35.887140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:00:35.887805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:00:35.888575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:00:35.889364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:00:35.911879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:35.912506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:35.913144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:35.914170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:35.914790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:35.915241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:35.966715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Getting quotas for project 0e4ab406de0748a18283fbc93059ed42. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:00:35.974523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Getting quotas for user a7e121b8f85246a1a48aee8fb0d058ab and project 0e4ab406de0748a18283fbc93059ed42. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:00:35.996357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:00:35.999253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:00:36.122237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ee5ed8e-1ccd-4f03-93e2-9fb8c5f14906 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202506 Oct 25 03:00:36.123987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 34/105] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:00:36.132754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7039b8b8-9228-4175-bab3-45dc10ce8512 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:36.168029 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7039b8b8-9228-4175-bab3-45dc10ce8512 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042120 Oct 25 03:00:36.182256 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 35/106] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:36.359796 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c453a1ab-8264-47f5-b3d3-aceca62cb64d tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] HTTP exception thrown: Flavor access not found for 28 / 23b55a4199a0439987e379030104531b combination. Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c453a1ab-8264-47f5-b3d3-aceca62cb64d tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Request method failure captured: Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/flavors/884911406/action HTTP/1.1 Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 70 Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKTqyqOWTd2xaQKE1wcXVgtPJQPzmXM9D5AcK98MQz4aF3-gIf8bYkIeIRnZOEOxFj-qsMIHHdzO2w0Qq8HgUcggGecGcDHDjbA7Hbf4gIwnnbIfJOIyciIZLIXISmMcebkhaAbplUODXB7MxYxd4HEt-aCtkegC-rjCf9pquRnRA Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bb4bf72866fa43d0998d58a1b47b8cef Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:36.362330 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb4bf72866fa43d0998d58a1b47b8cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb4bf72866fa43d0998d58a1b47b8cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb4bf72866fa43d0998d58a1b47b8cef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb4bf72866fa43d0998d58a1b47b8cef"}]}] Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bb4bf72866fa43d0998d58a1b47b8cef Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-534345883 Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 80d26430c53b48c5bbbc9224e636af17 Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: {"removeTenantAccess": {"tenant": "23b55a4199a0439987e379030104531b"}} Oct 25 03:00:36.363689 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: exception: Flavor access not found for 28 / 23b55a4199a0439987e379030104531b combination. Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '884911406', 'body': {'removeTenantAccess': {'tenant': '23b55a4199a0439987e379030104531b'}}} Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 25 03:00:36.364405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 28 / 23b55a4199a0439987e379030104531b combination. Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 28 / 23b55a4199a0439987e379030104531b combination. Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:36.365482 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 28 / 23b55a4199a0439987e379030104531b combination. Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c453a1ab-8264-47f5-b3d3-aceca62cb64d tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Returning 404 to user: Flavor access not found for 28 / 23b55a4199a0439987e379030104531b combination. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c453a1ab-8264-47f5-b3d3-aceca62cb64d tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/884911406/action" status: 404 len: 124 microversion: 2.1 time: 0.845096 Oct 25 03:00:36.366717 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 72/107] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 25 03:00:35 2022] POST /compute/v2.1/flavors/884911406/action => generated 124 bytes in 846 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:36.372544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a1b4cb70-47f8-4655-8fc9-cb1042a681e4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:36.373589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a1b4cb70-47f8-4655-8fc9-cb1042a681e4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:36.652535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-981853275", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:36.747811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:00:37.175618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:00:37.176177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:00:37.176728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:00:37.177202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:00:37.177709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:00:37.199469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:37.199980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:37.200768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:37.201517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:37.202017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:37.202455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:37.223798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Getting quotas for project 019b7b32bbcd4474b05101db46063770. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:00:37.228466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Getting quotas for user b89a2cc21f1549c7b59b97757cc60c33 and project 019b7b32bbcd4474b05101db46063770. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:00:37.242584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:00:37.262306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:00:37.364409 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-249db41c-0a57-4d64-919a-6876dab77d0c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180924 Oct 25 03:00:37.365848 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 36/108] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:00:37.376947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f64ab65-c715-4227-bbb9-545e7c93c76f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:37.401323 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f64ab65-c715-4227-bbb9-545e7c93c76f tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/862993921" status: 202 len: 0 microversion: 2.1 time: 0.033420 Oct 25 03:00:37.403034 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 37/109] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:37 2022] DELETE /compute/v2.1/flavors/862993921 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:37.409299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-247421bb-65e9-47c7-9622-faeb45b67722 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:37.482234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a1b4cb70-47f8-4655-8fc9-cb1042a681e4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:37.490234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-247421bb-65e9-47c7-9622-faeb45b67722 tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/884911406" status: 202 len: 0 microversion: 2.1 time: 0.085876 Oct 25 03:00:37.490840 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 38/110] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:37 2022] DELETE /compute/v2.1/flavors/884911406 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:37.536156 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a1b4cb70-47f8-4655-8fc9-cb1042a681e4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1242 microversion: 2.1 time: 1.164655 Oct 25 03:00:37.541841 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 73/111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:36 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1242 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:37.564224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b5fcced2-3411-4523-9222-bcc2be97d0ee tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:37.566231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b5fcced2-3411-4523-9222-bcc2be97d0ee tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:37.672273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b5fcced2-3411-4523-9222-bcc2be97d0ee tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:37.680970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b5fcced2-3411-4523-9222-bcc2be97d0ee tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1219 microversion: 2.1 time: 0.136449 Oct 25 03:00:37.697001 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 74/112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:37 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:37.697001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e7d7b8a-dd41-49a3-83d7-ee16ed4feb09 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:37.715500 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e7d7b8a-dd41-49a3-83d7-ee16ed4feb09 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031216 Oct 25 03:00:37.716111 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 75/113] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:37.727136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e2817d35-d4df-4147-b0cc-f9966dcad97c tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:37.765297 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e2817d35-d4df-4147-b0cc-f9966dcad97c tempest-FlavorsAccessNegativeTestJSON-534345883 tempest-FlavorsAccessNegativeTestJSON-534345883-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043151 Oct 25 03:00:37.766894 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 76/114] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:37.775385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d30de68-0e79-4d3f-a892-77d66c34c128 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-683293924", "id": 1093373456, "os-flavor-access:is_public": "False"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:37.821830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=78,nova_api:DELETE=16 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:37.835613 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7d30de68-0e79-4d3f-a892-77d66c34c128 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.065787 Oct 25 03:00:37.836582 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 77/115] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:37 2022] POST /compute/v2.1/flavors => generated 414 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:37.851188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52f1b44e-2fa4-4104-9a97-76a3c4fcd4ed tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:37.928664 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52f1b44e-2fa4-4104-9a97-76a3c4fcd4ed tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081388 Oct 25 03:00:37.930603 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 78/116] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:37.959722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-930a75d7-cd9c-497f-87a1-5819a92ad704 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.025526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-930a75d7-cd9c-497f-87a1-5819a92ad704 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077255 Oct 25 03:00:38.027581 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 79/117] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:38.050612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e112842-840a-451c-a5e9-bfb7b79bac99 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.100952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd3839ac10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.103012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.103507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.103963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.111980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e112842-840a-451c-a5e9-bfb7b79bac99 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1093373456" status: 202 len: 0 microversion: 2.1 time: 0.065330 Oct 25 03:00:38.116302 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 80/118] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:00:38 2022] DELETE /compute/v2.1/flavors/1093373456 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:00:38.149906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea5fa2e8-6bc4-4929-90d1-b0bfec5b4ead tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.155770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.156263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.156698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.189933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.191304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.192570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.213284 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eacae815-00a2-44e3-b8c2-2ee52e4da808 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.721396 Oct 25 03:00:38.224420 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea5fa2e8-6bc4-4929-90d1-b0bfec5b4ead tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.103022 Oct 25 03:00:38.227482 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 81/119] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:38.232641 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 39/120] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:38.260304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4fa55e52-2b1d-4ffb-b156-b0fe8036a7ce tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-568133650", "id": 747211462, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:38.264474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd382324c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.279418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.281113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.283354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.295429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4fa55e52-2b1d-4ffb-b156-b0fe8036a7ce tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.040504 Oct 25 03:00:38.296878 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 40/121] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:38 2022] POST /compute/v2.1/flavors => generated 410 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:38.310715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-306832eb-4d91-4f81-96a9-d0f832d40602 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.312476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.321748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.322896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.361104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.363558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.365031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.400365 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-636dba91-b100-4193-b66f-aa983426389c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.157742 Oct 25 03:00:38.402852 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 82/122] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:38.432950 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-306832eb-4d91-4f81-96a9-d0f832d40602 tempest-FlavorsAdminTestJSON-30685785 tempest-FlavorsAdminTestJSON-30685785-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.127288 Oct 25 03:00:38.442950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd382bff70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.449485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.450195 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 41/123] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:00:38.451028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.453314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.470301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a5f5f9b-3633-4d17-8818-632088bee74b tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.495561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.500035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.500696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.536264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.539087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.539857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.546751 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a5f5f9b-3633-4d17-8818-632088bee74b tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/747211462" status: 202 len: 0 microversion: 2.1 time: 0.088154 Oct 25 03:00:38.549952 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 42/124] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:38 2022] DELETE /compute/v2.1/flavors/747211462 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:38.559645 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37bff9de-da3a-45cd-a107-cef86c8b6962 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.144396 Oct 25 03:00:38.564273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 83/125] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:38.576634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e0456fe6-e671-4908-a014-ce09e0840837 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.577998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.580739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:38.594203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.596607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.598563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.600763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.602710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.603408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.663231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e0456fe6-e671-4908-a014-ce09e0840837 tempest-FlavorsAdminTestJSON-757591418 tempest-FlavorsAdminTestJSON-757591418-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.104591 Oct 25 03:00:38.663895 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 43/126] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:38.676077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd38d31940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.691685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.693491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.702099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.770746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:38.774715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:38.775517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:38.807138 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21bb672f-2bdf-4136-8c46-a30e805f3b53 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.140217 Oct 25 03:00:38.814490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 44/127] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:38.851117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f3ac6aa-d829-4eb1-8b36-04770c4294cb tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.853103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f3ac6aa-d829-4eb1-8b36-04770c4294cb tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:38.902693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10,nova_api:DELETE=11 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:38.922206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:38.957362 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dfa5cddd-22e3-46bc-b385-a1c1e9a5b4eb tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1234 microversion: 2.1 time: 0.389130 Oct 25 03:00:38.970727 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 84/128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1234 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:38.988973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3485bc1-781c-4619-823b-dba170145ab1 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd3810a9d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:38.999825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3485bc1-781c-4619-823b-dba170145ab1 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.003055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3485bc1-781c-4619-823b-dba170145ab1 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.003733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3485bc1-781c-4619-823b-dba170145ab1 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.058187 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3485bc1-781c-4619-823b-dba170145ab1 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.083763 Oct 25 03:00:39.061449 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 85/129] 10.222.0.36 () {58 vars in 1179 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:39.077288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd3810af70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:39.084004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.084498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.084947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.127870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1f3ac6aa-d829-4eb1-8b36-04770c4294cb tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:39.130555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.131107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.131546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.165415 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f3ac6aa-d829-4eb1-8b36-04770c4294cb tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1219 microversion: 2.1 time: 0.340341 Oct 25 03:00:39.171526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.172026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.176367 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 45/130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:38 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1219 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:39.194765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.207197 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f709fb8-21f5-42d8-9dee-f09be9b43474 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.136678 Oct 25 03:00:39.209723 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 86/131] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:39.222177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd382f2b80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:39.224205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.224805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.225428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.264311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.265005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.265754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.283991 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21ca0999-37a9-4d7d-a06c-e717da032e6d tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.066640 Oct 25 03:00:39.290800 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 46/132] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:39.309322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd380970d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:39.311447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.312953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.312953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.376017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.376518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.376962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.386163 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4afd9802-0e22-4ffd-ab60-7ae215edc064 tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.081059 Oct 25 03:00:39.396734 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 87/133] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:00:39 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:39.404262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Calling method '.version_select at 0x7efd38322700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:39.407738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.408242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.408859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.427632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.428167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.428610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.450136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.451445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.452127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.461559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:00:39.462235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f1e1770-bc44-4f5e-86d2-c879f959ed9c tempest-HypervisorAdminTestJSON-527038109 tempest-HypervisorAdminTestJSON-527038109-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:00:39.465345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.466202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.466781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.467922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:39.468556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:39.470481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:39.487504 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.compute.rpcapi [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 25 03:00:39.488740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] Releasing lock "compute-rpcapi-router" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:00:39.635529 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c50e1d3-1e1d-491a-8a10-77db8575a407 None None] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.236905 Oct 25 03:00:39.636039 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 47/134] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 25 03:00:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:39.937432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a17162a1-7dac-4fc3-86b3-4dfcf05d6e65 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1405485396", "id": 1668010889, "os-flavor-access:is_public": "True"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:39.986588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:39.988870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:39.994006 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a17162a1-7dac-4fc3-86b3-4dfcf05d6e65 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.363106 Oct 25 03:00:40.007587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 88/135] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:00:39 2022] POST /compute/v2.1/flavors => generated 449 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:40.008374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:40.008876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:40.011427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:40.012389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:40.015219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:40.017993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:40.299276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:40.319639 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94c492d4-6f01-44fc-877f-695a8e36f406 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1308 microversion: 2.1 time: 0.338688 Oct 25 03:00:40.324462 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 48/136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:39 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:40.333559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:40.334293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:40.350323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:40.354296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:40.354751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:40.355478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:40.369468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:40.375502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:40.555775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:40.586049 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b8fc38ea-d555-4556-b019-8abe96cb989e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1271 microversion: 2.1 time: 0.257699 Oct 25 03:00:40.594448 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 49/137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:40 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1271 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:40.624406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e717705c-c9a1-4db6-854f-6c582c3b7ee4 tempest-FlavorsV255TestJSON-421967689 tempest-FlavorsV255TestJSON-421967689-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:40.659818 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e717705c-c9a1-4db6-854f-6c582c3b7ee4 tempest-FlavorsV255TestJSON-421967689 tempest-FlavorsV255TestJSON-421967689-project] 10.222.0.36 "GET /compute/v2.1/flavors/1668010889" status: 200 len: 449 microversion: 2.55 time: 0.647605 Oct 25 03:00:40.665435 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 89/138] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Oct 25 03:00:40 2022] GET /compute/v2.1/flavors/1668010889 => generated 449 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:40.678617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4717bbea-88dc-47bd-8ac9-093ef4a347e0 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] Action: 'update', calling method: .version_select at 0x7efd393f5b80>, body: {"flavor": {"description": "new"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:40.768177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4717bbea-88dc-47bd-8ac9-093ef4a347e0 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/1668010889" status: 200 len: 450 microversion: 2.55 time: 0.093545 Oct 25 03:00:40.777653 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 50/139] 10.222.0.36 () {62 vars in 1219 bytes} [Tue Oct 25 03:00:40 2022] PUT /compute/v2.1/flavors/1668010889 => generated 450 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:40.785166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51f28c08-a233-48dc-b867-fd3a209b9033 tempest-FlavorsV255TestJSON-421967689 tempest-FlavorsV255TestJSON-421967689-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:40.840915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51f28c08-a233-48dc-b867-fd3a209b9033 tempest-FlavorsV255TestJSON-421967689 tempest-FlavorsV255TestJSON-421967689-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.062813 Oct 25 03:00:40.846905 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 90/140] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:00:40 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:00:40.868223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad23d2a1-c5cd-4752-87a6-be98d9cd88b0 tempest-FlavorsV255TestJSON-421967689 tempest-FlavorsV255TestJSON-421967689-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:40.904589 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad23d2a1-c5cd-4752-87a6-be98d9cd88b0 tempest-FlavorsV255TestJSON-421967689 tempest-FlavorsV255TestJSON-421967689-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.040451 Oct 25 03:00:40.905005 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 51/141] 10.222.0.36 () {60 vars in 1166 bytes} [Tue Oct 25 03:00:40 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:00:40.922571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7aa57917-5949-4ceb-993a-a22bc733c865 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:40.952221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7aa57917-5949-4ceb-993a-a22bc733c865 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1668010889" status: 202 len: 0 microversion: 2.55 time: 0.033988 Oct 25 03:00:40.953567 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 91/142] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Oct 25 03:00:40 2022] DELETE /compute/v2.1/flavors/1668010889 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:00:40.961949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-abe36c3c-3ad1-4374-9bb0-492f06434f93 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:41.002497 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-abe36c3c-3ad1-4374-9bb0-492f06434f93 tempest-FlavorsV255TestJSON-703121159 tempest-FlavorsV255TestJSON-703121159-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.044425 Oct 25 03:00:41.022284 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 52/143] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:00:40 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:00:41.340073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:41.344457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:41.345614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:41.366192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:41.367203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:41.369237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:41.370183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:41.371395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:41.372997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:41.625731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:41.627199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:41.643017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:41.651443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:41.656058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:41.658495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:41.659610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:41.661301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:41.868513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:41.886942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-443b5549-0559-4d3e-a62d-7847ccd17da8 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1277 microversion: 2.1 time: 0.266257 Oct 25 03:00:41.891417 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 53/144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:41 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:42.049318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:42.066674 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3248b1d0-41e6-45d8-a016-40e57916d869 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1296 microversion: 2.1 time: 0.723584 Oct 25 03:00:42.072309 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 92/145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:41 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1296 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:42.916898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:42.918543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:42.961400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:42.967554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:42.970669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:42.981792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:42.987943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:42.991118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:43.093104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:43.094365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:43.112333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:43.113750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:43.115674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:43.119009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:43.124087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:43.126829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:43.397187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:43.407112 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed587e07-f0f9-4ea4-8238-1749cdeeb51a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1277 microversion: 2.1 time: 0.500201 Oct 25 03:00:43.412389 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 54/146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:42 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1277 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:43.722839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:43.732877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f3b7ae1-1dad-4f4c-b7c3-5a3fd98e3a69 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1296 microversion: 2.1 time: 0.643572 Oct 25 03:00:43.735959 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 93/147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:43 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1296 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:44.449949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:44.450634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:44.477616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:44.479680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:44.480115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:44.481009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:44.485604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:44.492937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:44.684805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:44.702327 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca61505e-f2f1-4170-9a30-1968714c4b77 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1277 microversion: 2.1 time: 0.265093 Oct 25 03:00:44.703045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 55/148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:44 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:44.776395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:44.779607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:44.806741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:44.811140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:44.812541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:44.819982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:44.821481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:44.822748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:45.091045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:45.128332 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b3ef641-94a8-4202-acd5-af7184297728 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1296 microversion: 2.1 time: 0.361783 Oct 25 03:00:45.128966 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 56/149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:44 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1296 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:45.312907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6f0bde5-3eb3-4bfd-80d7-e25a87b9627a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:45.324666 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f6f0bde5-3eb3-4bfd-80d7-e25a87b9627a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.728958 Oct 25 03:00:45.338373 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 94/150] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:00:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:45.736651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:45.737338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:45.749501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:45.759096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:45.762244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:45.763764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:45.764291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:45.764841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:45.866547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-807ef5c4-4ab7-452e-98e3-15e164dca89c tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-672523161", "id": 1988608484, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:45.909373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-807ef5c4-4ab7-452e-98e3-15e164dca89c tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.557883 Oct 25 03:00:45.918064 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 57/151] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:45 2022] POST /compute/v2.1/flavors => generated 424 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:45.924053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc675e9d-9cbe-42a9-8536-893793ebe57c tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:45.976456 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc675e9d-9cbe-42a9-8536-893793ebe57c tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.056457 Oct 25 03:00:45.979154 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 58/152] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 25 03:00:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:45.989382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd2d9190-78f7-44c2-870c-324cfc52bc18 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-416540217", "id": 1809440273, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:46.096806 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd2d9190-78f7-44c2-870c-324cfc52bc18 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.107706 Oct 25 03:00:46.099735 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 59/153] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:45 2022] POST /compute/v2.1/flavors => generated 424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:46.133581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c8a96074-86a4-471e-847a-a02f25b9befd tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:46.168340 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c8a96074-86a4-471e-847a-a02f25b9befd tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055099 Oct 25 03:00:46.172154 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 60/154] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 25 03:00:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:46.185171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:46.189317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:46.213530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:46.214350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:46.215321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:46.217797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:46.220877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:46.221579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:46.379481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:46.398799 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-049a236e-52be-4b80-a5d6-7482c2fcde33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1277 microversion: 2.1 time: 0.665489 Oct 25 03:00:46.405225 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 95/155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:45 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1277 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:46.409256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:46.420956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-68f7b7b4-477b-48b7-8e9c-fd3425420d5c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Action: 'create', calling method: .version_select at 0x7efd38027670>, body: {"keypair": {"name": "tempest-keypair-202991637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADlni4MEsAHZd/8YN2YT6imbfofHM6bskQsGOEFdYawd/QMUmTn8fC5jVOgNz2DFavY9ZhOIXyGnbXcquWpYI7uhy+DnCcnx02oJLcYC4CURlAJ1LCl3UY9HyfkMRLDFQ=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:46.421794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c151aae-c06b-447b-801b-fedca46a4d19 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1296 microversion: 2.1 time: 0.247638 Oct 25 03:00:46.422602 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 61/156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:46 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1296 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:46.544553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-68f7b7b4-477b-48b7-8e9c-fd3425420d5c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Getting quotas for project b8b75865acf94a8a9a7899e766b10666. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:00:46.569919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-68f7b7b4-477b-48b7-8e9c-fd3425420d5c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Getting quotas for user fefa869da4ec498e985174e256f92ada and project b8b75865acf94a8a9a7899e766b10666. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:00:46.771214 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-68f7b7b4-477b-48b7-8e9c-fd3425420d5c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.364445 Oct 25 03:00:46.774126 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 96/157] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:00:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:47.428908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:47.431886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:47.452595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:47.454690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:47.468505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:47.469341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:47.474225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:47.474756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:47.475204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:47.476114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:47.479434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:47.479952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:47.480392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:47.481854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:47.482595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:47.483467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:48.029902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:48.059802 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c240c786-6e8b-488a-94a2-6f1a909058aa tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1277 microversion: 2.1 time: 0.638971 Oct 25 03:00:48.065577 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 62/158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:47 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1277 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:48.418349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:48.432009 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-88110626-f14f-4292-8ec4-e0f9554b9b9c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.984568 Oct 25 03:00:48.438813 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 97/159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:47 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:49.093329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:49.095269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:49.122773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:49.124671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:49.127769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:49.132010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:49.134858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:49.136150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:49.152973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:49.156963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:49.462369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:49.463644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:49.487129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:49.488468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:49.489638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:49.492749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:49.494875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:49.500183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:49.504542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:49.627889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:49.641837 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dfa159f6-e08d-4143-b2f4-094c3437c92d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.556918 Oct 25 03:00:49.646286 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 63/160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:49 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:50.351005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:50.370853 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-439c35f2-1089-4853-bbad-24b47fc19f88 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.913859 Oct 25 03:00:50.380791 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 98/161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:49 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:50.523208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-516ec9c4-8e1c-42bf-8450-b0a6ff5aaddd tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-191890502", "ram": 512, "vcpus": 1, "disk": 10, "id": 190959234, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:50.628138 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-516ec9c4-8e1c-42bf-8450-b0a6ff5aaddd tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.679461 Oct 25 03:00:50.642815 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 64/162] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:49 2022] POST /compute/v2.1/flavors => generated 412 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:50.667652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:50.668290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:50.688956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:50.692717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:50.694525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:50.696355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:50.702765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:50.703449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:51.155128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-511fd155-8534-40da-af17-7cb2537cd307 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:51.180074 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-511fd155-8534-40da-af17-7cb2537cd307 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] HTTP exception thrown: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-511fd155-8534-40da-af17-7cb2537cd307 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Request method failure captured: Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/flavors/190959234/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Fe3y5YEcX-MYJSs4HBrBfjuJFWyashhjpm-SEjp5ogzRXWiGryOB8-ac5pahfpC7CA-q_Y1wW_nJK53PYEybAOQgLEDupq9toV6_srVI11HGdfqBFY1a1kf42eKrLVoYqoovReWp6iDbhodYpeBrUCa5K-tb4gnxEm2EpjRkntpK4 Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:51.185650 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e93e42799c80402a93a7bd579ca66d30", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e93e42799c80402a93a7bd579ca66d30"}]}] Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: edf401b6b202431f8c2b9ab609804de2 Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:51.186929 n-d-862355-1 devstack@n-api.service[120563]: exception: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'flavor_id': '190959234', 'id': 'hw:cpu_thread_policy'} Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.187860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.189911 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.189911 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.189911 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.189911 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:51.189911 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:51.189911 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.189911 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.192000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-511fd155-8534-40da-af17-7cb2537cd307 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Returning 404 to user: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:51.193204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-511fd155-8534-40da-af17-7cb2537cd307 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] 10.222.0.36 "GET /compute/v2.1/flavors/190959234/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.545731 Oct 25 03:00:51.194788 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 99/163] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:00:50 2022] GET /compute/v2.1/flavors/190959234/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 548 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:51.204873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6a54f6f-c59c-40ae-b1ff-e90f9c98960e tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:51.211111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6a54f6f-c59c-40ae-b1ff-e90f9c98960e tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'edf401b6b202431f8c2b9ab609804de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93e42799c80402a93a7bd579ca66d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6a54f6f-c59c-40ae-b1ff-e90f9c98960e tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Request method failure captured: Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/flavors/190959234/os-extra_specs HTTP/1.1 Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 66 Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Fe3y5YEcX-MYJSs4HBrBfjuJFWyashhjpm-SEjp5ogzRXWiGryOB8-ac5pahfpC7CA-q_Y1wW_nJK53PYEybAOQgLEDupq9toV6_srVI11HGdfqBFY1a1kf42eKrLVoYqoovReWp6iDbhodYpeBrUCa5K-tb4gnxEm2EpjRkntpK4 Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:51.213292 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e93e42799c80402a93a7bd579ca66d30", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e93e42799c80402a93a7bd579ca66d30"}]}] Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: edf401b6b202431f8c2b9ab609804de2 Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 25 03:00:51.214506 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'flavor_id': '190959234', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:51.215164 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 25 03:00:51.216166 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.225774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6a54f6f-c59c-40ae-b1ff-e90f9c98960e tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:51.227014 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f6a54f6f-c59c-40ae-b1ff-e90f9c98960e tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] 10.222.0.36 "POST /compute/v2.1/flavors/190959234/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.026558 Oct 25 03:00:51.229363 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 100/164] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 25 03:00:51 2022] POST /compute/v2.1/flavors/190959234/os-extra_specs => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:00:51.248853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f117f52f-55ee-46b1-9755-cebc0dabc5b2 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:51.303006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:51.312463 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70a7d1cf-eeec-4ec2-9aa6-1a8a43ecf122 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.648300 Oct 25 03:00:51.316358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 65/165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:50 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:00:51.353804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f117f52f-55ee-46b1-9755-cebc0dabc5b2 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/190959234/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.118998 Oct 25 03:00:51.361253 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 101/166] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 25 03:00:51 2022] POST /compute/v2.1/flavors/190959234/os-extra_specs => generated 66 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:51.366497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b77e7bec-3d05-43b8-9559-4fe04a62ac23 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:51.368273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b77e7bec-3d05-43b8-9559-4fe04a62ac23 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'edf401b6b202431f8c2b9ab609804de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93e42799c80402a93a7bd579ca66d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b77e7bec-3d05-43b8-9559-4fe04a62ac23 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Request method failure captured: Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Fe3y5YEcX-MYJSs4HBrBfjuJFWyashhjpm-SEjp5ogzRXWiGryOB8-ac5pahfpC7CA-q_Y1wW_nJK53PYEybAOQgLEDupq9toV6_srVI11HGdfqBFY1a1kf42eKrLVoYqoovReWp6iDbhodYpeBrUCa5K-tb4gnxEm2EpjRkntpK4 Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:00:51.370707 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e93e42799c80402a93a7bd579ca66d30", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e93e42799c80402a93a7bd579ca66d30"}]}] Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: edf401b6b202431f8c2b9ab609804de2 Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:00:51.372072 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'flavor_id': '190959234', 'id': 'hw:numa_nodes'} Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:51.372702 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 25 03:00:51.373813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.375523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b77e7bec-3d05-43b8-9559-4fe04a62ac23 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:51.377255 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b77e7bec-3d05-43b8-9559-4fe04a62ac23 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] 10.222.0.36 "DELETE /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014925 Oct 25 03:00:51.379255 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 66/167] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:00:51 2022] DELETE /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:51.391016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4bfd35d5-07e8-40c5-8469-ef77bc8d8561 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:51.402448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:51.403506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:51.417163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:51.419759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:51.420505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:51.425863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:51.426676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:51.427273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:51.459048 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4bfd35d5-07e8-40c5-8469-ef77bc8d8561 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/190959234/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074121 Oct 25 03:00:51.459654 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 102/168] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 25 03:00:51 2022] POST /compute/v2.1/flavors/190959234/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:00:51.477069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ef24d6b-ba9b-40d8-b805-c813feda022a tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:51.486439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ef24d6b-ba9b-40d8-b805-c813feda022a tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'edf401b6b202431f8c2b9ab609804de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e93e42799c80402a93a7bd579ca66d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ef24d6b-ba9b-40d8-b805-c813feda022a tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Request method failure captured: Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 22 Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Fe3y5YEcX-MYJSs4HBrBfjuJFWyashhjpm-SEjp5ogzRXWiGryOB8-ac5pahfpC7CA-q_Y1wW_nJK53PYEybAOQgLEDupq9toV6_srVI11HGdfqBFY1a1kf42eKrLVoYqoovReWp6iDbhodYpeBrUCa5K-tb4gnxEm2EpjRkntpK4 Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:51.488362 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e93e42799c80402a93a7bd579ca66d30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e93e42799c80402a93a7bd579ca66d30", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e93e42799c80402a93a7bd579ca66d30"}]}] Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e93e42799c80402a93a7bd579ca66d30 Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: edf401b6b202431f8c2b9ab609804de2 Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: {"hw:numa_nodes": "1"} Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:51.489720 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'flavor_id': '190959234', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:51.490551 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 25 03:00:51.491645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.497327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ef24d6b-ba9b-40d8-b805-c813feda022a tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:51.498949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ef24d6b-ba9b-40d8-b805-c813feda022a tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659 tempest-FlavorsExtraSpecsNegativeTestJSON-1972354659-project] 10.222.0.36 "PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032141 Oct 25 03:00:51.507218 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 103/169] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:00:51 2022] PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:51.534407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56ae3e48-4840-441b-b13c-ce3a2dcef0ce tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:51.550249 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-56ae3e48-4840-441b-b13c-ce3a2dcef0ce tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] HTTP exception thrown: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56ae3e48-4840-441b-b13c-ce3a2dcef0ce tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Request method failure captured: Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/flavors/190959234/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FhtYTylGPJsVVQM_enz3QQTzFkHmNd6AvT-yQuw1DR7YlKTF4BsdCJ1cP8JGcULIVELcpraz-H7Vxm0g9rrO1luZ1lZQklOJ3HXZVQiBXae0WiwnxfljrB1R2p852BbZBxmyIte2wxbxiERZX4-o4WrLog8MnSSYNrz9j3lUBvSjo Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8c702f6e34d34058ae76bf22a4de314e Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:51.551920 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c702f6e34d34058ae76bf22a4de314e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c702f6e34d34058ae76bf22a4de314e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c702f6e34d34058ae76bf22a4de314e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c702f6e34d34058ae76bf22a4de314e"}]}] Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8c702f6e34d34058ae76bf22a4de314e Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 734eea2ac95c45449e72ed6fa6cc2ca2 Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:51.553235 n-d-862355-1 devstack@n-api.service[120563]: exception: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'flavor_id': '190959234', 'id': 'hw:cpu_thread_policy'} Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.553925 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.555179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.555179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.555179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.555179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:51.555179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:51.555179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. Oct 25 03:00:51.555179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.573791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56ae3e48-4840-441b-b13c-ce3a2dcef0ce tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Returning 404 to user: Flavor 190959234 has no extra specs with key hw:cpu_thread_policy. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:51.574983 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56ae3e48-4840-441b-b13c-ce3a2dcef0ce tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/190959234/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.059698 Oct 25 03:00:51.587217 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 104/170] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:00:51 2022] DELETE /compute/v2.1/flavors/190959234/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:51.608875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb6f62a8-5ee3-4c94-b14f-e41f132ba518 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:51.617536 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-bb6f62a8-5ee3-4c94-b14f-e41f132ba518 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb6f62a8-5ee3-4c94-b14f-e41f132ba518 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Request method failure captured: Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 27 Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FhtYTylGPJsVVQM_enz3QQTzFkHmNd6AvT-yQuw1DR7YlKTF4BsdCJ1cP8JGcULIVELcpraz-H7Vxm0g9rrO1luZ1lZQklOJ3HXZVQiBXae0WiwnxfljrB1R2p852BbZBxmyIte2wxbxiERZX4-o4WrLog8MnSSYNrz9j3lUBvSjo Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8c702f6e34d34058ae76bf22a4de314e Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:51.624206 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c702f6e34d34058ae76bf22a4de314e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c702f6e34d34058ae76bf22a4de314e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c702f6e34d34058ae76bf22a4de314e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c702f6e34d34058ae76bf22a4de314e"}]}] Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8c702f6e34d34058ae76bf22a4de314e Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 734eea2ac95c45449e72ed6fa6cc2ca2 Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: {"hw:cpu_policy": "shared"} Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:51.625477 n-d-862355-1 devstack@n-api.service[120563]: exception: Request body and URI mismatch Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'flavor_id': '190959234', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:51.626877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:51.628073 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:51.628073 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:51.628073 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 25 03:00:51.628073 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:51.629194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb6f62a8-5ee3-4c94-b14f-e41f132ba518 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:51.630329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb6f62a8-5ee3-4c94-b14f-e41f132ba518 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.041258 Oct 25 03:00:51.639860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 105/171] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:00:51 2022] PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes => generated 73 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:00:51.648831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a06ee978-e23e-44fc-8d5a-7aa4496da6a4 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a06ee978-e23e-44fc-8d5a-7aa4496da6a4 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Request method failure captured: Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 49 Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FhtYTylGPJsVVQM_enz3QQTzFkHmNd6AvT-yQuw1DR7YlKTF4BsdCJ1cP8JGcULIVELcpraz-H7Vxm0g9rrO1luZ1lZQklOJ3HXZVQiBXae0WiwnxfljrB1R2p852BbZBxmyIte2wxbxiERZX4-o4WrLog8MnSSYNrz9j3lUBvSjo Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8c702f6e34d34058ae76bf22a4de314e Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:52.035575 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c702f6e34d34058ae76bf22a4de314e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c702f6e34d34058ae76bf22a4de314e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c702f6e34d34058ae76bf22a4de314e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c702f6e34d34058ae76bf22a4de314e"}]}] Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8c702f6e34d34058ae76bf22a4de314e Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 734eea2ac95c45449e72ed6fa6cc2ca2 Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 25 03:00:52.036769 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'flavor_id': '190959234', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance: Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 25 03:00:52.037384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:52.038547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:52.042231 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:52.042231 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:52.042231 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:00:52.042231 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:00:52.042231 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 25 03:00:52.042231 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:52.042231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a06ee978-e23e-44fc-8d5a-7aa4496da6a4 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:52.042832 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a06ee978-e23e-44fc-8d5a-7aa4496da6a4 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.398175 Oct 25 03:00:52.048092 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 106/172] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:00:51 2022] PUT /compute/v2.1/flavors/190959234/os-extra_specs/hw:numa_nodes => generated 117 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:00:52.062707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f139b627-ec02-44f4-847e-b4b57c2c973e tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:52.086424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:52.095845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=8,nova_api:INSERT=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:52.104202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8bbe3154-da98-49cd-a370-8c5c171c9866 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.706182 Oct 25 03:00:52.107419 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 67/173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:51 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:00:52.114592 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f139b627-ec02-44f4-847e-b4b57c2c973e tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/190959234" status: 202 len: 0 microversion: 2.1 time: 0.061188 Oct 25 03:00:52.115446 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 107/174] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:00:52 2022] DELETE /compute/v2.1/flavors/190959234 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:00:52.129299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f77e8b8b-8a2d-4716-805d-909de27c2e48 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:52.187709 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f77e8b8b-8a2d-4716-805d-909de27c2e48 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665 tempest-FlavorsExtraSpecsNegativeTestJSON-823320665-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.064513 Oct 25 03:00:52.190760 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 68/175] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:00:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:52.340932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:52.347418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:52.356075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1286015570", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "1809440273", "adminPass": "***", "networks": [{"uuid": "f98dcb2c-981b-4036-acab-e0ebe19d18bd"}], "security_groups": [{"name": "tempest-securitygroup--50181374"}], "key_name": "tempest-keypair-202991637", "user_data": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:52.387731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:52.388703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:52.390067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:52.396624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:52.399009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:52.399609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:52.453417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:53.459601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:53.468438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8736360f-ce55-4d9b-83f0-77205f267fb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 1.133728 Oct 25 03:00:53.473367 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 108/176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:52 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:53.478252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:53.500217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:53.524182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:53.526674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:53.527187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:53.529370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:53.531175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:53.532977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:54.337215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:54.348912 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-85a586f7-8292-4ed5-afb8-d937672b5022 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.872985 Oct 25 03:00:54.348912 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 109/177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:53 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:54.935010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ec7c719d-2d81-411e-a5d6-2ec33c40560f req-b2e665d8-2c07-4dc4-aede-2c71d1ad9301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f316841f-cd83-426a-8952-0f229815f69f", "tag": "c50a14db-844b-4b99-8b52-0eabba119246"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:54.953140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec7c719d-2d81-411e-a5d6-2ec33c40560f req-b2e665d8-2c07-4dc4-aede-2c71d1ad9301 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:54.953668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec7c719d-2d81-411e-a5d6-2ec33c40560f req-b2e665d8-2c07-4dc4-aede-2c71d1ad9301 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:54.954880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec7c719d-2d81-411e-a5d6-2ec33c40560f req-b2e665d8-2c07-4dc4-aede-2c71d1ad9301 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:55.014053 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ec7c719d-2d81-411e-a5d6-2ec33c40560f req-b2e665d8-2c07-4dc4-aede-2c71d1ad9301 service nova] Creating event network-changed:c50a14db-844b-4b99-8b52-0eabba119246 for instance f316841f-cd83-426a-8952-0f229815f69f on n-h1-862355-1 Oct 25 03:00:55.014875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec7c719d-2d81-411e-a5d6-2ec33c40560f req-b2e665d8-2c07-4dc4-aede-2c71d1ad9301 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:00:55.017752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec7c719d-2d81-411e-a5d6-2ec33c40560f req-b2e665d8-2c07-4dc4-aede-2c71d1ad9301 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:00:55.019830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:55.022734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:55.025406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:55.026454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:55.028917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:55.029433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:55.047660 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.rpcapi [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 25 03:00:55.054022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] Releasing lock "compute-rpcapi-router" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:00:55.077539 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b4a81a24-ba2e-4e20-b8ef-16ffbadfa732 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.710417 Oct 25 03:00:55.079185 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 110/178] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:55.089165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:55.090570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:55.099536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:55.101421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:55.102120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:55.103287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:55.104200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:55.105385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:56.006903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:56.016206 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3a00162d-69ca-419e-8bf1-98c68ac7b385 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.934448 Oct 25 03:00:56.023045 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 111/179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:55 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:56.041352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:56.046985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:56.076486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:56.076486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:56.076486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:56.083020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:56.083764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:56.084891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:56.684006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:57.074648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:57.089992 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef4b1156-7909-4dd6-86df-2d9039abc570 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 1.064031 Oct 25 03:00:57.093686 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 112/180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:56 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:57.519659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Calling method '.version_select at 0x7efd33feaf70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:57.523355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:57.524170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:57.524621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:57.525353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:57.525827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:57.526422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:57.552154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6feab32c-a801-44fe-a7df-aa031d9f7a5f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.457107 Oct 25 03:00:57.552748 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 113/181] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 25 03:00:57 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:57.634079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] validate_networks() for [('f98dcb2c-981b-4036-acab-e0ebe19d18bd', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:00:57.755420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99c9209c-0640-470e-84a0-a486b05b5ae5 tempest-InstanceUsageAuditLogTestJSON-1960440706 tempest-InstanceUsageAuditLogTestJSON-1960440706-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:57.776163 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99c9209c-0640-470e-84a0-a486b05b5ae5 tempest-InstanceUsageAuditLogTestJSON-1960440706 tempest-InstanceUsageAuditLogTestJSON-1960440706-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-25 03:00:56" status: 200 len: 318 microversion: 2.1 time: 0.222182 Oct 25 03:00:57.776733 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 114/182] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:00:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-25%2003%3A00%3A56 => generated 318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:57.786789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99c9209c-0640-470e-84a0-a486b05b5ae5 tempest-InstanceUsageAuditLogTestJSON-1960440706 tempest-InstanceUsageAuditLogTestJSON-1960440706-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:57.788007 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99c9209c-0640-470e-84a0-a486b05b5ae5 tempest-InstanceUsageAuditLogTestJSON-1960440706 tempest-InstanceUsageAuditLogTestJSON-1960440706-project-admin] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001484 Oct 25 03:00:57.795699 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 115/183] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 25 03:00:57 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 25 03:00:57.795699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:57.795699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:57.800662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:57.801150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:57.801581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:57.802309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:57.802757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:57.803290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:58.068517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:58.081441 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8d930ff-0a95-4a96-83ac-9c599a9d4b6c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.292082 Oct 25 03:00:58.093833 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 116/184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:57 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:58.093833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b72a9937-86d2-42a7-8a4e-4da65a474bad req-85dd43d4-69f4-4f70-a65c-ceab93bf8642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb69892a-0d6b-4648-a443-f2b5dd056069", "tag": "4c394813-fd7a-446a-a496-3b6d16d339f3"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:58.100283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b72a9937-86d2-42a7-8a4e-4da65a474bad req-85dd43d4-69f4-4f70-a65c-ceab93bf8642 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:58.100849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b72a9937-86d2-42a7-8a4e-4da65a474bad req-85dd43d4-69f4-4f70-a65c-ceab93bf8642 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:58.101359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b72a9937-86d2-42a7-8a4e-4da65a474bad req-85dd43d4-69f4-4f70-a65c-ceab93bf8642 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:58.114134 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b72a9937-86d2-42a7-8a4e-4da65a474bad req-85dd43d4-69f4-4f70-a65c-ceab93bf8642 service nova] Creating event network-changed:4c394813-fd7a-446a-a496-3b6d16d339f3 for instance bb69892a-0d6b-4648-a443-f2b5dd056069 on n-h2-862355-1 Oct 25 03:00:58.123704 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b72a9937-86d2-42a7-8a4e-4da65a474bad req-85dd43d4-69f4-4f70-a65c-ceab93bf8642 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037875 Oct 25 03:00:58.127047 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 117/185] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:58.373027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5bf7e528-32ab-4aac-8a2e-efa76a322997 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Calling method '.version_select at 0x7efd33f8b310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.378535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5bf7e528-32ab-4aac-8a2e-efa76a322997 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '1f0263f6efd4461b9ec299ba12274f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e0b2732a67415a80309d26f712a1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5bf7e528-32ab-4aac-8a2e-efa76a322997 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Request method failure captured: Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FkVbZOaRjFHBUznQI_1QvdhttCO2gNdA49cEtA3Vxd4xkoSsofAMOB_vlSxXZT9CopdTyrxRuVoGtEXfhbrfAeqXE0tlD8Yg9USw7QiPWXuF6RHDFXsOj5BBqDXJUa95LiyE6sbUaWY2gJ02otEKullfDx-GReabfthR3dHA1O6iE Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:58.381250 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b5e0b2732a67415a80309d26f712a1dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b5e0b2732a67415a80309d26f712a1dd"}]}] Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 1f0263f6efd4461b9ec299ba12274f90 Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: action_args: {} Oct 25 03:00:58.382783 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:58.383802 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 25 03:00:58.385167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.387567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5bf7e528-32ab-4aac-8a2e-efa76a322997 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.398400 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5bf7e528-32ab-4aac-8a2e-efa76a322997 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.260123 Oct 25 03:00:58.399255 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 118/186] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 271 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:58.405245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-94ae1e61-de8d-4182-b125-9a9672468dd1 tempest-InstanceUsageAuditLogTestJSON-1960440706 tempest-InstanceUsageAuditLogTestJSON-1960440706-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.429374 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-94ae1e61-de8d-4182-b125-9a9672468dd1 tempest-InstanceUsageAuditLogTestJSON-1960440706 tempest-InstanceUsageAuditLogTestJSON-1960440706-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027541 Oct 25 03:00:58.430607 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 119/187] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:00:58.435189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.436004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:58.449851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:58.450985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:58.453424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:58.455449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:58.458459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:58.459690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:58.693435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:00:58.695389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:00:58.696136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:00:58.697005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:00:58.697778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:00:58.728368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:58.729651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:58.730243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:58.731974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:58.737953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:58.738221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:58.738221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:58.743082 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1db306b4-bec5-46c5-8e80-05222c97d485 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.311389 Oct 25 03:00:58.743843 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 120/188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:58.749902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c916246a-1ddf-4b05-8318-c608f3bf4531 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Calling method '.version_select at 0x7efd33f8baf0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.752371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c916246a-1ddf-4b05-8318-c608f3bf4531 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '1f0263f6efd4461b9ec299ba12274f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e0b2732a67415a80309d26f712a1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c916246a-1ddf-4b05-8318-c608f3bf4531 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Request method failure captured: Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/n-d-862355-1/reboot HTTP/1.1 Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FkVbZOaRjFHBUznQI_1QvdhttCO2gNdA49cEtA3Vxd4xkoSsofAMOB_vlSxXZT9CopdTyrxRuVoGtEXfhbrfAeqXE0tlD8Yg9USw7QiPWXuF6RHDFXsOj5BBqDXJUa95LiyE6sbUaWY2gJ02otEKullfDx-GReabfthR3dHA1O6iE Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:58.761970 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b5e0b2732a67415a80309d26f712a1dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b5e0b2732a67415a80309d26f712a1dd"}]}] Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 1f0263f6efd4461b9ec299ba12274f90 Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'n-d-862355-1'} Oct 25 03:00:58.763403 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:58.764193 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 25 03:00:58.765637 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.768243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c916246a-1ddf-4b05-8318-c608f3bf4531 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.770621 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c916246a-1ddf-4b05-8318-c608f3bf4531 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-862355-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.024384 Oct 25 03:00:58.774055 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 121/189] 10.222.0.36 () {58 vars in 1188 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/n-d-862355-1/reboot => generated 111 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:58.787258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02a3971e-8d73-4185-bdac-a303138efb7b tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Calling method '.version_select at 0x7efd38054a60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.792110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Getting quotas for project b8b75865acf94a8a9a7899e766b10666. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:00:58.802208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Getting quotas for user fefa869da4ec498e985174e256f92ada and project b8b75865acf94a8a9a7899e766b10666. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:00:58.809952 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-02a3971e-8d73-4185-bdac-a303138efb7b tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02a3971e-8d73-4185-bdac-a303138efb7b tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:58.812352 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'nonexistent_hostname'} Oct 25 03:00:58.814527 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:58.815295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 25 03:00:58.816879 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02a3971e-8d73-4185-bdac-a303138efb7b tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02a3971e-8d73-4185-bdac-a303138efb7b tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.035501 Oct 25 03:00:58.818243 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 122/190] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:58.825339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:00:58.827720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73a32a4b-13f9-4b88-adbe-0ab502dfe6db tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Calling method '.version_select at 0x7efd382fdee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.828089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:00:58.831457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73a32a4b-13f9-4b88-adbe-0ab502dfe6db tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '1f0263f6efd4461b9ec299ba12274f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e0b2732a67415a80309d26f712a1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73a32a4b-13f9-4b88-adbe-0ab502dfe6db tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Request method failure captured: Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/n-d-862355-1 HTTP/1.1 Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FkVbZOaRjFHBUznQI_1QvdhttCO2gNdA49cEtA3Vxd4xkoSsofAMOB_vlSxXZT9CopdTyrxRuVoGtEXfhbrfAeqXE0tlD8Yg9USw7QiPWXuF6RHDFXsOj5BBqDXJUa95LiyE6sbUaWY2gJ02otEKullfDx-GReabfthR3dHA1O6iE Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:58.833185 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b5e0b2732a67415a80309d26f712a1dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b5e0b2732a67415a80309d26f712a1dd"}]}] Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 1f0263f6efd4461b9ec299ba12274f90 Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'n-d-862355-1'} Oct 25 03:00:58.834494 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:58.835199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 25 03:00:58.836156 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.837029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73a32a4b-13f9-4b88-adbe-0ab502dfe6db tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.837029 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73a32a4b-13f9-4b88-adbe-0ab502dfe6db tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-862355-1" status: 403 len: 109 microversion: 2.1 time: 0.015401 Oct 25 03:00:58.838616 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 123/191] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/n-d-862355-1 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:58.848007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc5c7701-9705-4b11-8b66-93043a1a84b1 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Calling method '.version_select at 0x7efd33f8b790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.855563 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-cc5c7701-9705-4b11-8b66-93043a1a84b1 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc5c7701-9705-4b11-8b66-93043a1a84b1 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:58.857571 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'nonexistent_hostname'} Oct 25 03:00:58.858872 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.859550 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.860673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.863721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc5c7701-9705-4b11-8b66-93043a1a84b1 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.865782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc5c7701-9705-4b11-8b66-93043a1a84b1 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022016 Oct 25 03:00:58.867050 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 124/192] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:00:58.878805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-33479361-e6a4-4e96-9b88-8059c57a61c1 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Calling method '.version_select at 0x7efd33fdb9d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.880856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-33479361-e6a4-4e96-9b88-8059c57a61c1 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '1f0263f6efd4461b9ec299ba12274f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e0b2732a67415a80309d26f712a1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-33479361-e6a4-4e96-9b88-8059c57a61c1 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Request method failure captured: Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/n-d-862355-1/shutdown HTTP/1.1 Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FkVbZOaRjFHBUznQI_1QvdhttCO2gNdA49cEtA3Vxd4xkoSsofAMOB_vlSxXZT9CopdTyrxRuVoGtEXfhbrfAeqXE0tlD8Yg9USw7QiPWXuF6RHDFXsOj5BBqDXJUa95LiyE6sbUaWY2gJ02otEKullfDx-GReabfthR3dHA1O6iE Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:58.883079 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b5e0b2732a67415a80309d26f712a1dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b5e0b2732a67415a80309d26f712a1dd"}]}] Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 1f0263f6efd4461b9ec299ba12274f90 Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'n-d-862355-1'} Oct 25 03:00:58.884512 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:58.885372 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 25 03:00:58.886618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.887706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-33479361-e6a4-4e96-9b88-8059c57a61c1 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.887706 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-33479361-e6a4-4e96-9b88-8059c57a61c1 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-862355-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012801 Oct 25 03:00:58.894344 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 125/193] 10.222.0.36 () {58 vars in 1194 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/n-d-862355-1/shutdown => generated 113 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:58.910277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-931ab7b2-82b0-4146-91bd-6a8e144638e0 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Calling method '.version_select at 0x7efd33fea4c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.931101 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-931ab7b2-82b0-4146-91bd-6a8e144638e0 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-931ab7b2-82b0-4146-91bd-6a8e144638e0 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:58.933309 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'nonexistent_hostname'} Oct 25 03:00:58.934756 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:58.940937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 25 03:00:58.942148 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-931ab7b2-82b0-4146-91bd-6a8e144638e0 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-931ab7b2-82b0-4146-91bd-6a8e144638e0 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.033829 Oct 25 03:00:58.943135 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 126/194] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:58.946654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19f80db9-9a40-4f85-ace8-d1fa2b77be08 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Calling method '.version_select at 0x7efd33f8b8b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.948439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19f80db9-9a40-4f85-ace8-d1fa2b77be08 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '1f0263f6efd4461b9ec299ba12274f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e0b2732a67415a80309d26f712a1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19f80db9-9a40-4f85-ace8-d1fa2b77be08 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Request method failure captured: Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/n-d-862355-1/startup HTTP/1.1 Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FkVbZOaRjFHBUznQI_1QvdhttCO2gNdA49cEtA3Vxd4xkoSsofAMOB_vlSxXZT9CopdTyrxRuVoGtEXfhbrfAeqXE0tlD8Yg9USw7QiPWXuF6RHDFXsOj5BBqDXJUa95LiyE6sbUaWY2gJ02otEKullfDx-GReabfthR3dHA1O6iE Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:00:58.950140 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b5e0b2732a67415a80309d26f712a1dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b5e0b2732a67415a80309d26f712a1dd"}]}] Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 1f0263f6efd4461b9ec299ba12274f90 Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'n-d-862355-1'} Oct 25 03:00:58.951301 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:58.952113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 25 03:00:58.953295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:58.956152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19f80db9-9a40-4f85-ace8-d1fa2b77be08 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:58.956152 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19f80db9-9a40-4f85-ace8-d1fa2b77be08 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-862355-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010778 Oct 25 03:00:58.956152 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 127/195] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/n-d-862355-1/startup => generated 110 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:58.957369 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c117f92-7649-45a9-86af-ae2a752ab689 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 6.607606 Oct 25 03:00:58.965372 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 69/196] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:00:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 6609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:00:58.978314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d04f123-95d4-4d32-a066-5ffa66e9a38e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:58.979055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8d04f123-95d4-4d32-a066-5ffa66e9a38e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:58.984745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d79d7e8-3248-4b9d-8522-e19ed4633419 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Calling method '.version_select at 0x7efd38054940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:59.002889 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5d79d7e8-3248-4b9d-8522-e19ed4633419 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d79d7e8-3248-4b9d-8522-e19ed4633419 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:59.005738 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'nonexistent_hostname'} Oct 25 03:00:59.006970 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:59.007649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 25 03:00:59.008615 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.009668 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.014154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d79d7e8-3248-4b9d-8522-e19ed4633419 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:59.015750 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d79d7e8-3248-4b9d-8522-e19ed4633419 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.041979 Oct 25 03:00:59.022916 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 128/197] 10.222.0.36 () {58 vars in 1215 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:59.088391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d04f123-95d4-4d32-a066-5ffa66e9a38e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:59.100345 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d04f123-95d4-4d32-a066-5ffa66e9a38e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1264 microversion: 2.1 time: 0.125791 Oct 25 03:00:59.101112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 70/198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:58 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1264 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:59.106334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d8b2dc8-7256-4c30-8eeb-06ace406ba43 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Action: 'update', calling method: .version_select at 0x7efd382c9550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d8b2dc8-7256-4c30-8eeb-06ace406ba43 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/os-hosts/n-d-862355-1 HTTP/1.1 Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 51 Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:00:59.115654 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: {"status": "enable", "maintenance_mode": "invalid"} Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:00:59.117146 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'n-d-862355-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'disable', Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'Enable', Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'Disable', Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance: Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'invalid' Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.118014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.119591 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.120800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.120800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:00:59.120800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:00:59.120800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.120800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.122492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d8b2dc8-7256-4c30-8eeb-06ace406ba43 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:59.123503 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d8b2dc8-7256-4c30-8eeb-06ace406ba43 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-862355-1" status: 400 len: 199 microversion: 2.1 time: 0.021126 Oct 25 03:00:59.129937 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 71/199] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:00:59 2022] PUT /compute/v2.1/os-hosts/n-d-862355-1 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:00:59.134659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:59.136150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:59.316929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:59.317416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:59.317880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:59.318589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:59.320610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:59.324532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:59.396541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf913b65-f85c-4b4f-9ffe-4f170fcbf8b2 tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] Calling method '.version_select at 0x7efd33f8b670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:59.415596 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf913b65-f85c-4b4f-9ffe-4f170fcbf8b2 tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.391150 Oct 25 03:00:59.416994 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 129/200] 10.222.0.36 () {60 vars in 1226 bytes} [Tue Oct 25 03:00:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:59.424622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77ac44dd-69f3-4f72-af8e-2b8d16197f6f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Action: 'update', calling method: .version_select at 0x7efd33f8bb80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77ac44dd-69f3-4f72-af8e-2b8d16197f6f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/os-hosts/n-d-862355-1 HTTP/1.1 Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 51 Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:00:59.432308 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: {"status": "invalid", "maintenance_mode": "enable"} Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:00:59.434262 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'n-d-862355-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'disable', Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'Enable', Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'Disable', Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance: Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'invalid' Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.435260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.438272 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.440399 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.440399 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:00:59.440399 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:00:59.440399 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 25 03:00:59.440399 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.441768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77ac44dd-69f3-4f72-af8e-2b8d16197f6f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:59.443213 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77ac44dd-69f3-4f72-af8e-2b8d16197f6f tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-862355-1" status: 400 len: 189 microversion: 2.1 time: 0.024741 Oct 25 03:00:59.444373 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 130/201] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:00:59 2022] PUT /compute/v2.1/os-hosts/n-d-862355-1 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:00:59.452483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-763b6d3a-d6f5-4aa2-a733-b112be5ee2c9 tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] Action: 'update', calling method: .version_select at 0x7efd380c0b80>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:59.552196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:59.562961 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4526ceb0-e50a-40f7-8433-77bda56d9f3d tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.431668 Oct 25 03:00:59.564079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 72/202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:59 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:00:59.571012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4dd29d5-6559-415f-a992-05090b296df8 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Action: 'update', calling method: .version_select at 0x7efd381cc3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:59.582356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4dd29d5-6559-415f-a992-05090b296df8 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '1f0263f6efd4461b9ec299ba12274f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e0b2732a67415a80309d26f712a1dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4dd29d5-6559-415f-a992-05090b296df8 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Request method failure captured: Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/os-hosts/n-d-862355-1 HTTP/1.1 Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 50 Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FkVbZOaRjFHBUznQI_1QvdhttCO2gNdA49cEtA3Vxd4xkoSsofAMOB_vlSxXZT9CopdTyrxRuVoGtEXfhbrfAeqXE0tlD8Yg9USw7QiPWXuF6RHDFXsOj5BBqDXJUa95LiyE6sbUaWY2gJ02otEKullfDx-GReabfthR3dHA1O6iE Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:00:59.584961 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b5e0b2732a67415a80309d26f712a1dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b5e0b2732a67415a80309d26f712a1dd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b5e0b2732a67415a80309d26f712a1dd"}]}] Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b5e0b2732a67415a80309d26f712a1dd Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1513181534 Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 1f0263f6efd4461b9ec299ba12274f90 Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1513181534-project Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: {"status": "enable", "maintenance_mode": "enable"} Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 25 03:00:59.586395 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'n-d-862355-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:59.587255 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 25 03:00:59.588480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.592577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4dd29d5-6559-415f-a992-05090b296df8 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:59.596457 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b4dd29d5-6559-415f-a992-05090b296df8 tempest-HostsAdminNegativeTestJSON-1513181534 tempest-HostsAdminNegativeTestJSON-1513181534-project] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-862355-1" status: 403 len: 111 microversion: 2.1 time: 0.029171 Oct 25 03:00:59.603446 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 73/203] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:00:59 2022] PUT /compute/v2.1/os-hosts/n-d-862355-1 => generated 111 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:00:59.609332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d846cd62-f2f5-432b-ae51-bbea736374e3 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Action: 'update', calling method: .version_select at 0x7efd382c9b80>, body: {"status": null, "maintenance_mode": null} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d846cd62-f2f5-432b-ae51-bbea736374e3 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/os-hosts/n-d-862355-1 HTTP/1.1 Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 42 Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:00:59.614448 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: {"status": null, "maintenance_mode": null} Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 25 03:00:59.615769 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'n-d-862355-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'disable', Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'Enable', Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'Disable', Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance: Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi None Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.616538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.617832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.619289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:00:59.619289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:00:59.619289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 25 03:00:59.619289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.619527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d846cd62-f2f5-432b-ae51-bbea736374e3 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:59.620287 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d846cd62-f2f5-432b-ae51-bbea736374e3 tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-862355-1" status: 400 len: 127 microversion: 2.1 time: 0.015673 Oct 25 03:00:59.622821 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 74/204] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:00:59 2022] PUT /compute/v2.1/os-hosts/n-d-862355-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:00:59.638823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f1379a1-6242-4277-adf2-9b6781ddfb7a tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Action: 'update', calling method: .version_select at 0x7efd382c91f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:59.647309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.hosts [None req-9f1379a1-6242-4277-adf2-9b6781ddfb7a tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Enabling host nonexistent_hostname. Oct 25 03:00:59.664399 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-9f1379a1-6242-4277-adf2-9b6781ddfb7a tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f1379a1-6242-4277-adf2-9b6781ddfb7a tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Request method failure captured: Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 50 Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FnAqRShEOcDFv6Tpyq5yhW4_taD6U41QS99IwQ03xAPDQ6GKZPd3FI-O55POTYrcNwmRVlqOqns9gSaVamkWHeZEOV0NSNKjlUQ_NwEow1Rnv7Lp-334Jm6dLC3_UJBw0nkU_EfrtJrJGmfs7qhSCIxQLyp6STi_RCekRKkGXn480 Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:00:59.667793 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ab9a1372afe4df78ec663171ad7b74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ab9a1372afe4df78ec663171ad7b74e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ab9a1372afe4df78ec663171ad7b74e"}]}] Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6ab9a1372afe4df78ec663171ad7b74e Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1389422912 Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 508df5a7acc040258fe717ab7f8bfd58 Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1389422912-project-admin Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: {"status": "enable", "maintenance_mode": "enable"} Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.668962 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 25 03:00:59.669847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:00:59.671277 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:00:59.672904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f1379a1-6242-4277-adf2-9b6781ddfb7a tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:00:59.674923 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f1379a1-6242-4277-adf2-9b6781ddfb7a tempest-HostsAdminNegativeTestJSON-1389422912 tempest-HostsAdminNegativeTestJSON-1389422912-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039680 Oct 25 03:00:59.675560 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 75/205] 10.222.0.36 () {60 vars in 1211 bytes} [Tue Oct 25 03:00:59 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:00:59.748849 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-763b6d3a-d6f5-4aa2-a733-b112be5ee2c9 tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.302759 Oct 25 03:00:59.755932 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 131/206] 10.222.0.36 () {62 vars in 1247 bytes} [Tue Oct 25 03:00:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:59.761212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bfd6a7a-e321-45ba-9346-df65edb05ffc tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] Calling method '.version_select at 0x7efd381aa5e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:59.771962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:00:59.773854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:00:59.792803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:59.793326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:59.794566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:59.797231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:00:59.799094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:00:59.800435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:00:59.800554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6bfd6a7a-e321-45ba-9346-df65edb05ffc tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.039715 Oct 25 03:00:59.801694 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 76/207] 10.222.0.36 () {60 vars in 1226 bytes} [Tue Oct 25 03:00:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:00:59.813198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04e6ae1a-4531-4239-8ba7-b809c32854db tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] Action: 'update', calling method: .version_select at 0x7efd38203820>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:00:59.900723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=7,nova_api:INSERT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:00:59.925180 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-04e6ae1a-4531-4239-8ba7-b809c32854db tempest-QuotaClassesAdmin257Test-1581299968 tempest-QuotaClassesAdmin257Test-1581299968-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.116225 Oct 25 03:00:59.926525 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 77/208] 10.222.0.36 () {62 vars in 1247 bytes} [Tue Oct 25 03:00:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:01:00.122131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:00.127657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:00.128368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:00.134821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:00.135136 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8fd3e342-fc46-4b19-9efc-018670155d15 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.369422 Oct 25 03:01:00.135301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:00.135920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:00.137124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:00.137741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:00.138330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:00.141223 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 132/209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:00:59 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:00.218895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:00.237108 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6fcbd38-c602-4073-b491-dedf2f394986 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1268 microversion: 2.1 time: 0.116541 Oct 25 03:01:00.237817 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 78/210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:00 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1268 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:00.587138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:00.587811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:00.600788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:00.600788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:00.600788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:00.600788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:00.601186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:00.614091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:00.782975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:00.793002 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3a3f3cb-f0bf-45f0-b41b-f540caba978c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.209855 Oct 25 03:01:00.794108 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 133/211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:00 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:01.159921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:01.160416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:01.173854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:01.174436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:01.174815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:01.176490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:01.176969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:01.177502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:01.259434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:01.260036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:01.266687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:01.268750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:01.269437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:01.270663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:01.271326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:01.271954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:01.403641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:01.414211 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-45904cb0-7d4b-4aa7-9bf8-495fca89abed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1268 microversion: 2.1 time: 0.158370 Oct 25 03:01:01.426777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:01.427366 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 134/212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:01 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:01.436231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e572260-df49-48ae-b5ff-2be69320cdb5 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.281596 Oct 25 03:01:01.436807 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 79/213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:01 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:01.817858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:01.819307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:01.850738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:01.851340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:01.851826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:01.857535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:01.858014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:01.858827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:02.182925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:02.194629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2a77579-6a3c-4bf7-b925-d7ee6b1aa07b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.382127 Oct 25 03:01:02.195439 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 135/214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:01 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:02.441656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:02.442280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:02.451067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:02.451568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:02.452005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:02.456219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:02.457134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:02.459888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:02.461552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:02.462315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:02.478907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:02.479765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:02.480515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:02.482377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:02.483050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:02.483679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:02.619234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:02.639789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-04e33d09-c647-4d7a-824a-46fd61842c99 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1316 microversion: 2.1 time: 0.203586 Oct 25 03:01:02.659324 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 80/215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:02 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:03.222666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:03.223566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:03.236316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:03.237023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:03.238057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:03.243642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:03.244303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:03.244888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:03.255699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:03.265912 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b169d40d-d6d3-4062-ad88-c87c8c6a1005 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.808176 Oct 25 03:01:03.272807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 136/216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:02 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:03.654981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:03.666803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:03.667423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:03.670802 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-48ec8cfa-9294-48d8-b827-6d7ae45e1eb3 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.452366 Oct 25 03:01:03.671409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 81/217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:03 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:03.675749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:03.676252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:03.676693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:03.677401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:03.684365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:03.688560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:03.824354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:03.837327 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f2caa15-5518-406b-80a6-de02e1d923c9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1322 microversion: 2.1 time: 0.174197 Oct 25 03:01:03.838514 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 137/218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:03 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:04.290837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:04.291380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:04.297466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:04.298127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:04.301182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:04.302144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:04.303041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:04.307812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:04.704021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:04.707251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:04.726525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:04.728424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:04.729097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:04.730240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:04.730976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:04.731608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:04.879425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:04.892013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56d3918c-021c-48f1-b97a-851c6d4b6435 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.604917 Oct 25 03:01:04.913294 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 82/219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:04 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:04.923751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:04.924399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:04.950935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:04.951707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:04.952165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:04.953488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:04.954116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:04.954729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:05.506708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:05.519084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5b2ac64-da50-465f-8716-4218bfc59ecd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.820685 Oct 25 03:01:05.536014 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 138/220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:04 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:05.850765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Calling method '.version_select at 0x7efd33ffe280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:05.855834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:05.856840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:05.857725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:05.889636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:05.890432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:05.891084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:05.932793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:05.933346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:05.933818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:05.945538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:05.948206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:05.948848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:05.956222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:05.968991 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aa6e51ce-e835-4126-92a6-c665d731b59f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 1.054255 Oct 25 03:01:05.972145 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 83/221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:04 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:05.975336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:05.975949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:05.976452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:05.994026 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb7d0419-12d4-4b0e-9950-110b737e0391 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.365871 Oct 25 03:01:05.995198 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 139/222] 10.222.0.36 () {60 vars in 1243 bytes} [Tue Oct 25 03:01:05 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:01:06.010419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:06.011680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:06.027770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.028322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.028775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.029650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.034190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.035955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.058103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:06.092273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-48b62499-f2d3-4411-8aa7-7e765ec82dc4 req-a6dc5d90-97b6-4228-8d3a-10017acc409f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f316841f-cd83-426a-8952-0f229815f69f", "name": "network-vif-plugged", "status": "completed", "tag": "c50a14db-844b-4b99-8b52-0eabba119246"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:06.107097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48b62499-f2d3-4411-8aa7-7e765ec82dc4 req-a6dc5d90-97b6-4228-8d3a-10017acc409f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.107884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48b62499-f2d3-4411-8aa7-7e765ec82dc4 req-a6dc5d90-97b6-4228-8d3a-10017acc409f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.108522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48b62499-f2d3-4411-8aa7-7e765ec82dc4 req-a6dc5d90-97b6-4228-8d3a-10017acc409f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.137051 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-48b62499-f2d3-4411-8aa7-7e765ec82dc4 req-a6dc5d90-97b6-4228-8d3a-10017acc409f service nova] Creating event network-vif-plugged:c50a14db-844b-4b99-8b52-0eabba119246 for instance f316841f-cd83-426a-8952-0f229815f69f on n-h1-862355-1 Oct 25 03:01:06.145759 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-48b62499-f2d3-4411-8aa7-7e765ec82dc4 req-a6dc5d90-97b6-4228-8d3a-10017acc409f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171875 Oct 25 03:01:06.151566 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 84/223] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:06.163089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Calling method '.version_select at 0x7efd381aaca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:06.168094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.168788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.169527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.199787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.200690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.201215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.234066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.234624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.235244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.246970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.247686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.248275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.273178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.273732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.274156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.280567 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bbfda673-34a1-4f0b-8cc7-9e8a25390853 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.127534 Oct 25 03:01:06.281438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 85/224] 10.222.0.36 () {60 vars in 1222 bytes} [Tue Oct 25 03:01:06 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:06.295184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1c8a8786-540b-4ac9-9c1b-c3d407118de2 req-986667d3-42d2-4ac1-9b1c-b73ce8234b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db3b2e1-cbf3-4bde-bc31-2729770c052c", "tag": "36f57cdd-0a77-40b6-8edf-9c03c1e438ac"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:06.305349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1c8a8786-540b-4ac9-9c1b-c3d407118de2 req-986667d3-42d2-4ac1-9b1c-b73ce8234b6c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.305854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1c8a8786-540b-4ac9-9c1b-c3d407118de2 req-986667d3-42d2-4ac1-9b1c-b73ce8234b6c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.306894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1c8a8786-540b-4ac9-9c1b-c3d407118de2 req-986667d3-42d2-4ac1-9b1c-b73ce8234b6c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.324736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1c8a8786-540b-4ac9-9c1b-c3d407118de2 req-986667d3-42d2-4ac1-9b1c-b73ce8234b6c service nova] Creating event network-changed:36f57cdd-0a77-40b6-8edf-9c03c1e438ac for instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c on n-h2-862355-1 Oct 25 03:01:06.332428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1c8a8786-540b-4ac9-9c1b-c3d407118de2 req-986667d3-42d2-4ac1-9b1c-b73ce8234b6c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049294 Oct 25 03:01:06.333946 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 86/225] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:06.340794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Calling method '.version_select at 0x7efd381cc670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:06.347432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.348130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.348725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.377183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.378112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.378742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.386799 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34ead629-791b-404f-a983-ec4a8f257365 tempest-HypervisorAdminV253TestBase-320271247 tempest-HypervisorAdminV253TestBase-320271247-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/b6e2748e-7b91-404f-9dbe-8b1b4b6c0f5c" status: 200 len: 792 microversion: 2.53 time: 0.050285 Oct 25 03:01:06.395817 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 87/226] 10.222.0.36 () {60 vars in 1298 bytes} [Tue Oct 25 03:01:06 2022] GET /compute/v2.1/os-hypervisors/b6e2748e-7b91-404f-9dbe-8b1b4b6c0f5c => generated 792 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:06.545409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:06.546369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:06.560021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.560429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.562418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.565118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:06.565598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:06.566063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:06.859331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:06.886552 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad99cc70-cc93-4692-a2ae-228df25a469c tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.889689 Oct 25 03:01:06.896132 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 140/227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:05 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:07.017897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:07.017897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:07.034019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:07.034467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:07.034913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:07.035626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:07.038499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:07.039015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:07.078382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:07.088769 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1e63d48-7e8a-456e-ae43-771e9b25cbea tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.549094 Oct 25 03:01:07.094363 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 88/228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:06 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:07.533386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:07.925206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:07.925869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:07.943989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:07.944800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:07.945464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:07.946407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:07.947056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:07.947669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:08.001085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:08.010715 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-78b5f690-9033-447b-91e3-e9abb9482c66 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 1.019845 Oct 25 03:01:08.015334 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 141/229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:06 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:08.121117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:08.122105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:08.139119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:08.139836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:08.140477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:08.141441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:08.142253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:08.143113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:08.546490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:08.556160 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07f5c0d8-9228-446c-813b-1e7c5a891070 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.438711 Oct 25 03:01:08.560006 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 142/230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:08 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:08.677867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:08.687145 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b1ca12dd-18cb-4991-b495-6fb6604c8454 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1338 microversion: 2.1 time: 0.767916 Oct 25 03:01:08.694214 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 89/231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:07 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1338 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:08.794317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-bbaf1e11-756b-4157-9b06-caf950c96d14 req-a23eacd4-b5f8-4b2f-8dd1-9579c7489dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb69892a-0d6b-4648-a443-f2b5dd056069", "name": "network-vif-plugged", "status": "completed", "tag": "4c394813-fd7a-446a-a496-3b6d16d339f3"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:08.814809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bbaf1e11-756b-4157-9b06-caf950c96d14 req-a23eacd4-b5f8-4b2f-8dd1-9579c7489dbf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:08.815416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bbaf1e11-756b-4157-9b06-caf950c96d14 req-a23eacd4-b5f8-4b2f-8dd1-9579c7489dbf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:08.816925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bbaf1e11-756b-4157-9b06-caf950c96d14 req-a23eacd4-b5f8-4b2f-8dd1-9579c7489dbf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:08.840816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-bbaf1e11-756b-4157-9b06-caf950c96d14 req-a23eacd4-b5f8-4b2f-8dd1-9579c7489dbf service nova] Creating event network-vif-plugged:4c394813-fd7a-446a-a496-3b6d16d339f3 for instance bb69892a-0d6b-4648-a443-f2b5dd056069 on n-h2-862355-1 Oct 25 03:01:08.847744 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-bbaf1e11-756b-4157-9b06-caf950c96d14 req-a23eacd4-b5f8-4b2f-8dd1-9579c7489dbf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057555 Oct 25 03:01:08.848926 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 143/232] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:09.038736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:09.043940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:09.044674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:09.062660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:09.065584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:09.066060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:09.069905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:09.071623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:09.075990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:09.589264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:09.590368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:09.592638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=7,nova_api:INSERT=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:09.612603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:09.614359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:09.617927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:09.619227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:09.623283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:09.624000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:09.764132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:09.924104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:09.967612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:09.986778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:10.012007 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e33ffbf8-f8b6-4bb8-87aa-189802c657fd tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 0.973922 Oct 25 03:01:10.012523 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 90/233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:09 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:10.029441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:10.030095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:10.057715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:10.058456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:10.059071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:10.072196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:10.073611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:10.081382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:10.150695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:10.171442 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c457cbc7-f03f-4d79-a063-8abdd4522d95 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.586269 Oct 25 03:01:10.190044 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 144/234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:09 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:10.486341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:10.496729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-85331159-2bbf-42f2-a7b0-3c18f06b401e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1487 microversion: 2.1 time: 0.475908 Oct 25 03:01:10.497328 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 91/235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:10 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1487 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:10.521919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:10.524439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:10.537060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:10.539104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:10.539653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:10.541180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:10.545102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:10.546698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:11.037368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:11.038186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:11.047911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:11.048592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:11.051116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:11.054493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:11.060433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:11.061606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:11.489506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:11.506627 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97659d8e-4218-4576-84f4-6eafb138cf8b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 0.472878 Oct 25 03:01:11.507852 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 92/236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:11 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:11.517879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:11.520150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:11.552013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:11.552439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:11.566760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:11.569480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:11.572335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:11.573032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:12.128669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:12.143792 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c050c8a-b764-420d-b172-d27c9946750b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1319 microversion: 2.1 time: 0.629325 Oct 25 03:01:12.145588 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 93/237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:11 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:12.826942 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e440e253-4f89-402d-bab7-b5fbd803622f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1638 microversion: 2.1 time: 2.310578 Oct 25 03:01:12.840777 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 145/238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:10 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1638 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:12.862114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:12.871875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:12.893845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:12.900037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:12.900613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:12.901366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:12.901894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:12.902316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:13.091639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-165548703", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:13.223007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:01:13.413868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:13.422453 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b16a43cc-8381-4929-b8dd-3a8aa4351f18 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 0.576855 Oct 25 03:01:13.429024 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 146/239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:12 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:13.442454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:13.443857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:13.455215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:13.455960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:13.456546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:13.457461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:13.459846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:13.460496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:13.524845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:01:13.889667 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6402093a-e293-4cdd-a424-ce775e5b4ab4 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 204 len: 0 microversion: 2.1 time: 0.459042 Oct 25 03:01:13.894067 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 147/240] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:01:13 2022] DELETE /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:01:13.907120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:13.908698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:13.923082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:13.924175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:13.929707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:13.930773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:13.931266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:13.931712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:14.031254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:01:14.031936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:01:14.033154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:01:14.033797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:01:14.034409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:01:14.058781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:14.061937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:14.063859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:14.065475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:14.067486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:14.068415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:14.091664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Getting quotas for project dadc2c982cfd41c695952d8d54ecf314. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:01:14.098738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Getting quotas for user 690d08aa8d2a4ee2b5da985308ee130c and project dadc2c982cfd41c695952d8d54ecf314. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:01:14.113828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:01:14.116568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:01:14.178564 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7314bc95-f38b-4f0f-bced-5d54b67879a7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.716346 Oct 25 03:01:14.179550 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 94/241] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:01:14.216481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:14.216615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:14.232180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:14.235392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:14.236323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:14.238138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:14.240133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:14.240733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:14.620175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:14.634843 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d1db2b67-08c6-45c3-ab31-78800820bafd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1469 microversion: 2.1 time: 0.742398 Oct 25 03:01:14.652031 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 148/242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:13 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1469 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:14.669275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1404825501", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:14.805160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:01:14.831751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:14.851507 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4fe384d0-0460-43cb-915e-65467d1f6c1e tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1493 microversion: 2.1 time: 0.665854 Oct 25 03:01:14.856214 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 95/243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:14 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1493 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:14.887009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:14.887656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:14.916121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:14.916778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:14.917345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:14.919415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:14.921825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:14.922930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:15.216351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:15.227870 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5446f741-3216-46d1-b51d-8322ed9f5fca tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 0.368627 Oct 25 03:01:15.230480 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 96/244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:14 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:15.714160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:15.715669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:15.725029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:15.725872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:15.726536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:15.727934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:15.728545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:15.729125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:15.865944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:01:15.990197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:01:15.990700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:01:15.991374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:01:15.991929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:01:15.992499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:01:16.033691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.038841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.040193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:16.042436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.045553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.050416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:16.110652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Getting quotas for project dadc2c982cfd41c695952d8d54ecf314. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:01:16.122919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Getting quotas for user 690d08aa8d2a4ee2b5da985308ee130c and project dadc2c982cfd41c695952d8d54ecf314. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:01:16.178202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:01:16.190146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:01:16.282818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a601257f-d8f4-4f5a-867e-3c5b55a3ddef tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 204 len: 0 microversion: 2.1 time: 1.050415 Oct 25 03:01:16.287062 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 97/245] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:01:15 2022] DELETE /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:01:16.293666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:16.295290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:16.304500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.305328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.306544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:16.308885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.309633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.310318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:16.344910 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-78021df6-1f48-41a8-a229-9aed37c50096 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.691133 Oct 25 03:01:16.346856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 149/246] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:01:16.353096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:16.353974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:16.363624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.365415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.366110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:16.367592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.368337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.371448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:16.576937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:16.594353 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-785ae1e2-bc5e-43a7-8002-d31c42831997 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1493 microversion: 2.1 time: 0.305313 Oct 25 03:01:16.596652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 98/247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:16 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1493 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:16.609398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:16.609963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:16.628863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.630706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.631235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:16.633143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:16.636384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:16.637950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:17.139791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:17.156619 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b030936f-764d-41f7-923e-bea710122f5e tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1475 microversion: 2.1 time: 0.558670 Oct 25 03:01:17.169701 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 99/248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:16 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1475 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:17.187958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba328f8b-b1f5-423e-a80e-36077e29a1c5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:17.191393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba328f8b-b1f5-423e-a80e-36077e29a1c5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:17.343489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba328f8b-b1f5-423e-a80e-36077e29a1c5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:17.357530 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba328f8b-b1f5-423e-a80e-36077e29a1c5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1214 microversion: 2.1 time: 0.186748 Oct 25 03:01:17.373352 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 100/249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:17 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:17.624603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:17.625248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:17.635508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:17.636007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:17.636451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:17.637167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:17.637627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:17.638094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:17.848375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:17.867079 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4e3a5f7-4803-4cf8-9483-eff7eea2fb87 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 1.517613 Oct 25 03:01:17.869738 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 150/250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:16 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:18.183793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:18.184906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:18.205149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.205988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.207542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:18.209846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.210557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.213948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:18.303460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:18.312079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a330d11-0737-4f30-ab69-2ddd2d431aac tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1493 microversion: 2.1 time: 0.692542 Oct 25 03:01:18.322046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 101/251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:17 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1493 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:18.381318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:18.382832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:18.392641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.393510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.395251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:18.396268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.398655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.399648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:18.584405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:18.593208 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-35683b21-12ac-4384-ad38-d7bd03d5eda5 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1288 microversion: 2.1 time: 0.215858 Oct 25 03:01:18.599949 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 102/252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:18 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1288 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:18.610175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5b544534-4bd2-482e-9f54-6e9a3b15fc61 req-86436f81-4249-49c3-941b-714c3c8db17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db3b2e1-cbf3-4bde-bc31-2729770c052c", "name": "network-vif-plugged", "status": "completed", "tag": "36f57cdd-0a77-40b6-8edf-9c03c1e438ac"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:18.669093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b544534-4bd2-482e-9f54-6e9a3b15fc61 req-86436f81-4249-49c3-941b-714c3c8db17c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.669494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b544534-4bd2-482e-9f54-6e9a3b15fc61 req-86436f81-4249-49c3-941b-714c3c8db17c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.669959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b544534-4bd2-482e-9f54-6e9a3b15fc61 req-86436f81-4249-49c3-941b-714c3c8db17c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:18.757377 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5b544534-4bd2-482e-9f54-6e9a3b15fc61 req-86436f81-4249-49c3-941b-714c3c8db17c service nova] Creating event network-vif-plugged:36f57cdd-0a77-40b6-8edf-9c03c1e438ac for instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c on n-h2-862355-1 Oct 25 03:01:18.776166 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5b544534-4bd2-482e-9f54-6e9a3b15fc61 req-86436f81-4249-49c3-941b-714c3c8db17c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174477 Oct 25 03:01:18.784339 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 103/253] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:18.816304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-84fee65c-fce1-4d32-be65-1cf176b9d860 req-6eb39e9f-edbf-4da4-a139-d56e28689288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f316841f-cd83-426a-8952-0f229815f69f", "name": "network-vif-deleted", "tag": "c50a14db-844b-4b99-8b52-0eabba119246"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:18.843821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-84fee65c-fce1-4d32-be65-1cf176b9d860 req-6eb39e9f-edbf-4da4-a139-d56e28689288 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.851028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-84fee65c-fce1-4d32-be65-1cf176b9d860 req-6eb39e9f-edbf-4da4-a139-d56e28689288 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.852023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-84fee65c-fce1-4d32-be65-1cf176b9d860 req-6eb39e9f-edbf-4da4-a139-d56e28689288 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:18.884123 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-84fee65c-fce1-4d32-be65-1cf176b9d860 req-6eb39e9f-edbf-4da4-a139-d56e28689288 service nova] Creating event network-vif-deleted:c50a14db-844b-4b99-8b52-0eabba119246 for instance f316841f-cd83-426a-8952-0f229815f69f on n-h1-862355-1 Oct 25 03:01:18.898762 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-84fee65c-fce1-4d32-be65-1cf176b9d860 req-6eb39e9f-edbf-4da4-a139-d56e28689288 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090619 Oct 25 03:01:18.901250 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 104/254] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:01:18.917051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:18.919758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:18.934353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.937225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.939778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:18.941886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:18.942598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:18.956022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:19.171574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:19.188129 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5086e71-9518-4063-94bf-981dbc778edc tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1475 microversion: 2.1 time: 1.009195 Oct 25 03:01:19.203523 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 151/255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:18 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1475 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:19.337400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:19.338251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:19.351441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:19.352137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:19.354265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:19.355499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:19.357747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:19.358372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:19.411846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:19.412736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:19.413384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:19.414103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lazy-loading 'fault' on Instance uuid f316841f-cd83-426a-8952-0f229815f69f {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:19.530000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e121b8f85246a1a48aee8fb0d058ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4ab406de0748a18283fbc93059ed42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:19.544688 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8ac6062-53a7-40f5-b100-a336c3c6cee1 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 200 len: 1328 microversion: 2.1 time: 0.211483 Oct 25 03:01:19.547384 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 152/256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:19 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:19.629369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:19.631729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:19.643038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:19.647711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:19.648372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:19.650632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:19.651293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:19.658779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:19.930322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:19.944075 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-69872c63-6360-47c2-8885-742151143eb4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1294 microversion: 2.1 time: 0.319454 Oct 25 03:01:19.953336 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 153/257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:19 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1294 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:20.096637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:20.113613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b87fe74-863c-4acf-b3a0-7adf875f80df tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1388 microversion: 2.1 time: 1.206604 Oct 25 03:01:20.118177 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 105/258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:18 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1388 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:20.216886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:20.217627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:20.226973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:20.236537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:20.237254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:20.238264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:20.238983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:20.239629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:20.559319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:20.570515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:20.571195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:20.572739 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8506432-c037-4780-9146-1d3381976206 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 200 len: 1433 microversion: 2.1 time: 0.359744 Oct 25 03:01:20.587162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:20.587162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:20.587162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:20.587162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:20.587533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:20.587533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:20.594259 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 154/259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:20 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 1433 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:20.616641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] HTTP exception thrown: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Request method failure captured: Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f HTTP/1.1 Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FHOi9mIj9AeOA-JZ3xy2WRo4DFMiRbA2qqsnP2BcQIZNrUAocazlEsbofS5DYsBLzywTrsmW_BGRy_1O6ZLTjca6B2nO5eECpMOKmhYp4r0wND1baOET3RUVpCtx21b5d7rayVNQ5BG1eY9F_pMyNoNImElj7KGs83vsP5oLlJYbs Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0e4ab406de0748a18283fbc93059ed42 Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:01:20.621458 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e4ab406de0748a18283fbc93059ed42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e4ab406de0748a18283fbc93059ed42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0e4ab406de0748a18283fbc93059ed42", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0e4ab406de0748a18283fbc93059ed42"}]}] Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0e4ab406de0748a18283fbc93059ed42 Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminTestJSON-40227974-project Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: a7e121b8f85246a1a48aee8fb0d058ab Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminTestJSON-40227974-project Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:20.622733 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f316841f-cd83-426a-8952-0f229815f69f'} Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:20.623592 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:20.624837 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:20.627513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Returning 404 to user: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:20.627513 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e487c5b4-3ab2-4d11-98d6-da7f66b0d5b0 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 404 len: 111 microversion: 2.1 time: 0.056424 Oct 25 03:01:20.627684 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 106/260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:20 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:20.636971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa27fbe1-09d6-44f9-8a25-7e5ce88e8eea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:20.656198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa27fbe1-09d6-44f9-8a25-7e5ce88e8eea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:20.657200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa27fbe1-09d6-44f9-8a25-7e5ce88e8eea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:20.666807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa27fbe1-09d6-44f9-8a25-7e5ce88e8eea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:20.974460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa27fbe1-09d6-44f9-8a25-7e5ce88e8eea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 299 microversion: 2.1 time: 0.339394 Oct 25 03:01:20.975394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 155/261] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:01:20 2022] POST /compute/v2.1/os-aggregates/5/action => generated 299 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:20.977710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:20.978430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:20.990059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d05e4f34-8bae-4058-8b7e-f083c46bc1ff tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:20.991318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:20.991824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:20.992272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:20.997300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:20.997828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:20.998276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.032309 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d05e4f34-8bae-4058-8b7e-f083c46bc1ff tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.047173 Oct 25 03:01:21.034484 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 156/262] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:01:20 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 25 03:01:21.050080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a72d64aa-8017-4ec5-b18e-8c224d5ed108 req-e7e3a3cb-150d-4648-b25f-74c2dc0d6253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb69892a-0d6b-4648-a443-f2b5dd056069", "name": "network-vif-deleted", "tag": "4c394813-fd7a-446a-a496-3b6d16d339f3"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:21.097995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a72d64aa-8017-4ec5-b18e-8c224d5ed108 req-e7e3a3cb-150d-4648-b25f-74c2dc0d6253 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:21.105050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a72d64aa-8017-4ec5-b18e-8c224d5ed108 req-e7e3a3cb-150d-4648-b25f-74c2dc0d6253 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:21.105950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a72d64aa-8017-4ec5-b18e-8c224d5ed108 req-e7e3a3cb-150d-4648-b25f-74c2dc0d6253 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.134431 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a72d64aa-8017-4ec5-b18e-8c224d5ed108 req-e7e3a3cb-150d-4648-b25f-74c2dc0d6253 service nova] Creating event network-vif-deleted:4c394813-fd7a-446a-a496-3b6d16d339f3 for instance bb69892a-0d6b-4648-a443-f2b5dd056069 on n-h2-862355-1 Oct 25 03:01:21.149801 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a72d64aa-8017-4ec5-b18e-8c224d5ed108 req-e7e3a3cb-150d-4648-b25f-74c2dc0d6253 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112177 Oct 25 03:01:21.150418 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 157/263] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:21.159627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbaaddef-af50-4997-8404-642d783152c8 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1252371557"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:21.161773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-dbaaddef-af50-4997-8404-642d783152c8 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid 9cda7f7e-44b1-4903-9f56-98f6ea57ae4e for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:21.245634 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dbaaddef-af50-4997-8404-642d783152c8 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090188 Oct 25 03:01:21.248468 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 158/264] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:21.263341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:21.264113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:21.289170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:21.289713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:21.290171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.301584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:21.304415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:21.304588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:21.306897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.318845 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc19e6c9-4d1a-4ab8-9eb9-317c47c48f96 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1272 microversion: 2.1 time: 0.345007 Oct 25 03:01:21.319749 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 107/265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:20 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:21.335929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6266c09-d004-473c-94b6-b8ac9a96ee65 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:21.377263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6266c09-d004-473c-94b6-b8ac9a96ee65 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:21.382444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:21.383401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6266c09-d004-473c-94b6-b8ac9a96ee65 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:21.390766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6266c09-d004-473c-94b6-b8ac9a96ee65 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.466970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:21.703310 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6266c09-d004-473c-94b6-b8ac9a96ee65 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.380503 Oct 25 03:01:21.714185 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 108/266] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:01:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:21.723216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:21.726775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:21.737916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:21.737916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:21.738347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.739061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:21.739520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:21.739950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.767639 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] HTTP exception thrown: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Request method failure captured: Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 HTTP/1.1 Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FQr-2ho6m8UaRQfACs_1_3nBLWE7KYhVG8L8YKYC8yxM6zRvuX-ZAmufkRRYgz5nzVWUmZDoxpwKSlhYyJLqvqHhpHDhUTxsHyrj6W_kWFxHKsH5mjThBMFEa7y0t26rB9arcrnmIhU7EJIU85SrXyVNeqevmj1j5XcUEuMGR6ctU Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:01:21.770926 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_019b7b32bbcd4474b05101db46063770", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/019b7b32bbcd4474b05101db46063770"}]}] Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: b89a2cc21f1549c7b59b97757cc60c33 Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:21.772326 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'bb69892a-0d6b-4648-a443-f2b5dd056069'} Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:21.773115 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:21.774474 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.776546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Returning 404 to user: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:21.777566 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b0d352e6-a0ca-483e-bca3-394177e2e3e1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 404 len: 111 microversion: 2.1 time: 0.060448 Oct 25 03:01:21.778634 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 109/267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:21 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:21.806597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed29b258-6333-4ead-a50f-4d5f697d8c62 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:21.815021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed29b258-6333-4ead-a50f-4d5f697d8c62 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '33d5743faa8a4bd2bcb6784105576631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc11ebd8be4a4cb76ea30f105c10b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed29b258-6333-4ead-a50f-4d5f697d8c62 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Request method failure captured: Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 42 Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FHYAv5MZIawC6qYc1GXVtHa7V8EuDBslFUd20hcqlr0GnNn2NB2akWng-qqzBwBtXnJLGb8MY576BXzoORnS8EUKPLRF8zANeIh35mzfYOKN-9XSR_vwk0fS3ABhOT9KaE1XRr-w10eigXC12uiBTUtSKAp-9g9yPGB5YzAFsPftE Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:01:21.823060 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/27dc11ebd8be4a4cb76ea30f105c10b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_27dc11ebd8be4a4cb76ea30f105c10b9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/27dc11ebd8be4a4cb76ea30f105c10b9"}]}] Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 27dc11ebd8be4a4cb76ea30f105c10b9 Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-601130391 Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 33d5743faa8a4bd2bcb6784105576631 Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-601130391-project Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: {"remove_host": {"host": "n-h1-862355-1"}} Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:21.824421 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h1-862355-1'}}} Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:01:21.825199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 25 03:01:21.826361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:21.831149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed29b258-6333-4ead-a50f-4d5f697d8c62 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:21.833898 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed29b258-6333-4ead-a50f-4d5f697d8c62 tempest-AggregatesAdminNegativeTestJSON-601130391 tempest-AggregatesAdminNegativeTestJSON-601130391-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.053538 Oct 25 03:01:21.834757 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 110/268] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:01:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:21.851228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-107e71d8-bef4-40bd-a0da-ed7ca65e11d6 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:21.882906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-107e71d8-bef4-40bd-a0da-ed7ca65e11d6 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:21.885366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-107e71d8-bef4-40bd-a0da-ed7ca65e11d6 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:21.886034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-107e71d8-bef4-40bd-a0da-ed7ca65e11d6 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:21.925014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:22.009703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:22.021837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c5d77ade-da65-4917-8861-c462a5943091 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1587 microversion: 2.1 time: 0.771368 Oct 25 03:01:22.024725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 159/269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:21 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1587 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:22.043809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-662878380", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:22.104865 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-107e71d8-bef4-40bd-a0da-ed7ca65e11d6 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.263147 Oct 25 03:01:22.108805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 111/270] 10.222.0.36 () {60 vars in 1191 bytes} [Tue Oct 25 03:01:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:22.141291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:22.143457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:22.161862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:01:22.166989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:22.167499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:22.170021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:22.171109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:22.171854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:22.173408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:22.746744 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5ae0d542-0f3d-40bb-9dd0-8ba3caaec02c tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.636581 Oct 25 03:01:22.747275 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 112/271] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:01:22 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c/os-interface => generated 285 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:22.759858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6484ee3a-de91-468b-b4cd-7add6de6fe5e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:22.806834 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6484ee3a-de91-468b-b4cd-7add6de6fe5e tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.050500 Oct 25 03:01:22.809799 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 113/272] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:01:22 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:22.823887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:22.824804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:22.838451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:22.838818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:22.839254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:22.839970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:22.840424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:22.840849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:23.206467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:01:23.208146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:01:23.208830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:01:23.209440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:01:23.210194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:01:23.234712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:23.235156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:23.236775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:23.237541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:23.238039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:23.238469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:23.293886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Getting quotas for project 019b7b32bbcd4474b05101db46063770. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:01:23.301997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:23.325469 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-59d0f287-d96f-4eb5-895b-47983630b90f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 0.507177 Oct 25 03:01:23.326688 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 114/273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:22 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:23.336287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Getting quotas for user b89a2cc21f1549c7b59b97757cc60c33 and project 019b7b32bbcd4474b05101db46063770. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:01:23.352460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0621b1df-48d2-478f-a7bc-acdcf0e336d1 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2105241595"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:23.365846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.aggregate [None req-0621b1df-48d2-478f-a7bc-acdcf0e336d1 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Generated uuid 978e9a8b-7b48-474c-a585-2f8fd181472f for aggregate {{(pid=120562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:23.387700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:01:23.395244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:01:23.416284 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0621b1df-48d2-478f-a7bc-acdcf0e336d1 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.083005 Oct 25 03:01:23.418181 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 115/274] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:23.428311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ea1d0c3-9625-4ade-9939-1a62da637991 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1870544689"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:23.434831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.aggregate [None req-8ea1d0c3-9625-4ade-9939-1a62da637991 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid fb25ba2a-f376-4386-aa22-c3825a0a44a9 for aggregate {{(pid=120562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:23.476209 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ea1d0c3-9625-4ade-9939-1a62da637991 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056619 Oct 25 03:01:23.477296 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 116/275] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:23.491238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:23.511818 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6d7a2f8c-181c-4d12-a1e8-cd4659dfdb34 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.485911 Oct 25 03:01:23.513124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:23.514677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:23.523032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:23.523220 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 160/276] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:01:23.528376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d1febf91-f8df-4369-aa98-029d5ba67e19 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:23.529091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:23.530868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:23.532049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:23.551893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.compute.aggregates [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 25 03:01:23.552487 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Request method failure captured: Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 42 Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FKokXiTWC90jEF-6kkUpPXGA4iXuFsE1V78yYATpbZTDUei-So5hHvGHDJqlpYvec4RLKDlEHQZ45kEIw_ahKL80w_KRliwi7BdJPzELqwppaLehjnDFNkxLex_o69Mjs7cZ4JdXmbUmTTD93oJgbnvVfailwcsQuazbh-MpV9RGc Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:01:23.555364 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8598cb24254a45fb91219c26e2cc55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8598cb24254a45fb91219c26e2cc55f2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8598cb24254a45fb91219c26e2cc55f2"}]}] Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8598cb24254a45fb91219c26e2cc55f2 Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312 Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 2226d3a79ece4b0c9a8848ea4b200cf4 Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: {"remove_host": {"host": "nonexist_host"}} Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:23.556524 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot remove host nonexist_host in aggregate 10 Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 25 03:01:23.557393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 25 03:01:23.558495 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.559547 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-86579d55-32c5-40e4-83d3-31db1c690b56 tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.078114 Oct 25 03:01:23.560640 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 117/277] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:23 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:01:23.569082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a7e8920-f59c-4266-add4-52a878a26413 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:23.569825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a7e8920-f59c-4266-add4-52a878a26413 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:23.592835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1febf91-f8df-4369-aa98-029d5ba67e19 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:23.602008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1febf91-f8df-4369-aa98-029d5ba67e19 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:23.602941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1febf91-f8df-4369-aa98-029d5ba67e19 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:23.818673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d1febf91-f8df-4369-aa98-029d5ba67e19 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.298461 Oct 25 03:01:23.820005 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 161/278] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:23 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:23.825212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51aa681c-214a-4fa3-b219-6c4b8ceeb8ea tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:23.865229 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51aa681c-214a-4fa3-b219-6c4b8ceeb8ea tempest-AggregatesAdminNegativeTestJSON-1205128312 tempest-AggregatesAdminNegativeTestJSON-1205128312-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.043381 Oct 25 03:01:23.866406 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 162/279] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:23 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:23.892323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b231bbc-e279-47a0-bbdb-96d5a90e3d8b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:23.927241 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4b231bbc-e279-47a0-bbdb-96d5a90e3d8b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 243 microversion: 2.1 time: 0.054435 Oct 25 03:01:23.928311 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 163/280] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:01:23 2022] GET /compute/v2.1/os-aggregates/11 => generated 243 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:23.950207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c722725-2b18-4cc2-8ba8-59399c25acbc tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:23.976078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c722725-2b18-4cc2-8ba8-59399c25acbc tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:23.976622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c722725-2b18-4cc2-8ba8-59399c25acbc tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:23.977060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c722725-2b18-4cc2-8ba8-59399c25acbc tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:23.986642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=5 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:24.051533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a7e8920-f59c-4266-add4-52a878a26413 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:24.067182 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a7e8920-f59c-4266-add4-52a878a26413 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1219 microversion: 2.1 time: 0.507612 Oct 25 03:01:24.068080 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 118/281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:23 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1219 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:24.191003 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c722725-2b18-4cc2-8ba8-59399c25acbc tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.251517 Oct 25 03:01:24.193581 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 164/282] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:23 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:24.204050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45e57b83-871c-46e2-b8cb-7c2342600454 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:24.250674 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45e57b83-871c-46e2-b8cb-7c2342600454 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050607 Oct 25 03:01:24.266829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca7155ab-20bd-4ee7-8352-532306f38568 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-409390448"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:24.271677 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 119/283] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:24 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:24.273336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-ca7155ab-20bd-4ee7-8352-532306f38568 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid 4f90a150-e0ab-4585-a56e-38486106c2e3 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:24.330567 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca7155ab-20bd-4ee7-8352-532306f38568 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066864 Oct 25 03:01:24.344653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d925a185-dd94-4e21-9990-1a3da71ac79f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:24.349513 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 165/284] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:24.368147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:24.371549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:24.375884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d925a185-dd94-4e21-9990-1a3da71ac79f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:24.384672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d925a185-dd94-4e21-9990-1a3da71ac79f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:24.385611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d925a185-dd94-4e21-9990-1a3da71ac79f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:24.393413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:24.402899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:24.403668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:24.404510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:24.406150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:24.406684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:24.744897 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d925a185-dd94-4e21-9990-1a3da71ac79f tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.404259 Oct 25 03:01:24.753572 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 120/285] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:24 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:24.764872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aebb0b4d-b1cc-4123-b87a-97e2223e0c11 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:24.777091 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aebb0b4d-b1cc-4123-b87a-97e2223e0c11 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.022309 Oct 25 03:01:24.777703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 121/286] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:01:24 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:24.807116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6f6c3e5-be23-4709-a2fd-854b9367a5f8 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:24.836094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f6c3e5-be23-4709-a2fd-854b9367a5f8 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:24.837019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f6c3e5-be23-4709-a2fd-854b9367a5f8 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:24.837723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f6c3e5-be23-4709-a2fd-854b9367a5f8 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:25.063040 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6f6c3e5-be23-4709-a2fd-854b9367a5f8 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.275299 Oct 25 03:01:25.072416 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 122/287] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:24 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:25.086219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f100aecc-34b7-499d-9468-adac91802772 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:25.128220 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f100aecc-34b7-499d-9468-adac91802772 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.052827 Oct 25 03:01:25.131284 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 123/288] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:25.137739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:25.141207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:25.151642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:25.152140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:25.152580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:25.153859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:25.154637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:25.155146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:25.349530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:25.357983 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14308744-0f6f-4db9-8cb9-9685900c8583 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 1.007008 Oct 25 03:01:25.366497 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 166/289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:24 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:25.371430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9bb17568-455e-4e64-86db-4154c1cfd8ea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1958560936"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:25.379633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-9bb17568-455e-4e64-86db-4154c1cfd8ea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid 21cced2b-4f99-4f24-a2d3-e66beb474654 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:25.439726 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9bb17568-455e-4e64-86db-4154c1cfd8ea tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071158 Oct 25 03:01:25.458859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 167/290] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:25.469337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac2317a8-b28c-4cb8-aa7a-4075e4406d22 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:25.497642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac2317a8-b28c-4cb8-aa7a-4075e4406d22 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:25.500971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac2317a8-b28c-4cb8-aa7a-4075e4406d22 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:25.501859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac2317a8-b28c-4cb8-aa7a-4075e4406d22 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:25.677500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:25.708096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-119d350c-db44-4ddc-a279-8c7379b2ad57 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1271 microversion: 2.1 time: 0.570794 Oct 25 03:01:25.709396 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 124/291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:25 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1271 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:25.796399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac2317a8-b28c-4cb8-aa7a-4075e4406d22 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.335884 Oct 25 03:01:25.797039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 168/292] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:25.809810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b0a3683b-89e2-4522-9243-db4a988db2b7 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:25.828320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0a3683b-89e2-4522-9243-db4a988db2b7 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:25.834076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0a3683b-89e2-4522-9243-db4a988db2b7 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:25.834603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0a3683b-89e2-4522-9243-db4a988db2b7 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:26.120463 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b0a3683b-89e2-4522-9243-db4a988db2b7 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.315088 Oct 25 03:01:26.122984 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 125/293] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:26.152933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-967a52aa-7adf-4764-971b-c7631d8bece9 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.222811 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-967a52aa-7adf-4764-971b-c7631d8bece9 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.088711 Oct 25 03:01:26.228826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 169/294] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:26 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:26.237600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-171130ab-8291-4c85-8c6f-44e3156a9dd2 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1184516229"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:26.242129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.aggregate [None req-171130ab-8291-4c85-8c6f-44e3156a9dd2 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid f54d8b5d-bf37-4aaa-8fba-b610e3598171 for aggregate {{(pid=120562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:26.271183 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-171130ab-8291-4c85-8c6f-44e3156a9dd2 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040377 Oct 25 03:01:26.273176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 126/295] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:26.283442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea7b13b8-63f3-410e-a475-9a720861932a tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.322264 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea7b13b8-63f3-410e-a475-9a720861932a tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.042550 Oct 25 03:01:26.328880 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 170/296] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:26 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:26.332677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-40b2b9c1-8e6d-4a30-aebf-0e364a109dfd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.341019 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-40b2b9c1-8e6d-4a30-aebf-0e364a109dfd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-40b2b9c1-8e6d-4a30-aebf-0e364a109dfd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Request method failure captured: Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FKzFzquy-ufE5D4dd6_liXwW6C5TDhp5zkb_JYsc-d1rof8McXZlZsJnWTgz5c_psqm4hredNwPw6n7N2XPFl7wWF8gHfjQxh2G8d7ZfD5k6evM3bheXxidrydLLk3Lgqi_jeXzN9B5FKo-FsRlala-bFS6IQrxWGxxvY3WU1BTeQ Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:01:26.344881 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_334f0c934d6b419e924381f8486a329b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/334f0c934d6b419e924381f8486a329b"}]}] Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fcd831d3f29d419ba6939c15d8c9ca08 Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: exception: Aggregate 14 could not be found. Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '14'} Oct 25 03:01:26.346203 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.346942 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 25 03:01:26.347995 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.353265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-40b2b9c1-8e6d-4a30-aebf-0e364a109dfd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:26.354557 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-40b2b9c1-8e6d-4a30-aebf-0e364a109dfd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.026081 Oct 25 03:01:26.355988 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 127/297] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:01:26 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:01:26.369114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f283e0f3-c6c0-4287-9aea-bb053e080361 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.392756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.394739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:26.398792 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-f283e0f3-c6c0-4287-9aea-bb053e080361 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f283e0f3-c6c0-4287-9aea-bb053e080361 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Request method failure captured: Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKzFzquy-ufE5D4dd6_liXwW6C5TDhp5zkb_JYsc-d1rof8McXZlZsJnWTgz5c_psqm4hredNwPw6n7N2XPFl7wWF8gHfjQxh2G8d7ZfD5k6evM3bheXxidrydLLk3Lgqi_jeXzN9B5FKo-FsRlala-bFS6IQrxWGxxvY3WU1BTeQ Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:01:26.404225 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_334f0c934d6b419e924381f8486a329b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/334f0c934d6b419e924381f8486a329b"}]}] Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fcd831d3f29d419ba6939c15d8c9ca08 Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: exception: Aggregate 14 could not be found. Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '14'} Oct 25 03:01:26.405598 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:01:26.406377 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.407402 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.410753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.410753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:26.410753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:26.410753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 25 03:01:26.410753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.412402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f283e0f3-c6c0-4287-9aea-bb053e080361 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:26.414420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:26.415582 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f283e0f3-c6c0-4287-9aea-bb053e080361 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.054727 Oct 25 03:01:26.417044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:26.417540 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 171/298] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:26 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:01:26.424414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:26.427029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:26.427549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:26.427995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:26.435501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-394fe5a2-87a4-431a-800f-6f4ca0094b7b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-680910052", "name": "tempest-test_aggregate-1365464252"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:26.475686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-394fe5a2-87a4-431a-800f-6f4ca0094b7b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid 30cfc3ff-bc89-447c-a127-99e02a613663 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:26.531105 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-394fe5a2-87a4-431a-800f-6f4ca0094b7b tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.108220 Oct 25 03:01:26.532258 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 172/299] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 25 03:01:26 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:26.566155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d7b1019f-010f-47e2-9a6b-0d0652db0c72 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.617039 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d7b1019f-010f-47e2-9a6b-0d0652db0c72 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.073828 Oct 25 03:01:26.619002 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 173/300] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:26 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:26.629543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a7d6f386-254f-47b1-840d-b3e77852bdd1 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.639581 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a7d6f386-254f-47b1-840d-b3e77852bdd1 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a7d6f386-254f-47b1-840d-b3e77852bdd1 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Request method failure captured: Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKzFzquy-ufE5D4dd6_liXwW6C5TDhp5zkb_JYsc-d1rof8McXZlZsJnWTgz5c_psqm4hredNwPw6n7N2XPFl7wWF8gHfjQxh2G8d7ZfD5k6evM3bheXxidrydLLk3Lgqi_jeXzN9B5FKo-FsRlala-bFS6IQrxWGxxvY3WU1BTeQ Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:01:26.641691 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_334f0c934d6b419e924381f8486a329b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/334f0c934d6b419e924381f8486a329b"}]}] Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fcd831d3f29d419ba6939c15d8c9ca08 Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: exception: Aggregate 15 could not be found. Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '15'} Oct 25 03:01:26.643681 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.644389 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 25 03:01:26.645363 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.646348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a7d6f386-254f-47b1-840d-b3e77852bdd1 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:26.646348 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a7d6f386-254f-47b1-840d-b3e77852bdd1 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.021189 Oct 25 03:01:26.646348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 174/301] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:01:26 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:01:26.652781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0ecdf79-7654-49d9-8cd0-31f64edc02fd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.671474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-d0ecdf79-7654-49d9-8cd0-31f64edc02fd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0ecdf79-7654-49d9-8cd0-31f64edc02fd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Request method failure captured: Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FKzFzquy-ufE5D4dd6_liXwW6C5TDhp5zkb_JYsc-d1rof8McXZlZsJnWTgz5c_psqm4hredNwPw6n7N2XPFl7wWF8gHfjQxh2G8d7ZfD5k6evM3bheXxidrydLLk3Lgqi_jeXzN9B5FKo-FsRlala-bFS6IQrxWGxxvY3WU1BTeQ Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:01:26.674272 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/334f0c934d6b419e924381f8486a329b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_334f0c934d6b419e924381f8486a329b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/334f0c934d6b419e924381f8486a329b"}]}] Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 334f0c934d6b419e924381f8486a329b Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-819440199 Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fcd831d3f29d419ba6939c15d8c9ca08 Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminTestJSON-819440199-project-admin Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: exception: Aggregate 15 could not be found. Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '15'} Oct 25 03:01:26.675925 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:01:26.676625 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:26.678159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0ecdf79-7654-49d9-8cd0-31f64edc02fd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0ecdf79-7654-49d9-8cd0-31f64edc02fd tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.026870 Oct 25 03:01:26.679279 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 175/302] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:26 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:01:26.687753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf514f78-5edb-410a-aebc-56ab0f2b3a2c tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-493311049"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:26.694462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-cf514f78-5edb-410a-aebc-56ab0f2b3a2c tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid f1857d4e-17c7-4813-8292-c739e84a9fdf for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:26.737205 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf514f78-5edb-410a-aebc-56ab0f2b3a2c tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053240 Oct 25 03:01:26.738688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 176/303] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:01:26.755908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:26.757220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:26.764644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:26.765227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:26.765915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:26.766643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:26.767310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:26.767876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:27.110000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:27.121554 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93ec69dd-3802-4818-94fd-2d691c922726 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1277 microversion: 2.1 time: 0.380452 Oct 25 03:01:27.123697 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 177/304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:26 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:27.132399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9adff1f2-aee5-45ec-86ce-2ed2de901542 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.152066 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9adff1f2-aee5-45ec-86ce-2ed2de901542 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.027409 Oct 25 03:01:27.159974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 178/305] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:01:27 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.169977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96b033e7-429f-4f5e-af94-40979b37d871 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:27.221999 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96b033e7-429f-4f5e-af94-40979b37d871 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.060139 Oct 25 03:01:27.230043 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 179/306] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:01:27 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:01:27.332516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e9c9b57a-4586-46ce-bec5-641405d6851a req-f6e6113e-7455-4018-a2c4-68f17ef119dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c6eb87-b6da-475c-97c0-c5e9a437235e", "tag": "95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:27.352995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e9c9b57a-4586-46ce-bec5-641405d6851a req-f6e6113e-7455-4018-a2c4-68f17ef119dd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:27.354895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e9c9b57a-4586-46ce-bec5-641405d6851a req-f6e6113e-7455-4018-a2c4-68f17ef119dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:27.355376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e9c9b57a-4586-46ce-bec5-641405d6851a req-f6e6113e-7455-4018-a2c4-68f17ef119dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:27.370802 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e9c9b57a-4586-46ce-bec5-641405d6851a req-f6e6113e-7455-4018-a2c4-68f17ef119dd service nova] Creating event network-changed:95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f for instance a0c6eb87-b6da-475c-97c0-c5e9a437235e on n-h1-862355-1 Oct 25 03:01:27.378459 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e9c9b57a-4586-46ce-bec5-641405d6851a req-f6e6113e-7455-4018-a2c4-68f17ef119dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148920 Oct 25 03:01:27.379508 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 180/307] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.384887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe31dd68-c5c5-4d21-9a89-c93041ba9274 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.397291 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe31dd68-c5c5-4d21-9a89-c93041ba9274 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.016355 Oct 25 03:01:27.398724 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 181/308] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:01:27 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.410819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a26a1f64-7bf0-4115-a4e7-be5e7c118b72 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.469585 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a26a1f64-7bf0-4115-a4e7-be5e7c118b72 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.062688 Oct 25 03:01:27.471058 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 182/309] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:27 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:27.485087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f710be6a-be79-4527-ae89-e86b693d0cdb tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1586902576", "availability_zone": "tempest-test_az-998328333"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:27.492414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.aggregate [None req-f710be6a-be79-4527-ae89-e86b693d0cdb tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid d5d55222-c62f-4a0f-b64f-d408a9981186 for aggregate {{(pid=120563) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:27.535068 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f710be6a-be79-4527-ae89-e86b693d0cdb tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.057663 Oct 25 03:01:27.536367 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 183/310] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Oct 25 03:01:27 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.554580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:27.572190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-65a91b1f-27bf-4d78-8922-1ea86dae775d tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1586902576_new", "availability_zone": "tempest-test_az-998328333_new"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:27.572644 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4ab77d3-db8a-41ff-a15b-9cc0b7e1b69e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 1.180915 Oct 25 03:01:27.573959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 128/311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:26 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:27.621507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a91b1f-27bf-4d78-8922-1ea86dae775d tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:27.622096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a91b1f-27bf-4d78-8922-1ea86dae775d tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:27.622738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a91b1f-27bf-4d78-8922-1ea86dae775d tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:27.678332 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-65a91b1f-27bf-4d78-8922-1ea86dae775d tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.117620 Oct 25 03:01:27.681900 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 184/312] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 25 03:01:27 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.694173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2cfdb376-bbc7-4a29-8994-c69e1085d548 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.709377 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2cfdb376-bbc7-4a29-8994-c69e1085d548 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.019037 Oct 25 03:01:27.710488 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 129/313] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:01:27 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.724103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07e0a07b-ce9a-4d23-96ec-e9dca76a3064 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.740062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=11,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:27.771762 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07e0a07b-ce9a-4d23-96ec-e9dca76a3064 tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.052478 Oct 25 03:01:27.776203 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 185/314] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:27 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:01:27.782586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6217557f-39e9-4950-84f5-50198fe3fead tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1754569072"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:27.787565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.aggregate [None req-6217557f-39e9-4950-84f5-50198fe3fead tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Generated uuid 5d21be84-0600-4a90-a371-c353dfc98f44 for aggregate {{(pid=120562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:01:27.816556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6217557f-39e9-4950-84f5-50198fe3fead tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038434 Oct 25 03:01:27.823366 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 130/315] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:01:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.832262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-430edffd-f144-41cb-abb2-cbeb169d9fbc tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.858640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-430edffd-f144-41cb-abb2-cbeb169d9fbc tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.033881 Oct 25 03:01:27.859394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 186/316] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:01:27 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:01:27.868036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a637d449-3648-41ae-ac31-1c60fd76e473 req-c950b411-6073-4e60-a56d-df80eecdc66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c98b2f1-4950-4f07-b4dc-23cc9f12beda", "tag": "d8d06f64-80bb-4036-89bb-ce9c8e323487"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:27.873656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fedc5aac-cf36-4a7d-a524-e9cc8fcb169a tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.884088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a637d449-3648-41ae-ac31-1c60fd76e473 req-c950b411-6073-4e60-a56d-df80eecdc66d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:27.884574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a637d449-3648-41ae-ac31-1c60fd76e473 req-c950b411-6073-4e60-a56d-df80eecdc66d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:27.885006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a637d449-3648-41ae-ac31-1c60fd76e473 req-c950b411-6073-4e60-a56d-df80eecdc66d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:27.916170 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fedc5aac-cf36-4a7d-a524-e9cc8fcb169a tempest-AggregatesAdminTestJSON-819440199 tempest-AggregatesAdminTestJSON-819440199-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.046413 Oct 25 03:01:27.924500 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 187/317] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:01:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 25 03:01:27.926932 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a637d449-3648-41ae-ac31-1c60fd76e473 req-c950b411-6073-4e60-a56d-df80eecdc66d service nova] Creating event network-changed:d8d06f64-80bb-4036-89bb-ce9c8e323487 for instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda on n-h1-862355-1 Oct 25 03:01:27.931827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.932431 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a637d449-3648-41ae-ac31-1c60fd76e473 req-c950b411-6073-4e60-a56d-df80eecdc66d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076066 Oct 25 03:01:27.933077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 131/318] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:27.934814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:27.945291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:27.946511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:27.947165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:27.948452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:27.949115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:27.949793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:27.967304 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] HTTP exception thrown: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Request method failure captured: Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f HTTP/1.1 Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FHOi9mIj9AeOA-JZ3xy2WRo4DFMiRbA2qqsnP2BcQIZNrUAocazlEsbofS5DYsBLzywTrsmW_BGRy_1O6ZLTjca6B2nO5eECpMOKmhYp4r0wND1baOET3RUVpCtx21b5d7rayVNQ5BG1eY9F_pMyNoNImElj7KGs83vsP5oLlJYbs Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0e4ab406de0748a18283fbc93059ed42 Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:01:27.972251 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e4ab406de0748a18283fbc93059ed42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e4ab406de0748a18283fbc93059ed42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0e4ab406de0748a18283fbc93059ed42", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0e4ab406de0748a18283fbc93059ed42"}]}] Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0e4ab406de0748a18283fbc93059ed42 Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AggregatesAdminTestJSON-40227974-project Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: a7e121b8f85246a1a48aee8fb0d058ab Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AggregatesAdminTestJSON-40227974-project Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:27.973550 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f316841f-cd83-426a-8952-0f229815f69f'} Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:27.974281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:27.975477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:27.980132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Returning 404 to user: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:27.981243 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da5e59fd-0601-416d-a5cf-2e436dc08fb7 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 404 len: 111 microversion: 2.1 time: 0.055314 Oct 25 03:01:27.987026 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 188/319] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:01:27 2022] DELETE /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:27.992489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:27.993201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] [instance: f316841f-cd83-426a-8952-0f229815f69f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:28.007064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:28.007569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:28.008011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:28.008721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:28.009172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:28.009814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:28.056104 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] HTTP exception thrown: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Request method failure captured: Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f HTTP/1.1 Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FHOi9mIj9AeOA-JZ3xy2WRo4DFMiRbA2qqsnP2BcQIZNrUAocazlEsbofS5DYsBLzywTrsmW_BGRy_1O6ZLTjca6B2nO5eECpMOKmhYp4r0wND1baOET3RUVpCtx21b5d7rayVNQ5BG1eY9F_pMyNoNImElj7KGs83vsP5oLlJYbs Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0e4ab406de0748a18283fbc93059ed42 Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:01:28.060704 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e4ab406de0748a18283fbc93059ed42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0e4ab406de0748a18283fbc93059ed42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0e4ab406de0748a18283fbc93059ed42", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0e4ab406de0748a18283fbc93059ed42"}]}] Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0e4ab406de0748a18283fbc93059ed42 Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-40227974 Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AggregatesAdminTestJSON-40227974-project Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: a7e121b8f85246a1a48aee8fb0d058ab Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AggregatesAdminTestJSON-40227974-project Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:28.062191 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f316841f-cd83-426a-8952-0f229815f69f'} Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:28.062868 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. Oct 25 03:01:28.065203 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:28.066358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] Returning 404 to user: Instance f316841f-cd83-426a-8952-0f229815f69f could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:28.070004 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47151906-c033-4a99-a449-b49e343aa6b9 tempest-AggregatesAdminTestJSON-40227974 tempest-AggregatesAdminTestJSON-40227974-project] 10.222.0.36 "GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f" status: 404 len: 111 microversion: 2.1 time: 0.077899 Oct 25 03:01:28.075844 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 132/320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:27 2022] GET /compute/v2.1/servers/f316841f-cd83-426a-8952-0f229815f69f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:28.149715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:28.150547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:28.164679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:28.165178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:28.165614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:28.170710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:28.171343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:28.172051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:28.549398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:28.569565 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c0069de4-fddf-4ef1-beac-ad809580aa33 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1277 microversion: 2.1 time: 0.424852 Oct 25 03:01:28.593942 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 189/321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:28 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1277 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:28.604186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:28.604812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:28.618813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:28.619313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:28.619838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:28.620561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:28.621578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:28.621578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:29.069720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:29.070496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:29.084080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:29.084663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:29.085106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:29.085870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:29.086932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:29.087362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:29.958095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:29.969878 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a2b17925-d1ba-4b43-9aa9-828f421e4a8d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 1.374616 Oct 25 03:01:29.974665 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 133/322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:28 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:29.989316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:30.000919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:30.013460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:30.014285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:30.014895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:30.016041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:30.016656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:30.017285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:30.143791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:30.153726 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fbd8e830-9373-4079-aeb0-3a4d1197ce55 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 200 len: 1587 microversion: 2.1 time: 1.088204 Oct 25 03:01:30.155198 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 190/323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:29 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 1587 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:30.174846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e9226eb2-fb15-4567-97ef-62085e843e98 req-2603abdf-fa92-4f2c-85eb-ecb31948a7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db3b2e1-cbf3-4bde-bc31-2729770c052c", "tag": "36f57cdd-0a77-40b6-8edf-9c03c1e438ac"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:30.207783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e9226eb2-fb15-4567-97ef-62085e843e98 req-2603abdf-fa92-4f2c-85eb-ecb31948a7d7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:30.208283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e9226eb2-fb15-4567-97ef-62085e843e98 req-2603abdf-fa92-4f2c-85eb-ecb31948a7d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:30.208722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e9226eb2-fb15-4567-97ef-62085e843e98 req-2603abdf-fa92-4f2c-85eb-ecb31948a7d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:30.218995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:30.230958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db4e8677-8d26-430a-bd2b-9a069cd54a5c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1277 microversion: 2.1 time: 0.254608 Oct 25 03:01:30.235532 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 134/324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:29 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:30.256822 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e9226eb2-fb15-4567-97ef-62085e843e98 req-2603abdf-fa92-4f2c-85eb-ecb31948a7d7 service nova] Creating event network-changed:36f57cdd-0a77-40b6-8edf-9c03c1e438ac for instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c on n-h2-862355-1 Oct 25 03:01:30.278700 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e9226eb2-fb15-4567-97ef-62085e843e98 req-2603abdf-fa92-4f2c-85eb-ecb31948a7d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118389 Oct 25 03:01:30.279347 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 191/325] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:30.996081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:30.998910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:31.020770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:31.026482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:31.027381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:31.027979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:31.030863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:31.031929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:31.037521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:31.268529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:31.269659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:31.283523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:31.284803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:31.285243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:31.285993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:31.286445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:31.286866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:31.552198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:31.568593 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1769ce91-412b-42be-b5c4-7b1c0ddfeb4d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 0.575859 Oct 25 03:01:31.610330 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 135/326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:30 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:32.130529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:32.142778 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b2db223-4793-4647-be6f-db480043c15c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1319 microversion: 2.1 time: 0.881350 Oct 25 03:01:32.143500 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 192/327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:31 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1319 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:32.613091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:32.614924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:32.629535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:32.630389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:32.631043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:32.632634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:32.634537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:32.637755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:33.165966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:33.167031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:33.172963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:33.173801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:33.188686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:33.193974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:33.194518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:33.194963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:33.244539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:33.252790 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f78a083-2d36-4463-ad23-93ac56f7e415 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 0.644128 Oct 25 03:01:33.253388 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 136/328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:32 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:33.264303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:33.375855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:34.188228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:34.205733 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9026b9a8-dd85-48d0-8b20-76dc896e79f5 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1319 microversion: 2.1 time: 1.041725 Oct 25 03:01:34.222007 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 193/329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:33 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1319 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:34.273266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:34.274774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=10 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:34.280700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:34.281506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:34.306225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:34.306734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:34.307186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:34.309496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:34.311551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:34.319852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:34.661508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-0fb83545-5643-4c23-94a5-ca1937976ba6 req-8e45a210-e9e1-4802-9044-01698638a957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25417c1-0e9a-4e69-8a05-b1e1b033ff37", "tag": "ef3b0ef3-b210-47ed-b863-30bee415e227"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:34.680416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0fb83545-5643-4c23-94a5-ca1937976ba6 req-8e45a210-e9e1-4802-9044-01698638a957 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:34.680900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0fb83545-5643-4c23-94a5-ca1937976ba6 req-8e45a210-e9e1-4802-9044-01698638a957 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:34.686139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0fb83545-5643-4c23-94a5-ca1937976ba6 req-8e45a210-e9e1-4802-9044-01698638a957 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:34.722833 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-0fb83545-5643-4c23-94a5-ca1937976ba6 req-8e45a210-e9e1-4802-9044-01698638a957 service nova] Creating event network-changed:ef3b0ef3-b210-47ed-b863-30bee415e227 for instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 on n-h2-862355-1 Oct 25 03:01:34.749949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-0fb83545-5643-4c23-94a5-ca1937976ba6 req-8e45a210-e9e1-4802-9044-01698638a957 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090656 Oct 25 03:01:34.754623 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 194/330] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:35.384373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56529e23-4964-45fe-85fd-634fbc7d7ebe tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2054192481", "id": 1255467212, "os-flavor-access:is_public": "True"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:35.431515 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56529e23-4964-45fe-85fd-634fbc7d7ebe tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.333417 Oct 25 03:01:35.432201 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 195/331] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:01:35 2022] POST /compute/v2.1/flavors => generated 468 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:35.443885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:35.444848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:35.457428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:35.462221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:35.462683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:35.463429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:35.463893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:35.464488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:35.489624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:35.497708 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bde9ec43-c933-481d-b387-7451264764c9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 1.225991 Oct 25 03:01:35.514153 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 137/332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:34 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:35.703219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-253a9cb4-8d3d-4eec-83d5-3d5efd367190 tempest-FlavorsV261TestJSON-1333002444 tempest-FlavorsV261TestJSON-1333002444-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:35.722112 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-253a9cb4-8d3d-4eec-83d5-3d5efd367190 tempest-FlavorsV261TestJSON-1333002444 tempest-FlavorsV261TestJSON-1333002444-project] 10.222.0.36 "GET /compute/v2.1/flavors/1255467212" status: 200 len: 468 microversion: 2.61 time: 0.214929 Oct 25 03:01:35.723296 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 138/333] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Oct 25 03:01:35 2022] GET /compute/v2.1/flavors/1255467212 => generated 468 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:36.145651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:36.156323 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e7522f04-9acd-438a-bf25-7124e0de4fa7 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1319 microversion: 2.1 time: 0.722117 Oct 25 03:01:36.159635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 196/334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:35 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:36.176121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d42bbd9-0664-4464-bb61-df916879ae11 tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] Action: 'update', calling method: .version_select at 0x7efd393f5b80>, body: {"flavor": {"description": "new"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:36.301931 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d42bbd9-0664-4464-bb61-df916879ae11 tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/1255467212" status: 200 len: 469 microversion: 2.61 time: 0.140569 Oct 25 03:01:36.302291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 197/335] 10.222.0.36 () {62 vars in 1219 bytes} [Tue Oct 25 03:01:36 2022] PUT /compute/v2.1/flavors/1255467212 => generated 469 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:36.308077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d52def4e-9465-4445-9eee-de97ad5a355b req-86ad00df-68e1-4e82-8cb3-ca19d8616622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c6eb87-b6da-475c-97c0-c5e9a437235e", "name": "network-vif-plugged", "status": "completed", "tag": "95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:36.326562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d52def4e-9465-4445-9eee-de97ad5a355b req-86ad00df-68e1-4e82-8cb3-ca19d8616622 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:36.327531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d52def4e-9465-4445-9eee-de97ad5a355b req-86ad00df-68e1-4e82-8cb3-ca19d8616622 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:36.328171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d52def4e-9465-4445-9eee-de97ad5a355b req-86ad00df-68e1-4e82-8cb3-ca19d8616622 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:36.359539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1401382290", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "27a0e5b3-962f-476d-8c4b-975eff19a490"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:36.387998 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d52def4e-9465-4445-9eee-de97ad5a355b req-86ad00df-68e1-4e82-8cb3-ca19d8616622 service nova] Creating event network-vif-plugged:95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f for instance a0c6eb87-b6da-475c-97c0-c5e9a437235e on n-h1-862355-1 Oct 25 03:01:36.396820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d52def4e-9465-4445-9eee-de97ad5a355b req-86ad00df-68e1-4e82-8cb3-ca19d8616622 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093127 Oct 25 03:01:36.398721 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 198/336] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:36.404741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7526f0c4-b733-4358-93e1-4e280e2c6381 tempest-FlavorsV261TestJSON-1333002444 tempest-FlavorsV261TestJSON-1333002444-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:36.481136 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7526f0c4-b733-4358-93e1-4e280e2c6381 tempest-FlavorsV261TestJSON-1333002444 tempest-FlavorsV261TestJSON-1333002444-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 7158 microversion: 2.61 time: 0.080424 Oct 25 03:01:36.481963 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 199/337] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:01:36 2022] GET /compute/v2.1/flavors/detail => generated 7158 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:36.509807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02558887-3a26-4492-a064-c6f51fc56d09 tempest-FlavorsV261TestJSON-1333002444 tempest-FlavorsV261TestJSON-1333002444-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:36.525163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] validate_networks() for [('27a0e5b3-962f-476d-8c4b-975eff19a490', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:01:36.542232 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02558887-3a26-4492-a064-c6f51fc56d09 tempest-FlavorsV261TestJSON-1333002444 tempest-FlavorsV261TestJSON-1333002444-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3685 microversion: 2.61 time: 0.036227 Oct 25 03:01:36.542839 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 200/338] 10.222.0.36 () {60 vars in 1166 bytes} [Tue Oct 25 03:01:36 2022] GET /compute/v2.1/flavors => generated 3685 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:36.565801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:36.567133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:36.573973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:36.574479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:36.574970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:36.575749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:36.576282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:36.577300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:37.026944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:37.039844 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60d7eab5-0007-463f-90a6-7451cd122ae0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 0.478167 Oct 25 03:01:37.056483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 201/339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:36 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:37.064466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66cd5413-39c3-429e-85fc-2ddc4be669c8 tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:37.107968 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66cd5413-39c3-429e-85fc-2ddc4be669c8 tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1255467212" status: 202 len: 0 microversion: 2.61 time: 0.050119 Oct 25 03:01:37.109019 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 202/340] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Oct 25 03:01:37 2022] DELETE /compute/v2.1/flavors/1255467212 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:01:37.117093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0e7abce-a300-412d-afd5-265e8b1db006 tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:37.174413 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0e7abce-a300-412d-afd5-265e8b1db006 tempest-FlavorsV261TestJSON-2039240424 tempest-FlavorsV261TestJSON-2039240424-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6699 microversion: 2.61 time: 0.061087 Oct 25 03:01:37.175457 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 203/341] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:01:37 2022] GET /compute/v2.1/flavors/detail => generated 6699 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:01:37.192573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:37.193351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:37.211916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:37.212736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:37.213387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:37.214773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:37.219908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:37.227249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:37.553144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:37.567677 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60b94854-96c5-4289-a2f3-8dbcb4f15104 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1319 microversion: 2.1 time: 0.381226 Oct 25 03:01:37.568408 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 204/342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:37 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:38.073993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-641418127", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "556aa2e1-58ce-4095-abc1-534bf5c730ca"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:38.099769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:01:38.100320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:01:38.101717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:01:38.102218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:01:38.102644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:01:38.116708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:38.119129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:38.119741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:38.122777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:38.123423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:38.124027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:38.161885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:01:38.169076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for user 54c1fabb546b47cea96d2d70b32f4c69 and project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:01:38.186263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:01:38.190321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:01:38.224187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] validate_networks() for [('556aa2e1-58ce-4095-abc1-534bf5c730ca', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:01:38.258312 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6f96253-1a6d-4d83-8388-ff94fa5ba5b0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.533069 Oct 25 03:01:38.259253 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 139/343] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2535 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:01:38.264303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:38.265105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:38.273623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:38.274412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:38.275039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:38.275903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:38.276516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:38.277488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:38.519290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:38.547950 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf432442-52a2-46c1-8fd4-78fbde7b4bd8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 0.287273 Oct 25 03:01:38.567205 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 140/344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:38 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:38.584767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db751e70-0e1c-4ea2-831b-9692215ef9d9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:38.586115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db751e70-0e1c-4ea2-831b-9692215ef9d9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:38.652635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db751e70-0e1c-4ea2-831b-9692215ef9d9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:38.660844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db751e70-0e1c-4ea2-831b-9692215ef9d9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:38.663526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db751e70-0e1c-4ea2-831b-9692215ef9d9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:38.665444 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db751e70-0e1c-4ea2-831b-9692215ef9d9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1262 microversion: 2.25 time: 0.096743 Oct 25 03:01:38.679595 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 141/345] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:38 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1262 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:38.777913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1020555491", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "9f081643-3b9b-4dc0-a846-58f41d0a3888"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:38.859351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] validate_networks() for [('9f081643-3b9b-4dc0-a846-58f41d0a3888', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:01:40.029160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:01:40.029649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:01:40.030193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:01:40.030677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:01:40.031157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:01:40.052776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.056085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.056723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:40.058938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.065602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.066224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:40.142087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Getting quotas for project 937ffe1b16784ebd93aa92adf851684f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:01:40.163649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Getting quotas for user ae8cc32663de4615874ea69d683dc8f6 and project 937ffe1b16784ebd93aa92adf851684f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:01:40.225692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:01:40.228174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:01:40.328929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:01:40.330978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:01:40.331466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:01:40.331887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:01:40.332322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:01:40.350014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.355989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.356498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:40.357291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.357785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.360345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:40.420290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:01:40.437421 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8b6316e-165c-4a98-8d6b-5edc3eb512e0 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.601785 Oct 25 03:01:40.438084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for user f7fc1bae87d741e58f4e2182796f2df3 and project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:01:40.442125 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 205/346] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:01:40.454451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:40.463664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:40.490378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.491190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.491846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:40.493343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.494082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.495086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:40.506433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:01:40.520169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:01:40.662088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8496594a-fd17-4d92-b4f2-3576d8fa71da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.981212 Oct 25 03:01:40.667391 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 142/347] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:01:40.682557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:40.683675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:40.709532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.710600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.711223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:40.719130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:40.720057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:40.721413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:41.047397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:41.065875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-70b989fd-8af6-41b7-b591-a473424cba5b tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1319 microversion: 2.1 time: 0.619877 Oct 25 03:01:41.066368 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 206/348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:40 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1319 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:41.077006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:41.083079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:41.101021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:41.102404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:41.103462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:41.106493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:41.107728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:41.122751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:41.254890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:41.263766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d3d1ddf-ceaf-41c6-84be-0dd826448c61 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 0.595092 Oct 25 03:01:41.265215 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 143/349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:40 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:41.270302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-302b69ea-a244-4ffa-b658-2e42d3b968dd req-6c21ae84-122c-4555-b0b5-d8111e411f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c98b2f1-4950-4f07-b4dc-23cc9f12beda", "name": "network-vif-plugged", "status": "completed", "tag": "d8d06f64-80bb-4036-89bb-ce9c8e323487"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:41.280709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-302b69ea-a244-4ffa-b658-2e42d3b968dd req-6c21ae84-122c-4555-b0b5-d8111e411f6c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:41.281431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-302b69ea-a244-4ffa-b658-2e42d3b968dd req-6c21ae84-122c-4555-b0b5-d8111e411f6c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:41.282048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-302b69ea-a244-4ffa-b658-2e42d3b968dd req-6c21ae84-122c-4555-b0b5-d8111e411f6c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:41.297262 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-302b69ea-a244-4ffa-b658-2e42d3b968dd req-6c21ae84-122c-4555-b0b5-d8111e411f6c service nova] Creating event network-vif-plugged:d8d06f64-80bb-4036-89bb-ce9c8e323487 for instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda on n-h1-862355-1 Oct 25 03:01:41.304158 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-302b69ea-a244-4ffa-b658-2e42d3b968dd req-6c21ae84-122c-4555-b0b5-d8111e411f6c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037546 Oct 25 03:01:41.305384 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 144/350] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:41.312734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f0e2f4b-0699-41fe-bef4-57ef378f94d8 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:41.334331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:41.341328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f0e2f4b-0699-41fe-bef4-57ef378f94d8 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:41.357177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:41.369590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:41.373143 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08b25f46-0dc9-4de9-8c36-6b9a7fc00951 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1320 microversion: 2.25 time: 0.304139 Oct 25 03:01:41.376144 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 207/351] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:41 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:41.389393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73ce6107-1b6e-4d04-a9fc-60f62f45d2ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:41.390460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73ce6107-1b6e-4d04-a9fc-60f62f45d2ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:41.514274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f0e2f4b-0699-41fe-bef4-57ef378f94d8 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:41.524333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f0e2f4b-0699-41fe-bef4-57ef378f94d8 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1231 microversion: 2.1 time: 0.217417 Oct 25 03:01:41.524932 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 145/352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:41 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1231 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:41.562288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73ce6107-1b6e-4d04-a9fc-60f62f45d2ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:41.572546 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73ce6107-1b6e-4d04-a9fc-60f62f45d2ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1211 microversion: 2.1 time: 0.191981 Oct 25 03:01:41.573141 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 208/353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:41 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1211 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:42.092857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:42.093930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:42.115193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:42.116589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:42.117563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:42.125453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:42.127427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:42.128873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:42.291159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:42.292332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:42.310391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:42.310945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:42.311346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:42.314565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:42.315607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:42.318529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:42.409887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:42.838153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:42.854142 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b57e2348-ca07-49a6-83f5-d6bd61a9b19c tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1319 microversion: 2.1 time: 0.765390 Oct 25 03:01:42.856500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 146/354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:42 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:42.871650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:42.874532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:42.887414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:42.889517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:42.891202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:42.892894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:42.894625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:42.895371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.152236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:43.156374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:43.162443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:43.172829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:43.176354 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-897019e3-0f57-4567-80ef-ab583333468b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1362 microversion: 2.25 time: 0.316086 Oct 25 03:01:43.180313 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 147/355] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:42 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:43.191477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:43.192396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:43.214060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:43.214879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:43.215755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.216640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:43.217328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:43.217933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.343114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:43.358012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6de42aac-3943-4fcc-96fe-1dffceaaf7b9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1227 microversion: 2.1 time: 0.171957 Oct 25 03:01:43.358986 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 148/356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:43 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1227 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:43.373329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:43.374361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:43.387695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:43.401905 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9ac3d34-f2e3-493e-8076-94e37f07f25a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1314 microversion: 2.1 time: 1.114657 Oct 25 03:01:43.402697 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 209/357] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:42 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1314 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:43.406161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:43.406994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:43.409375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.410323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:43.410932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:43.411505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.631856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:43.641297 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f3c15cb6-fd6f-4c9a-84c4-67fa0a35630e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1271 microversion: 2.1 time: 0.281157 Oct 25 03:01:43.651637 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 149/358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:43 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:43.859067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1f1614e4-8449-410e-a9d1-00cf71e002c6 req-0e6a1686-cfdc-4dec-b0ea-c8a7770516a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25417c1-0e9a-4e69-8a05-b1e1b033ff37", "name": "network-vif-plugged", "status": "completed", "tag": "ef3b0ef3-b210-47ed-b863-30bee415e227"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:43.885955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1f1614e4-8449-410e-a9d1-00cf71e002c6 req-0e6a1686-cfdc-4dec-b0ea-c8a7770516a3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:43.886433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1f1614e4-8449-410e-a9d1-00cf71e002c6 req-0e6a1686-cfdc-4dec-b0ea-c8a7770516a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:43.886862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1f1614e4-8449-410e-a9d1-00cf71e002c6 req-0e6a1686-cfdc-4dec-b0ea-c8a7770516a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.927738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:43.929314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:43.929828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:43.930311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.931056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:43.931517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:43.931944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:43.936274 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1f1614e4-8449-410e-a9d1-00cf71e002c6 req-0e6a1686-cfdc-4dec-b0ea-c8a7770516a3 service nova] Creating event network-vif-plugged:ef3b0ef3-b210-47ed-b863-30bee415e227 for instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 on n-h2-862355-1 Oct 25 03:01:43.952742 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1f1614e4-8449-410e-a9d1-00cf71e002c6 req-0e6a1686-cfdc-4dec-b0ea-c8a7770516a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097562 Oct 25 03:01:43.957135 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 150/359] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:43.969095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:43.981469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:44.000367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.002257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.004319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.008108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.009045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.011265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.022199 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb6b7172-e1b8-4abb-9e40-56d826036150 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.618076 Oct 25 03:01:44.028905 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 210/360] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 25 03:01:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:01:44.042913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:44.051176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.051679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.054667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.055008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.055481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.055919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.143767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-187426d5-8e07-46e4-ad04-12a79cb322c4 tempest-AZAdminV2TestJSON-233703546 tempest-AZAdminV2TestJSON-233703546-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.104460 Oct 25 03:01:44.144582 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 211/361] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 25 03:01:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:44.206269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:44.207313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:44.228524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.232345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.234186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.235142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.240406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.241068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.700143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:44.721291 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19050ae5-55e3-4246-a4a8-d829a00c9938 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1319 microversion: 2.1 time: 0.759904 Oct 25 03:01:44.726124 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 151/362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:43 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:44.746097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:44.747139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:44.763964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.764698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.767641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.768603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:44.770979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:44.774319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:44.975917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:44.990813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87427029-e2a0-4c1d-bd67-33a8b70c9377 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1289 microversion: 2.1 time: 0.263386 Oct 25 03:01:44.998613 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 152/363] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:44 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1289 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:45.019015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:45.026351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:45.039660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:45.040161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:45.040600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:45.042748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:45.043242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:45.043732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:45.409028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:45.424935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:45.426417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:45.427578 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2393f4ce-d43f-4703-b2d7-9b9e2eb22be2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1362 microversion: 2.25 time: 1.227189 Oct 25 03:01:45.437554 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 212/364] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:44 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1362 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:01:45.462585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:45.463485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:45.480489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:45.488443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:45.489218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:45.490863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:45.492487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:45.494396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.162537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:46.177702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f55f8280-8d8f-443d-8ea4-c3d926aadf59 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1311 microversion: 2.1 time: 0.729709 Oct 25 03:01:46.178356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 213/365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:45 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1311 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:46.536604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Calling method '.version_select at 0x7efd38054940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:46.540016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.540859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.541565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.584108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.584797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.585243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.606703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.607562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.608372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.615897 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9f7f24b-befc-4ec9-a753-1c4121a5d093 tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.436339 Oct 25 03:01:46.622903 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 214/366] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:01:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:46.628735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:46.629615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:46.636883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:46.639042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.639888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.640640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.641765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.643235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.643922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.673442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:46.694201 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-841f52f3-8f24-42d8-9b01-2d5a7aa197f8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1464 microversion: 2.1 time: 1.690500 Oct 25 03:01:46.698088 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 153/367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:44 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1464 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:46.718099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-971b1871-ba6f-4dd2-9f10-ba5132c9b20f req-d833a81e-ec11-46e2-adf1-2cdb657f81ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c0d5f2-d314-4e8d-af27-cc6ef9cb3118", "tag": "d0a4f158-13c2-4754-9042-8eb43f5c1347"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:46.746566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-971b1871-ba6f-4dd2-9f10-ba5132c9b20f req-d833a81e-ec11-46e2-adf1-2cdb657f81ba service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.747161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-971b1871-ba6f-4dd2-9f10-ba5132c9b20f req-d833a81e-ec11-46e2-adf1-2cdb657f81ba service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.747765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-971b1871-ba6f-4dd2-9f10-ba5132c9b20f req-d833a81e-ec11-46e2-adf1-2cdb657f81ba service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.774067 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-971b1871-ba6f-4dd2-9f10-ba5132c9b20f req-d833a81e-ec11-46e2-adf1-2cdb657f81ba service nova] Creating event network-changed:d0a4f158-13c2-4754-9042-8eb43f5c1347 for instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 on n-h2-862355-1 Oct 25 03:01:46.784698 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-971b1871-ba6f-4dd2-9f10-ba5132c9b20f req-d833a81e-ec11-46e2-adf1-2cdb657f81ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083248 Oct 25 03:01:46.789291 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 154/368] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:46.805446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:46.812248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:46.827149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.827843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.828448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:46.832765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:46.833479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:46.837193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.206783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:47.215871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:47.233848 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63001fd8-d634-46a0-9433-ef737712acf7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.440285 Oct 25 03:01:47.239265 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-900931d4-95dc-4145-bc34-26611b62c86a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1469 microversion: 2.1 time: 0.614935 Oct 25 03:01:47.239871 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 215/369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:46 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1469 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:47.245452 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 155/370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:46 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:47.259042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Calling method '.version_select at 0x7efd33ff1d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:47.261915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.262549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.263003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.276445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:47.277939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:47.278217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.279048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.279650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.287204 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ffb907b-f67a-43f4-a75f-6c6b39ddda3b tempest-HypervisorAdminV228Test-739240164 tempest-HypervisorAdminV228Test-739240164-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.040407 Oct 25 03:01:47.288317 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 156/371] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 25 03:01:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:47.293543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:47.294346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:47.305621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.307870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.308416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.311424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.312963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.313516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.319354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.320644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.321257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.323946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.325661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.326609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.653352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:47.663929 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77cf8ff1-be54-44e6-b519-509420d67c77 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1463 microversion: 2.1 time: 0.374117 Oct 25 03:01:47.679333 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 157/372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:47 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1463 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:47.696953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2e6106df-c714-4b2a-a8ce-4da5f6c9bae1 req-954af178-b6af-4fd5-b13d-de12723e9dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55448dc-6c7b-4106-80ee-65b05ae56e71", "tag": "4e4aba84-66fb-484c-b7b8-0863d6075f02"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:47.712699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2e6106df-c714-4b2a-a8ce-4da5f6c9bae1 req-954af178-b6af-4fd5-b13d-de12723e9dbc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.714247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2e6106df-c714-4b2a-a8ce-4da5f6c9bae1 req-954af178-b6af-4fd5-b13d-de12723e9dbc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.714994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2e6106df-c714-4b2a-a8ce-4da5f6c9bae1 req-954af178-b6af-4fd5-b13d-de12723e9dbc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.729450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2e6106df-c714-4b2a-a8ce-4da5f6c9bae1 req-954af178-b6af-4fd5-b13d-de12723e9dbc service nova] Creating event network-changed:4e4aba84-66fb-484c-b7b8-0863d6075f02 for instance e55448dc-6c7b-4106-80ee-65b05ae56e71 on n-h1-862355-1 Oct 25 03:01:47.735540 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2e6106df-c714-4b2a-a8ce-4da5f6c9bae1 req-954af178-b6af-4fd5-b13d-de12723e9dbc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054355 Oct 25 03:01:47.738450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 158/373] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:47.745352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:47.746286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:47.753664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.754914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.755501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.756484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.757083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.757704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.829393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:47.842790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:47.850636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:47.851702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97ccb20c-4056-4d4f-8a34-5428d34c5147 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1362 microversion: 2.25 time: 0.606933 Oct 25 03:01:47.853367 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 216/374] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:47 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:47.860668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:47.865141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:47.880243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.880908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.882231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:47.883224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:47.883837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:47.884995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.075537 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e565b74e-44ca-4338-85aa-a4dff17c171a tempest-DeleteServersAdminTestJSON-1861045513 tempest-DeleteServersAdminTestJSON-1861045513-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37/action" status: 202 len: 0 microversion: 2.1 time: 0.218000 Oct 25 03:01:48.076419 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 217/375] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:01:47 2022] POST /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:01:48.097861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-260367467", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a0c6eb87-b6da-475c-97c0-c5e9a437235e"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:48.108237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:48.119944 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-137ec573-dc52-462f-9896-d63b968f865d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1311 microversion: 2.1 time: 0.380121 Oct 25 03:01:48.121954 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 159/376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:47 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1311 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:48.127419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:48.128196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:48.135849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.136588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.137168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.138193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.138772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.139609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.199983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:01:48.204062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.205164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.206049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.207190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lazy-loading 'fault' on Instance uuid a25417c1-0e9a-4e69-8a05-b1e1b033ff37 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:48.389017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:48.398238 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-489e8da4-a4f4-4312-9563-a4dd64e2ff87 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1452 microversion: 2.1 time: 0.274915 Oct 25 03:01:48.399028 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 160/377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:48 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1452 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:48.404542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:48.405314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:48.412414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:48.414547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.415324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.416222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.416941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.417401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.417860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.653117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:48.663686 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d714fca6-a3d4-4570-a048-e389ae5591fb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.262447 Oct 25 03:01:48.674815 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 161/378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:48 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:48.686212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:48.686887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:48.694420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.695341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.695783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.696836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.697323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.697806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.738057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:01:48.758160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:01:48.758812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:01:48.761268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:01:48.762353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:01:48.763024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:01:48.796530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.796530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.796765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.800744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.808835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.809381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.851739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Getting quotas for project dadc2c982cfd41c695952d8d54ecf314. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:01:48.874385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Getting quotas for user 690d08aa8d2a4ee2b5da985308ee130c and project dadc2c982cfd41c695952d8d54ecf314. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:01:48.893500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:01:48.895608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:01:48.940493 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09801dee-76bd-46c4-93f1-6acb79c773e2 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 204 len: 0 microversion: 2.1 time: 0.263191 Oct 25 03:01:48.946082 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 162/379] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:01:48 2022] DELETE /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:01:48.953651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f9d7ce41-efdc-460b-a5d4-70f2b2dcd226 req-56a8e4c5-09f1-4872-9872-03961fdfc16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db2114dd-7e3f-4719-a724-9a7d3d4ab926", "tag": "121bf50c-ad19-4ac2-8161-5917548e5033"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:48.965666 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03cc4090-b7b1-40b2-805b-f248212e4fe7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875554 Oct 25 03:01:48.970129 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 218/380] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:01:48.979718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f9d7ce41-efdc-460b-a5d4-70f2b2dcd226 req-56a8e4c5-09f1-4872-9872-03961fdfc16d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:48.980208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f9d7ce41-efdc-460b-a5d4-70f2b2dcd226 req-56a8e4c5-09f1-4872-9872-03961fdfc16d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:48.980626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f9d7ce41-efdc-460b-a5d4-70f2b2dcd226 req-56a8e4c5-09f1-4872-9872-03961fdfc16d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:48.984487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:48.985929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:49.001477 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f9d7ce41-efdc-460b-a5d4-70f2b2dcd226 req-56a8e4c5-09f1-4872-9872-03961fdfc16d service nova] Creating event network-changed:121bf50c-ad19-4ac2-8161-5917548e5033 for instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 on n-h1-862355-1 Oct 25 03:01:49.008857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f9d7ce41-efdc-460b-a5d4-70f2b2dcd226 req-56a8e4c5-09f1-4872-9872-03961fdfc16d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059608 Oct 25 03:01:49.009796 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 163/381] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:49.012855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.013706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.014180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.015512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.015512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.016134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.021115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:49.022065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:49.028642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.029354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.030035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.030949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.031631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.032284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.077577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.078820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.079470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.080345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lazy-loading 'fault' on Instance uuid a25417c1-0e9a-4e69-8a05-b1e1b033ff37 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:49.385624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:49.394409 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b8a4099-5270-44bd-b010-6d5c57150806 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1458 microversion: 2.1 time: 0.383255 Oct 25 03:01:49.399510 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 164/382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:49 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1458 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:49.414784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97eddf16-cc99-4e56-a91a-bf0127c75dd9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:49.415579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-97eddf16-cc99-4e56-a91a-bf0127c75dd9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:49.590104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-97eddf16-cc99-4e56-a91a-bf0127c75dd9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:49.605714 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97eddf16-cc99-4e56-a91a-bf0127c75dd9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1213 microversion: 2.1 time: 0.204998 Oct 25 03:01:49.607579 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 165/383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:49 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:49.640648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:49.645242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:49.664135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.667791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.668463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.670098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.670801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.671387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.680613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:49.868555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:49.891008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:49.896850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:49.900446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c3ae023-d71b-4545-af7c-b682302a0e65 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1362 microversion: 2.25 time: 0.927993 Oct 25 03:01:49.903777 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 219/384] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:48 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1362 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:49.917866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:49.921668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:49.938497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.938948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.940182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:49.940943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:49.941418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:49.942399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:50.286398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:50.301129 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7973bd76-8abc-47af-9fa8-03ac31c19b36 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.392504 Oct 25 03:01:50.304641 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 220/385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:49 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:50.390175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:50.423131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:50.424906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:50.441443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:50.443751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:50.444229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:50.446329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:50.447451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:50.447908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:50.517429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:50.518188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:50.518806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:50.519559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lazy-loading 'fault' on Instance uuid a25417c1-0e9a-4e69-8a05-b1e1b033ff37 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:50.537764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:50.552792 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-25734a3a-90d8-4dda-8b82-d48778ee0cfe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1311 microversion: 2.1 time: 0.924259 Oct 25 03:01:50.556933 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 166/386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:49 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1311 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:50.698267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:50.711475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4036a638-a95f-4dbe-aa28-0310a78468f0 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1458 microversion: 2.1 time: 0.294998 Oct 25 03:01:50.713982 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 221/387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:50 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1458 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:50.718897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:50.720106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:50.734733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:50.738543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:50.739209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:50.740435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:50.741057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:50.741844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:50.770901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d3e7ad4d-d8bc-4cf1-a770-92d754f14cb9 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1747892703", "id": 211477076, "os-flavor-access:is_public": "False"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:50.808038 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d3e7ad4d-d8bc-4cf1-a770-92d754f14cb9 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.219043 Oct 25 03:01:50.820362 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 167/388] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:50 2022] POST /compute/v2.1/flavors => generated 428 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:01:50.833988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfa68e95-ee62-46e1-bc13-32c40c49a3a2 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "abd4b4ab4e6c49fd9741b52d482d0801"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:50.854376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:50.869859 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-af26d9aa-96fd-4383-9716-e88b7c98ae36 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1265 microversion: 2.1 time: 0.154047 Oct 25 03:01:50.871190 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 222/389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:50 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:50.920867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfa68e95-ee62-46e1-bc13-32c40c49a3a2 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/211477076/action" status: 200 len: 96 microversion: 2.1 time: 0.091557 Oct 25 03:01:50.921505 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 168/390] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 25 03:01:50 2022] POST /compute/v2.1/flavors/211477076/action => generated 96 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:01:50.944362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:50.946147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:50.960079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:50.961208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:50.963694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:50.965103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:50.967076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:50.967625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.278437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:51.293156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:51.295828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:51.300705 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54bad4fd-9cdd-4b87-9a90-1441844bae0b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1362 microversion: 2.25 time: 0.371549 Oct 25 03:01:51.305805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 169/391] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:50 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:51.336670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:51.337709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:51.347321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:51.360455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:51.362319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.366650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:51.368299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:51.369110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.384534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ec564fb-4475-436f-baae-855d771dc206 tempest-FlavorsAccessTestJSON-225577450 tempest-FlavorsAccessTestJSON-225577450-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:51.451008 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ec564fb-4475-436f-baae-855d771dc206 tempest-FlavorsAccessTestJSON-225577450 tempest-FlavorsAccessTestJSON-225577450-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6237 microversion: 2.1 time: 0.521955 Oct 25 03:01:51.464168 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 223/392] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:01:50 2022] GET /compute/v2.1/flavors/detail => generated 6237 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:51.479289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9472559d-3f2e-4a07-a7fe-4dd538863364 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "abd4b4ab4e6c49fd9741b52d482d0801"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:51.687418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:51.702169 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f47350c-a7dd-4daf-a434-a430a2034f0f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.369028 Oct 25 03:01:51.707078 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 170/393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:51 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:51.714648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:51.718471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:51.734687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:51.739816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:51.740464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.741497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:51.743564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:51.746151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.895512 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9472559d-3f2e-4a07-a7fe-4dd538863364 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/211477076/action" status: 200 len: 21 microversion: 2.1 time: 0.423081 Oct 25 03:01:51.899693 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 224/394] 10.222.0.36 () {60 vars in 1197 bytes} [Tue Oct 25 03:01:51 2022] POST /compute/v2.1/flavors/211477076/action => generated 21 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:01:51.911340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:51.915495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:51.925642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:51.926627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:51.927356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.928463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:51.929216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:51.929822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.979262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:51.983905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:51.984583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:51.985159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:51.985813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lazy-loading 'fault' on Instance uuid a25417c1-0e9a-4e69-8a05-b1e1b033ff37 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:51.991752 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-912a3f6b-f639-407c-b8fc-5189cdf4fd31 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1311 microversion: 2.1 time: 0.283255 Oct 25 03:01:51.992347 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 171/395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:51 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1311 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:52.019566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.020237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:52.029231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:52.029954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:52.030443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:52.031186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:52.031647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:52.032150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:52.104068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:52.112725 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00f61112-03a3-4f86-8b82-c7cdaa0b0b19 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1271 microversion: 2.1 time: 0.098049 Oct 25 03:01:52.113500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 172/396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:52 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:52.118274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36f07f3f-d34f-4b08-8994-dc8a68580877 tempest-FlavorsAccessTestJSON-225577450 tempest-FlavorsAccessTestJSON-225577450-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.152948 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36f07f3f-d34f-4b08-8994-dc8a68580877 tempest-FlavorsAccessTestJSON-225577450 tempest-FlavorsAccessTestJSON-225577450-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.038150 Oct 25 03:01:52.153890 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 173/397] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:01:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:52.173092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ea27aad-362b-4b22-bf34-05d2daf72957 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.193218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ea27aad-362b-4b22-bf34-05d2daf72957 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/211477076" status: 202 len: 0 microversion: 2.1 time: 0.023595 Oct 25 03:01:52.197498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 174/398] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:01:52 2022] DELETE /compute/v2.1/flavors/211477076 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:01:52.203311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66b80376-3372-47f6-9718-f2f5b6749c10 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.236015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66b80376-3372-47f6-9718-f2f5b6749c10 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.037349 Oct 25 03:01:52.237950 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 175/399] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:01:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:52.260372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b41e0252-be8c-40c0-8b29-66d1882b99f9 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-512485059", "id": 194287975, "os-flavor-access:is_public": "False"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:52.290465 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b41e0252-be8c-40c0-8b29-66d1882b99f9 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.032901 Oct 25 03:01:52.290465 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 176/400] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:01:52 2022] POST /compute/v2.1/flavors => generated 427 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:01:52.305848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef68a307-d5cc-4fd5-93f5-f03b93931b49 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.327501 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef68a307-d5cc-4fd5-93f5-f03b93931b49 tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/194287975/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.028262 Oct 25 03:01:52.328792 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 177/401] 10.222.0.36 () {58 vars in 1206 bytes} [Tue Oct 25 03:01:52 2022] GET /compute/v2.1/flavors/194287975/os-flavor-access => generated 21 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:01:52.334901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.336531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:52.344310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:52.345052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:52.346716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:52.347761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:52.348372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:52.348957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:52.421998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:52.433876 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91cf91c7-608e-4266-ab72-03b5df122033 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1458 microversion: 2.1 time: 0.532272 Oct 25 03:01:52.435778 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 225/402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:51 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1458 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:52.455968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c5bf3b5f-cecb-4182-a5a4-239c6eba930f tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.492187 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c5bf3b5f-cecb-4182-a5a4-239c6eba930f tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/194287975" status: 202 len: 0 microversion: 2.1 time: 0.054713 Oct 25 03:01:52.493737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 226/403] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:01:52 2022] DELETE /compute/v2.1/flavors/194287975 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:01:52.507558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-fc40dea5-b336-4164-a110-abaf21884a00 req-c0ebb04c-9d49-4392-b383-54269ad0bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c0d5f2-d314-4e8d-af27-cc6ef9cb3118", "name": "network-vif-plugged", "status": "completed", "tag": "d0a4f158-13c2-4754-9042-8eb43f5c1347"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:52.535919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fc40dea5-b336-4164-a110-abaf21884a00 req-c0ebb04c-9d49-4392-b383-54269ad0bca9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:52.536464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fc40dea5-b336-4164-a110-abaf21884a00 req-c0ebb04c-9d49-4392-b383-54269ad0bca9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:52.536982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fc40dea5-b336-4164-a110-abaf21884a00 req-c0ebb04c-9d49-4392-b383-54269ad0bca9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:52.558628 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-fc40dea5-b336-4164-a110-abaf21884a00 req-c0ebb04c-9d49-4392-b383-54269ad0bca9 service nova] Creating event network-vif-plugged:d0a4f158-13c2-4754-9042-8eb43f5c1347 for instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 on n-h2-862355-1 Oct 25 03:01:52.566973 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-fc40dea5-b336-4164-a110-abaf21884a00 req-c0ebb04c-9d49-4392-b383-54269ad0bca9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066127 Oct 25 03:01:52.567947 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 227/404] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:52.574829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-584c64ce-81b3-44c9-b5ef-4aaa77745b3c tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.610424 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-584c64ce-81b3-44c9-b5ef-4aaa77745b3c tempest-FlavorsAccessTestJSON-368926041 tempest-FlavorsAccessTestJSON-368926041-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.041152 Oct 25 03:01:52.615423 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 228/405] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:01:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:52.702420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:52.726927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:52.728761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:52.730120 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a1e5241-d4a7-448a-9121-e2d483710eef tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1362 microversion: 2.25 time: 0.400155 Oct 25 03:01:52.730593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:52.731645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:52.746408 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 178/406] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:52 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:52.746622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:52.746622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:52.748287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:52.754253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:52.757221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:52.758194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.016197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:53.016412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:53.024799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.025598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.026440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.027398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.028001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.028573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.312682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:53.321760 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee8b377d-8746-494f-ae76-2ebb278a0c18 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.595281 Oct 25 03:01:53.342696 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 229/407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:52 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:01:53.356174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:53.356847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:53.368283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.380758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.382298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.383704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.388506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.389327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.534523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:53.543572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a0b8695-b27e-4139-967a-8a150d108eb5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1311 microversion: 2.1 time: 0.531682 Oct 25 03:01:53.548331 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 179/408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:53 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1311 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:53.566492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-52446849-2741-4bfe-9ad5-edad701b2c67 req-5d703202-95f3-4107-99e6-4acd5fca2a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25417c1-0e9a-4e69-8a05-b1e1b033ff37", "name": "network-vif-deleted", "tag": "ef3b0ef3-b210-47ed-b863-30bee415e227"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:53.585062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52446849-2741-4bfe-9ad5-edad701b2c67 req-5d703202-95f3-4107-99e6-4acd5fca2a13 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.585712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52446849-2741-4bfe-9ad5-edad701b2c67 req-5d703202-95f3-4107-99e6-4acd5fca2a13 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.586332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52446849-2741-4bfe-9ad5-edad701b2c67 req-5d703202-95f3-4107-99e6-4acd5fca2a13 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.612813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-52446849-2741-4bfe-9ad5-edad701b2c67 req-5d703202-95f3-4107-99e6-4acd5fca2a13 service nova] Creating event network-vif-deleted:ef3b0ef3-b210-47ed-b863-30bee415e227 for instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 on n-h2-862355-1 Oct 25 03:01:53.622329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-52446849-2741-4bfe-9ad5-edad701b2c67 req-5d703202-95f3-4107-99e6-4acd5fca2a13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071649 Oct 25 03:01:53.623565 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 180/409] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:53.632967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:53.634042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:53.647234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.647985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.648671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.649587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.650325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.650858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.666800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:53.669717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:53.694283 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fcc99e86-1b3f-4df2-a2eb-2956835d5aa7 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1313 microversion: 2.1 time: 0.349943 Oct 25 03:01:53.695694 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 230/410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:53 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:53.716374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.717604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.718022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.719308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lazy-loading 'fault' on Instance uuid a25417c1-0e9a-4e69-8a05-b1e1b033ff37 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:53.760294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:53.761122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:53.772519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.773311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.774029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.774907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:53.775505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:53.776073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:53.797726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89a2cc21f1549c7b59b97757cc60c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b7b32bbcd4474b05101db46063770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:53.819124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-790d8a46-9cac-482d-a036-0d48b934d11a tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 200 len: 1309 microversion: 2.1 time: 0.192173 Oct 25 03:01:53.834072 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 181/411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:53 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:54.197730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:54.212796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:54.214618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:54.216330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b029b100-91d8-41e1-ac37-60458a9a47e2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1362 microversion: 2.25 time: 0.459985 Oct 25 03:01:54.236260 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 231/412] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:53 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:01:54.355081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:54.356124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:54.364555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:54.365380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:54.366076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:54.367182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:54.367881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:54.368604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:54.573738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:54.575225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:54.587828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:54.589660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:54.592147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:54.593152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:54.595367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:54.596122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:54.848683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:54.857449 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54b6380e-d3e9-4841-bd81-5842769aff6f tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.506878 Oct 25 03:01:54.858177 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 182/413] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:54 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:54.873558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-79dd8bd5-c3da-42d8-94b5-2e0430458ee7 req-d960e281-ba78-48f2-9e16-dbb126d10b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25417c1-0e9a-4e69-8a05-b1e1b033ff37", "name": "network-vif-unplugged", "status": "completed", "tag": "ef3b0ef3-b210-47ed-b863-30bee415e227"}, {"server_uuid": "e55448dc-6c7b-4106-80ee-65b05ae56e71", "name": "network-vif-plugged", "status": "completed", "tag": "4e4aba84-66fb-484c-b7b8-0863d6075f02"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:54.910369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-79dd8bd5-c3da-42d8-94b5-2e0430458ee7 req-d960e281-ba78-48f2-9e16-dbb126d10b1a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:54.913308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-79dd8bd5-c3da-42d8-94b5-2e0430458ee7 req-d960e281-ba78-48f2-9e16-dbb126d10b1a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:54.913954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-79dd8bd5-c3da-42d8-94b5-2e0430458ee7 req-d960e281-ba78-48f2-9e16-dbb126d10b1a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:54.954092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-79dd8bd5-c3da-42d8-94b5-2e0430458ee7 req-d960e281-ba78-48f2-9e16-dbb126d10b1a service nova] Creating event network-vif-unplugged:ef3b0ef3-b210-47ed-b863-30bee415e227 for instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 on n-h2-862355-1 Oct 25 03:01:54.957493 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-79dd8bd5-c3da-42d8-94b5-2e0430458ee7 req-d960e281-ba78-48f2-9e16-dbb126d10b1a service nova] Creating event network-vif-plugged:4e4aba84-66fb-484c-b7b8-0863d6075f02 for instance e55448dc-6c7b-4106-80ee-65b05ae56e71 on n-h1-862355-1 Oct 25 03:01:54.972263 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-79dd8bd5-c3da-42d8-94b5-2e0430458ee7 req-d960e281-ba78-48f2-9e16-dbb126d10b1a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.112924 Oct 25 03:01:54.974468 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 183/414] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:55.004398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.006409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.049156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.050528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.051038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.052290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.053171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.056015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.278777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:55.294167 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c1e542b-e831-4ac8-897d-bd11be7fb7f3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1311 microversion: 2.1 time: 0.724304 Oct 25 03:01:55.311380 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 232/415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:54 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1311 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:55.319430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.320325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.328761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.329317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.330737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.331644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.332112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.332723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.352870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] HTTP exception thrown: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Request method failure captured: Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 HTTP/1.1 Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FQr-2ho6m8UaRQfACs_1_3nBLWE7KYhVG8L8YKYC8yxM6zRvuX-ZAmufkRRYgz5nzVWUmZDoxpwKSlhYyJLqvqHhpHDhUTxsHyrj6W_kWFxHKsH5mjThBMFEa7y0t26rB9arcrnmIhU7EJIU85SrXyVNeqevmj1j5XcUEuMGR6ctU Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:01:55.354746 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_019b7b32bbcd4474b05101db46063770", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/019b7b32bbcd4474b05101db46063770"}]}] Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: b89a2cc21f1549c7b59b97757cc60c33 Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.356055 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'a25417c1-0e9a-4e69-8a05-b1e1b033ff37'} Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:55.356765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.357873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.359996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Returning 404 to user: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:55.359996 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5933bff4-c626-425a-acb8-66af92366e46 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 404 len: 111 microversion: 2.1 time: 0.042701 Oct 25 03:01:55.359996 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 233/416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:55 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:55.369634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.370869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.378933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.379940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.380648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.381667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.382355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.382973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.638940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:55.653143 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd4ab8b0-4057-44e2-93f6-5ba9a7426310 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1313 microversion: 2.1 time: 0.671758 Oct 25 03:01:55.654163 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 184/417] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:54 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:55.675277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.677981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.686776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.688104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.688943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.691862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.692653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.693613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.716354 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] HTTP exception thrown: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Request method failure captured: Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 HTTP/1.1 Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FQr-2ho6m8UaRQfACs_1_3nBLWE7KYhVG8L8YKYC8yxM6zRvuX-ZAmufkRRYgz5nzVWUmZDoxpwKSlhYyJLqvqHhpHDhUTxsHyrj6W_kWFxHKsH5mjThBMFEa7y0t26rB9arcrnmIhU7EJIU85SrXyVNeqevmj1j5XcUEuMGR6ctU Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:01:55.719654 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_019b7b32bbcd4474b05101db46063770", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/019b7b32bbcd4474b05101db46063770"}]}] Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: b89a2cc21f1549c7b59b97757cc60c33 Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.721833 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a25417c1-0e9a-4e69-8a05-b1e1b033ff37'} Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:55.722519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.723623 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.724698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Returning 404 to user: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:55.725432 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05e0f43f-19ff-47fa-9d9e-eae99e0f97a1 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 404 len: 111 microversion: 2.1 time: 0.070134 Oct 25 03:01:55.731232 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 185/418] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:01:55 2022] DELETE /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:55.738473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c1a90aad-5346-4e8b-bbb2-123e2b81042c req-541a2ee8-e97c-4830-91b2-a9bdcef4e80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836d890d-f96e-42cc-bc00-f54993eb0e2c", "tag": "f008a742-4315-456d-903b-76771148e899"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:55.757449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1a90aad-5346-4e8b-bbb2-123e2b81042c req-541a2ee8-e97c-4830-91b2-a9bdcef4e80e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.759787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1a90aad-5346-4e8b-bbb2-123e2b81042c req-541a2ee8-e97c-4830-91b2-a9bdcef4e80e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.760334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1a90aad-5346-4e8b-bbb2-123e2b81042c req-541a2ee8-e97c-4830-91b2-a9bdcef4e80e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.779323 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c1a90aad-5346-4e8b-bbb2-123e2b81042c req-541a2ee8-e97c-4830-91b2-a9bdcef4e80e service nova] Creating event network-changed:f008a742-4315-456d-903b-76771148e899 for instance 836d890d-f96e-42cc-bc00-f54993eb0e2c on n-h1-862355-1 Oct 25 03:01:55.794007 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c1a90aad-5346-4e8b-bbb2-123e2b81042c req-541a2ee8-e97c-4830-91b2-a9bdcef4e80e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064360 Oct 25 03:01:55.795118 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 186/419] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:55.803017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.803969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: a25417c1-0e9a-4e69-8a05-b1e1b033ff37] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.813546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.816008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.817208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.818576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.819184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.821886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.850676 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] HTTP exception thrown: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Request method failure captured: Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 HTTP/1.1 Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FQr-2ho6m8UaRQfACs_1_3nBLWE7KYhVG8L8YKYC8yxM6zRvuX-ZAmufkRRYgz5nzVWUmZDoxpwKSlhYyJLqvqHhpHDhUTxsHyrj6W_kWFxHKsH5mjThBMFEa7y0t26rB9arcrnmIhU7EJIU85SrXyVNeqevmj1j5XcUEuMGR6ctU Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:01:55.852669 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_019b7b32bbcd4474b05101db46063770", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/019b7b32bbcd4474b05101db46063770"}]}] Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: b89a2cc21f1549c7b59b97757cc60c33 Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.853969 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a25417c1-0e9a-4e69-8a05-b1e1b033ff37'} Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:55.854631 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. Oct 25 03:01:55.855694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.856655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Returning 404 to user: Instance a25417c1-0e9a-4e69-8a05-b1e1b033ff37 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:55.856655 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-478e9b8a-c60a-4157-bdc4-02b69d85f5cd tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37" status: 404 len: 111 microversion: 2.1 time: 0.056928 Oct 25 03:01:55.856655 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 187/420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:55 2022] GET /compute/v2.1/servers/a25417c1-0e9a-4e69-8a05-b1e1b033ff37 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:55.867484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.904460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.904460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.904460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.904460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.905513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.905513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.905513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.924090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:55.927396 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] HTTP exception thrown: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Request method failure captured: Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 HTTP/1.1 Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FQr-2ho6m8UaRQfACs_1_3nBLWE7KYhVG8L8YKYC8yxM6zRvuX-ZAmufkRRYgz5nzVWUmZDoxpwKSlhYyJLqvqHhpHDhUTxsHyrj6W_kWFxHKsH5mjThBMFEa7y0t26rB9arcrnmIhU7EJIU85SrXyVNeqevmj1j5XcUEuMGR6ctU Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:01:55.931270 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_019b7b32bbcd4474b05101db46063770", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/019b7b32bbcd4474b05101db46063770"}]}] Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: b89a2cc21f1549c7b59b97757cc60c33 Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:55.932617 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'bb69892a-0d6b-4648-a443-f2b5dd056069'} Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:55.933315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:55.937024 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:01:55.941236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Returning 404 to user: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:55.941236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f451092-ace4-43dc-9e31-9cf2b8c76363 tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 404 len: 111 microversion: 2.1 time: 0.073917 Oct 25 03:01:55.941236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 188/421] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:01:55 2022] DELETE /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:55.942370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:55.942370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:55.943521 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9fb5bd2-f71e-4946-832c-fd3a5859ec37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1558 microversion: 2.25 time: 0.585172 Oct 25 03:01:55.944066 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 234/422] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:55 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1558 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:55.953147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.953864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] [instance: bb69892a-0d6b-4648-a443-f2b5dd056069] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.955669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:55.956552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:55.974498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.974899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.975023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.975332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.975449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.975840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.976039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.976478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.976902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.977600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:55.978264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:55.978875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:55.997738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] HTTP exception thrown: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Request method failure captured: Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 HTTP/1.1 Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FQr-2ho6m8UaRQfACs_1_3nBLWE7KYhVG8L8YKYC8yxM6zRvuX-ZAmufkRRYgz5nzVWUmZDoxpwKSlhYyJLqvqHhpHDhUTxsHyrj6W_kWFxHKsH5mjThBMFEa7y0t26rB9arcrnmIhU7EJIU85SrXyVNeqevmj1j5XcUEuMGR6ctU Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:01:56.001025 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/019b7b32bbcd4474b05101db46063770"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_019b7b32bbcd4474b05101db46063770", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/019b7b32bbcd4474b05101db46063770"}]}] Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 019b7b32bbcd4474b05101db46063770 Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1228108010 Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: b89a2cc21f1549c7b59b97757cc60c33 Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersAdminTestJSON-1228108010-project Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:56.002897 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'bb69892a-0d6b-4648-a443-f2b5dd056069'} Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:01:56.003589 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. Oct 25 03:01:56.004676 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:01:56.007324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] Returning 404 to user: Instance bb69892a-0d6b-4648-a443-f2b5dd056069 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:01:56.008393 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc53d3cc-a045-46eb-bc11-6f510c85f0ed tempest-DeleteServersAdminTestJSON-1228108010 tempest-DeleteServersAdminTestJSON-1228108010-project] 10.222.0.36 "GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069" status: 404 len: 111 microversion: 2.1 time: 0.063016 Oct 25 03:01:56.013836 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 235/423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:55 2022] GET /compute/v2.1/servers/bb69892a-0d6b-4648-a443-f2b5dd056069 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:01:56.272124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:56.280524 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-69efd600-91fd-4b12-a283-9639b4d7db25 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.346253 Oct 25 03:01:56.287698 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 189/424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:55 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:56.324377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:56.325227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:56.334354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:56.335344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:56.335964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:56.337005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:56.337611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:56.338250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:56.374605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:56.375410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:56.383640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:56.399180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:56.399990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:56.402311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:56.404351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:56.405761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:56.869427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:56.888302 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-468fdfcf-7306-4689-8700-3c9d447e0fd3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1311 microversion: 2.1 time: 0.575609 Oct 25 03:01:56.889516 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 190/425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:56 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1311 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:56.901815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:56.902667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:56.916099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:56.916795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:56.917395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:56.918396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:56.918996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:56.919587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:56.988616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:57.097395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39d34c73-cd1b-4b8a-a2d9-8db5d76a489e tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 2051 microversion: 2.25 time: 1.081497 Oct 25 03:01:57.098840 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 236/426] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:56 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 2051 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:57.118280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:57.123316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:57.124885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:57.132042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.132940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.133544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.135237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.136843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.137597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.146951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc07d463-a043-4653-a995-daf2496d39aa tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1313 microversion: 2.1 time: 0.253349 Oct 25 03:01:57.148923 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 191/427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:56 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:57.160399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7eac3c00-4344-40ae-bfc9-4308173ca20e req-f0d64512-2e4d-4ab7-8f50-f16dc80be20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db2114dd-7e3f-4719-a724-9a7d3d4ab926", "name": "network-vif-plugged", "status": "completed", "tag": "121bf50c-ad19-4ac2-8161-5917548e5033"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:57.193033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7eac3c00-4344-40ae-bfc9-4308173ca20e req-f0d64512-2e4d-4ab7-8f50-f16dc80be20f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.193532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7eac3c00-4344-40ae-bfc9-4308173ca20e req-f0d64512-2e4d-4ab7-8f50-f16dc80be20f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.194025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7eac3c00-4344-40ae-bfc9-4308173ca20e req-f0d64512-2e4d-4ab7-8f50-f16dc80be20f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.224772 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7eac3c00-4344-40ae-bfc9-4308173ca20e req-f0d64512-2e4d-4ab7-8f50-f16dc80be20f service nova] Creating event network-vif-plugged:121bf50c-ad19-4ac2-8161-5917548e5033 for instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 on n-h1-862355-1 Oct 25 03:01:57.240237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7eac3c00-4344-40ae-bfc9-4308173ca20e req-f0d64512-2e4d-4ab7-8f50-f16dc80be20f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085138 Oct 25 03:01:57.240874 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 192/428] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:01:57.312301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:57.315501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:57.327307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.330620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.331988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.333474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.334828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.335803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.442423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:57.457581 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-604dfdbd-6ffe-49e1-ac1c-9655497d8006 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 2051 microversion: 2.25 time: 0.338130 Oct 25 03:01:57.474514 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 237/429] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:01:57 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 2051 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:01:57.487576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:57.496452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.499361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.501384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.503084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.505513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.506176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.585004 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b14ec0f7-89ef-4cba-85df-d83cfff0891c tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.104692 Oct 25 03:01:57.585630 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 238/430] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 25 03:01:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:01:57.599748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862355-1", "block_migration": "auto"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:01:57.602028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:57.609707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.610425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.611577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.612481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.613100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.613699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.703778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:57.717360 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff18bc96-0b0b-4cd8-ae31-c957861bd41b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.410545 Oct 25 03:01:57.721509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'flavor' on Instance uuid 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:01:57.729521 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 193/431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:57 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:57.791539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Going to try to live migrate instance to n-h1-862355-1 {{(pid=120563) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:01:57.922212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:57.924735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:57.950899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.954202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.954954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.957503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:57.959629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:57.961040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:57.973234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:58.241588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:58.249610 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b20c5504-072a-4f46-828c-ce16dcdf9e8e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1494 microversion: 2.1 time: 0.334233 Oct 25 03:01:58.267029 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 194/432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:57 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:58.271959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:58.272578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:58.282486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:58.283531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:58.283974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:58.284683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:58.285144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:58.285737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:58.498247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:58.512327 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b9f390d-f0cc-4c16-b912-313a0e1b9289 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1313 microversion: 2.1 time: 0.243013 Oct 25 03:01:58.514403 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 195/433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:58 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:58.888233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=14 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:59.141426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:59.142200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:59.157137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:59.157633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:59.165522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:59.166337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:59.166823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:59.167259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:59.535645 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e988634-6c8b-4d2d-9ea9-7791095ef43e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1645 microversion: 2.1 time: 1.017150 Oct 25 03:01:59.542490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 196/434] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:58 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1645 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:01:59.550587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:01:59.551597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:01:59.568988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:59.570954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:59.571382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:59.571817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:59.572535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:01:59.572991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:01:59.573417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:01:59.638268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=18 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:01:59.875462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:01:59.886124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c1f524c-a718-4457-857f-e22488ea1b43 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1331 microversion: 2.1 time: 0.340154 Oct 25 03:01:59.887940 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 197/435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:01:59 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1331 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:00.177096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Calling method '.version_select at 0x7efd3814e820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:00.179333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.180010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.180458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.222149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.222877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.223421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.235253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.235848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.236980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.243957 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8564233-28af-4192-97f0-a3b6828c5e94 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.354486 Oct 25 03:02:00.244656 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 198/436] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:01:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:00.249429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:00.250843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:00.258621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.259430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.260116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.261366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.262170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.262782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.623935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:00.636222 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba91644a-6c37-48ed-9d12-f03fdf57d9c0 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1313 microversion: 2.1 time: 0.390414 Oct 25 03:02:00.639608 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 199/437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:00 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:00.646619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:00.652281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:00.665168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.666752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.669494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.674824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.675748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.676095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.945647 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6b864850-3169-4f39-a1c3-12e3977bce6b tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1645 microversion: 2.1 time: 0.300315 Oct 25 03:02:00.946063 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 200/438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:00 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1645 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:00.954723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Calling method '.version_select at 0x7efd33f064c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:00.959389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.959997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.962191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:00.996967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:00.997463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:00.999093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.029592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.030409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.030838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.037871 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-449da809-5662-4038-b819-82f721bc3356 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h1-862355-1/servers" status: 200 len: 512 microversion: 2.1 time: 0.090730 Oct 25 03:02:01.048913 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 201/439] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Oct 25 03:02:00 2022] GET /compute/v2.1/os-hypervisors/n-h1-862355-1/servers => generated 512 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:01.056122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:01.056761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:01.067395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.067892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.068480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.069343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.069824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.070251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.279028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:01.290670 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d421d577-0244-45be-a6d1-3c28cbed7dcb tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1534 microversion: 2.1 time: 0.240100 Oct 25 03:02:01.291923 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 202/440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:01 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1534 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:01.297056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:01.302177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.303153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.303765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.304743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.305379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.306136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.355817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c8fbe14-0eb8-40df-9f57-4efd1a669b2e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062458 Oct 25 03:02:01.358857 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 203/441] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:02:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:01.361973 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0693c067-0088-4d6a-af45-0373ea393838 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118/action" status: 202 len: 0 microversion: 2.25 time: 3.765940 Oct 25 03:02:01.363445 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 239/442] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:01:57 2022] POST /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118/action => generated 0 bytes in 3769 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:02:01.368938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cdee45e5-ec8d-47f1-9a02-bcb159c26f70 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'create', calling method: .version_select at 0x7efd33c0bc10>, body: {"pool": "d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1"} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:01.381340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Calling method '.version_select at 0x7efd33ed7160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:01.383928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.384424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.384864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.402154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.403003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.403633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.416593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.417498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.418163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.427130 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-174a8b59-91b5-4f89-8ec1-418a885f1587 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054072 Oct 25 03:02:01.428279 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 204/443] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:02:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:01.438955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862355-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:01.442626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:01.449884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.450545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.451149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.451942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:01.452493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:01.453256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:01.617608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lazy-loading 'flavor' on Instance uuid e55448dc-6c7b-4106-80ee-65b05ae56e71 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:02:01.678162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Going to try to live migrate instance to n-h2-862355-1 {{(pid=120562) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:02:04.026830 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cdee45e5-ec8d-47f1-9a02-bcb159c26f70 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.662107 Oct 25 03:02:04.038958 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 240/444] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:02:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:04.045024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:04.046014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:04.055431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.056305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.057037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.058001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.058748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.059459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.329369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:04.346165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:04.348728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:04.350351 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d33ae90-6f88-4ba7-a1d7-b0febee90181 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1568 microversion: 2.25 time: 0.309890 Oct 25 03:02:04.370397 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 241/445] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:04 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1568 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:04.375104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Calling method '.version_select at 0x7efd33b7eee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:04.377501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.378096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.378702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.408663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.410227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.412607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.421451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fde74f9c-cb45-4c3a-b4af-281317db2788 tempest-HypervisorAdminUnderV252Test-465035118 tempest-HypervisorAdminUnderV252Test-465035118-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h1-862355-1/search" status: 200 len: 104 microversion: 2.1 time: 0.068881 Oct 25 03:02:04.431572 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 242/446] 10.222.0.36 () {58 vars in 1209 bytes} [Tue Oct 25 03:02:04 2022] GET /compute/v2.1/os-hypervisors/n-h1-862355-1/search => generated 104 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:04.438893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:04.439872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:04.451607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.452891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.454157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.455787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.457393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.458233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.637947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d445a28-f675-49a5-815d-7f9e8b58c741 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71/action" status: 202 len: 0 microversion: 2.1 time: 3.208332 Oct 25 03:02:04.640940 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 205/447] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:01 2022] POST /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71/action => generated 0 bytes in 3212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:04.731976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:04.747086 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-535af290-d2a7-4f69-a318-28371491b31b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1313 microversion: 2.1 time: 0.314087 Oct 25 03:02:04.747674 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 243/448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:04 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:04.758215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ca95836e-d5eb-4568-b6f7-20b165a94b2f req-edd4975a-acda-4bd5-8366-9a19e30f121b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836d890d-f96e-42cc-bc00-f54993eb0e2c", "name": "network-vif-plugged", "status": "completed", "tag": "f008a742-4315-456d-903b-76771148e899"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:04.777119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ca95836e-d5eb-4568-b6f7-20b165a94b2f req-edd4975a-acda-4bd5-8366-9a19e30f121b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.786346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ca95836e-d5eb-4568-b6f7-20b165a94b2f req-edd4975a-acda-4bd5-8366-9a19e30f121b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.786803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ca95836e-d5eb-4568-b6f7-20b165a94b2f req-edd4975a-acda-4bd5-8366-9a19e30f121b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.808534 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ca95836e-d5eb-4568-b6f7-20b165a94b2f req-edd4975a-acda-4bd5-8366-9a19e30f121b service nova] Creating event network-vif-plugged:f008a742-4315-456d-903b-76771148e899 for instance 836d890d-f96e-42cc-bc00-f54993eb0e2c on n-h1-862355-1 Oct 25 03:02:04.821087 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ca95836e-d5eb-4568-b6f7-20b165a94b2f req-edd4975a-acda-4bd5-8366-9a19e30f121b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072004 Oct 25 03:02:04.823401 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 244/449] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:04.851886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-46720f42-a0f4-4f9d-a843-2cfa9ae6ad53 req-9cdbe2f5-5f89-4723-bfec-cd5ae8618405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c0d5f2-d314-4e8d-af27-cc6ef9cb3118", "name": "network-vif-unplugged", "status": "completed", "tag": "d0a4f158-13c2-4754-9042-8eb43f5c1347"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:04.869565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3e4b615-3d71-4540-bd37-20927216bc2e tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-70890022", "id": 691610914, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:04.912542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-46720f42-a0f4-4f9d-a843-2cfa9ae6ad53 req-9cdbe2f5-5f89-4723-bfec-cd5ae8618405 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:04.914082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-46720f42-a0f4-4f9d-a843-2cfa9ae6ad53 req-9cdbe2f5-5f89-4723-bfec-cd5ae8618405 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:04.916404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-46720f42-a0f4-4f9d-a843-2cfa9ae6ad53 req-9cdbe2f5-5f89-4723-bfec-cd5ae8618405 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:04.953186 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3e4b615-3d71-4540-bd37-20927216bc2e tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.86 time: 0.306828 Oct 25 03:02:04.959145 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-46720f42-a0f4-4f9d-a843-2cfa9ae6ad53 req-9cdbe2f5-5f89-4723-bfec-cd5ae8618405 service nova] Creating event network-vif-unplugged:d0a4f158-13c2-4754-9042-8eb43f5c1347 for instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 on n-h2-862355-1 Oct 25 03:02:04.970169 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 206/450] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:02:04 2022] POST /compute/v2.1/flavors => generated 466 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:02:04.988862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'action', calling method: .version_select at 0x7efd392b0af0>, body: {"addFloatingIp": {"address": "172.25.3.64"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:04.991708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:04.993642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-46720f42-a0f4-4f9d-a843-2cfa9ae6ad53 req-9cdbe2f5-5f89-4723-bfec-cd5ae8618405 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168696 Oct 25 03:02:04.996489 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 245/451] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:05.007570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:05.010102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:05.010822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:05.011708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:05.012291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:05.015209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:05.015831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:05.016918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:05.032415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:05.040776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:05.041307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:05.043452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:05.043981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:05.044364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:05.164820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:02:05.165429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquired lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:02:05.975325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:05.987301 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8547686f-0419-4261-85b7-d80cf04920ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.988522 Oct 25 03:02:05.987901 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 246/452] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:04 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:06.003708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb068f90-5cfd-46b9-b6ed-7890ba85dd93 tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:06.335285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:06.370129 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb068f90-5cfd-46b9-b6ed-7890ba85dd93 tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/691610914/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.378531 Oct 25 03:02:06.371370 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 247/453] 10.222.0.36 () {62 vars in 1262 bytes} [Tue Oct 25 03:02:05 2022] POST /compute/v2.1/flavors/691610914/os-extra_specs => generated 62 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:06.384979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:06.387133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:06.405065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:06.409615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:06.410953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:06.413036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:06.414008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:06.414717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:06.961711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:06.978685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:06.980931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:06.984822 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cc6d1fe-7837-40cf-9dcc-d29a62f1ac88 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1568 microversion: 2.25 time: 0.609781 Oct 25 03:02:06.985156 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 248/454] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:06 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1568 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:07.000528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:07.004691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:07.018552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:07.019444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:07.020800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:07.023982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:07.024829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:07.025424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:07.518277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:07.712292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:07.729424 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-584bb1c2-8266-459a-8ac2-0f0a1e700b8e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1313 microversion: 2.1 time: 0.739476 Oct 25 03:02:07.730150 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 249/455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:06 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:07.740364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7eac2bc6-3a2b-4d9d-ab67-af4b610b6951 tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:07.787723 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7eac2bc6-3a2b-4d9d-ab67-af4b610b6951 tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/691610914" status: 202 len: 0 microversion: 2.86 time: 0.055883 Oct 25 03:02:07.788979 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 250/456] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Oct 25 03:02:07 2022] DELETE /compute/v2.1/flavors/691610914 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:02:07.798363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:07.799974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:07.814965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:07.816334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:07.818295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:07.819185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:07.820123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:07.822276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:07.860040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:08.193290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:08.211926 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6ded5758-2312-4020-baff-b5fe3980aa72 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.421497 Oct 25 03:02:08.214487 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 251/457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:07 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:08.223595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4d8c0fb9-bf60-421b-b955-a50d54eb6f69 req-7edde75c-a05f-43d5-842f-f61118db8437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c0d5f2-d314-4e8d-af27-cc6ef9cb3118", "tag": "d0a4f158-13c2-4754-9042-8eb43f5c1347"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:08.253410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d8c0fb9-bf60-421b-b955-a50d54eb6f69 req-7edde75c-a05f-43d5-842f-f61118db8437 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:08.256947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d8c0fb9-bf60-421b-b955-a50d54eb6f69 req-7edde75c-a05f-43d5-842f-f61118db8437 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:08.257553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d8c0fb9-bf60-421b-b955-a50d54eb6f69 req-7edde75c-a05f-43d5-842f-f61118db8437 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:08.277997 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4d8c0fb9-bf60-421b-b955-a50d54eb6f69 req-7edde75c-a05f-43d5-842f-f61118db8437 service nova] Creating event network-changed:d0a4f158-13c2-4754-9042-8eb43f5c1347 for instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 on n-h2-862355-1 Oct 25 03:02:08.292651 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4d8c0fb9-bf60-421b-b955-a50d54eb6f69 req-7edde75c-a05f-43d5-842f-f61118db8437 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076333 Oct 25 03:02:08.293401 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 252/458] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:08.338604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4eb3146-3ddd-4a14-a03f-b6fe82434b3e tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:08.380842 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4eb3146-3ddd-4a14-a03f-b6fe82434b3e tempest-FlavorMetadataValidation-1322776450 tempest-FlavorMetadataValidation-1322776450-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.084429 Oct 25 03:02:08.381763 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 253/459] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:02:08 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:08.398504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:08.399391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:08.409278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:08.410298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:08.411004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:08.412055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:08.412728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:08.413377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:09.029004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:09.039262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:09.044335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:09.045669 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b481540-2d7f-4cd7-b23c-7f2ca8cfd541 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1568 microversion: 2.25 time: 0.661033 Oct 25 03:02:09.048488 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 254/460] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:08 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1568 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:09.058882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:09.066360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:09.075573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:09.076152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:09.076673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:09.077462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:09.082328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:09.082890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:09.445905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Building network info cache for instance {{(pid=120562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:02:09.456234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:09.482473 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7314aae6-c8e1-4853-851e-acd8730e46a9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1463 microversion: 2.1 time: 0.427688 Oct 25 03:02:09.484480 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 255/461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:09 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1463 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:09.506444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:09.507830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:09.519124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:09.522936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:09.525968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:09.526874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:09.527465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:09.531041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:10.065823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:10.077636 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf47f9ba-388c-4965-b642-68df190ae88a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.583571 Oct 25 03:02:10.084050 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 256/462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:09 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:10.572041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:10.594835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Searching by: {'deleted': False, 'project_id': 'fdce6e52d1984791aadbca40b5fa35ac'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:10.613801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:10.617302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:10.620865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:10.622080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:10.624031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:10.624633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:10.924723 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6a272874-e573-4a67-9b51-386b47eb5147 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.837588 Oct 25 03:02:10.925057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 257/463] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:02:10 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:02:10.956901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-73b8aa40-ac70-4a58-ab21-b96c9e4fadac req-cf2fbf88-3e23-4d5b-93c2-bb5b42ebce32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db2114dd-7e3f-4719-a724-9a7d3d4ab926", "tag": "121bf50c-ad19-4ac2-8161-5917548e5033"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:10.977184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-73b8aa40-ac70-4a58-ab21-b96c9e4fadac req-cf2fbf88-3e23-4d5b-93c2-bb5b42ebce32 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:10.978513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-73b8aa40-ac70-4a58-ab21-b96c9e4fadac req-cf2fbf88-3e23-4d5b-93c2-bb5b42ebce32 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:10.979052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-73b8aa40-ac70-4a58-ab21-b96c9e4fadac req-cf2fbf88-3e23-4d5b-93c2-bb5b42ebce32 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:11.032781 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-73b8aa40-ac70-4a58-ab21-b96c9e4fadac req-cf2fbf88-3e23-4d5b-93c2-bb5b42ebce32 service nova] Creating event network-changed:121bf50c-ad19-4ac2-8161-5917548e5033 for instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 on n-h1-862355-1 Oct 25 03:02:11.045234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Updating instance_info_cache with network_info: [{"id": "121bf50c-ad19-4ac2-8161-5917548e5033", "address": "fa:16:3e:3d:4c:2e", "network": {"id": "556aa2e1-58ce-4095-abc1-534bf5c730ca", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-716151900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "937ffe1b16784ebd93aa92adf851684f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap121bf50c-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:02:11.055458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-73b8aa40-ac70-4a58-ab21-b96c9e4fadac req-cf2fbf88-3e23-4d5b-93c2-bb5b42ebce32 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107577 Oct 25 03:02:11.062583 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 258/464] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:11.074676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:11.076795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Releasing lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:02:11.078207 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4d565a53-5750-4558-b091-7d96e1a4c9a7 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action" status: 202 len: 0 microversion: 2.1 time: 6.105824 Oct 25 03:02:11.081597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:11.082968 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 207/465] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:04 2022] POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action => generated 0 bytes in 6112 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 25 03:02:11.099256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8576359f-5fd6-4b5a-aa3f-eb76872c2da5 req-71687796-0fd1-47ae-b4c9-cd63af2b7fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55448dc-6c7b-4106-80ee-65b05ae56e71", "name": "network-vif-unplugged", "status": "completed", "tag": "4e4aba84-66fb-484c-b7b8-0863d6075f02"}, {"name": "network-changed", "server_uuid": "e55448dc-6c7b-4106-80ee-65b05ae56e71", "tag": "4e4aba84-66fb-484c-b7b8-0863d6075f02"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:11.108143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:11.112664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:11.116662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:11.118836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:11.121999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:11.126142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:11.148038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8576359f-5fd6-4b5a-aa3f-eb76872c2da5 req-71687796-0fd1-47ae-b4c9-cd63af2b7fb3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:11.148347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8576359f-5fd6-4b5a-aa3f-eb76872c2da5 req-71687796-0fd1-47ae-b4c9-cd63af2b7fb3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:11.161505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8576359f-5fd6-4b5a-aa3f-eb76872c2da5 req-71687796-0fd1-47ae-b4c9-cd63af2b7fb3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:11.215852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8576359f-5fd6-4b5a-aa3f-eb76872c2da5 req-71687796-0fd1-47ae-b4c9-cd63af2b7fb3 service nova] Creating event network-vif-unplugged:4e4aba84-66fb-484c-b7b8-0863d6075f02 for instance e55448dc-6c7b-4106-80ee-65b05ae56e71 on n-h1-862355-1 Oct 25 03:02:11.216367 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8576359f-5fd6-4b5a-aa3f-eb76872c2da5 req-71687796-0fd1-47ae-b4c9-cd63af2b7fb3 service nova] Creating event network-changed:4e4aba84-66fb-484c-b7b8-0863d6075f02 for instance e55448dc-6c7b-4106-80ee-65b05ae56e71 on n-h1-862355-1 Oct 25 03:02:11.235196 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8576359f-5fd6-4b5a-aa3f-eb76872c2da5 req-71687796-0fd1-47ae-b4c9-cd63af2b7fb3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.150689 Oct 25 03:02:11.241784 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 208/466] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:11.255836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:11.268433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Searching by: {'deleted': False} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:11.276410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:11.276999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:11.277513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:11.278374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:11.278971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:11.279468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:11.458296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:02:11.669292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:11.727381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:11.729431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:11.730123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:11.803905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:11.820347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:11.821841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:11.823025 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9362aa06-d265-486a-ba7c-e4d9300921df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1568 microversion: 2.25 time: 0.759319 Oct 25 03:02:11.823611 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 259/467] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:11 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1568 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:11.835005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3870ee55-2724-46af-bd30-89fa69e9e2a9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'create', calling method: .version_select at 0x7efd33ace670>, body: {"pool": "d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1"} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:13.000251 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-306d8c0f-f345-407c-af4e-485838b2a86a tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11782 microversion: 2.1 time: 1.756987 Oct 25 03:02:13.001445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 209/468] 10.222.0.36 () {58 vars in 1171 bytes} [Tue Oct 25 03:02:11 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11782 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:02:13.036994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:13.037794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:13.051544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:13.052044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:13.054159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:13.057242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:13.059417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:13.060028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:13.449391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:13.493487 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4760c34c-b7ef-4e7d-ae2d-a0f8ad5a91e0 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.478132 Oct 25 03:02:13.501148 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 210/469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:13 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:13.815054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Calling method '.version_select at 0x7efd33e7aca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:13.818183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:13.818990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:13.819650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:13.849145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:13.850858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:13.851669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:13.913499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:13.915180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:13.915721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:13.934733 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5268273c-e341-42fd-b7a0-a0aec3add073 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.426959 Oct 25 03:02:13.944590 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 211/470] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:02:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:13.954447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:13.956740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:13.971026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:13.971542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:13.974263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:13.976172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:13.976710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:13.977173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:14.366960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:14.375704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:14.382497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:14.384287 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fb511232-c9b0-4eec-ba39-d697c7974077 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1568 microversion: 2.25 time: 0.444870 Oct 25 03:02:14.389448 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 212/471] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:13 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1568 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:14.412501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:14.435032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Searching by: {'deleted': False, 'project_id': 'fdce6e52d1984791aadbca40b5fa35ac'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:14.447699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:14.448194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:14.448631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:14.449358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:14.449851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:14.450279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:14.707226 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-326cb897-6cd5-41f6-8e7b-fab20e7a1195 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?tenant_id=dadc2c982cfd41c695952d8d54ecf314" status: 200 len: 15 microversion: 2.1 time: 0.314222 Oct 25 03:02:14.708441 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 213/472] 10.222.0.36 () {58 vars in 1231 bytes} [Tue Oct 25 03:02:14 2022] GET /compute/v2.1/servers/detail?tenant_id=dadc2c982cfd41c695952d8d54ecf314 => generated 15 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:02:15.068877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b59355a-4cff-4993-9bad-809cd6ff15ba tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Calling method '.version_select at 0x7efd33db6430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:15.071991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b59355a-4cff-4993-9bad-809cd6ff15ba tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '067a91405551400e8c15975aee15bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66c92355631466fb6c0a76550bdaf99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b59355a-4cff-4993-9bad-809cd6ff15ba tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Request method failure captured: Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-hypervisors/n-h1-862355-1/search HTTP/1.1 Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1GyNo5KfqHfFjeCLx9Cim_jHExsgy4YUKop0WScews5_K_bO0poYPiJRhO2-z9buTLiXWF8AI_vMw1K1iFpIZiDiLdapsT1uvjBIAfVziJjBe0yvIJwQHywlebzOLjuUAaJBgwKYaJrH4reTF87eMTthSY-Fi9hmO7xF2GVYSBaM-4 Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e66c92355631466fb6c0a76550bdaf99 Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1121187628 Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:15.074372 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e66c92355631466fb6c0a76550bdaf99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e66c92355631466fb6c0a76550bdaf99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e66c92355631466fb6c0a76550bdaf99", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e66c92355631466fb6c0a76550bdaf99"}]}] Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1121187628 Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e66c92355631466fb6c0a76550bdaf99 Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1121187628 Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 067a91405551400e8c15975aee15bbdf Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 25 03:02:15.076452 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'n-h1-862355-1'} Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:02:15.077191 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 25 03:02:15.078521 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:15.082308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b59355a-4cff-4993-9bad-809cd6ff15ba tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:15.092794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b59355a-4cff-4993-9bad-809cd6ff15ba tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h1-862355-1/search" status: 403 len: 117 microversion: 2.1 time: 0.382106 Oct 25 03:02:15.093550 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 214/473] 10.222.0.36 () {58 vars in 1209 bytes} [Tue Oct 25 03:02:14 2022] GET /compute/v2.1/os-hypervisors/n-h1-862355-1/search => generated 117 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:02:15.098990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:15.099992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:15.116127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:15.116940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:15.117499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:15.119424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:15.122804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:15.123391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:15.990808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:16.017335 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ac906e7-9d05-4ed9-b0db-5355278ed0fa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.922603 Oct 25 03:02:16.019804 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 215/474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:15 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:16.028049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:16.066790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Searching by: {'tenant_id': 'dadc2c982cfd41c695952d8d54ecf314', 'deleted': False} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:16.078962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.087470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.088178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:16.092150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.092806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.093403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:16.188363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:02:16.425586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.427874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.428561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:16.517411 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3870ee55-2724-46af-bd30-89fa69e9e2a9 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.691706 Oct 25 03:02:16.527204 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 260/475] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:02:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:16.543214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Calling method '.version_select at 0x7efd33b27b80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:16.551065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.552251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.554087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:16.584819 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Request method failure captured: Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1GzLSkIcIcKG30CJMjqxN7XgH8z2n0C3Pn3y4y7nuInKD8_wltVCWOAPTR1UVo5w6SjumALnYpp30Qmwu3FnvvZ5gFJi2Yq9naJXL2n9fpBKX8bK6q2Hnw3SZZMdwpdifxCJ--F7unrfyJ0_p_PEi3Vj4bf8G0Sp8loM8ZQtul5L74 Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 924a899c9af24072a402a0b8d87724ab Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1838752943 Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:02:16.587422 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/924a899c9af24072a402a0b8d87724ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/924a899c9af24072a402a0b8d87724ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_924a899c9af24072a402a0b8d87724ab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/924a899c9af24072a402a0b8d87724ab"}]}] Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1838752943 Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 924a899c9af24072a402a0b8d87724ab Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1838752943 Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4b57f7e3ebcf4999b8c253cbf879ff4e Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 25 03:02:16.588685 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:16.589456 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:16.590900 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:16.590900 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:16.590900 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:16.590900 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 25 03:02:16.590900 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:16.590900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:16.595287 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-22677244-f6fd-4205-9677-ba3f3ab98d49 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.066738 Oct 25 03:02:16.606173 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 261/476] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:02:16 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:02:16.618104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:16.621046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:16.630226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.631024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.632023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:16.634104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.634963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.635546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:16.954285 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c655fa26-44d4-4348-89a7-3ef437fc54cf tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=dadc2c982cfd41c695952d8d54ecf314" status: 200 len: 4826 microversion: 2.1 time: 0.933126 Oct 25 03:02:16.954900 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 216/477] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 25 03:02:16 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=dadc2c982cfd41c695952d8d54ecf314 => generated 4826 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:16.970636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.188"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:16.973516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:16.989434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.991077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.992344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:16.994204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:16.995306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:16.995911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.042126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:02:17.043777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquired lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:02:17.103885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:17.117269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:17.118752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:17.120396 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-598b2ae9-0bad-43c2-8e97-828180ec82c0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1558 microversion: 2.25 time: 0.512498 Oct 25 03:02:17.120516 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 262/478] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:16 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1558 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:17.124892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Calling method '.version_select at 0x7efd33b27dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:17.126779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.127504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.128129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.147250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.147779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.149062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.165081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.165570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.166046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.174171 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-305bdd83-3850-450c-a701-d98c9432bcb7 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052561 Oct 25 03:02:17.174876 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 263/479] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:17.343041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2f999b3-3be1-472d-93b2-294a13e81fb3 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:17.344426 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a2f999b3-3be1-472d-93b2-294a13e81fb3 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2f999b3-3be1-472d-93b2-294a13e81fb3 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417-project-admin] Request method failure captured: Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1G49BlwLKadtVIhaT8XiTbJZ-NNqY7wJAjMX8uYLXuCpL3Ww7SlPahLNFjaRbSM8Ea1YqdQKP59KCB4DhVZAUr3zWwFMMOr4XoDx0ecR5Rmi3mGyeHsu7vLHKDME_aGUMtPlvJhPL9pmATf3z_Z2F49ONtBhq0pRp3vAEaSp9e09FI Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b112407ab22b4bc09d15c1f3be530bb7 Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:02:17.354001 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b112407ab22b4bc09d15c1f3be530bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b112407ab22b4bc09d15c1f3be530bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b112407ab22b4bc09d15c1f3be530bb7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b112407ab22b4bc09d15c1f3be530bb7"}]}] Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b112407ab22b4bc09d15c1f3be530bb7 Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417-project-admin Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 35c5e7aa019b4fda885866a85d84bfc5 Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417-project-admin Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:02:17.355325 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid timestamp for date invalid_time Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'invalid_time'} Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:17.355998 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2f999b3-3be1-472d-93b2-294a13e81fb3 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:17.357124 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a2f999b3-3be1-472d-93b2-294a13e81fb3 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417 tempest-InstanceUsageAuditLogNegativeTestJSON-2118025417-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.179676 Oct 25 03:02:17.363878 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 264/480] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:02:17.372091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:17.382361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Searching by: {'tenant_id': 'fdce6e52d1984791aadbca40b5fa35ac', 'deleted': False} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:17.403535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.404526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.409733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.410897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.411571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.412165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.476497 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e858be2-7177-4990-b7f4-62932c448be9 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fdce6e52d1984791aadbca40b5fa35ac" status: 200 len: 15 microversion: 2.1 time: 0.110987 Oct 25 03:02:17.495343 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 265/481] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fdce6e52d1984791aadbca40b5fa35ac => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:02:17.514424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:17.515418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:17.541045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.543024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.547962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.549642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.550516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.551323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.734415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1.", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:02:17.735384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Releasing lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:02:17.737437 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1. Oct 25 03:02:17.737437 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-c1a5b1ff-e7c9-43fa-8454-44823644d657'] Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Request method failure captured: Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action HTTP/1.1 Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 46 Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1GRoaQLDOJKxf9WEJOIhVXYkM9oyFcp5kZeQIT7-jXRqOS8v-FJYtaal-W8PorO0ozH3xIv9vMJNrOaQ8MvO58zKodwLEUlTkh8q4UwheFdciJcuY_za1XJqsrSylrGWjmKmgpqXvUs7OJNhDCkzCmraHTbayKD9W_mBR0KyHLWRww Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:17.756430 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_937ffe1b16784ebd93aa92adf851684f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/937ffe1b16784ebd93aa92adf851684f"}]}] Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ae8cc32663de4615874ea69d683dc8f6 Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: {"addFloatingIp": {"address": "172.25.3.188"}} Oct 25 03:02:17.758010 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1. Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-c1a5b1ff-e7c9-43fa-8454-44823644d657'] Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'db2114dd-7e3f-4719-a724-9a7d3d4ab926', 'body': {'addFloatingIp': {'address': '172.25.3.188'}}} Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:02:17.758925 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:02:17.760903 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1. Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1a5b1ff-e7c9-43fa-8454-44823644d657'] Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1. Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1a5b1ff-e7c9-43fa-8454-44823644d657'] Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.762152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1. Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1a5b1ff-e7c9-43fa-8454-44823644d657'] Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.764265 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1. Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1a5b1ff-e7c9-43fa-8454-44823644d657'] Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Returning 400 to user: Cannot associate floating IP 172.25.3.188 (17b03004-053e-4498-b6cd-c4d2a8813284) with port 121bf50c-ad19-4ac2-8161-5917548e5033 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1. Oct 25 03:02:17.767386 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-c1a5b1ff-e7c9-43fa-8454-44823644d657'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:17.770018 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17d37eba-00ec-414f-8bd8-fff66ea8f249 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action" status: 400 len: 381 microversion: 2.1 time: 0.805954 Oct 25 03:02:17.770018 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 217/482] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:16 2022] POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action => generated 381 bytes in 808 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:02:17.778823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8e0ea9e-6d9d-4d28-8e7d-98d29bebc2a7 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '.version_select at 0x7efd33a41d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:17.787299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8e0ea9e-6d9d-4d28-8e7d-98d29bebc2a7 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:17.788137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8e0ea9e-6d9d-4d28-8e7d-98d29bebc2a7 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:17.789141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8e0ea9e-6d9d-4d28-8e7d-98d29bebc2a7 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:17.816008 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8e0ea9e-6d9d-4d28-8e7d-98d29bebc2a7 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1344 microversion: 2.25 time: 0.048176 Oct 25 03:02:17.817802 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 218/483] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/os-migrations => generated 1344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:17.842202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c75b314c-7488-4f65-9aec-a68284447f23 tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Calling method '.version_select at 0x7efd33a5a940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:17.845464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c75b314c-7488-4f65-9aec-a68284447f23 tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '067a91405551400e8c15975aee15bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66c92355631466fb6c0a76550bdaf99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c75b314c-7488-4f65-9aec-a68284447f23 tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Request method failure captured: Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1GyNo5KfqHfFjeCLx9Cim_jHExsgy4YUKop0WScews5_K_bO0poYPiJRhO2-z9buTLiXWF8AI_vMw1K1iFpIZiDiLdapsT1uvjBIAfVziJjBe0yvIJwQHywlebzOLjuUAaJBgwKYaJrH4reTF87eMTthSY-Fi9hmO7xF2GVYSBaM-4 Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e66c92355631466fb6c0a76550bdaf99 Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1121187628 Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:17.848162 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e66c92355631466fb6c0a76550bdaf99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e66c92355631466fb6c0a76550bdaf99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e66c92355631466fb6c0a76550bdaf99", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e66c92355631466fb6c0a76550bdaf99"}]}] Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1121187628 Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e66c92355631466fb6c0a76550bdaf99 Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1121187628 Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 067a91405551400e8c15975aee15bbdf Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 25 03:02:17.849524 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '1'} Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:02:17.850268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 25 03:02:17.851917 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:17.854592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c75b314c-7488-4f65-9aec-a68284447f23 tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:17.855728 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c75b314c-7488-4f65-9aec-a68284447f23 tempest-HypervisorAdminNegativeUnderV252Test-1121187628 tempest-HypervisorAdminNegativeUnderV252Test-1121187628-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.036527 Oct 25 03:02:17.856771 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 219/484] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:02:17.894107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:17.915711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82e54330-904f-42e2-a7de-03fcecfe4a02 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.416481 Oct 25 03:02:17.916914 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 266/485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:17.929320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e77b9b4-dbd1-4d47-bd58-53af64c9822f tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:17.939307 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e77b9b4-dbd1-4d47-bd58-53af64c9822f tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.016414 Oct 25 03:02:17.941084 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 267/486] 10.222.0.36 () {58 vars in 1189 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:02:17.958083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9eab3caf-072c-4244-9ed9-dcd1186c194a tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '.version_select at 0x7efd33b8f3a0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:18.044634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6c0e66e-0f08-4011-92b4-b300aefe4120 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:18.053240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6c0e66e-0f08-4011-92b4-b300aefe4120 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd5243168c8124e73956320b9e6391792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414f5ed176344b15b63a19701ea652af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6c0e66e-0f08-4011-92b4-b300aefe4120 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Request method failure captured: Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1G3HS_WFks5LdSFfe0oI3L0_Sbx_uNQApP-lZm2PSrNF-0zNJMpYzoFK4GNxHiMjEnCCdRj_HhkRsY0SAB7mGc16oeKLlO07M6WB4yXT4lxLfoSHAoWaNz8_DozsxfO7D2UZOfB4J4TYTN1G5j9EOg3iKWfw2CGEH0jQ-kbjexRZGk Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 414f5ed176344b15b63a19701ea652af Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:18.055139 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/414f5ed176344b15b63a19701ea652af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/414f5ed176344b15b63a19701ea652af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_414f5ed176344b15b63a19701ea652af", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/414f5ed176344b15b63a19701ea652af"}]}] Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 414f5ed176344b15b63a19701ea652af Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d5243168c8124e73956320b9e6391792 Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project Oct 25 03:02:18.056381 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:02:18.057087 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 25 03:02:18.058384 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.059566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6c0e66e-0f08-4011-92b4-b300aefe4120 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:18.059566 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6c0e66e-0f08-4011-92b4-b300aefe4120 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.198378 Oct 25 03:02:18.059566 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 220/487] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 25 03:02:17 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:02:18.074916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:18.075763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:18.082425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:18.083375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:18.083750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:18.084633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:18.085096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:18.085541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:18.343145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:02:18.453325 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3600df20-ec72-4a69-9331-81ed16ff6100 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 2051 microversion: 2.25 time: 0.379293 Oct 25 03:02:18.454092 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 221/488] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:18 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 2051 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:18.462726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Calling method '.version_select at 0x7efd33bcfc10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:18.465026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:18.473498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:18.490640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:18.506532 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] HTTP exception thrown: No hypervisor matching '9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7' could be found. Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Request method failure captured: Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-hypervisors/9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7/servers HTTP/1.1 Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1GzLSkIcIcKG30CJMjqxN7XgH8z2n0C3Pn3y4y7nuInKD8_wltVCWOAPTR1UVo5w6SjumALnYpp30Qmwu3FnvvZ5gFJi2Yq9naJXL2n9fpBKX8bK6q2Hnw3SZZMdwpdifxCJ--F7unrfyJ0_p_PEi3Vj4bf8G0Sp8loM8ZQtul5L74 Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 924a899c9af24072a402a0b8d87724ab Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1838752943 Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:02:18.508208 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/924a899c9af24072a402a0b8d87724ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/924a899c9af24072a402a0b8d87724ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_924a899c9af24072a402a0b8d87724ab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/924a899c9af24072a402a0b8d87724ab"}]}] Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1838752943 Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 924a899c9af24072a402a0b8d87724ab Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1838752943 Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 4b57f7e3ebcf4999b8c253cbf879ff4e Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: exception: No hypervisor matching '9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7' could be found. Oct 25 03:02:18.509742 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7'} Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7' could be found. Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.510597 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:18.512851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:18.512851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:18.512851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:18.512851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:18.512851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7' could be found. Oct 25 03:02:18.512851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.513850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] Returning 404 to user: No hypervisor matching '9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7' could be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:18.516121 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7c5bac9f-ad37-4c9b-9f9d-f36894638ff0 tempest-HypervisorAdminNegativeUnderV252Test-1838752943 tempest-HypervisorAdminNegativeUnderV252Test-1838752943-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7/servers" status: 404 len: 123 microversion: 2.1 time: 0.059726 Oct 25 03:02:18.516911 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 222/489] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 25 03:02:18 2022] GET /compute/v2.1/os-hypervisors/9006f516-f9f0-4ac6-b4e1-ffe8e5a411e7/servers => generated 123 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:02:18.533371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:18.536712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:18.546641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:18.547338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:18.548624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:18.549549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:18.550196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:18.551043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:18.756993 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d9e38f6-d434-471c-aba4-7d50e4065c6b tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action" status: 202 len: 0 microversion: 2.1 time: 0.227011 Oct 25 03:02:18.762350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 223/490] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:18 2022] POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:18.765939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-246e28d4-cfd9-4a1e-8303-5fddd1ed3a4d tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:18.772244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-246e28d4-cfd9-4a1e-8303-5fddd1ed3a4d tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd5243168c8124e73956320b9e6391792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414f5ed176344b15b63a19701ea652af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-246e28d4-cfd9-4a1e-8303-5fddd1ed3a4d tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Request method failure captured: Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-25%2003:02:18 HTTP/1.1 Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1G3HS_WFks5LdSFfe0oI3L0_Sbx_uNQApP-lZm2PSrNF-0zNJMpYzoFK4GNxHiMjEnCCdRj_HhkRsY0SAB7mGc16oeKLlO07M6WB4yXT4lxLfoSHAoWaNz8_DozsxfO7D2UZOfB4J4TYTN1G5j9EOg3iKWfw2CGEH0jQ-kbjexRZGk Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 414f5ed176344b15b63a19701ea652af Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:18.774816 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/414f5ed176344b15b63a19701ea652af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/414f5ed176344b15b63a19701ea652af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_414f5ed176344b15b63a19701ea652af", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/414f5ed176344b15b63a19701ea652af"}]}] Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 414f5ed176344b15b63a19701ea652af Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d5243168c8124e73956320b9e6391792 Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project Oct 25 03:02:18.776223 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2022-10-25 03:02:18'} Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:02:18.777036 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 25 03:02:18.778393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:18.779497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-246e28d4-cfd9-4a1e-8303-5fddd1ed3a4d tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:18.779497 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-246e28d4-cfd9-4a1e-8303-5fddd1ed3a4d tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552 tempest-InstanceUsageAuditLogNegativeTestJSON-1595809552-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-25 03:02:18" status: 403 len: 128 microversion: 2.1 time: 0.018263 Oct 25 03:02:18.779497 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 224/491] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:02:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-25%2003%3A02%3A18 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:02:18.782769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1179979046", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "27a0e5b3-962f-476d-8c4b-975eff19a490"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:18.926096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] validate_networks() for [('27a0e5b3-962f-476d-8c4b-975eff19a490', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:02:19.277459 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9eab3caf-072c-4244-9ed9-dcd1186c194a tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/17b03004-053e-4498-b6cd-c4d2a8813284" status: 202 len: 0 microversion: 2.1 time: 1.334910 Oct 25 03:02:19.278639 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 268/492] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:02:17 2022] DELETE /compute/v2.1/os-floating-ips/17b03004-053e-4498-b6cd-c4d2a8813284 => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:19.284989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:19.290457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:19.292401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:19.300353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.301226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.302166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:19.303342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.304256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.304881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:19.407798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:02:19.547096 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34179dd7-678a-4192-a836-6f61acd56ec8 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.267257 Oct 25 03:02:19.551056 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 269/493] 10.222.0.36 () {58 vars in 1150 bytes} [Tue Oct 25 03:02:19 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:19.560176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:19.561065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:19.570877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.571584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.572197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:19.573103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.573759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.574330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:19.762989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:02:19.764122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:02:19.764798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:02:19.765389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:02:19.766045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:02:19.778229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.779227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.779823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:19.780726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.782020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.782735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:19.791698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:19.800965 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ab0ca0c4-f522-4409-9b39-28c24c03c98c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.248701 Oct 25 03:02:19.809756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:19.815977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for user 54c1fabb546b47cea96d2d70b32f4c69 and project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:19.818172 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 270/494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:19 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:19.823659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'action', calling method: .version_select at 0x7efd392b0c10>, body: {"removeFloatingIp": {"address": "172.25.3.64"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:19.831465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:02:19.833975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:02:19.901993 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d89bb192-8244-4180-b306-c505f7b96de6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.123178 Oct 25 03:02:19.902631 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 225/495] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:02:19.915627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:19.918367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:19.930378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.931086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.931672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:19.932549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:19.933152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:19.934052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:20.043903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01bf5d2a-6dd0-484d-9f53-c4556f71c859 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action" status: 202 len: 0 microversion: 2.1 time: 0.139965 Oct 25 03:02:20.044967 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 226/496] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:19 2022] POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:20.052154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a2dfc91-95ae-43d9-bf0a-fd37d6343a94 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:20.052772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a2dfc91-95ae-43d9-bf0a-fd37d6343a94 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:20.131518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:20.137577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:20.138095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:20.138534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:20.139415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:20.139787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:20.140209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:20.229781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a2dfc91-95ae-43d9-bf0a-fd37d6343a94 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:20.238271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a2dfc91-95ae-43d9-bf0a-fd37d6343a94 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:20.244812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a2dfc91-95ae-43d9-bf0a-fd37d6343a94 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:20.249637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a2dfc91-95ae-43d9-bf0a-fd37d6343a94 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1262 microversion: 2.25 time: 0.203347 Oct 25 03:02:20.261701 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 227/497] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:20 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1262 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:20.266044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:20.266956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:20.286407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:20.287293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:20.287935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:20.288836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:20.289642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:20.290309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:20.648293 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f884cbe-70bd-47b6-9f81-aa18ac8a79ea tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1614 microversion: 2.1 time: 0.396526 Oct 25 03:02:20.652347 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 228/498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:20 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1614 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:20.681599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:20.685522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:20.698576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:20.702241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:02:20.702754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquired lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:02:20.703532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:20.709249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:20.711762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:20.712514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:20.714967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:20.795764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:21.100716 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27eee6c1-db84-4347-8c18-d0f1dca68151 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1614 microversion: 2.1 time: 0.424248 Oct 25 03:02:21.102542 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 229/499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:20 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1614 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:21.110304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:21.111861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:21.125110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:21.126025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:21.127376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:21.129225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:21.130010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:21.130970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:21.138627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:21.558004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:21.585717 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8b244066-2ad3-43d9-8666-eb958daf5d2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.480332 Oct 25 03:02:21.587230 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 230/500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:21 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:21.592990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:21.602486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Searching by: {'host': 'n-h1-862355-1', 'deleted': False} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:21.621794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:21.623047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:21.624685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:21.626399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:21.628338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:21.629161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:21.762068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:02:21.832120 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19fb992b-c282-4ee4-b0d3-1efb2acac9d6 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=n-h1-862355-1&all_tenants=1" status: 200 len: 1991 microversion: 2.1 time: 0.243114 Oct 25 03:02:21.842575 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 231/501] 10.222.0.36 () {58 vars in 1190 bytes} [Tue Oct 25 03:02:21 2022] GET /compute/v2.1/servers?host=n-h1-862355-1&all_tenants=1 => generated 1991 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:21.847850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:21.848641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:21.855566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:21.856614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:21.857936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:21.858865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:21.859542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:21.860340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.007284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:22.022200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:22.024341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:22.025910 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f0bcf8f1-cb87-4b4c-882a-12d6193ada97 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1320 microversion: 2.25 time: 0.181991 Oct 25 03:02:22.027627 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 232/502] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:21 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:22.034782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:22.043569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:02:22.051111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.052724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.053386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.054770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.055935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.056588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.085296 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90692521-f681-41e4-977b-b9ae89a54d30 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.055574 Oct 25 03:02:22.086467 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 233/503] 10.222.0.36 () {58 vars in 1196 bytes} [Tue Oct 25 03:02:22 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:02:22.102914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:22.106093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:22.115050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.115892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.116552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.117461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.118183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.118929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.223760 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27e95d79-44e9-4dc7-b682-4e81790add34 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action" status: 202 len: 0 microversion: 2.1 time: 0.128553 Oct 25 03:02:22.224816 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 234/504] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:22 2022] POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:02:22.235960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:22.239120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:22.246572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.247179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.247692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.248532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.249080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.249572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.711977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:02:22.712479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:02:22.713342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:02:22.713342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:02:22.713889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:02:22.888822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:22.906413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.907378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.907948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.910075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:22.910551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:22.910983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:22.979407 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57189910-5176-4024-ab62-dfc3608c4e98 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action" status: 202 len: 1067 microversion: 2.1 time: 0.749665 Oct 25 03:02:22.982774 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 235/505] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:22 2022] POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action => generated 1067 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 25 03:02:22.999157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:22.999784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:23.013561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:23.014469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:23.014558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:23.015227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:23.015683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:23.016106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:23.259430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Building network info cache for instance {{(pid=120563) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:02:23.578977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:23.591728 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2694f162-6500-465a-b0d0-093adbc69f63 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.605190 Oct 25 03:02:23.605707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 236/506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:22 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:23.611868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:23.612334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:23.629242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:23.631252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:23.631724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:23.635812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:23.637362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:23.638796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:24.056190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:24.065355 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b2d5ece-34c2-4316-83d4-d7fd523a739f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.468244 Oct 25 03:02:24.077811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 237/507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:23 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:24.077811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:24.087891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:24.113383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:24.114831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:24.115710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:24.120050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:24.122634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:24.123857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:24.631710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:24.641107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:24.643179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:24.644525 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f89c439-813e-4bae-a53e-36e2584d02bf tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.577335 Oct 25 03:02:24.664647 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 238/508] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:24 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:24.681584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5a5fc8e4-dd59-470f-903a-c78008f011ff req-1f365c44-9873-493b-a920-806fd1b71ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db2114dd-7e3f-4719-a724-9a7d3d4ab926", "tag": "121bf50c-ad19-4ac2-8161-5917548e5033"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:24.711813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5a5fc8e4-dd59-470f-903a-c78008f011ff req-1f365c44-9873-493b-a920-806fd1b71ece service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:24.712302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5a5fc8e4-dd59-470f-903a-c78008f011ff req-1f365c44-9873-493b-a920-806fd1b71ece service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:24.712782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5a5fc8e4-dd59-470f-903a-c78008f011ff req-1f365c44-9873-493b-a920-806fd1b71ece service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:24.743079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5a5fc8e4-dd59-470f-903a-c78008f011ff req-1f365c44-9873-493b-a920-806fd1b71ece service nova] Creating event network-changed:121bf50c-ad19-4ac2-8161-5917548e5033 for instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 on n-h1-862355-1 Oct 25 03:02:24.753352 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5a5fc8e4-dd59-470f-903a-c78008f011ff req-1f365c44-9873-493b-a920-806fd1b71ece service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083041 Oct 25 03:02:24.753999 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 239/509] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:24.790398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:24.791058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:24.816895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:24.818971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:24.819544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:24.822917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:24.825231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:24.826541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.274553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:25.284218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81e89cde-d6ef-4a52-bd1b-16c24c415998 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1504 microversion: 2.1 time: 0.522436 Oct 25 03:02:25.297793 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 240/510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:24 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:25.297793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:25.297793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:25.306737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.306737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.306737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.306737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.307151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.307151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.482204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:25.492884 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc2c970f-5130-41d8-bdff-7b1cf7b5e710 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.203530 Oct 25 03:02:25.508633 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 241/511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:25 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:25.729873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Action: 'update', calling method: .version_select at 0x7efd339a3310>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:25.735064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.735966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.736468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.746239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.746797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.747240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.756524 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] HTTP exception thrown: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Request method failure captured: Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf HTTP/1.1 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 56 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HBD8KYDcGRJCqLC5s1FG5VhrjrvW-tMRsFlWkWCEVGA68Mc1CHZCSgALYRfV-WZ5xJC-jaQoVLrnVT3VlWyHCuHXlwZscNUsAvOZt2R5e5e5wHrvXZDkUV-Sr0ZcxcyC1iuu_mBSwjuWra6MVDY9S0ggsropYof9t56xhuxS0EaL4 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.53 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f215cbe1dbd04795b1962b8da7b011f1 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:02:25.759774 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f215cbe1dbd04795b1962b8da7b011f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f215cbe1dbd04795b1962b8da7b011f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f215cbe1dbd04795b1962b8da7b011f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f215cbe1dbd04795b1962b8da7b011f1"}]}] Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f215cbe1dbd04795b1962b8da7b011f1 Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f4b49b2e651f4dbd87474a095490f355 Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:25.761167 n-d-862355-1 devstack@n-api.service[120562]: exception: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '988a3757-894e-49d0-bcb4-5f0758ab2daf', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:25.762016 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:25.763222 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:25.764847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:25.764847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:25.764847 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:25.766187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Returning 404 to user: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:25.767429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9b7b2c1-1ab4-4da3-a5b9-dab28a0bba73 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf" status: 404 len: 110 microversion: 2.53 time: 0.272972 Oct 25 03:02:25.768429 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 242/512] 10.222.0.36 () {62 vars in 1309 bytes} [Tue Oct 25 03:02:25 2022] PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf => generated 110 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:02:25.776478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:25.777097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:25.783871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.784364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.784804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.785501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.786206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.786822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.949028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:25.959711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:25.961183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:25.962370 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f6a2005-1cc2-4a51-9bb4-fc2b1ee58812 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.192764 Oct 25 03:02:25.973899 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 243/513] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:25 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:25.979780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Action: 'update', calling method: .version_select at 0x7efd33de7040>, body: {"status": "disabled"} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:25.984347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.984851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.986281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:25.994169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:25.994661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:25.995105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.004523 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] HTTP exception thrown: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Request method failure captured: Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf HTTP/1.1 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 22 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HBD8KYDcGRJCqLC5s1FG5VhrjrvW-tMRsFlWkWCEVGA68Mc1CHZCSgALYRfV-WZ5xJC-jaQoVLrnVT3VlWyHCuHXlwZscNUsAvOZt2R5e5e5wHrvXZDkUV-Sr0ZcxcyC1iuu_mBSwjuWra6MVDY9S0ggsropYof9t56xhuxS0EaL4 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.53 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f215cbe1dbd04795b1962b8da7b011f1 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:02:26.006648 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f215cbe1dbd04795b1962b8da7b011f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f215cbe1dbd04795b1962b8da7b011f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f215cbe1dbd04795b1962b8da7b011f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f215cbe1dbd04795b1962b8da7b011f1"}]}] Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f215cbe1dbd04795b1962b8da7b011f1 Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f4b49b2e651f4dbd87474a095490f355 Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: {"status": "disabled"} Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: exception: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.008738 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '988a3757-894e-49d0-bcb4-5f0758ab2daf', 'body': {'status': 'disabled'}} Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.009793 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:26.011280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:26.012545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.012545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.013847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Returning 404 to user: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:26.016111 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-006fa653-7338-466e-9e33-e99f7975a8d7 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf" status: 404 len: 110 microversion: 2.53 time: 0.050682 Oct 25 03:02:26.017449 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 244/514] 10.222.0.36 () {62 vars in 1309 bytes} [Tue Oct 25 03:02:25 2022] PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf => generated 110 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:02:26.027131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Action: 'update', calling method: .version_select at 0x7efd339f73a0>, body: {"status": "enabled"} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:26.030768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.031259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.031709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.044530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.045923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.045923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.056826 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] HTTP exception thrown: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Request method failure captured: Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf HTTP/1.1 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 21 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HBD8KYDcGRJCqLC5s1FG5VhrjrvW-tMRsFlWkWCEVGA68Mc1CHZCSgALYRfV-WZ5xJC-jaQoVLrnVT3VlWyHCuHXlwZscNUsAvOZt2R5e5e5wHrvXZDkUV-Sr0ZcxcyC1iuu_mBSwjuWra6MVDY9S0ggsropYof9t56xhuxS0EaL4 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.53 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f215cbe1dbd04795b1962b8da7b011f1 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:02:26.058694 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f215cbe1dbd04795b1962b8da7b011f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f215cbe1dbd04795b1962b8da7b011f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f215cbe1dbd04795b1962b8da7b011f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f215cbe1dbd04795b1962b8da7b011f1"}]}] Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f215cbe1dbd04795b1962b8da7b011f1 Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574 Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f4b49b2e651f4dbd87474a095490f355 Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: {"status": "enabled"} Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: exception: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.059999 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '988a3757-894e-49d0-bcb4-5f0758ab2daf', 'body': {'status': 'enabled'}} Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.060800 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:26.061986 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:26.063127 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. Oct 25 03:02:26.063127 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:26.063127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Returning 404 to user: Service 988a3757-894e-49d0-bcb4-5f0758ab2daf could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:26.063127 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ae2ac7fe-889f-46da-8a1e-6020fe125ac5 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf" status: 404 len: 110 microversion: 2.53 time: 0.037663 Oct 25 03:02:26.063127 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 245/515] 10.222.0.36 () {62 vars in 1309 bytes} [Tue Oct 25 03:02:26 2022] PUT /compute/v2.1/os-services/988a3757-894e-49d0-bcb4-5f0758ab2daf => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:02:26.070934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.075828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.076665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.076860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.077830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.078327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.078772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.084474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:26.112445 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70c0b5c7-b5ee-4e25-b472-0b6814c44bd3 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044682 Oct 25 03:02:26.113312 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 246/516] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:26.126240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.131434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.131986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.132439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.133381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.134142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.134580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.161108 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7fea7b17-4385-4639-bff5-210d57897ddb tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.039006 Oct 25 03:02:26.165713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 247/517] 10.222.0.36 () {60 vars in 1211 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:02:26.176486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.182304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.183051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.183287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.184129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.184683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.185496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.208815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Updating instance_info_cache with network_info: [{"id": "121bf50c-ad19-4ac2-8161-5917548e5033", "address": "fa:16:3e:3d:4c:2e", "network": {"id": "556aa2e1-58ce-4095-abc1-534bf5c730ca", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-716151900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "937ffe1b16784ebd93aa92adf851684f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap121bf50c-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120563) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:02:26.215595 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1428b3a-52ad-424b-a75b-e1cf9423db1e tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043005 Oct 25 03:02:26.216224 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 248/518] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:02:26.229529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.232477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Releasing lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:02:26.233395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.233923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.234373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.235280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.235586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.236011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.237547 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8407e027-a450-4b08-bcf2-8ed5aa812e7c tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action" status: 202 len: 0 microversion: 2.1 time: 6.414285 Oct 25 03:02:26.239408 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 271/519] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:19 2022] POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action => generated 0 bytes in 6420 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 25 03:02:26.256722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ab35990-3763-4218-acbe-fa49c59602fe tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '.version_select at 0x7efd33b06b80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.262353 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fc52280-2c99-4224-b4e9-9e15f01e357d tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-862355-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.037241 Oct 25 03:02:26.264415 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 249/520] 10.222.0.36 () {60 vars in 1235 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/os-services?host=n-d-862355-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:26.390686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8f295c5e-456d-4e04-be9d-a59064da1a1b tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Action: 'create', calling method: .version_select at 0x7efd339f7ca0>, body: {"keypair": {"name": "tempest-keypair-29387808", "type": "ssh", "user_id": "f2f4dee6fedc4988883905fa76e20616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZqK4fhp0ba/Bsf5napdlsUsYJyeOmWj93j2AGQ0m8zbffG1mwflxSzdTpQfj7b6NOcdUiS+AjlIHbjSBhWLHoHyL3xKjSD0FmLUfjNTmPJIBu0yCWERfCgmkZC4MysVA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:26.412643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8f295c5e-456d-4e04-be9d-a59064da1a1b tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Getting quotas for project 884c79d1f0484335aa91814c3599314e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:26.417215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8f295c5e-456d-4e04-be9d-a59064da1a1b tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Getting quotas for user 45c78dcf8a00466a83ba20d84e0c4c0e and project 884c79d1f0484335aa91814c3599314e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:26.442718 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8f295c5e-456d-4e04-be9d-a59064da1a1b tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.176574 Oct 25 03:02:26.443332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 250/521] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:02:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 25 03:02:26.456146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.459806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.460297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.460741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.461470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.461959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.462389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.488230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b083c56b-ce35-41b0-904a-bded52c72f3c tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043849 Oct 25 03:02:26.496216 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 251/522] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:26.501866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.503880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:26.510086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.510419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.510875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.511882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.512351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.512863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.768142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:26.778633 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-037045ae-608b-457f-97ba-b6a890a8474a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1494 microversion: 2.1 time: 0.288725 Oct 25 03:02:26.779233 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 252/523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1494 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:26.784318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-332cc7a0-c827-4f4e-b41d-20e2ace98863 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Action: 'create', calling method: .version_select at 0x7efd33de3d30>, body: {"keypair": {"name": "tempest-keypair-1114281362", "type": "ssh", "user_id": "f2f4dee6fedc4988883905fa76e20616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyql2aBLHpSClK3iwcR57fegxazaMQTdgEihpeMbP4SW1qx63c50sxiT/gIRGvIEfROHFLV93UnVEgEsiUESCaBGtPl45E8NnAtu0dDr4CrHGYRmqhSl1Q+8LqrLXGlIQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:26.808555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-332cc7a0-c827-4f4e-b41d-20e2ace98863 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Getting quotas for project 884c79d1f0484335aa91814c3599314e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:26.814574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-332cc7a0-c827-4f4e-b41d-20e2ace98863 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Getting quotas for user 45c78dcf8a00466a83ba20d84e0c4c0e and project 884c79d1f0484335aa91814c3599314e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:26.867089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-332cc7a0-c827-4f4e-b41d-20e2ace98863 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.086704 Oct 25 03:02:26.867873 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 253/524] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:02:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 25 03:02:26.878465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.885606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.887472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.890329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.891161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.891638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.892080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.919949 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d9e6a9c9-02e8-4b30-bb6f-9778765a5521 tempest-ServicesAdminNegativeV253TestJSON-2069667574 tempest-ServicesAdminNegativeV253TestJSON-2069667574-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.050987 Oct 25 03:02:26.921180 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 254/525] 10.222.0.36 () {60 vars in 1239 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:26.926723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:26.929092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:26.936619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.937122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.937628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:26.938406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:26.938889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:26.939619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:27.204185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:27.243437 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a53c8a0e-b9e9-45d2-ac58-537e15013637 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.320700 Oct 25 03:02:27.257902 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 255/526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:26 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:27.265392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4698245b-3f14-456e-8b9f-bb050fbcf819 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '.version_select at 0x7efd33a41a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:27.274098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4698245b-3f14-456e-8b9f-bb050fbcf819 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:27.274974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4698245b-3f14-456e-8b9f-bb050fbcf819 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:27.275780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4698245b-3f14-456e-8b9f-bb050fbcf819 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:27.287438 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4698245b-3f14-456e-8b9f-bb050fbcf819 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.041840 Oct 25 03:02:27.289138 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 256/527] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:02:27 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:27.294006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-31cc1a2a-c81e-4ca7-9c4b-b4ed7b12e219 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Calling method '.version_select at 0x7efd33deed30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:27.305862 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-31cc1a2a-c81e-4ca7-9c4b-b4ed7b12e219 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-29387808?user_id=f2f4dee6fedc4988883905fa76e20616" status: 200 len: 510 microversion: 2.10 time: 0.016528 Oct 25 03:02:27.306571 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 257/528] 10.222.0.36 () {60 vars in 1334 bytes} [Tue Oct 25 03:02:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-29387808?user_id=f2f4dee6fedc4988883905fa76e20616 => generated 510 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:02:27.453151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-476ee722-9426-4db0-ac7e-87d83023e8a6 tempest-ServicesAdminNegativeV253TestJSON-88302269 tempest-ServicesAdminNegativeV253TestJSON-88302269-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:27.457203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-476ee722-9426-4db0-ac7e-87d83023e8a6 tempest-ServicesAdminNegativeV253TestJSON-88302269 tempest-ServicesAdminNegativeV253TestJSON-88302269-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0404d9026d4749b8919db8004107a592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11446dd1bf704d74be78d55206ba7e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-476ee722-9426-4db0-ac7e-87d83023e8a6 tempest-ServicesAdminNegativeV253TestJSON-88302269 tempest-ServicesAdminNegativeV253TestJSON-88302269-project] Request method failure captured: Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1G_pQK-w7F5Tz7JrlGcbBEuq4xL6dhR_mRYbhCpIamvXLW4hlRcBnKhrAr2VrvED0k9tZAz_jn14QIWkdsw30RUGHn9EIMjJwfqsk9_N0tuhbmE1fNdDJoclXwXhY5S8ovQLNfMhSK-qxGpkJDlPJhN8JFXYh5znvSCTfwywmTdQGY Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.53 Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 11446dd1bf704d74be78d55206ba7e13 Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-88302269 Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:27.460060 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/11446dd1bf704d74be78d55206ba7e13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/11446dd1bf704d74be78d55206ba7e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_11446dd1bf704d74be78d55206ba7e13", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/11446dd1bf704d74be78d55206ba7e13"}]}] Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-88302269 Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 11446dd1bf704d74be78d55206ba7e13 Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-88302269 Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServicesAdminNegativeV253TestJSON-88302269-project Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0404d9026d4749b8919db8004107a592 Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-88302269-project Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 25 03:02:27.461614 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:02:27.472764 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 25 03:02:27.474828 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:27.475944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-476ee722-9426-4db0-ac7e-87d83023e8a6 tempest-ServicesAdminNegativeV253TestJSON-88302269 tempest-ServicesAdminNegativeV253TestJSON-88302269-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:27.475944 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-476ee722-9426-4db0-ac7e-87d83023e8a6 tempest-ServicesAdminNegativeV253TestJSON-88302269 tempest-ServicesAdminNegativeV253TestJSON-88302269-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.142622 Oct 25 03:02:27.475944 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 258/529] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Oct 25 03:02:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 155 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:02:27.475944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a7050d61-92e4-41cf-ae34-b15fc091934d req-8798d3f3-c4db-4843-a941-2e653d510502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18469533-ab8d-41ee-b31a-ed6af250dca2", "tag": "aab9bd8d-50b0-491f-98df-0eb600f06623"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:27.490319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a7050d61-92e4-41cf-ae34-b15fc091934d req-8798d3f3-c4db-4843-a941-2e653d510502 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:27.491483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a7050d61-92e4-41cf-ae34-b15fc091934d req-8798d3f3-c4db-4843-a941-2e653d510502 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:27.491937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a7050d61-92e4-41cf-ae34-b15fc091934d req-8798d3f3-c4db-4843-a941-2e653d510502 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:27.511374 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a7050d61-92e4-41cf-ae34-b15fc091934d req-8798d3f3-c4db-4843-a941-2e653d510502 service nova] Creating event network-changed:aab9bd8d-50b0-491f-98df-0eb600f06623 for instance 18469533-ab8d-41ee-b31a-ed6af250dca2 on n-h2-862355-1 Oct 25 03:02:27.523703 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a7050d61-92e4-41cf-ae34-b15fc091934d req-8798d3f3-c4db-4843-a941-2e653d510502 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059114 Oct 25 03:02:27.525945 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 259/530] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:27.537544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:27.540785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:27.559706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:27.560223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:27.560665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:27.561402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:27.561898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:27.562336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:27.881943 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ab35990-3763-4218-acbe-fa49c59602fe tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/9a8ba352-01c2-49d2-8470-b7203ec06c0e" status: 202 len: 0 microversion: 2.1 time: 1.637789 Oct 25 03:02:27.883468 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 272/531] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:02:26 2022] DELETE /compute/v2.1/os-floating-ips/9a8ba352-01c2-49d2-8470-b7203ec06c0e => generated 0 bytes in 1640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:02:27.889925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:27.890780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:27.902608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:27.910989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:27.916956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:27.918449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:27.919583 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36f517aa-a91a-40cc-ae74-8231d2acc6ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.392342 Oct 25 03:02:27.920731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:27.921180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:27.922560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:27.923048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:27.923480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:27.924536 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 260/532] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:27 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:27.931960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a50eee12-9f8b-4039-abf8-5b81a4985ab7 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Action: 'create', calling method: .version_select at 0x7efd33eb3160>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-567390192", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTkrovDINXA3WJSNsBkR9IXkqYznyXiC/H7bYn2nFd8RNdi9Px5U67UIoTenAyendC9lptN+N2qxUlc65eaOQwuxzQHjo+Wj3vA9BiEL848VIVUfs9TJauCxLGfJCjbbA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:27.950129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a50eee12-9f8b-4039-abf8-5b81a4985ab7 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Getting quotas for project 884c79d1f0484335aa91814c3599314e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:27.955382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a50eee12-9f8b-4039-abf8-5b81a4985ab7 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Getting quotas for user 45c78dcf8a00466a83ba20d84e0c4c0e and project 884c79d1f0484335aa91814c3599314e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:27.973798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:27.984308 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a50eee12-9f8b-4039-abf8-5b81a4985ab7 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.058627 Oct 25 03:02:27.984957 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 261/533] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:02:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 25 03:02:27.997255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97f15c95-b0ef-49e2-911f-01eb85399c9b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97f15c95-b0ef-49e2-911f-01eb85399c9b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Request method failure captured: Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action HTTP/1.1 Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 34 Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1GRoaQLDOJKxf9WEJOIhVXYkM9oyFcp5kZeQIT7-jXRqOS8v-FJYtaal-W8PorO0ozH3xIv9vMJNrOaQ8MvO58zKodwLEUlTkh8q4UwheFdciJcuY_za1XJqsrSylrGWjmKmgpqXvUs7OJNhDCkzCmraHTbayKD9W_mBR0KyHLWRww Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:28.002528 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_937ffe1b16784ebd93aa92adf851684f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/937ffe1b16784ebd93aa92adf851684f"}]}] Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ae8cc32663de4615874ea69d683dc8f6 Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: {"addFloatingIp": {"address": ""}} Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:28.004049 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'db2114dd-7e3f-4719-a724-9a7d3d4ab926', 'body': {'addFloatingIp': {'address': ''}}} Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi '' Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:28.004918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:02:28.006472 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:02:28.008061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 25 03:02:28.008061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.010747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97f15c95-b0ef-49e2-911f-01eb85399c9b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:28.018481 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97f15c95-b0ef-49e2-911f-01eb85399c9b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action" status: 400 len: 142 microversion: 2.1 time: 0.032080 Oct 25 03:02:28.023604 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 262/534] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:27 2022] POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action => generated 142 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:02:28.029089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd5b59da-c11a-434c-8780-6a5c9906af59 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Calling method '.version_select at 0x7efd33bcf5e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.034027 n-d-862355-1 devstack@n-api.service[120562]: WARNING oslo_db.sqlalchemy.utils [None req-fd5b59da-c11a-434c-8780-6a5c9906af59 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 25 03:02:28.041486 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd5b59da-c11a-434c-8780-6a5c9906af59 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs?user_id=f2f4dee6fedc4988883905fa76e20616" status: 200 len: 724 microversion: 2.10 time: 0.016808 Oct 25 03:02:28.042106 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 263/535] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Oct 25 03:02:28 2022] GET /compute/v2.1/os-keypairs?user_id=f2f4dee6fedc4988883905fa76e20616 => generated 724 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:02:28.050103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:28.053289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:28.066883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.067467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.067973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.068676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.069132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.069559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.097781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:02:28.098185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquired lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:02:28.135482 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9203e6e5-9ee1-4be4-b326-db43a5dd5862 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1645 microversion: 2.1 time: 0.250212 Oct 25 03:02:28.136362 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 273/536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:27 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1645 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:28.141379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3708e18-8249-4e5b-a66a-4dbfc99edb90 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Calling method '.version_select at 0x7efd33b06b80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.182904 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3708e18-8249-4e5b-a66a-4dbfc99edb90 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-567390192" status: 204 len: 0 microversion: 2.10 time: 0.045181 Oct 25 03:02:28.185940 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 274/537] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Oct 25 03:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-567390192 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:02:28.194781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5079953-e273-4f14-a861-f819e460f1ef tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Calling method '.version_select at 0x7efd338f6040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.220422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Releasing lock "refresh_cache-db2114dd-7e3f-4719-a724-9a7d3d4ab926" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:02:28.221034 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] HTTP exception thrown: floating IP not found Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Request method failure captured: Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action HTTP/1.1 Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 41 Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1GRoaQLDOJKxf9WEJOIhVXYkM9oyFcp5kZeQIT7-jXRqOS8v-FJYtaal-W8PorO0ozH3xIv9vMJNrOaQ8MvO58zKodwLEUlTkh8q4UwheFdciJcuY_za1XJqsrSylrGWjmKmgpqXvUs7OJNhDCkzCmraHTbayKD9W_mBR0KyHLWRww Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:28.222985 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_937ffe1b16784ebd93aa92adf851684f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/937ffe1b16784ebd93aa92adf851684f"}]}] Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ae8cc32663de4615874ea69d683dc8f6 Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:28.224494 n-d-862355-1 devstack@n-api.service[120562]: exception: floating IP not found Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'db2114dd-7e3f-4719-a724-9a7d3d4ab926', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:28.225479 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 25 03:02:28.226806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.228225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Returning 404 to user: floating IP not found {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:28.228225 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c348725d-4157-40c7-8bf0-1e7cd90ad359 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action" status: 404 len: 67 microversion: 2.1 time: 0.181226 Oct 25 03:02:28.228225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 264/538] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:28 2022] POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action => generated 67 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:02:28.235305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2eb71ae6-9c45-4b4c-82d9-811eb75faaab tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Action: 'action', calling method: .version_select at 0x7efd392b0c10>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:28.239643 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5079953-e273-4f14-a861-f819e460f1ef tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114281362?user_id=f2f4dee6fedc4988883905fa76e20616" status: 204 len: 0 microversion: 2.10 time: 0.051326 Oct 25 03:02:28.240975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 275/539] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114281362?user_id=f2f4dee6fedc4988883905fa76e20616 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:02:28.250524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-76370164-548d-49e0-b803-dd4bd5965d97 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] Calling method '.version_select at 0x7efd33809ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.299121 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-76370164-548d-49e0-b803-dd4bd5965d97 tempest-KeyPairsV210TestJSON-1578090947 tempest-KeyPairsV210TestJSON-1578090947-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29387808?user_id=f2f4dee6fedc4988883905fa76e20616" status: 204 len: 0 microversion: 2.10 time: 0.053043 Oct 25 03:02:28.300169 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 276/540] 10.222.0.36 () {60 vars in 1337 bytes} [Tue Oct 25 03:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29387808?user_id=f2f4dee6fedc4988883905fa76e20616 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:02:28.312616 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2eb71ae6-9c45-4b4c-82d9-811eb75faaab tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 25 03:02:28.314032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2eb71ae6-9c45-4b4c-82d9-811eb75faaab tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Request method failure captured: Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action HTTP/1.1 Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 44 Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1GRoaQLDOJKxf9WEJOIhVXYkM9oyFcp5kZeQIT7-jXRqOS8v-FJYtaal-W8PorO0ozH3xIv9vMJNrOaQ8MvO58zKodwLEUlTkh8q4UwheFdciJcuY_za1XJqsrSylrGWjmKmgpqXvUs7OJNhDCkzCmraHTbayKD9W_mBR0KyHLWRww Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:02:28.314271 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_937ffe1b16784ebd93aa92adf851684f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/937ffe1b16784ebd93aa92adf851684f"}]}] Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ae8cc32663de4615874ea69d683dc8f6 Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:02:28.316342 n-d-862355-1 devstack@n-api.service[120562]: exception: Floating IP not found for address 0.0.0.0. Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'db2114dd-7e3f-4719-a724-9a7d3d4ab926', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:28.317218 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 25 03:02:28.320179 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:02:28.322077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2eb71ae6-9c45-4b4c-82d9-811eb75faaab tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:28.322077 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2eb71ae6-9c45-4b4c-82d9-811eb75faaab tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action" status: 404 len: 88 microversion: 2.1 time: 0.085280 Oct 25 03:02:28.322077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 265/541] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:28 2022] POST /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926/action => generated 88 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:02:28.323293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:28.327487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.328221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:28.332159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.333205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.333894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.335431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.336141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.336810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.354528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.355863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.358677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.360621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.362047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.362227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.402521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:02:28.540352 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d6dc01c3-feaa-49ef-84d4-8ef50be18b84 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 204 len: 0 microversion: 2.1 time: 0.216966 Oct 25 03:02:28.541365 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 266/542] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:02:28 2022] DELETE /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:02:28.554076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-615616091", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "9f081643-3b9b-4dc0-a846-58f41d0a3888"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:28.626313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] validate_networks() for [('9f081643-3b9b-4dc0-a846-58f41d0a3888', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:02:28.631945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:28.640701 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-045648cc-87c9-40ff-aea8-cffa47bf0aa4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.331932 Oct 25 03:02:28.646477 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 277/543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:28 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:28.651587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.652546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:28.659960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.660696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.661319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.662059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.662642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.663254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.885916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:28.899893 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d6e5b97-ebb1-487c-b209-9628e5460076 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1540 microversion: 2.1 time: 0.251829 Oct 25 03:02:28.901106 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 278/544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:28 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1540 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:28.946779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:28.949339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:28.963894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.964929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.965667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.967389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:28.968218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:28.968823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:28.974700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:29.225708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:29.240646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:29.245099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:29.246345 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-466263bf-a78f-4660-89b8-39d0737636a2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.305173 Oct 25 03:02:29.247762 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 279/545] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:28 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:02:29.263611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:02:29.264246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:02:29.265958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:02:29.266456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:02:29.267364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:02:29.298092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:29.300096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:29.301100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:29.302061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:29.302716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:29.303348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:29.329134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:29.335201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for user f7fc1bae87d741e58f4e2182796f2df3 and project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:29.350982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:02:29.353667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:02:29.428662 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aa941a1a-c596-4812-9084-174029656bb8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885756 Oct 25 03:02:29.429797 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 267/546] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:02:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:02:29.444890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-538bffaa-5b23-496a-8053-d4b228d50671 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:29.445915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-538bffaa-5b23-496a-8053-d4b228d50671 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:29.452097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:29.602505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-538bffaa-5b23-496a-8053-d4b228d50671 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:29.626970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-538bffaa-5b23-496a-8053-d4b228d50671 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1210 microversion: 2.1 time: 0.189600 Oct 25 03:02:29.629548 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 280/547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:29 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1210 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:29.666394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:29.668218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:29.678103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:29.679158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:29.680534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:29.681466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:29.682173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:29.683670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:29.894851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:29.903669 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01ff0b6f-e22f-4012-9110-e5d056525687 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.241301 Oct 25 03:02:29.904279 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 268/548] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:29 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:29.926228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:29.926851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:29.936369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:29.936873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:29.937314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:29.938716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:29.939241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:29.940258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:30.272571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:30.273200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:30.288735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:30.289230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:30.289702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:30.290419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:30.290891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:30.291347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:30.346920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:30.356164 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fd11068f-1346-40a1-8bca-2ca3955ea3ec tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1540 microversion: 2.1 time: 0.435297 Oct 25 03:02:30.358116 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 281/549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:29 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1540 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:30.597440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:30.608592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:30.610931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:30.615044 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2639fa8-b3ba-45e4-b8ff-6aea6d66065c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.346328 Oct 25 03:02:30.617949 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 269/550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:30 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:02:30.655830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:30.656358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:30.668927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:30.669343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:30.670013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:30.670724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:30.671180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:30.671770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:30.853278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:30.854978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:30.865577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:30.866410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:30.867360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:30.869234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:30.870916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:30.872181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:30.916121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:02:31.003673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:31.020914 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5efc5479-71c0-4c47-a2c8-bc5d2a5cedef tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1262 microversion: 2.1 time: 0.369483 Oct 25 03:02:31.036582 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 282/551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:30 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1262 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:31.036582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:31.036582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:31.041603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:31.042261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:31.042392 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b080c378-1fb3-4f74-b519-bc16cc07c599 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 204 len: 0 microversion: 2.1 time: 0.193770 Oct 25 03:02:31.042716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:31.043215 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 270/552] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:02:30 2022] DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:02:31.043432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:31.043897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:31.044328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:31.243641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1729587088", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "1988608484", "adminPass": "***", "networks": [{"uuid": "f98dcb2c-981b-4036-acab-e0ebe19d18bd"}], "security_groups": [{"name": "tempest-securitygroup--50181374"}], "key_name": "tempest-keypair-202991637", "user_data": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:31.317075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:31.327093 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-16a848c5-7511-4888-b59c-7dbe6a8e8ae6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.302037 Oct 25 03:02:31.329320 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 283/553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:31 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:31.379589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] validate_networks() for [('f98dcb2c-981b-4036-acab-e0ebe19d18bd', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:02:31.380866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:31.381575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:31.390655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:31.393471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:31.396259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:31.397141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:31.398675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:31.399188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:31.530253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae8cc32663de4615874ea69d683dc8f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '937ffe1b16784ebd93aa92adf851684f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:31.544474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bcd3b374-931e-475f-b96f-765674bdb52b tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 200 len: 1498 microversion: 2.1 time: 0.167909 Oct 25 03:02:31.571647 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 284/554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:31 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:02:31.632710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-9f5de84f-ef86-4589-a1b7-08a12f2ec5b9 req-4dac162e-9757-4400-8939-2949d719944b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db2114dd-7e3f-4719-a724-9a7d3d4ab926", "name": "network-vif-deleted", "tag": "121bf50c-ad19-4ac2-8161-5917548e5033"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:31.647933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9f5de84f-ef86-4589-a1b7-08a12f2ec5b9 req-4dac162e-9757-4400-8939-2949d719944b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:31.648942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9f5de84f-ef86-4589-a1b7-08a12f2ec5b9 req-4dac162e-9757-4400-8939-2949d719944b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:31.649531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9f5de84f-ef86-4589-a1b7-08a12f2ec5b9 req-4dac162e-9757-4400-8939-2949d719944b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:31.663035 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-9f5de84f-ef86-4589-a1b7-08a12f2ec5b9 req-4dac162e-9757-4400-8939-2949d719944b service nova] Creating event network-vif-deleted:121bf50c-ad19-4ac2-8161-5917548e5033 for instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 on n-h1-862355-1 Oct 25 03:02:31.669834 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-9f5de84f-ef86-4589-a1b7-08a12f2ec5b9 req-4dac162e-9757-4400-8939-2949d719944b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042515 Oct 25 03:02:31.677484 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 285/555] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:31.697037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:31.698066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:31.706490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:31.707255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:31.707981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:31.708902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:31.709652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:31.710292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:31.979649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:31.992504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:32.004804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:32.006020 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d1b14e3d-d940-4085-a9c8-e5e0dae1ca93 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.313710 Oct 25 03:02:32.011926 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 286/556] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:31 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:32.078971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:02:32.079483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:02:32.079858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:02:32.081694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:02:32.082033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:02:32.099583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.100189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.100868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.101755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.102602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.103196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.118779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=35 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:32.146434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Getting quotas for project b8b75865acf94a8a9a7899e766b10666. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:32.154501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Getting quotas for user fefa869da4ec498e985174e256f92ada and project b8b75865acf94a8a9a7899e766b10666. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:32.170604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:02:32.174777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:02:32.255220 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d71ca0ae-4f71-4d2b-bb11-cfa4b473da1d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.016076 Oct 25 03:02:32.256796 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 271/557] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:02:31 2022] POST /compute/v2.1/servers => generated 400 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:02:32.264401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:32.265251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:32.273918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.274622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.275289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.276884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.277547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.278537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.391544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:32.403853 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fabbb3ab-d313-4bae-a28c-26b0fcf5a2e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1280 microversion: 2.1 time: 0.145687 Oct 25 03:02:32.405020 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 272/558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:32 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:32.410399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-23d9b2d3-e2f9-4dcb-b79e-eddedc7785ab tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:32.411235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-23d9b2d3-e2f9-4dcb-b79e-eddedc7785ab tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:32.452407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d3b34f8-808b-442d-a608-aadc97d093f6 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Action: 'create', calling method: .version_select at 0x7efd3383a550>, body: {"keypair": {"name": "tempest-keypair-216346860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjIqJqG4aXwmfBMMfdEYywspeRedDccCBWH0VnKYBy1oAzIqNBFb+1Ky4RJr0+ZZB8TztRRzDXgNYrq3dU7Jd8vbPsIWRl9dYn8yS+cwuAbrnuGfASS8Xql5t50xheSmA=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:32.509975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-23d9b2d3-e2f9-4dcb-b79e-eddedc7785ab tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:32.518841 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-23d9b2d3-e2f9-4dcb-b79e-eddedc7785ab tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1264 microversion: 2.1 time: 0.112329 Oct 25 03:02:32.521163 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 273/559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:32 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1264 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:32.526159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:32.527351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:32.532820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0d3b34f8-808b-442d-a608-aadc97d093f6 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:32.552558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0d3b34f8-808b-442d-a608-aadc97d093f6 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for user 7cf6f873f1024247bba5c0118a3f6cdf and project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:32.554627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.563794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.564437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.565975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.576801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.577369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.590266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:INSERT=1,nova_api:RELEASE=1,nova_api:SELECT=92,nova_api:DELETE=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:32.621503 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d3b34f8-808b-442d-a608-aadc97d093f6 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.603597 Oct 25 03:02:32.624897 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 287/560] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:02:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:32.640519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:32.643958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] [instance: db2114dd-7e3f-4719-a724-9a7d3d4ab926] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:32.659683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.660607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.661597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.663834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:32.664530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:32.665159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:32.693901 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] HTTP exception thrown: Instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 could not be found. Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Request method failure captured: Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 HTTP/1.1 Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1GRoaQLDOJKxf9WEJOIhVXYkM9oyFcp5kZeQIT7-jXRqOS8v-FJYtaal-W8PorO0ozH3xIv9vMJNrOaQ8MvO58zKodwLEUlTkh8q4UwheFdciJcuY_za1XJqsrSylrGWjmKmgpqXvUs7OJNhDCkzCmraHTbayKD9W_mBR0KyHLWRww Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:02:32.696172 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/937ffe1b16784ebd93aa92adf851684f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_937ffe1b16784ebd93aa92adf851684f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/937ffe1b16784ebd93aa92adf851684f"}]}] Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 937ffe1b16784ebd93aa92adf851684f Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288 Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ae8cc32663de4615874ea69d683dc8f6 Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 could not be found. Oct 25 03:02:32.697541 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'db2114dd-7e3f-4719-a724-9a7d3d4ab926'} Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 could not be found. Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:02:32.698329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 could not be found. Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 could not be found. Oct 25 03:02:32.699542 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:02:32.703035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] Returning 404 to user: Instance db2114dd-7e3f-4719-a724-9a7d3d4ab926 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:02:32.704760 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15319ef8-6667-4c75-bac5-46cea23ce2c6 tempest-FloatingIPsAssociationNegativeTestJSON-13016288 tempest-FloatingIPsAssociationNegativeTestJSON-13016288-project] 10.222.0.36 "GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926" status: 404 len: 111 microversion: 2.1 time: 0.076089 Oct 25 03:02:32.709612 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 288/561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:32 2022] GET /compute/v2.1/servers/db2114dd-7e3f-4719-a724-9a7d3d4ab926 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:02:32.716227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d7d92df-35eb-4530-adc9-b30b311e7628 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd33ae28b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:32.729209 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d7d92df-35eb-4530-adc9-b30b311e7628 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-216346860" status: 200 len: 496 microversion: 2.1 time: 0.018167 Oct 25 03:02:32.730379 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 289/562] 10.222.0.36 () {58 vars in 1215 bytes} [Tue Oct 25 03:02:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-216346860 => generated 496 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:32.750291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84665b7f-eb79-424f-9385-df3cfaa5f599 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd33817dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:32.793202 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84665b7f-eb79-424f-9385-df3cfaa5f599 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-216346860" status: 202 len: 0 microversion: 2.1 time: 0.041086 Oct 25 03:02:32.805545 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 290/563] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-216346860 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:32.815954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-65b34e9a-0431-4071-afef-85673d1b2242 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Action: 'create', calling method: .version_select at 0x7efd33809700>, body: {"keypair": {"name": "tempest-keypair-647449527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmjtTxv2SQvtD+DxfDyDxDcS/x78wmGNAeRHBPiEUpISL0eZCNcuQVkOjKz2lLm5CY5RwGUE1MOtW7kZqDAeEp2zJK8Xgwfmd9kMtAaIny7QwF8c9YRlEPLOC/3fJdvYA=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:32.835312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-65b34e9a-0431-4071-afef-85673d1b2242 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:32.844726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-65b34e9a-0431-4071-afef-85673d1b2242 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for user 7cf6f873f1024247bba5c0118a3f6cdf and project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:32.882804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-65b34e9a-0431-4071-afef-85673d1b2242 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073367 Oct 25 03:02:32.884327 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 291/564] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:02:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:02:32.898748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61e153ae-37ba-4c62-a75c-877551c046ff tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd338091f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:32.930361 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-61e153ae-37ba-4c62-a75c-877551c046ff tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647449527" status: 202 len: 0 microversion: 2.1 time: 0.038383 Oct 25 03:02:32.933990 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 292/565] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647449527 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:32.951037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d278980d-0f06-4e47-a5b8-85ad62ad909a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Action: 'create', calling method: .version_select at 0x7efd33ae2790>, body: {"keypair": {"name": "tempest-keypair-1129379405", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:32.984951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d278980d-0f06-4e47-a5b8-85ad62ad909a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:32.993873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d278980d-0f06-4e47-a5b8-85ad62ad909a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for user 7cf6f873f1024247bba5c0118a3f6cdf and project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:33.034702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d278980d-0f06-4e47-a5b8-85ad62ad909a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.090529 Oct 25 03:02:33.037086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 293/566] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:02:32 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:02:33.055052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:33.055965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:33.075953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:33.076693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:33.077389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:33.078598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:33.079594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:33.080344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:33.404138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:33.413286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:33.414784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:33.415935 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1266aef0-3b82-46ce-a6af-59fc74189128 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.375918 Oct 25 03:02:33.422056 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 294/567] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:33 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:33.436472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9f18f26-5c2a-4b39-baa2-ed7cb18249b9 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd33ae2a60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:33.472048 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9f18f26-5c2a-4b39-baa2-ed7cb18249b9 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129379405" status: 202 len: 0 microversion: 2.1 time: 0.048831 Oct 25 03:02:33.472869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 295/568] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:02:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129379405 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:33.710430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:33.721276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-880e60aa-5098-4ca6-8a7c-860f8dd70749 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 1.198594 Oct 25 03:02:33.728000 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 274/569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:32 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:33.733204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:33.738444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:33.751287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:33.751852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:33.752378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:33.753293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:33.753830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:33.754393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:33.775565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:33.876467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:33.890031 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a59b0776-5e1e-4642-b01a-ab69c26db5d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1268 microversion: 2.1 time: 0.159163 Oct 25 03:02:33.909846 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 275/570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:33 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:33.916748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e7dc1da-762d-4523-9153-46fdbca44c3b tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Action: 'create', calling method: .version_select at 0x7efd33a55280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1723849394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaOGKBDNOCJdXrdoNG6vzX6C6tTxCoHLZp8+RTLrJWN+cUhIvLTobXDZGUI+HcQXsl2vKblAnrZLfVGzxF9hn01RFSSO5UboFhgCVNeqeome+YST95lwF4y72XOTpGb8A=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:33.948014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5e7dc1da-762d-4523-9153-46fdbca44c3b tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:33.953272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5e7dc1da-762d-4523-9153-46fdbca44c3b tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for user 7cf6f873f1024247bba5c0118a3f6cdf and project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:33.989405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dac57ed1-9f38-42e4-b595-f9710ac927f1 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Calling method '.version_select at 0x7efd33ace040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:33.990029 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e7dc1da-762d-4523-9153-46fdbca44c3b tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.078811 Oct 25 03:02:33.993111 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 276/571] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:02:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:33.998035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:33.998860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:34.030617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.032255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.032941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.035683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.036334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.036968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.115459 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dac57ed1-9f38-42e4-b595-f9710ac927f1 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64" status: 200 len: 371 microversion: 2.1 time: 0.641747 Oct 25 03:02:34.116736 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 296/572] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:02:33 2022] GET /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64 => generated 371 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:34.126475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15ea46ef-2c20-4a6e-b7c6-bea807d0acff tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Action: 'create', calling method: .version_select at 0x7efd3383a9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1610232725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzDW8P5usT80lsngrUZHSjPq/yQNLUYcypU8DfFUxqMpi425qBck50Lrl/CHHbEa1YpRF+F9E/VPG8SErEsGpFT9a1eIOo5b8UtZ7yp3W50CWRFYDz+HfpQoMkvgrmr4g=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:34.144304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-15ea46ef-2c20-4a6e-b7c6-bea807d0acff tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:34.155169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-15ea46ef-2c20-4a6e-b7c6-bea807d0acff tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for user 7cf6f873f1024247bba5c0118a3f6cdf and project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:34.184062 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15ea46ef-2c20-4a6e-b7c6-bea807d0acff tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.065901 Oct 25 03:02:34.193813 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 297/573] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:02:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:34.197530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:34.198871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Action: 'update', calling method: .version_select at 0x7efd338171f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:34.214092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-98403571-fcb4-4c54-8eb2-ed22410ec420 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1316 microversion: 2.1 time: 0.219672 Oct 25 03:02:34.214934 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 277/574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:33 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:34.219774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5dddb655-11bb-400c-9f02-d4a32e0ba44a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Action: 'create', calling method: .version_select at 0x7efd3810ef70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2069983241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyQCDAlPd758z57CfdnwkmfPN+Dl6GBmvUle7iePyUBZ9lmw7Sw6VN4yzEfsRIkVs1hem8uI8BwLs/2DePpheSkeWWRQDsp1vS05cqZDd1m6uW/MwsiJqXu4QE1tA/LaQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:34.262790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5dddb655-11bb-400c-9f02-d4a32e0ba44a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:34.269639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5dddb655-11bb-400c-9f02-d4a32e0ba44a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Getting quotas for user 7cf6f873f1024247bba5c0118a3f6cdf and project 2fd7d08c7cb74647810eac8ea2fe6bc3. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:34.282280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.282899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.284426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.285328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.286125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.286687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.319237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5dddb655-11bb-400c-9f02-d4a32e0ba44a tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.102635 Oct 25 03:02:34.319517 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 278/575] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:02:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:34.330016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-838cf040-6d4e-478e-a849-6740b0988505 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd339f75e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.337709 n-d-862355-1 devstack@n-api.service[120562]: WARNING oslo_db.sqlalchemy.utils [None req-838cf040-6d4e-478e-a849-6740b0988505 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 25 03:02:34.362283 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-838cf040-6d4e-478e-a849-6740b0988505 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.035004 Oct 25 03:02:34.367797 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 279/576] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:02:34 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:34.379519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8b92ebc7-34bc-4a9c-bb46-a6158fa9bb42 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd38150040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.412305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:34.423355 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8b92ebc7-34bc-4a9c-bb46-a6158fa9bb42 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2069983241" status: 202 len: 0 microversion: 2.1 time: 0.048692 Oct 25 03:02:34.424797 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 280/577] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 25 03:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2069983241 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:02:34.432198 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36966857-5df0-48b3-a66c-62057d55c070 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64" status: 200 len: 328 microversion: 2.1 time: 0.237041 Oct 25 03:02:34.442024 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 298/578] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:02:34 2022] PUT /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64 => generated 328 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:34.444595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2bb5b994-e1c1-45eb-83cf-e222c58bca61 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd3814e670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.447482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.448111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:34.461656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.462746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.463843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.466968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.469212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.475358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.494366 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2bb5b994-e1c1-45eb-83cf-e222c58bca61 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1610232725" status: 202 len: 0 microversion: 2.1 time: 0.064088 Oct 25 03:02:34.494995 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 281/579] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 25 03:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1610232725 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:34.512482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c102a8a-fbb9-4b44-900d-51abcb020098 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.542173 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c102a8a-fbb9-4b44-900d-51abcb020098 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64" status: 202 len: 0 microversion: 2.1 time: 0.040287 Oct 25 03:02:34.543238 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 282/580] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:02:34 2022] DELETE /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:34.551402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b9298212-c5b1-4b77-a194-79d1caef0638 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] Calling method '.version_select at 0x7efd339f7d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.603177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b9298212-c5b1-4b77-a194-79d1caef0638 tempest-KeyPairsV2TestJSON-1080241987 tempest-KeyPairsV2TestJSON-1080241987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1723849394" status: 202 len: 0 microversion: 2.1 time: 0.058405 Oct 25 03:02:34.612486 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 283/581] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 25 03:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1723849394 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:34.627113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-880dcd5d-0871-408d-a0b0-b514a3f12a44 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Calling method '.version_select at 0x7efd339931f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.755711 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-880dcd5d-0871-408d-a0b0-b514a3f12a44 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64" status: 200 len: 371 microversion: 2.1 time: 0.141763 Oct 25 03:02:34.756950 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 284/582] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:02:34 2022] GET /compute/v2.1/os-quota-sets/c02ec56d83ff469fb2da43aaf54e8c64 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:34.784191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2a205e24-912d-4285-89d9-a0f6292a2370 req-ca38bc6b-12db-4425-a14d-a3ef66197b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18469533-ab8d-41ee-b31a-ed6af250dca2", "name": "network-vif-plugged", "status": "completed", "tag": "aab9bd8d-50b0-491f-98df-0eb600f06623"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:34.827286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2a205e24-912d-4285-89d9-a0f6292a2370 req-ca38bc6b-12db-4425-a14d-a3ef66197b99 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.827790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2a205e24-912d-4285-89d9-a0f6292a2370 req-ca38bc6b-12db-4425-a14d-a3ef66197b99 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.828238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2a205e24-912d-4285-89d9-a0f6292a2370 req-ca38bc6b-12db-4425-a14d-a3ef66197b99 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.848384 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2a205e24-912d-4285-89d9-a0f6292a2370 req-ca38bc6b-12db-4425-a14d-a3ef66197b99 service nova] Creating event network-vif-plugged:aab9bd8d-50b0-491f-98df-0eb600f06623 for instance 18469533-ab8d-41ee-b31a-ed6af250dca2 on n-h2-862355-1 Oct 25 03:02:34.863544 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2a205e24-912d-4285-89d9-a0f6292a2370 req-ca38bc6b-12db-4425-a14d-a3ef66197b99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105107 Oct 25 03:02:34.864346 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 285/583] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:34.869434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:34.870177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:34.891228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.891740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.892180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:34.893579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:34.894051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:34.894663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:35.108899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:35.130749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:35.132442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:35.134564 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2e11d106-379d-4f90-b916-49637efb976c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 0.690631 Oct 25 03:02:35.136501 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 299/584] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:34 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:02:35.145935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:35.147410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:35.156630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:35.157309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:35.157906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:35.159387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:35.160068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:35.160796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:35.235406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:35.250675 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61c24ff4-bff9-4082-b7ac-bd5b63d0346f tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.385235 Oct 25 03:02:35.253014 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 286/585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:34 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:35.259664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79a0932f-1a1a-4a5a-bd8c-bd903e230e76 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Calling method '.version_select at 0x7efd33fd1c10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:35.521328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:35.522080 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79a0932f-1a1a-4a5a-bd8c-bd903e230e76 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029/defaults" status: 200 len: 371 microversion: 2.1 time: 0.267326 Oct 25 03:02:35.523569 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 287/586] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:02:35 2022] GET /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029/defaults => generated 371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:35.532874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:35.534302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:35.540422 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2e3a4170-82df-4815-bff6-f3d0c4335b4f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.401767 Oct 25 03:02:35.552118 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 300/587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:35 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:35.574281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:35.575638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:35.576823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:35.582791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:35.585823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:35.587359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:35.810162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Action: 'update', calling method: .version_select at 0x7efd33c54310>, body: {"quota_set": {"ram": "5120"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:35.836441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:35.849403 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53e28849-3e4f-4c7b-988b-af954f173cdf tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1322 microversion: 2.1 time: 0.323422 Oct 25 03:02:35.851848 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 288/588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:35 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:35.899754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4bca8d84-7883-4d54-832c-adb99284724e req-f2892913-f101-4f10-8177-caf2cb0eb3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854f52da-f0d9-4754-8851-e49bc29f2b87", "tag": "7c5a35c2-56c8-4882-91a0-17c0ee655ba7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:35.918307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4bca8d84-7883-4d54-832c-adb99284724e req-f2892913-f101-4f10-8177-caf2cb0eb3b6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:35.921125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4bca8d84-7883-4d54-832c-adb99284724e req-f2892913-f101-4f10-8177-caf2cb0eb3b6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:35.921794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4bca8d84-7883-4d54-832c-adb99284724e req-f2892913-f101-4f10-8177-caf2cb0eb3b6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:35.953069 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4bca8d84-7883-4d54-832c-adb99284724e req-f2892913-f101-4f10-8177-caf2cb0eb3b6 service nova] Creating event network-changed:7c5a35c2-56c8-4882-91a0-17c0ee655ba7 for instance 854f52da-f0d9-4754-8851-e49bc29f2b87 on n-h2-862355-1 Oct 25 03:02:35.966740 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4bca8d84-7883-4d54-832c-adb99284724e req-f2892913-f101-4f10-8177-caf2cb0eb3b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070045 Oct 25 03:02:35.969992 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 289/589] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:02:36.038225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.039671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.040343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:36.041435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.042207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.042855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:36.114594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-38d48682-3c5a-4330-b6c6-ed5d730216ef tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157" status: 200 len: 328 microversion: 2.1 time: 0.309442 Oct 25 03:02:36.124334 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 301/590] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:02:35 2022] PUT /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157 => generated 328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:36.128299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Calling method '.version_select at 0x7efd33fd1ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:36.166131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:36.166809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:36.180901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.184150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.185022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:36.186518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.187214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.187804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:36.261162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.261992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.262716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:36.263748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.264428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.265113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:36.305111 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-11966467-3d2e-48fd-b0c3-d54bdce84088 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157/detail" status: 200 len: 916 microversion: 2.1 time: 0.178837 Oct 25 03:02:36.306092 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 290/591] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:02:36 2022] GET /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157/detail => generated 916 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:02:36.329992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:36.332142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:36.353719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.355028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.356434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:36.358353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:36.360138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:36.360905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.163899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:37.174856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:37.185587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:37.194967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:37.196497 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c198f09e-6211-4d17-8b90-2dc1d60f4fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1362 microversion: 2.25 time: 1.035781 Oct 25 03:02:37.198495 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 302/592] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:36 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1362 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:02:37.203278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f0cb3891-ec94-498d-9708-1322592aca22 req-988d7e58-fdf1-4362-8fcc-07d313d8319d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db3b2e1-cbf3-4bde-bc31-2729770c052c", "name": "network-vif-deleted", "tag": "36f57cdd-0a77-40b6-8edf-9c03c1e438ac"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:37.213464 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37bf3441-fe8b-4bdb-b6eb-4e8dc0a22f89 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.905368 Oct 25 03:02:37.215963 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 291/593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:36 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:37.237345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:37.239027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:37.240077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f0cb3891-ec94-498d-9708-1322592aca22 req-988d7e58-fdf1-4362-8fcc-07d313d8319d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.241605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f0cb3891-ec94-498d-9708-1322592aca22 req-988d7e58-fdf1-4362-8fcc-07d313d8319d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.242361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f0cb3891-ec94-498d-9708-1322592aca22 req-988d7e58-fdf1-4362-8fcc-07d313d8319d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.256948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.259333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.261021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.262369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.265034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.265901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.278544 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f0cb3891-ec94-498d-9708-1322592aca22 req-988d7e58-fdf1-4362-8fcc-07d313d8319d service nova] Creating event network-vif-deleted:36f57cdd-0a77-40b6-8edf-9c03c1e438ac for instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c on n-h2-862355-1 Oct 25 03:02:37.294249 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f0cb3891-ec94-498d-9708-1322592aca22 req-988d7e58-fdf1-4362-8fcc-07d313d8319d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091998 Oct 25 03:02:37.296074 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 303/594] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:37.312412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Action: 'update', calling method: .version_select at 0x7efd33ace040>, body: {"quota_set": {"ram": "2048"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:37.752560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.757571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.759252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.760657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.763567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.765514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.822324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:DELETE=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:37.874263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.874752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.882689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.883541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.884017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.884449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.923723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:37.937195 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61b5a400-a3a5-4ed4-8137-e6905e3eb5ed tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.716050 Oct 25 03:02:37.937825 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 292/595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:37 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:37.955046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:37.955046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:37.975120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.976073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.976839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:37.978328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:37.979038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:37.979693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:38.075506 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91579e81-6d86-4d6f-a293-584e2a064833 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157?user_id=cd5402875f5b42b3a392fab4ff2e2f71" status: 200 len: 328 microversion: 2.1 time: 0.777752 Oct 25 03:02:38.076186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 304/596] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:02:37 2022] PUT /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157?user_id=cd5402875f5b42b3a392fab4ff2e2f71 => generated 328 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:38.089651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e01d0a2c-452b-40e1-8080-5b59583a9acb tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Calling method '.version_select at 0x7efd33b7edc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:38.385631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:38.397998 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54c658fa-3b45-488e-9453-6ad584eae481 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.459049 Oct 25 03:02:38.398600 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 293/597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:37 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:38.426550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:38.428221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:38.442228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:38.442722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:38.443160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:38.443899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:38.444352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:38.444777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:38.536138 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e01d0a2c-452b-40e1-8080-5b59583a9acb tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157?user_id=cd5402875f5b42b3a392fab4ff2e2f71" status: 200 len: 370 microversion: 2.1 time: 0.450026 Oct 25 03:02:38.536770 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 305/598] 10.222.0.36 () {58 vars in 1323 bytes} [Tue Oct 25 03:02:38 2022] GET /compute/v2.1/os-quota-sets/eb77532fa7f84bb2aa5d8e11b065f157?user_id=cd5402875f5b42b3a392fab4ff2e2f71 => generated 370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:02:38.548646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:38.549529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:38.566331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:38.569719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:38.570180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:38.572438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:38.572914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:38.573440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:38.833320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:38.844810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:38.850138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:38.852053 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-517c188a-602a-4865-a13a-4f73277f86c9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1558 microversion: 2.25 time: 0.436367 Oct 25 03:02:38.858476 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 294/599] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:38 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1558 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:38.889494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:38.891251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:38.902494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:38.906645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:38.907361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:38.911538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:38.912084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:38.912536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:39.147208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:39.163670 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5857c33-7e56-4404-a764-c72ae700b4bb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.625370 Oct 25 03:02:39.174661 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 306/600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:38 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:39.185929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:39.186818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:39.200876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:39.201596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:39.202280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:39.204719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:39.211119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:39.211700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:39.315931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 18469533-ab8d-41ee-b31a-ed6af250dca2 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:02:39.331727 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0449b7d5-93f6-493b-9567-890de2ae77ff tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 2051 microversion: 2.25 time: 0.448158 Oct 25 03:02:39.353539 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 295/601] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:38 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 2051 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:39.360363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e02c2392-93a4-4f56-aa05-e80f232da7ff tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Calling method '.version_select at 0x7efd381ccaf0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:39.544854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:39.558738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-100e9968-c6ef-4ea4-889e-7a8515265f26 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.380827 Oct 25 03:02:39.559577 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 307/602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:39 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:39.567258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:39.568082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:39.586981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:39.587484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:39.588270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:39.588988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:39.589450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:39.589922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:39.712160 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e02c2392-93a4-4f56-aa05-e80f232da7ff tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029/defaults" status: 200 len: 371 microversion: 2.1 time: 0.356909 Oct 25 03:02:39.722644 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 296/603] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:02:39 2022] GET /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029/defaults => generated 371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:39.729717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:39.731246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:39.739463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:39.740310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:39.741009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:39.742008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:39.743313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:39.745052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.131824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 18469533-ab8d-41ee-b31a-ed6af250dca2 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:02:40.149036 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e52a4cee-2bf3-4847-86d9-b27db1ec888f tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 2051 microversion: 2.25 time: 0.588241 Oct 25 03:02:40.149632 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 308/604] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:39 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 2051 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:40.170006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Action: 'update', calling method: .version_select at 0x7efd33c0b790>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:40.271131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.275242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.275957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.276863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.277545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.278084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.378311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:40.399129 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0340224b-f24d-4674-99d0-4b1e14fb8b16 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.672387 Oct 25 03:02:40.399750 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 297/605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:39 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:40.418839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ab256cea-8d9b-4e3d-804a-9da17b904477 req-fc96dc93-0988-43ab-9cd1-4892a734571d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1953a61-1d9b-4e63-9233-39bd0365c53d", "tag": "ad1e4435-87ae-47e9-a050-7348e0f7d986"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:40.435501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab256cea-8d9b-4e3d-804a-9da17b904477 req-fc96dc93-0988-43ab-9cd1-4892a734571d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.436809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab256cea-8d9b-4e3d-804a-9da17b904477 req-fc96dc93-0988-43ab-9cd1-4892a734571d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.437870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab256cea-8d9b-4e3d-804a-9da17b904477 req-fc96dc93-0988-43ab-9cd1-4892a734571d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.459580 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ab256cea-8d9b-4e3d-804a-9da17b904477 req-fc96dc93-0988-43ab-9cd1-4892a734571d service nova] Creating event network-changed:ad1e4435-87ae-47e9-a050-7348e0f7d986 for instance c1953a61-1d9b-4e63-9233-39bd0365c53d on n-h1-862355-1 Oct 25 03:02:40.470164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ab256cea-8d9b-4e3d-804a-9da17b904477 req-fc96dc93-0988-43ab-9cd1-4892a734571d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066419 Oct 25 03:02:40.472306 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 298/606] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:40.484128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:40.490710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.492932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.493406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.495043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.495516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.495955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.528596 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d1885c8-bb50-4bc2-bab7-1badc77ae5c2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048978 Oct 25 03:02:40.529658 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 299/607] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 25 03:02:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:02:40.536568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:40.538133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:40.546316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.548388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.549632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.550973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.551661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.552303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.695109 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b677072-1a4f-4455-9f10-5a23f4aada94 tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029" status: 200 len: 329 microversion: 2.1 time: 0.544177 Oct 25 03:02:40.702091 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 309/608] 10.222.0.36 () {60 vars in 1263 bytes} [Tue Oct 25 03:02:40 2022] PUT /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029 => generated 329 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:40.708000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:40.717040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:40.737529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.738390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.738643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.739618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.740269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.740893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.819462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:40.887754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b7ab3c3-24f1-4b52-ac19-69999026b84b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2/action" status: 202 len: 0 microversion: 2.25 time: 0.183432 Oct 25 03:02:40.892260 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 310/609] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:02:40 2022] POST /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:02:40.899793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:40.900990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:40.918174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.918737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.919593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:40.920425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:40.920947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:40.925456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:41.024820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:41.035546 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fafca400-28c6-4e37-ab3b-e1ffcbbab42c tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.503636 Oct 25 03:02:41.036778 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 300/610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:40 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:41.041710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Action: 'update', calling method: .version_select at 0x7efd33f064c0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:41.123990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=51 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:41.129640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:41.130310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:41.130869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:41.131895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:41.132761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:41.133255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:41.460188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=4,nova_api:INSERT=10,nova_api:UPDATE=9 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:41.648561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d22ab8ff-f016-400d-90be-1c1919f588ae tempest-QuotasAdminTestJSON-1207939353 tempest-QuotasAdminTestJSON-1207939353-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029" status: 200 len: 329 microversion: 2.1 time: 0.610469 Oct 25 03:02:41.653988 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 301/611] 10.222.0.36 () {60 vars in 1263 bytes} [Tue Oct 25 03:02:41 2022] PUT /compute/v2.1/os-quota-sets/4e72c0f985b64c0da6591b54f8130029 => generated 329 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:41.657829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:41.674889 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f275556-5258-46f7-94fe-a3ad5a99b22a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.780475 Oct 25 03:02:41.675643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 311/612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:40 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:41.677524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:41.678179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:41.680754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:41.692741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:41.697214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:41.697935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:41.698375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:41.699547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:41.700006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:41.700434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:41.703530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:41.704508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:41.706068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:41.708304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:41.710003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:41.710613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:41.884984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 18469533-ab8d-41ee-b31a-ed6af250dca2 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:02:41.901592 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dcd265c9-3af9-4d8b-956f-4349f3757744 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 2036 microversion: 2.25 time: 0.240615 Oct 25 03:02:41.902399 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 302/613] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:41 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 2036 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:42.083799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:42.099281 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba72bc77-9167-4643-bbb2-1c53e723ffa3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.421361 Oct 25 03:02:42.100236 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 312/614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:41 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:42.114378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862355-1", "block_migration": "auto"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:42.120572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:42.140046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:42.141519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:42.141998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:42.145060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:42.147391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:42.147917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:42.217284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'flavor' on Instance uuid 18469533-ab8d-41ee-b31a-ed6af250dca2 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:02:42.241173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2ae664e-37ed-4b05-91da-20a5a4ddd709 tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] Calling method '.version_select at 0x7efd33a4f040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:42.270096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2ae664e-37ed-4b05-91da-20a5a4ddd709 tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.365622 Oct 25 03:02:42.275001 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 303/615] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 25 03:02:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:42.284498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Going to try to live migrate instance to n-h1-862355-1 {{(pid=120563) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:02:42.291303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:42.292424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:42.304944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:42.309037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:42.310901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:42.312968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:42.315251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:42.319374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:42.568706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:42.586491 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e51097ef-4faf-42f4-97b7-75c221b03e3d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.301893 Oct 25 03:02:42.587399 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 304/616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:42 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:42.601617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-149b85fd-4d72-4210-beac-78ec0aa2188a tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] Action: 'update', calling method: .version_select at 0x7efd339f78b0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:43.086475 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-149b85fd-4d72-4210-beac-78ec0aa2188a tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.497797 Oct 25 03:02:43.087898 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 305/617] 10.222.0.36 () {60 vars in 1206 bytes} [Tue Oct 25 03:02:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:43.094448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:43.095073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:43.103488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:43.104041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:43.104545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:43.105567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:43.106054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:43.106482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:43.344993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:43.369398 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ccdf6d0d-4d46-44ec-98a0-fa3b98e9f361 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.275633 Oct 25 03:02:43.381707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 306/618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:43 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:43.396439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89c73b4b-99cc-4865-b4df-b64023816692 tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] Calling method '.version_select at 0x7efd33f3a0d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:43.422267 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89c73b4b-99cc-4865-b4df-b64023816692 tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.047985 Oct 25 03:02:43.423130 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 307/619] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 25 03:02:43 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:43.431070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:43.432754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:43.444273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:43.445084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:43.446238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:43.447195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:43.448204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:43.449351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:43.483249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:43.879180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:43.891303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a264a6ee-86a1-4f9b-b216-ebcca98dd08e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.465960 Oct 25 03:02:43.891922 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 308/620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:43 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:43.908947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-216272a1-137a-4eea-a21e-55f780a21340 tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] Action: 'update', calling method: .version_select at 0x7efd381e8820>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:44.025014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:UPDATE=27,nova_api:SELECT=62,nova_api:INSERT=11 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:44.078667 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-216272a1-137a-4eea-a21e-55f780a21340 tempest-QuotaClassesAdminTestJSON-1296378058 tempest-QuotaClassesAdminTestJSON-1296378058-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.185275 Oct 25 03:02:44.099689 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 309/621] 10.222.0.36 () {60 vars in 1206 bytes} [Tue Oct 25 03:02:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:44.099689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:44.099689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:44.099689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.099689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.100362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:44.100362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.100362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.100362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:44.533778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:44.550272 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-caf6ec8a-58d2-48ed-9d77-73cc09bd44c2 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1471 microversion: 2.1 time: 0.460128 Oct 25 03:02:44.552793 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 310/622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:44 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1471 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:44.557520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:44.558172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:44.572552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.573050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.573493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:44.574241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.574707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.577334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:44.825288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:44.838999 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6b60ddca-657c-4f35-b569-4dd10974b551 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.285056 Oct 25 03:02:44.840113 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 311/623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:44 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:44.892534 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-efd9c8e1-c622-4d19-bacb-d119971d0406 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2/action" status: 202 len: 0 microversion: 2.25 time: 2.790972 Oct 25 03:02:44.894431 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 313/624] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:02:42 2022] POST /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2/action => generated 0 bytes in 2794 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:02:44.909792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:44.910584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:44.919554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:44.920175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:44.921875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.922543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.923141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:44.924557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.929086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.930142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:44.944194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.944720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.946418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:44.948149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:44.948636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:44.949078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:45.161135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:45.175523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:45.177661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:45.182699 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90e220a6-36a3-4111-964e-b045bebdca10 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.283862 Oct 25 03:02:45.188130 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 312/625] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:44 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:45.482703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:45.500583 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d08caf64-7437-4951-9471-cf9e54a03bd9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.586576 Oct 25 03:02:45.501205 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 314/626] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:44 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:02:45.577574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:45.579149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:45.601731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:45.601731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:45.601731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:45.602099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:45.602340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:45.602684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:45.870742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:45.872005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:45.882956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:45.883828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:45.884491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:45.885786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:45.887051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:45.887698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:46.093975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:46.106438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2f490a5f-6f2b-4530-8994-72fc65baa9ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.242799 Oct 25 03:02:46.107376 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 315/627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:45 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:46.195624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:46.203438 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57489285-e0f7-4233-a67b-198f6c87bf27 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1477 microversion: 2.1 time: 0.629797 Oct 25 03:02:46.213970 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 313/628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:45 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1477 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:46.229228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:46.230372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:46.242494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:46.243288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:46.244347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:46.248134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:46.249829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:46.251031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:46.487590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:46.498463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:46.500588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:46.502012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-477912f4-50e1-4dd4-8b49-f5b6b47b3774 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.286721 Oct 25 03:02:46.503132 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 316/629] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:46 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:46.529108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:46.530426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:46.540385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:46.541086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:46.541708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:46.542600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:46.543209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:46.543924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:46.900602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:46.918477 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e380dac-1a8c-4d89-81cd-9898a4cdadb3 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.391781 Oct 25 03:02:46.939906 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 314/630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:46 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:47.131244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:47.131878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:47.140957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.141450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.146647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.153118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.153802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.154554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.232971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:47.233656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:47.245036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.245626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.247511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.248281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.250308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.250951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.366469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:47.399915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2687d46-6d64-4372-812d-5d7544e6c549 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.269227 Oct 25 03:02:47.402716 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 317/631] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:47 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:47.535103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:47.535857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:47.551779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.555355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.557513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.559907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.562235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.564067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.772501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:47.785921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:47.787787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:47.789291 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77a272b6-7ce1-407f-956e-1a676908b39e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.262115 Oct 25 03:02:47.791223 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 318/632] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:47 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:02:47.797595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-81f72d67-64df-4695-a1a8-6bb9cf441ee1 req-a6c1bcb4-c0b9-40b6-ab5c-1d286f8756e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854f52da-f0d9-4754-8851-e49bc29f2b87", "name": "network-vif-plugged", "status": "completed", "tag": "7c5a35c2-56c8-4882-91a0-17c0ee655ba7"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:47.815442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:47.820566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-81f72d67-64df-4695-a1a8-6bb9cf441ee1 req-a6c1bcb4-c0b9-40b6-ab5c-1d286f8756e4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.822175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-81f72d67-64df-4695-a1a8-6bb9cf441ee1 req-a6c1bcb4-c0b9-40b6-ab5c-1d286f8756e4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.822582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-81f72d67-64df-4695-a1a8-6bb9cf441ee1 req-a6c1bcb4-c0b9-40b6-ab5c-1d286f8756e4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.825312 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89670e4e-2029-4c70-883c-3666e229f6f9 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1477 microversion: 2.1 time: 0.596457 Oct 25 03:02:47.826767 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 315/633] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:47 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1477 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:47.851089 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-81f72d67-64df-4695-a1a8-6bb9cf441ee1 req-a6c1bcb4-c0b9-40b6-ab5c-1d286f8756e4 service nova] Creating event network-vif-plugged:7c5a35c2-56c8-4882-91a0-17c0ee655ba7 for instance 854f52da-f0d9-4754-8851-e49bc29f2b87 on n-h2-862355-1 Oct 25 03:02:47.865208 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-81f72d67-64df-4695-a1a8-6bb9cf441ee1 req-a6c1bcb4-c0b9-40b6-ab5c-1d286f8756e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072580 Oct 25 03:02:47.874161 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 319/634] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:47.948274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:47.949087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:47.961591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.962475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.965039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:47.966237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:47.969350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:47.970148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:48.369661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1221135551", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:48.482031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:02:48.640092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:48.650585 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-feb87bfb-7717-4e88-ac7b-9675e5b6245d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.706959 Oct 25 03:02:48.662342 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 316/635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:47 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:48.672144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:48.673046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:48.680351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:48.681192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:48.681841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:48.682776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:48.683399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:48.683993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:48.995248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:49.007904 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-415e682b-e861-4114-a68a-e7d704f659e4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1310 microversion: 2.1 time: 0.343098 Oct 25 03:02:49.009885 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 317/636] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:48 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1310 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:49.026097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:49.026771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:49.031010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:02:49.031589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:02:49.032054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:02:49.033352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:02:49.034107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:02:49.044978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.046126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.046254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.046628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.047071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:49.047384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:49.047782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.048237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.048660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:49.049007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.049661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.050438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:49.095088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Getting quotas for project a75eef4423b94baa9afa561b2c3097b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:49.103701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:49.105274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Getting quotas for user cc9f48a99e274518a7c5c9cd0f5a5795 and project a75eef4423b94baa9afa561b2c3097b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:49.140250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:02:49.144545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:02:49.287211 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6768a459-c877-4d6b-ba45-17879640d51a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144608 Oct 25 03:02:49.302058 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 320/637] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:02:49.316718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:49.319043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:49.333561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.335014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.337294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:49.340875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.341766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.343542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:49.606113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:49.618846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:49.626749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:49.631097 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5cea0351-6041-41b5-822d-57d101806925 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.619573 Oct 25 03:02:49.648290 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 318/638] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:49 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:49.674576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e11f621-2971-49ab-8d3b-f35b6c021a45 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:49.675384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e11f621-2971-49ab-8d3b-f35b6c021a45 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:49.879577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e11f621-2971-49ab-8d3b-f35b6c021a45 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:49.903663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e11f621-2971-49ab-8d3b-f35b6c021a45 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1223 microversion: 2.1 time: 0.244174 Oct 25 03:02:49.918233 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 319/639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:49 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1223 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:49.931108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:49.931834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:49.939357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.940685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.941637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:49.943069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:49.945122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:49.945701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.384683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:50.395093 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-041b9234-4e7a-45f6-a9fe-7e7235d7b634 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1463 microversion: 2.1 time: 1.091522 Oct 25 03:02:50.414016 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 321/640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:49 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1463 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:50.423947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-eb561756-ac07-4add-8c3f-d3db1b515ffc req-7489c305-cf51-477b-b365-4de7449d5849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18469533-ab8d-41ee-b31a-ed6af250dca2", "name": "network-vif-unplugged", "status": "completed", "tag": "aab9bd8d-50b0-491f-98df-0eb600f06623"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:50.437477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-eb561756-ac07-4add-8c3f-d3db1b515ffc req-7489c305-cf51-477b-b365-4de7449d5849 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.438365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-eb561756-ac07-4add-8c3f-d3db1b515ffc req-7489c305-cf51-477b-b365-4de7449d5849 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.439076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-eb561756-ac07-4add-8c3f-d3db1b515ffc req-7489c305-cf51-477b-b365-4de7449d5849 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.451263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:50.463915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-74a7285f-ceb8-4809-ba57-11ecd4cb683e tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.544079 Oct 25 03:02:50.464347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-eb561756-ac07-4add-8c3f-d3db1b515ffc req-7489c305-cf51-477b-b365-4de7449d5849 service nova] Creating event network-vif-unplugged:aab9bd8d-50b0-491f-98df-0eb600f06623 for instance 18469533-ab8d-41ee-b31a-ed6af250dca2 on n-h2-862355-1 Oct 25 03:02:50.467363 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 320/641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:49 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:50.470282 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-eb561756-ac07-4add-8c3f-d3db1b515ffc req-7489c305-cf51-477b-b365-4de7449d5849 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051762 Oct 25 03:02:50.471196 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 322/642] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:50.478000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:50.478959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:50.481552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ffe9374f-6d4c-4e2e-9868-fdfb389565e0 req-482d6cc2-b091-4e59-98b2-6523ae85eff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c6eb87-b6da-475c-97c0-c5e9a437235e", "name": "network-vif-unplugged", "status": "completed", "tag": "95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:50.496674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.504912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.505934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.506912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.509911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.510683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.535149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ffe9374f-6d4c-4e2e-9868-fdfb389565e0 req-482d6cc2-b091-4e59-98b2-6523ae85eff6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.535764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ffe9374f-6d4c-4e2e-9868-fdfb389565e0 req-482d6cc2-b091-4e59-98b2-6523ae85eff6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.539129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ffe9374f-6d4c-4e2e-9868-fdfb389565e0 req-482d6cc2-b091-4e59-98b2-6523ae85eff6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.574399 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ffe9374f-6d4c-4e2e-9868-fdfb389565e0 req-482d6cc2-b091-4e59-98b2-6523ae85eff6 service nova] Creating event network-vif-unplugged:95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f for instance a0c6eb87-b6da-475c-97c0-c5e9a437235e on n-h1-862355-1 Oct 25 03:02:50.589088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ffe9374f-6d4c-4e2e-9868-fdfb389565e0 req-482d6cc2-b091-4e59-98b2-6523ae85eff6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114183 Oct 25 03:02:50.590994 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 321/643] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:50.612253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:50.616613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:50.638809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.639329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.639826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.643528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.644898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.647780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.882387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:50.892530 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed400e21-7b8a-403f-ae38-b5f53b1d014b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1463 microversion: 2.1 time: 0.299810 Oct 25 03:02:50.907232 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 322/644] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:50 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:50.918901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:50.921122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:50.935944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.939114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.940661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:50.942960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:50.944535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:50.947947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:51.076634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:51.090315 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b623c33e-2da3-41cf-b6cd-0b81a2dffbcc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1494 microversion: 2.1 time: 0.617033 Oct 25 03:02:51.095548 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 323/645] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:50 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1494 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:51.144847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=7 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:51.201876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:51.214047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:51.216139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:51.217769 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8961adb-19d1-40f4-ab1a-9aae5a79e0d2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.308913 Oct 25 03:02:51.237389 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 323/646] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:50 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:51.237389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:51.244724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:51.254835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:51.256310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:51.256945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:51.263451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:51.264113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:51.264751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:51.421784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:02:51.423361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:02:51.427212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:02:51.430228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:02:51.430712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:02:51.620029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:51.695131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:51.696812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:51.698359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:51.700003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:51.701925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1755528831", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "aa55aff8-6f05-40c7-b6cc-14a47f593d2d"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:51.702439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:51.705927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:51.813001 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0350b2d2-e954-4f96-833d-3be8665ea909 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action" status: 202 len: 1067 microversion: 2.1 time: 0.580061 Oct 25 03:02:51.822359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] validate_networks() for [('aa55aff8-6f05-40c7-b6cc-14a47f593d2d', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:02:51.829235 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 324/647] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:51 2022] POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action => generated 1067 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 25 03:02:51.838329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:51.840363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:51.849717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:51.850744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:51.851607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:51.852440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:51.853057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:51.853564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:51.963239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:51.966980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:51.974875 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-768466cd-1387-4a20-b349-3ba52697fbb7 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1281 microversion: 2.1 time: 0.141378 Oct 25 03:02:51.975699 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 325/648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:51 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:51.998078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:51.998704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:52.009160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.009665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.010223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.011012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.011482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.012229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.249543 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3777eb7-a386-48c1-be2b-fd9f2bfe7608 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1645 microversion: 2.1 time: 0.258032 Oct 25 03:02:52.250175 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 326/649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:51 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1645 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:52.265527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:52.266180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:52.272994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.273493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.273956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.274717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.275113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.275540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.448238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:52.461536 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f8fff67-7bce-4278-ac91-89464079d3fb tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.210306 Oct 25 03:02:52.473703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 327/650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:52 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:52.473703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:52.473703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:52.485852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.486342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.487890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.488380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.488964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.489395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.700985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:52.711207 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d4d7f7f7-a50d-4f32-8fb4-91ba54d2f23b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.248009 Oct 25 03:02:52.714726 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 328/651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:52 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:52.915719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:52.919623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.920257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.920543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.921280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.926733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.927240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.958959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b4875611-3e7a-4736-90f9-a487a5c6fa26 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.243269 Oct 25 03:02:52.959712 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 329/652] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:02:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:52.967191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:52.968147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:52.975962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.976878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.977601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:52.978576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:52.979289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:52.979934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.158185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:53.167662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:53.169301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:53.170512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-736fa5d6-132a-40a1-bdc8-84bed5c13cf8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.207798 Oct 25 03:02:53.171070 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 330/653] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:52 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:53.176670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:53.177611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:53.184204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.184887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.185473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.186370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.186972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.187548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.340999 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-deb46c94-47e7-4822-9111-b38f18f27230 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1645 microversion: 2.1 time: 0.167954 Oct 25 03:02:53.342050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 331/654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:53 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1645 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:53.370230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4be30f5d-3758-4550-97a1-68285f34ef54 req-8e745305-58fe-4d96-99ae-c3600e4296c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18469533-ab8d-41ee-b31a-ed6af250dca2", "tag": "aab9bd8d-50b0-491f-98df-0eb600f06623"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:53.392328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4be30f5d-3758-4550-97a1-68285f34ef54 req-8e745305-58fe-4d96-99ae-c3600e4296c8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.393187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4be30f5d-3758-4550-97a1-68285f34ef54 req-8e745305-58fe-4d96-99ae-c3600e4296c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.395707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4be30f5d-3758-4550-97a1-68285f34ef54 req-8e745305-58fe-4d96-99ae-c3600e4296c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.410457 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4be30f5d-3758-4550-97a1-68285f34ef54 req-8e745305-58fe-4d96-99ae-c3600e4296c8 service nova] Creating event network-changed:aab9bd8d-50b0-491f-98df-0eb600f06623 for instance 18469533-ab8d-41ee-b31a-ed6af250dca2 on n-h2-862355-1 Oct 25 03:02:53.416357 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4be30f5d-3758-4550-97a1-68285f34ef54 req-8e745305-58fe-4d96-99ae-c3600e4296c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072531 Oct 25 03:02:53.417697 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 332/655] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:53.423614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f7a7398a-63ee-45e9-910a-7a2ab7832bdc req-a868475e-44f0-460a-bf0b-c487b292213e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1953a61-1d9b-4e63-9233-39bd0365c53d", "name": "network-vif-plugged", "status": "completed", "tag": "ad1e4435-87ae-47e9-a050-7348e0f7d986"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:53.449136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f7a7398a-63ee-45e9-910a-7a2ab7832bdc req-a868475e-44f0-460a-bf0b-c487b292213e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.452439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f7a7398a-63ee-45e9-910a-7a2ab7832bdc req-a868475e-44f0-460a-bf0b-c487b292213e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.453100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f7a7398a-63ee-45e9-910a-7a2ab7832bdc req-a868475e-44f0-460a-bf0b-c487b292213e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.470227 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f7a7398a-63ee-45e9-910a-7a2ab7832bdc req-a868475e-44f0-460a-bf0b-c487b292213e service nova] Creating event network-vif-plugged:ad1e4435-87ae-47e9-a050-7348e0f7d986 for instance c1953a61-1d9b-4e63-9233-39bd0365c53d on n-h1-862355-1 Oct 25 03:02:53.478279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f7a7398a-63ee-45e9-910a-7a2ab7832bdc req-a868475e-44f0-460a-bf0b-c487b292213e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058933 Oct 25 03:02:53.482333 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 333/656] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:53.489227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:53.516566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.518997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.519458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.523811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.524566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.525033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.586624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:02:53.588747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:02:53.590030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:02:53.590625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:02:53.591735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:02:53.592425 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-68690784-4efb-4fda-8d82-d849eaeaf11a tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-862355-1" status: 200 len: 578 microversion: 2.1 time: 0.108554 Oct 25 03:02:53.593068 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 334/657] 10.222.0.36 () {58 vars in 1172 bytes} [Tue Oct 25 03:02:53 2022] GET /compute/v2.1/os-services?host=n-d-862355-1 => generated 578 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:53.610462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:53.611236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:53.614358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.614865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.615299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.618184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.618651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.620308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.633951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.637957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.638776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.640176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.640809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.641522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.667456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Getting quotas for project 19d0f88beaea4c38a2a1878b7a313560. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:02:53.682968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Getting quotas for user 0a079336752a450ca0d8e3ff5ffd4a44 and project 19d0f88beaea4c38a2a1878b7a313560. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:02:53.714526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:02:53.726109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:02:53.874683 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f662c4e3-da30-4238-a733-537169e0eace tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.775653 Oct 25 03:02:53.891152 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 324/658] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:02:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:02:53.901521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:53.910335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.913236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.914614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.917235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:53.919526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:53.921130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:53.985482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:53.999775 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fbb3ff08-b0e3-4f67-bb21-a695e3e00865 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104482 Oct 25 03:02:54.004425 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b7694d6b-6028-4a21-9c63-7be1afad0644 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1281 microversion: 2.1 time: 0.410282 Oct 25 03:02:54.005016 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 335/659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:53 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1281 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:54.019598 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 325/660] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:02:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:54.023179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:54.038026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:54.044495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:54.056158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.056827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.058147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.060545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.061791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.064336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.068233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.068734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.069174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.069921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.070382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.070808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.144904 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b01fb8d6-8102-4b6b-9e54-f8dc6664be75 tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104483 Oct 25 03:02:54.146897 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 326/661] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:02:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:54.161701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:54.162657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:54.178925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.181947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.183515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.185815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.186457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.189285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.381380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:54.396717 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4cb2c39-1434-40f6-9060-7a65eb2cc1d0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1388 microversion: 2.1 time: 0.390595 Oct 25 03:02:54.411250 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 336/662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:54 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1388 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:54.428159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d269545d-ccb5-49a2-8827-30410e3e49fc tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:54.428781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d269545d-ccb5-49a2-8827-30410e3e49fc tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:54.511560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d269545d-ccb5-49a2-8827-30410e3e49fc tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:54.524177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d269545d-ccb5-49a2-8827-30410e3e49fc tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1217 microversion: 2.1 time: 0.105668 Oct 25 03:02:54.525044 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 337/663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:54 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:54.533131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:54.537069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:54.552262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.552705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.554298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.558815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.559631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.560215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.743592 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5c7db9c-c224-43b9-9ec5-0da97a6e723e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87/action" status: 202 len: 0 microversion: 2.1 time: 0.215704 Oct 25 03:02:54.744573 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 338/664] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:54 2022] POST /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:54.751429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:54.763481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.763990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.764444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.770034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.770661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.771112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.837525 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d466b69b-66e2-43e4-ab5c-42c8dd52500d tempest-ServicesAdminTestJSON-822007178 tempest-ServicesAdminTestJSON-822007178-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091619 Oct 25 03:02:54.838581 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 339/665] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:02:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:54.854383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:54.857546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:54.872326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.875704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.877133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:54.878804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:54.880512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:54.881051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.158254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:55.168815 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-858d6045-a6f2-4b9e-bc12-c0d6096abb88 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 1.020071 Oct 25 03:02:55.169432 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 327/666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:54 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:55.173380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:55.188404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:55.189075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:55.196070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:55.205099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.206176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.207641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:55.209326 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3078bc35-fd00-4abb-a184-50b48a5c6005 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.359766 Oct 25 03:02:55.216106 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 340/667] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:54 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:55.226354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:55.228154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:55.237452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.238555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.239196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.239780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.243151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.243672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.244161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.251327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.252009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.253408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.287232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:55.509663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:55.524614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca0b8f45-a245-4e05-ba0c-aed0c3c80111 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.306947 Oct 25 03:02:55.525399 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 341/668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:55 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:55.538136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:55.542341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:55.586750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.587641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.591076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.594352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.595784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.597849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.782011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dbe932c8-5988-405e-a17d-70f7a8b76f1e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1630 microversion: 2.1 time: 0.610039 Oct 25 03:02:55.788592 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 328/669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:55 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1630 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:55.797443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:55.801079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:55.827282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.827790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.832749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:55.836553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:55.837215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:55.837909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:56.012585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:56.023318 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4be3ef3e-b07f-43f6-9e71-f8a45d77ed53 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1269 microversion: 2.1 time: 0.233236 Oct 25 03:02:56.055622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 329/670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:55 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1269 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:56.065281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-70d85be2-f309-44ad-b694-c44a736c0ab5 req-ed249564-e972-46a0-9f1c-78886ca4d622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c6eb87-b6da-475c-97c0-c5e9a437235e", "name": "network-vif-plugged", "status": "completed", "tag": "95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:56.077808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-70d85be2-f309-44ad-b694-c44a736c0ab5 req-ed249564-e972-46a0-9f1c-78886ca4d622 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:56.078549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-70d85be2-f309-44ad-b694-c44a736c0ab5 req-ed249564-e972-46a0-9f1c-78886ca4d622 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:56.079139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-70d85be2-f309-44ad-b694-c44a736c0ab5 req-ed249564-e972-46a0-9f1c-78886ca4d622 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:56.093579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-70d85be2-f309-44ad-b694-c44a736c0ab5 req-ed249564-e972-46a0-9f1c-78886ca4d622 service nova] Creating event network-vif-plugged:95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f for instance a0c6eb87-b6da-475c-97c0-c5e9a437235e on n-h1-862355-1 Oct 25 03:02:56.102800 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-70d85be2-f309-44ad-b694-c44a736c0ab5 req-ed249564-e972-46a0-9f1c-78886ca4d622 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045162 Oct 25 03:02:56.104009 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 330/671] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:56.110434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862355-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:56.114580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:56.121591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:56.122724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:56.123640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:56.124566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:56.125211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:56.125868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:56.162412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lazy-loading 'flavor' on Instance uuid 854f52da-f0d9-4754-8851-e49bc29f2b87 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:02:56.180556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Going to try to live migrate instance to n-h1-862355-1 {{(pid=120563) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:02:56.185223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:56.194527 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2baed881-b063-4d61-9792-84a53998b60b tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1586 microversion: 2.1 time: 0.667616 Oct 25 03:02:56.195115 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 342/672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:55 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1586 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:56.255853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:56.256766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:56.277227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:56.280101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:56.281489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:56.284756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:56.285833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:56.288463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:56.850920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:56.868593 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec24800c-08c6-4098-9153-a011df2c409e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.640638 Oct 25 03:02:56.869883 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 343/673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:56 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:56.910544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:56.911070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:56.930597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:56.932053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:56.936287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:56.937895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:56.939171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:56.940666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:57.147577 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91d7158d-724e-4d88-badb-756b46b3add9 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.262354 Oct 25 03:02:57.149814 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 344/674] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:02:56 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:57.155030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:57.156043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:57.171847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:57.172360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:57.172808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:57.173531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:57.174031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:57.183073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:58.257639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:58.290870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:58.297146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:58.300146 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6d5c4d7-80c3-44a8-a47e-20918d32037f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 1.148580 Oct 25 03:02:58.303659 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 345/675] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:57 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:02:58.320181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:58.320833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:58.330958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:58.331612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:58.332052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:58.332901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:58.333374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:58.333831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:58.344294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:59.169389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:59.182686 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-392ea94d-62a8-48e7-8a97-059014283b73 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.877788 Oct 25 03:02:59.185456 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 346/676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:58 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:59.206502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:59.207714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:59.214856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:59.215558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:59.216161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:59.217109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:59.217750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:59.218398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:59.622568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:02:59.636851 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7aaf923b-3172-4891-86da-7de3ebe1bd8f tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1317 microversion: 2.1 time: 0.435250 Oct 25 03:02:59.641522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 347/677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:59 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:02:59.671901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5b9ade8e-6df1-4f59-b93e-ecc37237313f req-e0e887b1-bd6b-45c6-95f9-8a8356e98783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cedf448-7706-40e9-85f9-dca7d9c7e851", "tag": "65c238b4-e0f6-4624-90ab-597bf202ce38"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:02:59.706603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b9ade8e-6df1-4f59-b93e-ecc37237313f req-e0e887b1-bd6b-45c6-95f9-8a8356e98783 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:59.707436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b9ade8e-6df1-4f59-b93e-ecc37237313f req-e0e887b1-bd6b-45c6-95f9-8a8356e98783 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:59.708212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b9ade8e-6df1-4f59-b93e-ecc37237313f req-e0e887b1-bd6b-45c6-95f9-8a8356e98783 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:59.723571 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5b9ade8e-6df1-4f59-b93e-ecc37237313f req-e0e887b1-bd6b-45c6-95f9-8a8356e98783 service nova] Creating event network-changed:65c238b4-e0f6-4624-90ab-597bf202ce38 for instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 on n-h2-862355-1 Oct 25 03:02:59.731846 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5b9ade8e-6df1-4f59-b93e-ecc37237313f req-e0e887b1-bd6b-45c6-95f9-8a8356e98783 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088820 Oct 25 03:02:59.733240 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 348/678] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:02:59.740341 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa4b78cd-1176-4d5c-b6f3-756a414b83ea tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87/action" status: 202 len: 0 microversion: 2.1 time: 3.634898 Oct 25 03:02:59.741284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:59.741713 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 331/679] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:02:56 2022] POST /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87/action => generated 0 bytes in 3637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:02:59.742689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:59.747083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:02:59.747700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:02:59.757504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:02:59.761125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:59.763641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:59.764095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:59.764896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:59.765889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:59.766630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:59.767100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:59.767532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:59.768555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:02:59.770826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:02:59.772724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:02:59.773524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:00.080718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:00.090241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:00.092079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:00.093534 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a341d11-b383-4aaa-aa0d-612dbd9851f2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.350721 Oct 25 03:03:00.094374 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 332/680] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:02:59 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:00.100088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:00.101128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:00.108243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:00.109080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:00.109780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:00.110995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:00.112222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:00.112907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:00.459536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:00.470853 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea068d86-ca36-4a5d-bf6b-b289eaa6dd06 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.374972 Oct 25 03:03:00.483159 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 333/681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:00 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:00.489053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:00.489901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:00.496412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:00.497153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:00.497796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:00.498659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:00.499265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:00.499871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:00.649871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:00.659867 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d96fb6c-fb57-40e4-bf43-c7eea099121e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.174261 Oct 25 03:03:00.671546 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 334/682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:00 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:00.679473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:00.680106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:00.688539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:00.689044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:00.689731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:00.690850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:00.691107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:00.692529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:00.701670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:00.717484 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a5fb4bf-85cf-462c-aed3-7ef5310e9818 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.982287 Oct 25 03:03:00.730132 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 349/683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:02:59 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:00.855437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:00.867893 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91faecf4-05f4-43a7-909e-e7762cdf1290 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1317 microversion: 2.1 time: 0.194147 Oct 25 03:03:00.869083 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 335/684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:00 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:01.042441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-975aca3f-0946-4720-846b-967f3eac7202 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Calling method '.version_select at 0x7efd3389d4c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:01.066710 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-975aca3f-0946-4720-846b-967f3eac7202 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] HTTP exception thrown: Image not found. Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-975aca3f-0946-4720-846b-967f3eac7202 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Request method failure captured: Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/images/031fa16d-3e60-4812-8476-4c61246f20b8/metadata/os_distro HTTP/1.1 Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HksVeo3gV7wpxY-s3jbZ6LLfDZMJZahfb8mED9NZ708Rd8nSjdF_rwp6uhoiGdEiaX4F7ILSOjfS7UOQxctsEm0G7fdLv2EBPbcLq1v_TuiJIWXwSKduKTov0d2cSwd_JzoGQBcIhhDYbabbPchZBdpzIdnDe97ra9YohSmANA6jY Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:01.073660 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfb278a971a5496a9b5492fb40704dc1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfb278a971a5496a9b5492fb40704dc1"}]}] Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5613651f84f24e459589186eadd8b8cb Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'image_id': '031fa16d-3e60-4812-8476-4c61246f20b8', 'id': 'os_distro'} Oct 25 03:03:01.075159 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.076199 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 031fa16d-3e60-4812-8476-4c61246f20b8 Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.077346 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 031fa16d-3e60-4812-8476-4c61246f20b8 could not be found. Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:03:01.079771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:03:01.082106 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.086185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-975aca3f-0946-4720-846b-967f3eac7202 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:01.087096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-975aca3f-0946-4720-846b-967f3eac7202 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] 10.222.0.36 "DELETE /compute/v2.1/images/031fa16d-3e60-4812-8476-4c61246f20b8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.182963 Oct 25 03:03:01.090480 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 350/685] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 25 03:03:00 2022] DELETE /compute/v2.1/images/031fa16d-3e60-4812-8476-4c61246f20b8/metadata/os_distro => generated 62 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:03:01.099851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1da8a555-2163-4c1a-ac9e-276ddbb801b4 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Calling method '.version_select at 0x7efd3383a9d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:01.128302 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-1da8a555-2163-4c1a-ac9e-276ddbb801b4 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] HTTP exception thrown: Image not found. Oct 25 03:03:01.130462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:01.131223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1da8a555-2163-4c1a-ac9e-276ddbb801b4 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Request method failure captured: Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/images/458d44bd-3811-46fd-9c58-643fdaa91dad/metadata/os_version HTTP/1.1 Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1HksVeo3gV7wpxY-s3jbZ6LLfDZMJZahfb8mED9NZ708Rd8nSjdF_rwp6uhoiGdEiaX4F7ILSOjfS7UOQxctsEm0G7fdLv2EBPbcLq1v_TuiJIWXwSKduKTov0d2cSwd_JzoGQBcIhhDYbabbPchZBdpzIdnDe97ra9YohSmANA6jY Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:03:01.135061 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfb278a971a5496a9b5492fb40704dc1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfb278a971a5496a9b5492fb40704dc1"}]}] Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5613651f84f24e459589186eadd8b8cb Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'image_id': '458d44bd-3811-46fd-9c58-643fdaa91dad', 'id': 'os_version'} Oct 25 03:03:01.136412 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.137216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 458d44bd-3811-46fd-9c58-643fdaa91dad Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.138633 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 458d44bd-3811-46fd-9c58-643fdaa91dad could not be found. Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:03:01.141599 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:03:01.145764 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.150800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.150800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.150800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.150800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.153620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.153827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1da8a555-2163-4c1a-ac9e-276ddbb801b4 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:01.153987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.154241 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1da8a555-2163-4c1a-ac9e-276ddbb801b4 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] 10.222.0.36 "GET /compute/v2.1/images/458d44bd-3811-46fd-9c58-643fdaa91dad/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.052536 Oct 25 03:03:01.154241 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 336/686] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 25 03:03:01 2022] GET /compute/v2.1/images/458d44bd-3811-46fd-9c58-643fdaa91dad/metadata/os_version => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:03:01.162064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f707ca09-9242-45d1-8f43-912409355e0d tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Calling method '.version_select at 0x7efd33c0b160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:01.191362 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-f707ca09-9242-45d1-8f43-912409355e0d tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] HTTP exception thrown: Image not found. Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f707ca09-9242-45d1-8f43-912409355e0d tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Request method failure captured: Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/images/69cfd74e-cf18-4aef-a3c7-714082e36c83/metadata HTTP/1.1 Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1HksVeo3gV7wpxY-s3jbZ6LLfDZMJZahfb8mED9NZ708Rd8nSjdF_rwp6uhoiGdEiaX4F7ILSOjfS7UOQxctsEm0G7fdLv2EBPbcLq1v_TuiJIWXwSKduKTov0d2cSwd_JzoGQBcIhhDYbabbPchZBdpzIdnDe97ra9YohSmANA6jY Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:03:01.195836 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfb278a971a5496a9b5492fb40704dc1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfb278a971a5496a9b5492fb40704dc1"}]}] Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5613651f84f24e459589186eadd8b8cb Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'image_id': '69cfd74e-cf18-4aef-a3c7-714082e36c83'} Oct 25 03:03:01.197191 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.198183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 69cfd74e-cf18-4aef-a3c7-714082e36c83 Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.199261 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69cfd74e-cf18-4aef-a3c7-714082e36c83 could not be found. Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:03:01.201985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:03:01.203533 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.206641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f707ca09-9242-45d1-8f43-912409355e0d tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:01.211392 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f707ca09-9242-45d1-8f43-912409355e0d tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] 10.222.0.36 "GET /compute/v2.1/images/69cfd74e-cf18-4aef-a3c7-714082e36c83/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055714 Oct 25 03:03:01.212719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 337/687] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:03:01 2022] GET /compute/v2.1/images/69cfd74e-cf18-4aef-a3c7-714082e36c83/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:03:01.224892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:01.225510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:01.231825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.232310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.232930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.233739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.234236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.234704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.386532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:01.396528 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-721afe9b-06a3-436f-a0f6-7e7c7b668cf0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1586 microversion: 2.1 time: 0.182685 Oct 25 03:03:01.410439 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 338/688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:01 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1586 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:01.420949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-afe9337c-de7f-40bc-9636-d80bec1f4660 req-977fa42c-ae2a-4718-a6ea-dd11c655df04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1953a61-1d9b-4e63-9233-39bd0365c53d", "tag": "ad1e4435-87ae-47e9-a050-7348e0f7d986"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:01.431931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afe9337c-de7f-40bc-9636-d80bec1f4660 req-977fa42c-ae2a-4718-a6ea-dd11c655df04 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.432546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afe9337c-de7f-40bc-9636-d80bec1f4660 req-977fa42c-ae2a-4718-a6ea-dd11c655df04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.433148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afe9337c-de7f-40bc-9636-d80bec1f4660 req-977fa42c-ae2a-4718-a6ea-dd11c655df04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.445578 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-afe9337c-de7f-40bc-9636-d80bec1f4660 req-977fa42c-ae2a-4718-a6ea-dd11c655df04 service nova] Creating event network-changed:ad1e4435-87ae-47e9-a050-7348e0f7d986 for instance c1953a61-1d9b-4e63-9233-39bd0365c53d on n-h1-862355-1 Oct 25 03:03:01.451078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-afe9337c-de7f-40bc-9636-d80bec1f4660 req-977fa42c-ae2a-4718-a6ea-dd11c655df04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039052 Oct 25 03:03:01.452258 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 339/689] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:01.458740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6df18de1-bb63-419c-991a-15ab9b88c030 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Action: 'update_all', calling method: .version_select at 0x7efd33d6f940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:01.492485 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-6df18de1-bb63-419c-991a-15ab9b88c030 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] HTTP exception thrown: Image not found. Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6df18de1-bb63-419c-991a-15ab9b88c030 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Request method failure captured: Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/images/2ec1eccc-ecab-4c10-a6ce-eaa50b712e11/metadata HTTP/1.1 Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 57 Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1HksVeo3gV7wpxY-s3jbZ6LLfDZMJZahfb8mED9NZ708Rd8nSjdF_rwp6uhoiGdEiaX4F7ILSOjfS7UOQxctsEm0G7fdLv2EBPbcLq1v_TuiJIWXwSKduKTov0d2cSwd_JzoGQBcIhhDYbabbPchZBdpzIdnDe97ra9YohSmANA6jY Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:03:01.498463 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfb278a971a5496a9b5492fb40704dc1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfb278a971a5496a9b5492fb40704dc1"}]}] Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5613651f84f24e459589186eadd8b8cb Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:03:01.499959 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'image_id': '2ec1eccc-ecab-4c10-a6ce-eaa50b712e11', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.500815 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2ec1eccc-ecab-4c10-a6ce-eaa50b712e11 Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.501924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ec1eccc-ecab-4c10-a6ce-eaa50b712e11 could not be found. Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:01.504583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:03:01.505830 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.507047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:01.507149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6df18de1-bb63-419c-991a-15ab9b88c030 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:01.507149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6df18de1-bb63-419c-991a-15ab9b88c030 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] 10.222.0.36 "PUT /compute/v2.1/images/2ec1eccc-ecab-4c10-a6ce-eaa50b712e11/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047119 Oct 25 03:03:01.507149 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 340/690] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:03:01 2022] PUT /compute/v2.1/images/2ec1eccc-ecab-4c10-a6ce-eaa50b712e11/metadata => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:03:01.514383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:01.514555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:01.515566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:01.515936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:01.517198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-662345c7-33b4-4774-b948-e507d1bd854e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.397072 Oct 25 03:03:01.517804 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 351/691] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:01 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:01.526770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.527385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.527975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.528761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.529343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.529948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.537730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f1b24d4-30f6-4154-bdc0-c265bc310df2 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Action: 'update', calling method: .version_select at 0x7efd338baee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:01.571859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-4f1b24d4-30f6-4154-bdc0-c265bc310df2 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] HTTP exception thrown: Image not found. Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f1b24d4-30f6-4154-bdc0-c265bc310df2 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Request method failure captured: Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/images/9e4300f3-1f2f-4474-b2bc-73b25aaa3bfe/metadata/os_distro HTTP/1.1 Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 30 Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HksVeo3gV7wpxY-s3jbZ6LLfDZMJZahfb8mED9NZ708Rd8nSjdF_rwp6uhoiGdEiaX4F7ILSOjfS7UOQxctsEm0G7fdLv2EBPbcLq1v_TuiJIWXwSKduKTov0d2cSwd_JzoGQBcIhhDYbabbPchZBdpzIdnDe97ra9YohSmANA6jY Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:01.574020 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfb278a971a5496a9b5492fb40704dc1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfb278a971a5496a9b5492fb40704dc1"}]}] Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5613651f84f24e459589186eadd8b8cb Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: {"meta": {"os_distro": "alt"}} Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:03:01.575286 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'image_id': '9e4300f3-1f2f-4474-b2bc-73b25aaa3bfe', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.576117 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9e4300f3-1f2f-4474-b2bc-73b25aaa3bfe Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.577142 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9e4300f3-1f2f-4474-b2bc-73b25aaa3bfe could not be found. Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:01.578279 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:03:01.579359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.580697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f1b24d4-30f6-4154-bdc0-c265bc310df2 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:01.580697 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f1b24d4-30f6-4154-bdc0-c265bc310df2 tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] 10.222.0.36 "PUT /compute/v2.1/images/9e4300f3-1f2f-4474-b2bc-73b25aaa3bfe/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.056356 Oct 25 03:03:01.580697 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 352/692] 10.222.0.36 () {60 vars in 1310 bytes} [Tue Oct 25 03:03:01 2022] PUT /compute/v2.1/images/9e4300f3-1f2f-4474-b2bc-73b25aaa3bfe/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:03:01.586853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e3affe1e-26a3-4068-b049-aa31c9fdc50b tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Action: 'create', calling method: .version_select at 0x7efd3386fa60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:01.655561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e3affe1e-26a3-4068-b049-aa31c9fdc50b tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] HTTP exception thrown: Image not found. Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e3affe1e-26a3-4068-b049-aa31c9fdc50b tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Request method failure captured: Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/images/bfc28df8-7f56-4ae8-b1be-bf6d6ad1b998/metadata HTTP/1.1 Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 57 Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HksVeo3gV7wpxY-s3jbZ6LLfDZMJZahfb8mED9NZ708Rd8nSjdF_rwp6uhoiGdEiaX4F7ILSOjfS7UOQxctsEm0G7fdLv2EBPbcLq1v_TuiJIWXwSKduKTov0d2cSwd_JzoGQBcIhhDYbabbPchZBdpzIdnDe97ra9YohSmANA6jY Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:01.657622 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfb278a971a5496a9b5492fb40704dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfb278a971a5496a9b5492fb40704dc1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfb278a971a5496a9b5492fb40704dc1"}]}] Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bfb278a971a5496a9b5492fb40704dc1 Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927 Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5613651f84f24e459589186eadd8b8cb Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1837830927-project Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:03:01.660016 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'image_id': 'bfc28df8-7f56-4ae8-b1be-bf6d6ad1b998', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.661068 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bfc28df8-7f56-4ae8-b1be-bf6d6ad1b998 Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:03:01.662333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bfc28df8-7f56-4ae8-b1be-bf6d6ad1b998 could not be found. Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:01.663404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:03:01.664457 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:01.665806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e3affe1e-26a3-4068-b049-aa31c9fdc50b tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:01.665806 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e3affe1e-26a3-4068-b049-aa31c9fdc50b tempest-ImagesMetadataNegativeTestJSON-1837830927 tempest-ImagesMetadataNegativeTestJSON-1837830927-project] 10.222.0.36 "POST /compute/v2.1/images/bfc28df8-7f56-4ae8-b1be-bf6d6ad1b998/metadata" status: 404 len: 62 microversion: 2.1 time: 0.077592 Oct 25 03:03:01.665806 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 353/693] 10.222.0.36 () {60 vars in 1281 bytes} [Tue Oct 25 03:03:01 2022] POST /compute/v2.1/images/bfc28df8-7f56-4ae8-b1be-bf6d6ad1b998/metadata => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:03:01.685934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:01.686729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:01.697235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.699572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.700320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:01.706642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:01.708212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:01.708971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.050841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:02.061384 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d7742247-e300-4392-80c5-d4aba8a26e25 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.379072 Oct 25 03:03:02.066423 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 354/694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:01 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:02.078850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:02.079625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:02.079625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:02.080012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36b9baf9-7e88-4023-872f-710dc7d98e35 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.577961 Oct 25 03:03:02.085126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:02.086118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:02.086793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.087861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:02.088534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:02.089208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.095267 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 341/695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:01 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:02.107054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-715ac18c-13b7-41c7-821f-f17c8206b314 req-2023fe0e-f678-4e00-b9f7-e23349e6eb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f642c66e-a717-49f0-9b40-95018795fe55", "tag": "be8ee130-0c53-4a20-b3f6-ab1112dc77ca"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:02.123238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-715ac18c-13b7-41c7-821f-f17c8206b314 req-2023fe0e-f678-4e00-b9f7-e23349e6eb08 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:02.125101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-715ac18c-13b7-41c7-821f-f17c8206b314 req-2023fe0e-f678-4e00-b9f7-e23349e6eb08 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:02.126520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-715ac18c-13b7-41c7-821f-f17c8206b314 req-2023fe0e-f678-4e00-b9f7-e23349e6eb08 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.166015 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-715ac18c-13b7-41c7-821f-f17c8206b314 req-2023fe0e-f678-4e00-b9f7-e23349e6eb08 service nova] Creating event network-changed:be8ee130-0c53-4a20-b3f6-ab1112dc77ca for instance f642c66e-a717-49f0-9b40-95018795fe55 on n-h1-862355-1 Oct 25 03:03:02.185008 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-715ac18c-13b7-41c7-821f-f17c8206b314 req-2023fe0e-f678-4e00-b9f7-e23349e6eb08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088392 Oct 25 03:03:02.186526 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 342/696] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:02.202055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:02.205299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:02.222130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:02.224203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:02.224910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.228614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:02.229499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:02.230066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.485141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:02.498808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94c56341-57d5-49bf-92a6-393db37c41fe tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.431035 Oct 25 03:03:02.499990 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 355/697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:02 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:02.543386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:02.544147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:02.562877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:02.566094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:02.568078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.570531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:02.571355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:02.573052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:02.697456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:02.705240 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d853cbe7-bffe-4bbe-be78-04b2878dde25 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1317 microversion: 2.1 time: 0.516025 Oct 25 03:03:02.710416 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 343/698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:02 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:02.912711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:02.930999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:02.938025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:02.941733 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c1e80b6-3841-4026-9f72-e3fc08d8accd tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1568 microversion: 2.25 time: 0.402354 Oct 25 03:03:02.946284 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 356/699] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:02 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1568 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:02.988330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8dfdab31-65c6-4d8e-95a2-797e46580047 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Action: 'create', calling method: .version_select at 0x7efd33f328b0>, body: {"pool": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:03.094036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:03.096739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:03.104091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.104959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.105603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:03.106533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.107182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.107799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:03.270978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:03.279553 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-99a44269-0f2b-4358-88b4-c5278ebe462a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.189930 Oct 25 03:03:03.281232 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 357/700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:03 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:03.287967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:03.288901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:03.296583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.297394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.298080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:03.300855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.301586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.302279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:03.545189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:03.557821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9e4f6f5e-bf2d-44fe-bd87-60e594a4a650 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.274760 Oct 25 03:03:03.584556 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 358/701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:03 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:03.590065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:03.593150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:03.609961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.610474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.610930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:03.613996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.615193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.616922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:03.702364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=98 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:03.804244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:03.814314 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80a7ea72-0fd3-40dd-860b-90e24fe9b978 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.228245 Oct 25 03:03:03.834879 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 359/702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:03 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:03.841052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:03.848233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:03.863140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.863935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.865854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:03.867588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:03.868390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:03.869007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.058478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:04.068514 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b7008e6-6770-4131-9fab-fe6941a8a8ec tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1317 microversion: 2.1 time: 0.231286 Oct 25 03:03:04.069446 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 360/703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:03 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:04.074456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:04.075412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:04.082278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:04.083086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:04.083748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.084709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:04.085239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:04.086767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.088062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=19 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:04.240241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:04.256153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:04.258066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:04.259851 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b207b606-491f-4193-8514-3985eb208a2a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1543 microversion: 2.25 time: 0.188989 Oct 25 03:03:04.260639 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 361/704] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:04 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1543 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:04.299448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a890f684-8e4c-478a-9ef0-a62bd8752044 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '.version_select at 0x7efd3392c040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:04.309074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a890f684-8e4c-478a-9ef0-a62bd8752044 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:04.310188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a890f684-8e4c-478a-9ef0-a62bd8752044 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:04.310642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a890f684-8e4c-478a-9ef0-a62bd8752044 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.333619 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a890f684-8e4c-478a-9ef0-a62bd8752044 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2183 microversion: 2.25 time: 0.046395 Oct 25 03:03:04.337894 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 362/705] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 25 03:03:04 2022] GET /compute/v2.1/os-migrations => generated 2183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:04.343463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:04.344323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:04.353220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:04.354040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:04.354797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.355868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:04.356483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:04.357328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.518892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=66,nova_cell0:UPDATE=7 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:04.570117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:04.583819 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-35ad4aa1-ad0c-4c33-bfc7-e598ae7d879a tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.248165 Oct 25 03:03:04.584765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 363/706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:04 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:04.590147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:04.591165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:04.598793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:04.599420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:04.600002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.603221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:04.603882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:04.605019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:04.801949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:04.908430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 18469533-ab8d-41ee-b31a-ed6af250dca2 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:04.956460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a62a5354-0207-4a8a-8d9b-554d205453cb tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 2036 microversion: 2.25 time: 0.370468 Oct 25 03:03:04.956987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 364/707] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:04 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 2036 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:04.978387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:04.980090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:05.000109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:05.000714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:05.001229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:05.002936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:05.004044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:05.004643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:05.281802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:05.291679 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-101ce3c6-d8dc-4eb5-983d-30f5d92cc86c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.322390 Oct 25 03:03:05.308414 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 365/708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:04 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:05.317374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:05.320424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:05.343904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:05.344409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:05.344854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:05.345566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:05.346367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:05.348757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:05.585306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:05.589233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:05.597819 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4519ea4-5eca-454f-81e6-abfb82422542 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.286619 Oct 25 03:03:05.605731 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 366/709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:05 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:05.618922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-498829a8-5fd0-490a-9ae1-1382b7c773a1 req-daf918c9-4404-444b-b409-4899e3aa6286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedf448-7706-40e9-85f9-dca7d9c7e851", "name": "network-vif-plugged", "status": "completed", "tag": "65c238b4-e0f6-4624-90ab-597bf202ce38"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:05.632685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-498829a8-5fd0-490a-9ae1-1382b7c773a1 req-daf918c9-4404-444b-b409-4899e3aa6286 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:05.633556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-498829a8-5fd0-490a-9ae1-1382b7c773a1 req-daf918c9-4404-444b-b409-4899e3aa6286 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:05.634375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-498829a8-5fd0-490a-9ae1-1382b7c773a1 req-daf918c9-4404-444b-b409-4899e3aa6286 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:05.649275 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-498829a8-5fd0-490a-9ae1-1382b7c773a1 req-daf918c9-4404-444b-b409-4899e3aa6286 service nova] Creating event network-vif-plugged:65c238b4-e0f6-4624-90ab-597bf202ce38 for instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 on n-h2-862355-1 Oct 25 03:03:05.655910 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-498829a8-5fd0-490a-9ae1-1382b7c773a1 req-daf918c9-4404-444b-b409-4899e3aa6286 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055369 Oct 25 03:03:05.656810 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 367/710] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:05.667771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d22d801-4df7-43bf-a4ea-1771ad2b4995 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Action: 'create', calling method: .version_select at 0x7efd339f7ee0>, body: {"keypair": {"name": "tempest-keypair-1887778576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJALDX+DeRimxNLp+NiThDDLGnwuS92JXS0vOGO74h8I0NqItkujqUcPmHjsRo7IZsLVEsakzxi4auXfE/RAsCR8bkhwC0gXa+TCJVVbJjJuDxkBV2EPOpoHrFNEv/Psw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:05.718616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-9d22d801-4df7-43bf-a4ea-1771ad2b4995 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:05.746123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-9d22d801-4df7-43bf-a4ea-1771ad2b4995 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for user 54c1fabb546b47cea96d2d70b32f4c69 and project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:05.800620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9d22d801-4df7-43bf-a4ea-1771ad2b4995 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.142065 Oct 25 03:03:05.803310 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 368/711] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:03:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 25 03:03:05.817274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:05.818620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:05.837792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:05.838591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:05.839206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:05.840145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:05.840814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:05.841561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:06.004052 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8dfdab31-65c6-4d8e-95a2-797e46580047 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.206822 Oct 25 03:03:06.005003 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 344/712] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:03:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:03:06.015730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:06.017067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:06.033948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:06.039132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:06.040972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:06.047214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:06.048157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:06.048614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:06.297647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:06.306134 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4521c156-4b02-49f6-b089-28b1fc6a99ff tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.299765 Oct 25 03:03:06.306904 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 345/713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:06 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:06.318438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c6bc54e-3885-4c49-8a20-06710a6c4008 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Action: 'create', calling method: .version_select at 0x7efd33ace040>, body: {"pool": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:06.328083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:06.338565 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56177ed4-a53a-45a2-bde1-f9bbe72b7eb4 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1317 microversion: 2.1 time: 0.532638 Oct 25 03:03:06.339672 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 369/714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:05 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:06.358249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:06.362732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:06.374336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:06.375885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:06.376521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:06.377477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:06.378145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:06.378896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:06.668001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:06.676989 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7479522-3ebb-4023-a52a-5575e24175df tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.335502 Oct 25 03:03:06.678904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 370/715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:06 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:06.684380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:06.685337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:06.692026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:06.693115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:06.693770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:06.695276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:06.696945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:06.697606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:06.914089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:06.925852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-457e9001-b7a7-4648-a707-2a973a1d01b1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.245660 Oct 25 03:03:06.930061 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 371/716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:06 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:07.335541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:07.336329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:07.342604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:07.343309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:07.343901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:07.345375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:07.346028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:07.346746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:07.500268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:07.510571 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80facfaa-06ce-4304-8cb1-96d7de6a839b tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1323 microversion: 2.1 time: 0.179762 Oct 25 03:03:07.527689 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 372/717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:07 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:07.535291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:07.537170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:07.544810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:07.545546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:07.548255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:07.549280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:07.550116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:07.550914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:08.206596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:08.237095 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-512bb62a-c776-4b2d-98af-131b110f897a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1317 microversion: 2.1 time: 0.707847 Oct 25 03:03:08.238769 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 373/718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:07 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1317 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:08.244898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:08.245739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:08.252693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:08.253187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:08.253632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:08.254438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:08.254907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:08.255340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:08.647291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:08.657291 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2052002-f5a4-4d38-8493-a288e6230aaa tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.417151 Oct 25 03:03:08.658553 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 374/719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:08 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:08.667456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-40e17089-cfb4-4198-b84c-9c7609447db2 req-fbff1295-4d6f-444e-81a2-9820ae86ebe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f642c66e-a717-49f0-9b40-95018795fe55", "name": "network-vif-plugged", "status": "completed", "tag": "be8ee130-0c53-4a20-b3f6-ab1112dc77ca"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:08.692088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-40e17089-cfb4-4198-b84c-9c7609447db2 req-fbff1295-4d6f-444e-81a2-9820ae86ebe6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:08.693072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-40e17089-cfb4-4198-b84c-9c7609447db2 req-fbff1295-4d6f-444e-81a2-9820ae86ebe6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:08.693704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-40e17089-cfb4-4198-b84c-9c7609447db2 req-fbff1295-4d6f-444e-81a2-9820ae86ebe6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:08.706793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-40e17089-cfb4-4198-b84c-9c7609447db2 req-fbff1295-4d6f-444e-81a2-9820ae86ebe6 service nova] Creating event network-vif-plugged:be8ee130-0c53-4a20-b3f6-ab1112dc77ca for instance f642c66e-a717-49f0-9b40-95018795fe55 on n-h1-862355-1 Oct 25 03:03:08.712212 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-40e17089-cfb4-4198-b84c-9c7609447db2 req-fbff1295-4d6f-444e-81a2-9820ae86ebe6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052166 Oct 25 03:03:08.713445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 375/720] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:08.721041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:08.722728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:08.729822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:08.730555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:08.731220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:08.732142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:08.732870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:08.733547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.086327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:09.100216 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed14c312-dc2f-4746-ba07-32fe93746260 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.385366 Oct 25 03:03:09.101384 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 376/721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:08 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:09.111125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-61d3521e-c47c-4d74-93ab-43150823c86e req-14ed7a9e-71ea-4956-81af-cd6d01d9c37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854f52da-f0d9-4754-8851-e49bc29f2b87", "name": "network-vif-unplugged", "status": "completed", "tag": "7c5a35c2-56c8-4882-91a0-17c0ee655ba7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:09.129968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-61d3521e-c47c-4d74-93ab-43150823c86e req-14ed7a9e-71ea-4956-81af-cd6d01d9c37e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.130715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-61d3521e-c47c-4d74-93ab-43150823c86e req-14ed7a9e-71ea-4956-81af-cd6d01d9c37e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.131339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-61d3521e-c47c-4d74-93ab-43150823c86e req-14ed7a9e-71ea-4956-81af-cd6d01d9c37e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.146964 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-61d3521e-c47c-4d74-93ab-43150823c86e req-14ed7a9e-71ea-4956-81af-cd6d01d9c37e service nova] Creating event network-vif-unplugged:7c5a35c2-56c8-4882-91a0-17c0ee655ba7 for instance 854f52da-f0d9-4754-8851-e49bc29f2b87 on n-h2-862355-1 Oct 25 03:03:09.153148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-61d3521e-c47c-4d74-93ab-43150823c86e req-14ed7a9e-71ea-4956-81af-cd6d01d9c37e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047820 Oct 25 03:03:09.154377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 377/722] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:09.160813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:09.161850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:09.169062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.169966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.170673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.171561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.172174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.172815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.320779 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c6bc54e-3885-4c49-8a20-06710a6c4008 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.009534 Oct 25 03:03:09.323004 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 346/723] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:03:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:09.334276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:09.335777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:09.348094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.348876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.349552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.351221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.351927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.352574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.527819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:09.537637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:09.546618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4b1d96cd-3c59-4076-afe5-2fe8542fc721 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1317 microversion: 2.1 time: 0.222271 Oct 25 03:03:09.557733 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 347/724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:09 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:09.557934 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa71d4a7-b156-4a55-b4ea-bd2dfe676535 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1472 microversion: 2.1 time: 0.393047 Oct 25 03:03:09.557934 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 378/725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:09 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:09.558092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d558ad6e-4929-4d68-83d4-69512c833972 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Action: 'create', calling method: .version_select at 0x7efd338098b0>, body: {"pool": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:09.574857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:09.575366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:09.583680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.584561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.585172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.586421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.587099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.587746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.621356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Request method failure captured: Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851/diagnostics HTTP/1.1 Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HWY5siTRHSsjJEOcowuAkWerM5zB50Fi7K1j1oO5KZOO-nEvuhdJbGllFkSk9fXViSEVFKUzmtSQnrNVIPxC83Pa_aE-zpOUq-tvT1HQlXXtrwSI48WDw-BSMVmK-MvBmLSVGfemJUKGSG8rLcGBh4NcFcoeU_t4NeD8m13oYE7fQ Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a75eef4423b94baa9afa561b2c3097b2 Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1283252619 Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:09.623972 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a75eef4423b94baa9afa561b2c3097b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a75eef4423b94baa9afa561b2c3097b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a75eef4423b94baa9afa561b2c3097b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a75eef4423b94baa9afa561b2c3097b2"}]}] Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1283252619 Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a75eef4423b94baa9afa561b2c3097b2 Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1283252619 Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerDiagnosticsNegativeTest-1283252619-project Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: cc9f48a99e274518a7c5c9cd0f5a5795 Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1283252619-project Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:09.625313 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '0cedf448-7706-40e9-85f9-dca7d9c7e851'} Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:03:09.626530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 25 03:03:09.628330 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:09.633048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:09.634422 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ff88233-e769-4e30-9608-eadd277e2d70 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.063846 Oct 25 03:03:09.635651 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 379/726] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:03:09 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851/diagnostics => generated 117 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:03:09.647527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:09.648808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:09.656224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.656728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.657175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.657931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.658661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.659256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.715372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:03:09.867623 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f1b2a21c-8284-408d-892b-1be0eb463fb6 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 204 len: 0 microversion: 2.1 time: 0.225683 Oct 25 03:03:09.871872 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 380/727] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:09 2022] DELETE /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:03:09.876496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:09.878896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:09.886698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.887779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.889566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:09.889566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:09.890000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:09.890481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:10.162078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:10.170587 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51a35fc5-a234-4985-aecf-ed07e0fb28fc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.299898 Oct 25 03:03:10.176750 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 381/728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:09 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:10.186090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:10.187159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:10.194878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:10.195641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:10.196255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:10.197447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:10.198141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:10.198728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:10.511587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:10.526503 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a96f6ab7-e683-4aeb-a1a5-bdf2548cc8cf tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1478 microversion: 2.1 time: 0.348622 Oct 25 03:03:10.527102 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 382/729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:10 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1478 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:10.543219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:10.544107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:10.555425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:10.555926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:10.556369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:10.557080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:10.557539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:10.557998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:10.805141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:10.813649 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ba74ceb-a00e-4577-a3e6-172ddd8b97df tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.285414 Oct 25 03:03:10.826227 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 383/730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:10 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:10.836899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1957337429", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "27a0e5b3-962f-476d-8c4b-975eff19a490"}], "security_groups": [{"name": "tempest-securitygroup--1879056232"}], "key_name": "tempest-keypair-1887778576", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:10.980995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] validate_networks() for [('27a0e5b3-962f-476d-8c4b-975eff19a490', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:03:11.113606 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d558ad6e-4929-4d68-83d4-69512c833972 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.564658 Oct 25 03:03:11.114352 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 348/731] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:03:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:11.119803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:11.120649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:11.129213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:11.129738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:11.130185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:11.131473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:11.131946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:11.132382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:11.303798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:11.315526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dbdf7111-b13c-4de5-9adb-e578fe7e4de8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1506 microversion: 2.1 time: 0.199989 Oct 25 03:03:11.318107 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 349/732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:11 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:11.324994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-872c3f3a-a8eb-4481-9517-e9e5d7f2dc0f tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Action: 'create', calling method: .version_select at 0x7efd33db10d0>, body: {"pool": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:11.997867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:03:11.999598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:03:12.000387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:03:12.000961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:03:12.001892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:03:12.023071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.025365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.026828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.027788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.028419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.029035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.067199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:12.075203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for user 54c1fabb546b47cea96d2d70b32f4c69 and project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:12.095303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:03:12.100078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:03:12.180536 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87eb839f-66ef-449e-8f1c-61aef92b69ea tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.352995 Oct 25 03:03:12.187324 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 384/733] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:03:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:03:12.187836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:12.188738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:12.199248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.200540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.201313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.202568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.204739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.206715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.446054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:12.449938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:12.456662 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1164c89b-f2ef-4d08-8cf4-d19092747356 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.272825 Oct 25 03:03:12.458400 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 385/734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:12 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:12.464290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-90d95564-6a2f-4c37-be4b-9c98a2f4be1b req-d638c7da-1320-447f-82ba-f39f787fdd87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854f52da-f0d9-4754-8851-e49bc29f2b87", "tag": "7c5a35c2-56c8-4882-91a0-17c0ee655ba7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:12.477033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-90d95564-6a2f-4c37-be4b-9c98a2f4be1b req-d638c7da-1320-447f-82ba-f39f787fdd87 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.478016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-90d95564-6a2f-4c37-be4b-9c98a2f4be1b req-d638c7da-1320-447f-82ba-f39f787fdd87 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.479081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-90d95564-6a2f-4c37-be4b-9c98a2f4be1b req-d638c7da-1320-447f-82ba-f39f787fdd87 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.495767 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-90d95564-6a2f-4c37-be4b-9c98a2f4be1b req-d638c7da-1320-447f-82ba-f39f787fdd87 service nova] Creating event network-changed:7c5a35c2-56c8-4882-91a0-17c0ee655ba7 for instance 854f52da-f0d9-4754-8851-e49bc29f2b87 on n-h2-862355-1 Oct 25 03:03:12.500754 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-90d95564-6a2f-4c37-be4b-9c98a2f4be1b req-d638c7da-1320-447f-82ba-f39f787fdd87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040647 Oct 25 03:03:12.501652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 386/735] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:12.507553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:12.508157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:12.511917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:12.516170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.516707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.517315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.519007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.519875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.520476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.575747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:12.577262 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6265190-56ee-426f-8405-a852ee4a841c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55/os-instance-actions/req-f662c4e3-da30-4238-a733-537169e0eace" status: 200 len: 313 microversion: 2.1 time: 0.074474 Oct 25 03:03:12.578348 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 387/736] 10.222.0.36 () {58 vars in 1419 bytes} [Tue Oct 25 03:03:12 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55/os-instance-actions/req-f662c4e3-da30-4238-a733-537169e0eace => generated 313 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:12.584265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:12.585184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:12.591771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.592527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.593332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.594269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.594941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.595822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.642824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.644700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.645409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.646207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lazy-loading 'fault' on Instance uuid 0cedf448-7706-40e9-85f9-dca7d9c7e851 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:12.832212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc9f48a99e274518a7c5c9cd0f5a5795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75eef4423b94baa9afa561b2c3097b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:12.844153 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6855966-17b4-4f96-96d0-9c488ab33a77 tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 200 len: 1313 microversion: 2.1 time: 0.264497 Oct 25 03:03:12.846798 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 388/737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:12 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:12.874722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:12.875647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:12.885520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.886982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.887651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:12.888893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:12.889590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:12.890480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.151309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:13.163075 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d70a1326-bfd7-4477-820c-3f4c73f39bd4 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.301366 Oct 25 03:03:13.164112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 389/738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:12 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:13.204940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:13.210652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:13.234226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.235720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.237160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.238172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.238858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.239454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.344169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:13.371111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:13.373142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:13.377099 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e7b8603-356a-49cd-a9a0-89ae8a846fd2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1290 microversion: 2.25 time: 0.193268 Oct 25 03:03:13.379373 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 390/739] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:13 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1290 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:13.384176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4b7598a3-f469-4706-b50c-b09aae18d7c1 req-5611dd3d-234f-479b-a0a7-21d405c0c5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedf448-7706-40e9-85f9-dca7d9c7e851", "name": "network-vif-deleted", "tag": "65c238b4-e0f6-4624-90ab-597bf202ce38"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:13.394700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4b7598a3-f469-4706-b50c-b09aae18d7c1 req-5611dd3d-234f-479b-a0a7-21d405c0c5fc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.395428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4b7598a3-f469-4706-b50c-b09aae18d7c1 req-5611dd3d-234f-479b-a0a7-21d405c0c5fc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.396167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4b7598a3-f469-4706-b50c-b09aae18d7c1 req-5611dd3d-234f-479b-a0a7-21d405c0c5fc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.410403 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4b7598a3-f469-4706-b50c-b09aae18d7c1 req-5611dd3d-234f-479b-a0a7-21d405c0c5fc service nova] Creating event network-vif-deleted:65c238b4-e0f6-4624-90ab-597bf202ce38 for instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 on n-h2-862355-1 Oct 25 03:03:13.415977 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4b7598a3-f469-4706-b50c-b09aae18d7c1 req-5611dd3d-234f-479b-a0a7-21d405c0c5fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035151 Oct 25 03:03:13.416776 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 391/740] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:13.424229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:13.446241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:13.453251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.455302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.457092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.458117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.458813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.459489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.653951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03f6c87e-424e-4796-8b40-1c13b44e9865 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "POST /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55/action" status: 202 len: 0 microversion: 2.1 time: 0.235520 Oct 25 03:03:13.657392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 392/741] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:03:13 2022] POST /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:13.664570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:13.665909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:13.673270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.685470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.687458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.688741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.689480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.690605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.887176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:13.897497 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc1927bc-25bb-4970-ae7e-ea95d17166f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.238717 Oct 25 03:03:13.902438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 393/742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:13 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:13.903351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:13.904080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:13.911301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.911947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.912489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:13.913301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:13.914004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:13.914560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.122485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:14.144431 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d8429c9-f89b-491f-a765-19f7f4d8885c tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1508 microversion: 2.1 time: 0.234548 Oct 25 03:03:14.146623 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 394/743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:13 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:14.167666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:14.173100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] [instance: 0cedf448-7706-40e9-85f9-dca7d9c7e851] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:14.197220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.199550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.200181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.202200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.202923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.203534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.226890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] HTTP exception thrown: Instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 could not be found. Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Request method failure captured: Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 HTTP/1.1 Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1HWY5siTRHSsjJEOcowuAkWerM5zB50Fi7K1j1oO5KZOO-nEvuhdJbGllFkSk9fXViSEVFKUzmtSQnrNVIPxC83Pa_aE-zpOUq-tvT1HQlXXtrwSI48WDw-BSMVmK-MvBmLSVGfemJUKGSG8rLcGBh4NcFcoeU_t4NeD8m13oYE7fQ Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a75eef4423b94baa9afa561b2c3097b2 Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1283252619 Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:14.228569 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a75eef4423b94baa9afa561b2c3097b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a75eef4423b94baa9afa561b2c3097b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a75eef4423b94baa9afa561b2c3097b2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a75eef4423b94baa9afa561b2c3097b2"}]}] Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1283252619 Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a75eef4423b94baa9afa561b2c3097b2 Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1283252619 Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerDiagnosticsNegativeTest-1283252619-project Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: cc9f48a99e274518a7c5c9cd0f5a5795 Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1283252619-project Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 could not be found. Oct 25 03:03:14.230146 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0cedf448-7706-40e9-85f9-dca7d9c7e851'} Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 could not be found. Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:14.231033 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 could not be found. Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 could not be found. Oct 25 03:03:14.232455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:14.233879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] Returning 404 to user: Instance 0cedf448-7706-40e9-85f9-dca7d9c7e851 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:14.234025 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e9dbc149-abab-4979-a02b-4c20ef20509e tempest-ServerDiagnosticsNegativeTest-1283252619 tempest-ServerDiagnosticsNegativeTest-1283252619-project] 10.222.0.36 "GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851" status: 404 len: 111 microversion: 2.1 time: 0.079159 Oct 25 03:03:14.236489 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 395/744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:14 2022] GET /compute/v2.1/servers/0cedf448-7706-40e9-85f9-dca7d9c7e851 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:14.256035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:14.258483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:14.267367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.271912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.278958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.280350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.281512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.282701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.634244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:14.645415 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94bef530-0479-43d1-9303-96094461635a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.405835 Oct 25 03:03:14.646798 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 396/745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:14 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:14.655032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:14.655944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:14.663996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.664745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.665767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.667178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.667809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.668412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.722921 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-872c3f3a-a8eb-4481-9517-e9e5d7f2dc0f tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.403470 Oct 25 03:03:14.724658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 350/746] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:03:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:14.740574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46fdaccc-3289-435b-91d8-c09d8cc0f85a tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Calling method '.version_select at 0x7efd33b0d310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:14.794678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:14.811258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:14.817461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:14.820986 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3c13527-6c83-4557-945a-bc55f4ebc48a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1344 microversion: 2.25 time: 0.170785 Oct 25 03:03:14.835628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 397/747] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:14 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1344 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:14.925632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:14.928384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:14.939537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.941179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.941179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:14.941797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:14.942262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:14.942695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:15.342417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:15.352110 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b9266b41-9109-4e68-80ad-86182444b234 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.433840 Oct 25 03:03:15.366153 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 398/748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:14 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:15.392175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:15.394151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:15.411838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:15.412473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:15.413233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:15.414498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:15.415044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:15.416374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:15.517210 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46fdaccc-3289-435b-91d8-c09d8cc0f85a tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/ba535500-cf24-47c6-8083-81a61a338926" status: 200 len: 141 microversion: 2.1 time: 0.782020 Oct 25 03:03:15.533000 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 351/749] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:03:14 2022] GET /compute/v2.1/os-floating-ips/ba535500-cf24-47c6-8083-81a61a338926 => generated 141 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:15.538901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e83c2102-d461-4747-a265-5466d95e7438 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Calling method '.version_select at 0x7efd3383a280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:15.759113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:15.768057 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ddea11a6-9ba8-4963-aff6-81e1b7b9f7e5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1508 microversion: 2.1 time: 0.400359 Oct 25 03:03:15.773458 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 399/750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:15 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:15.785406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:15.786408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:15.808228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:15.809013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:15.809697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:15.810651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:15.815622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:15.816216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:16.138285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:16.155779 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-86b88ad6-1b03-4669-a985-b90086facd69 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.379466 Oct 25 03:03:16.157624 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 400/751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:15 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:16.178525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:16.179156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:16.186362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:16.187090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:16.188158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:16.189102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:16.189565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:16.190782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:16.412071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:16.425320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:16.431537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:16.434605 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3bab3651-d9f5-44a4-80da-268fb6c44537 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.263075 Oct 25 03:03:16.435547 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 401/752] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:16 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:16.457174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:16.460282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:16.468378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:16.469238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:16.469929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:16.472328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:16.473780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:16.474583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:16.786590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:16.797821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-010242bd-55ad-48da-827c-20a0834ebfdf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.361124 Oct 25 03:03:16.798906 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 402/753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:16 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:16.814364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:16.815840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:16.823779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:16.824290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:16.824738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:16.825483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:16.825976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:16.826595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:16.831873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:17.055472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:17.069150 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b01a0e5f-77fe-4448-ab1b-c5d374c837df tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1513 microversion: 2.1 time: 0.268159 Oct 25 03:03:17.103414 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 403/754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:16 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:17.116772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2e271b48-4ccf-4d42-baa7-7b985f7184c7 req-8f04a5e1-ddbe-4960-acd9-e88492bb8ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6dbd798-ea90-476c-91fc-c466e0b7bd7a", "tag": "65ec2208-6a10-4f7c-be38-2e1cb525e222"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:17.135321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2e271b48-4ccf-4d42-baa7-7b985f7184c7 req-8f04a5e1-ddbe-4960-acd9-e88492bb8ae0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:17.136154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2e271b48-4ccf-4d42-baa7-7b985f7184c7 req-8f04a5e1-ddbe-4960-acd9-e88492bb8ae0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:17.136579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2e271b48-4ccf-4d42-baa7-7b985f7184c7 req-8f04a5e1-ddbe-4960-acd9-e88492bb8ae0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:17.150703 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2e271b48-4ccf-4d42-baa7-7b985f7184c7 req-8f04a5e1-ddbe-4960-acd9-e88492bb8ae0 service nova] Creating event network-changed:65ec2208-6a10-4f7c-be38-2e1cb525e222 for instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a on n-h2-862355-1 Oct 25 03:03:17.156148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2e271b48-4ccf-4d42-baa7-7b985f7184c7 req-8f04a5e1-ddbe-4960-acd9-e88492bb8ae0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050173 Oct 25 03:03:17.157002 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 404/755] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:17.187117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:17.187836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:17.196143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:17.196738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:17.197254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:17.198110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:17.198653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:17.199176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:17.409878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:17.419147 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-25ca73ab-c976-4e21-b81b-732949a935ab tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.236296 Oct 25 03:03:17.427388 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 405/756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:17 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:17.463048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:17.463930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:17.470411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:17.471127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:17.472370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:17.473255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:17.473914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:17.474492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:17.739795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:17.751639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:17.753913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:17.755724 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73dfeddf-b2b4-442f-9fab-3900d4eeebf9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.296997 Oct 25 03:03:17.756548 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 406/757] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:17 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:17.823284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:17.824075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:17.832257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:17.832895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:17.833432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:17.834540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:17.835169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:17.835600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:17.984257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:17.992699 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ca5249b-30eb-47d4-a8d7-9751a4438b46 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.173100 Oct 25 03:03:17.993229 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 407/758] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:17 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:18.075673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e83c2102-d461-4747-a265-5466d95e7438 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/ba535500-cf24-47c6-8083-81a61a338926" status: 202 len: 0 microversion: 2.1 time: 2.540885 Oct 25 03:03:18.076977 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 352/759] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:03:15 2022] DELETE /compute/v2.1/os-floating-ips/ba535500-cf24-47c6-8083-81a61a338926 => generated 0 bytes in 2543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:18.089924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7330fec9-1e89-4629-92fe-1af689a62e27 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Calling method '.version_select at 0x7efd3387b9d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:18.110448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:18.111664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:18.120402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:18.121093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:18.121709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:18.122740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:18.123363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:18.123952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:18.316115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:18.325830 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-45823164-fe0c-49a3-9477-1c2b30246be6 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1506 microversion: 2.1 time: 0.219275 Oct 25 03:03:18.342802 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 353/760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:18 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:18.622140 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7330fec9-1e89-4629-92fe-1af689a62e27 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.534659 Oct 25 03:03:18.622140 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 408/761] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 25 03:03:18 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:03:18.628252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '.version_select at 0x7efd380434c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:18.629025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:18.638897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:18.639725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:18.640342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:18.641201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:18.641849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:18.642707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:18.652538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ef65e60-55fa-4d84-a338-9ac560e266ba tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Action: 'create', calling method: .version_select at 0x7efd33e575e0>, body: {"keypair": {"name": "tempest-keypair-554582342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOHtRJmk86B4yxyTTOJqocLb2a5Ko8eqIE/3QREGT0rmCBQm7ERZ7thGGTo+y1tneV6EF/IJ+TA62fGRAWo1HWPDDi2iMNwVmRFVKKIg+kANQLoDj9bi8E6iz0dHl74UA=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:18.692355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0ef65e60-55fa-4d84-a338-9ac560e266ba tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Getting quotas for project 38e7ec3d31bd45fcb2c568a0e02cf399. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:18.718314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0ef65e60-55fa-4d84-a338-9ac560e266ba tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Getting quotas for user 3e6d4ed5c63e4f98b72f26a0404d496e and project 38e7ec3d31bd45fcb2c568a0e02cf399. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:18.738063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33746262-96fd-45a2-b84e-fcaf3984132a tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.110979 Oct 25 03:03:18.740968 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 409/762] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 25 03:03:18 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55/os-instance-actions => generated 611 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:18.752369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:18.754452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:18.756284 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ef65e60-55fa-4d84-a338-9ac560e266ba tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.411557 Oct 25 03:03:18.760053 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 354/763] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:03:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:18.770216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:18.770753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:18.771176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:18.774698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:18.775396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:18.776194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:18.782213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12294726-aa24-4154-a49d-a958d31014cc tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Calling method '.version_select at 0x7efd33d02280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:19.171670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:19.180209 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-29598758-e6e2-4a77-ac74-4e12f5d2d18a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1472 microversion: 2.1 time: 0.438026 Oct 25 03:03:19.180827 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 410/764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:18 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:19.197445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:19.202160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:19.212059 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12294726-aa24-4154-a49d-a958d31014cc tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.450669 Oct 25 03:03:19.212816 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 355/765] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:03:18 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:19.218919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:19.221068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:19.224390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.225012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.225462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:19.226369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.226863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.227652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:19.228817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:19.229158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.229613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.230147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:19.230853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.231312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.231741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:19.236905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:19.278455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:03:19.406972 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88d02375-d6b4-4b3e-b0d6-5ac64d5963d5 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 204 len: 0 microversion: 2.1 time: 0.224756 Oct 25 03:03:19.411142 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 411/766] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:19 2022] DELETE /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:03:19.414690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:19.419402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:19.421763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:19.423375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:19.425626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:19.426772 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e6cfe313-8974-4959-ab14-4bb9e231823e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.212758 Oct 25 03:03:19.433238 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 356/767] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:19 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:19.436497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.437196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.438008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:19.439445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.440883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.441563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:19.450983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed1c5457-aa07-4cb9-95ac-a9cf94b569e4 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Calling method '.version_select at 0x7efd337cea60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:19.743059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:19.764354 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6e52f5cc-27bb-4c0f-8651-e9774093d5d8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.351418 Oct 25 03:03:19.765170 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 412/768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:19 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:19.775290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:19.776115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:19.794528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.795387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.795994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:19.796890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:19.797509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:19.798136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:20.331240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:20.342368 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9af77e2-ff73-445d-84b4-b01a163a42f1 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1512 microversion: 2.1 time: 0.575933 Oct 25 03:03:20.366272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 413/769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:19 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1512 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:20.670379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-2117870215", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": "none"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:20.763754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:03:20.765054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:03:20.765795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:03:20.766417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:03:20.767069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:03:20.778203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:20.778819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:20.779351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:20.780365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:20.780935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:20.781462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:20.803696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Getting quotas for project 49b5a4d4bc134bc6ad9680ef8c081889. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:20.809669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Getting quotas for user 5ee1b4d10210450fb806f675fbfa8434 and project 49b5a4d4bc134bc6ad9680ef8c081889. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:20.823210 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed1c5457-aa07-4cb9-95ac-a9cf94b569e4 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/03c377f5-41d0-42b0-b858-a1220013b79b" status: 202 len: 0 microversion: 2.1 time: 1.381912 Oct 25 03:03:20.823862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 357/770] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:03:19 2022] DELETE /compute/v2.1/os-floating-ips/03c377f5-41d0-42b0-b858-a1220013b79b => generated 0 bytes in 1390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:20.827819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:03:20.830142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:20.830530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:03:20.832274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:20.842546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:20.843057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:20.843501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:20.845456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:20.846169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:20.847105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:20.892814 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d409eabb-6964-4f62-a3c6-3ff7346d77f1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.525343 Oct 25 03:03:20.895028 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 414/771] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:03:20.902298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:20.903496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:20.915973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:20.916847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:20.917611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:20.918776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:20.919514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:20.920417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:21.076039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.085118 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86fcd108-9943-41e2-bad6-ee5bb8c445af tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1478 microversion: 2.1 time: 0.259847 Oct 25 03:03:21.085728 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 358/772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:20 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1478 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:21.103266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:21.103883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:21.114728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:21.115225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:21.115655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:21.116358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:21.116810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:21.117230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:21.318377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.335715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.338023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.339413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-671fbe81-8f01-405e-8575-3a3e7c836b01 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.442445 Oct 25 03:03:21.352413 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 415/773] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:20 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:21.353376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.353494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2e7d0ac-440b-4fd7-831e-05a2c5bae134 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Calling method '.version_select at 0x7efd3387b790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:21.369301 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-429115d6-5fad-49b5-bd58-0e4ddda57400 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1504 microversion: 2.1 time: 0.276942 Oct 25 03:03:21.382528 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 359/774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:21 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:21.410782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea5d06e8-5d08-41b2-a052-ae3139225d4a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:21.411568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea5d06e8-5d08-41b2-a052-ae3139225d4a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:21.511238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea5d06e8-5d08-41b2-a052-ae3139225d4a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.522624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea5d06e8-5d08-41b2-a052-ae3139225d4a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.526333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea5d06e8-5d08-41b2-a052-ae3139225d4a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:21.548154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea5d06e8-5d08-41b2-a052-ae3139225d4a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1454 microversion: 2.91 time: 0.163790 Oct 25 03:03:21.552038 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 360/775] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:21 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:21.598741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:21.599396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:21.626784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:21.627273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:21.630274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:21.631045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:21.631534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:21.631966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.099215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:22.117352 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42104174-0285-4d61-9273-57d68e05dfd8 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1512 microversion: 2.1 time: 0.536942 Oct 25 03:03:22.118321 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 361/776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:21 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1512 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:22.123084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:22.123680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:22.162682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.163669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.164319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.169309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.170727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.171550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.603400 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2e7d0ac-440b-4fd7-831e-05a2c5bae134 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/3530255a-3f21-4b7f-a12b-20a1a912f6f8" status: 202 len: 0 microversion: 2.1 time: 1.259436 Oct 25 03:03:22.605030 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 416/777] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:03:21 2022] DELETE /compute/v2.1/os-floating-ips/3530255a-3f21-4b7f-a12b-20a1a912f6f8 => generated 0 bytes in 1262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:22.611328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:22.613193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:22.620420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.621708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.622339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.623180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.623635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.624394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.628650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:22.637862 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36dcce95-918d-4a1b-86fa-d2496cee88bf tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1478 microversion: 2.1 time: 0.518055 Oct 25 03:03:22.638840 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 362/778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:22 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1478 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:22.644103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:22.644794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:22.651992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.652885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.653705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.654626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.655293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.655932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.804670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:22.817226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:22.819843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:22.821287 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d022ed1-60e7-4c2d-88d6-e2bb04811a16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.214835 Oct 25 03:03:22.822458 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 417/779] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:22 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:22.844321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:22.847214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:22.856497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.857946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.858683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:22.864557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:22.866021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:22.866727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.028542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:23.040395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:23.050770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:23.066404 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e17fa49-cd7d-4641-891e-fde89416128c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1514 microversion: 2.91 time: 0.242400 Oct 25 03:03:23.067891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:23.082076 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 418/780] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:22 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:23.087174 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6663e944-7579-45f1-ac1a-ce63151d174a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1479 microversion: 2.1 time: 0.447113 Oct 25 03:03:23.093578 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 363/781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:22 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1479 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:23.094822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6df4e578-2b0a-4f10-b419-86a9ba3a4d95 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] Calling method '.version_select at 0x7efd339e93a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:23.120493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c7e3413e-b4c0-4a8c-9c69-d8ad9b45d40e req-7035316c-587b-45ba-8e4d-fb1de49130fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f642c66e-a717-49f0-9b40-95018795fe55", "name": "network-vif-deleted", "tag": "be8ee130-0c53-4a20-b3f6-ab1112dc77ca"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:23.136200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c7e3413e-b4c0-4a8c-9c69-d8ad9b45d40e req-7035316c-587b-45ba-8e4d-fb1de49130fa service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.136880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c7e3413e-b4c0-4a8c-9c69-d8ad9b45d40e req-7035316c-587b-45ba-8e4d-fb1de49130fa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.137419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c7e3413e-b4c0-4a8c-9c69-d8ad9b45d40e req-7035316c-587b-45ba-8e4d-fb1de49130fa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.170660 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c7e3413e-b4c0-4a8c-9c69-d8ad9b45d40e req-7035316c-587b-45ba-8e4d-fb1de49130fa service nova] Creating event network-vif-deleted:be8ee130-0c53-4a20-b3f6-ab1112dc77ca for instance f642c66e-a717-49f0-9b40-95018795fe55 on n-h1-862355-1 Oct 25 03:03:23.181422 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c7e3413e-b4c0-4a8c-9c69-d8ad9b45d40e req-7035316c-587b-45ba-8e4d-fb1de49130fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071576 Oct 25 03:03:23.186997 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 364/782] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:23.201502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc75e883-a741-4e9b-a0df-c4ca6bf5245e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '.version_select at 0x7efd33798160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:23.208337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc75e883-a741-4e9b-a0df-c4ca6bf5245e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.209172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc75e883-a741-4e9b-a0df-c4ca6bf5245e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.209896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc75e883-a741-4e9b-a0df-c4ca6bf5245e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.242423 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc75e883-a741-4e9b-a0df-c4ca6bf5245e tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.053697 Oct 25 03:03:23.260236 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 365/783] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:03:23 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:23.276620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:23.280983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:23.318759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.319550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.320182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.321067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.323274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.324898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.400124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.406296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.407000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.407692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lazy-loading 'fault' on Instance uuid f642c66e-a717-49f0-9b40-95018795fe55 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:23.549446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a079336752a450ca0d8e3ff5ffd4a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d0f88beaea4c38a2a1878b7a313560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:23.562419 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed4948ea-c58f-4362-ba00-d0fe58c17b38 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 200 len: 1307 microversion: 2.1 time: 0.300795 Oct 25 03:03:23.563203 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 366/784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:23 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 1307 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:23.598027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:23.598666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:23.610579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.611341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.612881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.613807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.614613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.615464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.880738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7091214c-820f-4526-b138-c9bd8a3a7459 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1630 microversion: 2.1 time: 0.302318 Oct 25 03:03:23.881410 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 367/785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:23 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1630 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:23.899350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:23.906749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:23.916556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.917056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.917504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:23.918397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:23.918956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:23.919398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.082228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:24.090690 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-70d36e19-543c-4c70-905b-bb0a7bb845da tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1463 microversion: 2.1 time: 0.207772 Oct 25 03:03:24.091277 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 368/786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:23 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1463 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:24.099038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:24.099654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:24.113516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.115384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.115384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.115384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.115728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.116158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.350667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:24.381229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:24.382969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:24.384764 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-779bae29-0bb7-48a7-8ebd-803836ec536d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.292207 Oct 25 03:03:24.397703 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 369/787] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:24 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:24.397703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-62a94bc7-f612-436b-a4e2-8a01ce70622d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Action: 'create', calling method: .version_select at 0x7efd338f6550>, body: {"keypair": {"name": "tempest-keypair-2002187416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs6VPGX9ADlROeRM3sgoh9TEWMgwxguBXfYIK8CF7ZUU47mjbKy94V18b5x6Hpwa4YpmCUAzO5uno9uwDAseeNTu6wQWtXMT7+QXa94zFA8a0TgfMNehqQBXSzIHWrJ7Q=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:24.415963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-62a94bc7-f612-436b-a4e2-8a01ce70622d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for project a9eaf27614124019998010f834321c31. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:24.417945 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6df4e578-2b0a-4f10-b419-86a9ba3a4d95 tempest-FloatingIPDetailsTestJSON-874055118 tempest-FloatingIPDetailsTestJSON-874055118-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/825416b5-aa6d-4911-a2e7-5f4e5c60113c" status: 202 len: 0 microversion: 2.1 time: 1.324815 Oct 25 03:03:24.419816 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 419/788] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:03:23 2022] DELETE /compute/v2.1/os-floating-ips/825416b5-aa6d-4911-a2e7-5f4e5c60113c => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:24.425845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:24.426476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-62a94bc7-f612-436b-a4e2-8a01ce70622d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for user f7fc1bae87d741e58f4e2182796f2df3 and project a9eaf27614124019998010f834321c31. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:24.427643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:24.438540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.439171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.439699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.440878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.441560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.442244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.464403 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-62a94bc7-f612-436b-a4e2-8a01ce70622d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076521 Oct 25 03:03:24.466160 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 370/789] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:03:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:24.476228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:24.482382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:24.490950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.491999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.492654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.493907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.494580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.495220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.557474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:24.572082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:24.573470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:24.594866 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79413b7c-7055-410d-90cc-a23584e0fdf0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1512 microversion: 2.91 time: 0.173705 Oct 25 03:03:24.597261 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 420/790] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:24 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:24.610772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:24.615679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] [instance: f642c66e-a717-49f0-9b40-95018795fe55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:24.645333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.647277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.648707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.649956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.651726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.653959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.680212 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3974cf07-b5bc-4d4a-abf3-0a405cfe0a98 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action" status: 202 len: 0 microversion: 2.1 time: 0.212427 Oct 25 03:03:24.681835 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 371/791] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:03:24 2022] POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:24.695420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:24.698332 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] HTTP exception thrown: Instance f642c66e-a717-49f0-9b40-95018795fe55 could not be found. Oct 25 03:03:24.698497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Request method failure captured: Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 HTTP/1.1 Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Ha3wDHqBBrFgO9HJ9zXO3qOzTdRMB5PsrXU-ee1BQoLLkxiKSbcopWgbNff4z0B2ZXa56xjLF47sNDboI3l1i7IY7qYUDowEXuWWdl0u7RurBIzdttj6OCrG5V4x8MzKy8TzbL3xAT4QTQv2B9KTojZ1UkZ-3wwIG7w8a-oGJkLZg Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 19d0f88beaea4c38a2a1878b7a313560 Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-InstanceActionsTestJSON-142090848 Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:24.701917 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19d0f88beaea4c38a2a1878b7a313560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19d0f88beaea4c38a2a1878b7a313560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19d0f88beaea4c38a2a1878b7a313560", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19d0f88beaea4c38a2a1878b7a313560"}]}] Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-InstanceActionsTestJSON-142090848 Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 19d0f88beaea4c38a2a1878b7a313560 Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-InstanceActionsTestJSON-142090848 Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-InstanceActionsTestJSON-142090848-project Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0a079336752a450ca0d8e3ff5ffd4a44 Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-InstanceActionsTestJSON-142090848-project Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f642c66e-a717-49f0-9b40-95018795fe55 could not be found. Oct 25 03:03:24.703267 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f642c66e-a717-49f0-9b40-95018795fe55'} Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f642c66e-a717-49f0-9b40-95018795fe55 could not be found. Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:24.704003 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f642c66e-a717-49f0-9b40-95018795fe55 could not be found. Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f642c66e-a717-49f0-9b40-95018795fe55 could not be found. Oct 25 03:03:24.705171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:24.708755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] Returning 404 to user: Instance f642c66e-a717-49f0-9b40-95018795fe55 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:24.709912 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f4a8fb6-be7d-4321-8230-d2ea90b66c09 tempest-InstanceActionsTestJSON-142090848 tempest-InstanceActionsTestJSON-142090848-project] 10.222.0.36 "GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55" status: 404 len: 111 microversion: 2.1 time: 0.111350 Oct 25 03:03:24.710497 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 421/792] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:24 2022] GET /compute/v2.1/servers/f642c66e-a717-49f0-9b40-95018795fe55 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:24.722667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.723295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.723753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.724546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.724974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.725409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.774341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:24.774840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:24.775283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:24.775742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lazy-loading 'fault' on Instance uuid a0c6eb87-b6da-475c-97c0-c5e9a437235e {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:25.074817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39e11c9a-3492-45be-947b-b2dacc6a0406 tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1597 microversion: 2.1 time: 0.388906 Oct 25 03:03:25.075345 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 372/793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:24 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1597 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:25.099916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:25.103810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:25.118314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.119098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.120937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.122548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.125512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.129003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.162400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-88b3641a-5aeb-4ba5-b83d-07aa9b71da48 req-635d7cf2-6553-437c-b1f8-3f88c1bee826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6dbd798-ea90-476c-91fc-c466e0b7bd7a", "name": "network-vif-plugged", "status": "completed", "tag": "65ec2208-6a10-4f7c-be38-2e1cb525e222"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:25.182175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-88b3641a-5aeb-4ba5-b83d-07aa9b71da48 req-635d7cf2-6553-437c-b1f8-3f88c1bee826 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.182669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-88b3641a-5aeb-4ba5-b83d-07aa9b71da48 req-635d7cf2-6553-437c-b1f8-3f88c1bee826 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.183107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-88b3641a-5aeb-4ba5-b83d-07aa9b71da48 req-635d7cf2-6553-437c-b1f8-3f88c1bee826 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.225724 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-88b3641a-5aeb-4ba5-b83d-07aa9b71da48 req-635d7cf2-6553-437c-b1f8-3f88c1bee826 service nova] Creating event network-vif-plugged:65ec2208-6a10-4f7c-be38-2e1cb525e222 for instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a on n-h2-862355-1 Oct 25 03:03:25.229892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:25.238444 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-88b3641a-5aeb-4ba5-b83d-07aa9b71da48 req-635d7cf2-6553-437c-b1f8-3f88c1bee826 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079773 Oct 25 03:03:25.239677 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 373/794] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:25.282054 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e047aa86-182c-49e1-bcc2-8b4d00ad5c1d tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action" status: 202 len: 0 microversion: 2.1 time: 0.183156 Oct 25 03:03:25.282847 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 422/795] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:03:25 2022] POST /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:25.293046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:25.293784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:25.307968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.308468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.308912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.309629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.310110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.310532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.414888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:25.416128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:25.429943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.431930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.433752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.436885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.437821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.439029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.709107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:25.722586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:25.727322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:25.729496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b2f267c-ea70-493a-93a8-6b9afa472852 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.319788 Oct 25 03:03:25.746965 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 423/796] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:25 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:25.759021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:25.775995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:25.793473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.794768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.795729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.796739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.798246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.799203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.953341 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13e6018c-f3c5-4ad3-b476-54134605f77c tempest-ServersAdminTestJSON-343885237 tempest-ServersAdminTestJSON-343885237-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1614 microversion: 2.1 time: 0.665559 Oct 25 03:03:25.958600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 374/797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:25 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1614 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:25.981414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:25.982752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:25.997068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:25.997854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:25.998475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:25.999375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:26.000339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:26.004529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:26.036203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:26.041218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:03:26.133960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:26.145702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:26.147280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:26.153453 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d3573fa-f615-4ee6-b282-ee0822c90b74 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1512 microversion: 2.91 time: 0.405079 Oct 25 03:03:26.166113 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 424/798] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:25 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:26.192702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-44f7bd2a-8731-4321-91b1-3de44aeda26a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "DELETE /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 204 len: 0 microversion: 2.1 time: 0.214870 Oct 25 03:03:26.193997 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 375/799] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:25 2022] DELETE /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:03:26.203184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:26.204193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:26.212558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:26.214249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:26.215891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:26.216913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:26.217605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:26.218231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:26.533128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:26.542264 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-15e07973-2769-4949-bca8-c0e2a8af238a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1469 microversion: 2.1 time: 0.343402 Oct 25 03:03:26.546901 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 425/800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:26 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:26.761965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:26.763144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:26.776937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:26.777448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:26.777930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:26.778657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:26.779123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:26.779557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:27.187753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:27.188959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:27.201910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:27.204060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:27.204944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:27.206836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:27.207783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:27.208698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:27.210225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:27.318292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:27.345436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:27.349531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:27.351239 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9fe072a5-48f9-42b8-a911-41e5f1777cf4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.594267 Oct 25 03:03:27.361971 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 376/801] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:26 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:27.368301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7d260a9a-7df9-477e-acdf-efc5e742e244 req-45da45c5-62e3-4e8a-97ac-a617ea6a7a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c6eb87-b6da-475c-97c0-c5e9a437235e", "name": "network-vif-plugged", "status": "completed", "tag": "95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:27.395186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7d260a9a-7df9-477e-acdf-efc5e742e244 req-45da45c5-62e3-4e8a-97ac-a617ea6a7a1d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:27.403071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7d260a9a-7df9-477e-acdf-efc5e742e244 req-45da45c5-62e3-4e8a-97ac-a617ea6a7a1d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:27.404490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7d260a9a-7df9-477e-acdf-efc5e742e244 req-45da45c5-62e3-4e8a-97ac-a617ea6a7a1d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:27.433092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:27.441449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:27.445372 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7d260a9a-7df9-477e-acdf-efc5e742e244 req-45da45c5-62e3-4e8a-97ac-a617ea6a7a1d service nova] Creating event network-vif-plugged:95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f for instance a0c6eb87-b6da-475c-97c0-c5e9a437235e on n-h1-862355-1 Oct 25 03:03:27.447188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:27.450726 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7d260a9a-7df9-477e-acdf-efc5e742e244 req-45da45c5-62e3-4e8a-97ac-a617ea6a7a1d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086954 Oct 25 03:03:27.451340 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 377/802] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:27.462502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79d2bbf9-a5a8-4365-93b3-5e9facba8947 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1512 microversion: 2.91 time: 0.281783 Oct 25 03:03:27.463269 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 426/803] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:27 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:27.569931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:27.571372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:27.589445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:27.590926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:27.591542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:27.592430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:27.593446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:27.594187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:28.189268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:28.208561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12cbcff0-43a0-4fdc-9ac6-a470a8c40863 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1469 microversion: 2.1 time: 0.643752 Oct 25 03:03:28.234448 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 378/804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:27 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1469 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:28.391859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:28.392480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:28.406423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:28.406962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:28.407349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:28.408262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:28.408945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:28.416135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:28.495956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:28.497242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:28.510920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:28.511628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:28.512601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:28.513882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:28.514670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:28.515275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:28.724401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:28.735742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:28.745904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:28.760873 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bea0c4af-5e96-4f0f-9426-887304aadb83 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1533 microversion: 2.91 time: 0.269448 Oct 25 03:03:28.764391 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 379/805] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:28 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1533 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:28.918055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:28.918954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:28.933267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:28.934000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:28.939375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:28.941191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:28.941906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:28.942515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:29.062992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:29.076699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:29.083203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:29.087071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-788fbbb7-37e1-4376-94c4-10d610b22dac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1412 microversion: 2.25 time: 0.699064 Oct 25 03:03:29.089761 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 427/806] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:28 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1412 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:29.240446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:29.241789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:29.250921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:29.262522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:29.263244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:29.264005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:29.264468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:29.264904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:29.516496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lazy-loading 'services' on Instance uuid afaa770c-434c-4b63-8193-cbdf552be58a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:29.562872 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5c53b2ce-2432-455a-b590-2ed6c998fecc tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1938 microversion: 2.91 time: 0.756780 Oct 25 03:03:29.564186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 380/807] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:28 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1938 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:29.603534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:29.604354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:29.630145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:29.631231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:29.631876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:29.633927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:29.634614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:29.635230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:29.720990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:29.742416 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-708bd67c-ae5f-4550-92fb-fa208237da70 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1469 microversion: 2.1 time: 0.505790 Oct 25 03:03:29.764135 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 428/808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:29 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:29.876341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lazy-loading 'services' on Instance uuid afaa770c-434c-4b63-8193-cbdf552be58a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:29.904998 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e04a0ec2-6c64-4649-b4fa-f7fe8a526ea7 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1938 microversion: 2.91 time: 0.306244 Oct 25 03:03:29.906011 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 381/809] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:29 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1938 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:29.936837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:29.940576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:29.941070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:29.941512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:29.949247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:29.949787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:29.950500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.018776 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e099fa34-6a94-490a-98cf-520c1533fd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.085068 Oct 25 03:03:30.023927 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 429/810] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 25 03:03:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:03:30.047326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:30.048132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:30.075138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.077355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.078449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.085496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.086016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.086468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.119512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:30.120513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:30.139475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.139985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.140438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.141160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.141625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.142091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.175048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lazy-loading 'flavor' on Instance uuid afaa770c-434c-4b63-8193-cbdf552be58a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:30.720388 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-813dd3f5-2813-4d6f-9186-d45fc5db9c92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action" status: 202 len: 0 microversion: 2.91 time: 0.688057 Oct 25 03:03:30.727425 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 382/811] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:03:30 2022] POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:03:30.742157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:30.752295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2a5b8ec5-622f-4be6-89cd-258949707091 req-3ef8d78a-9944-4f6a-824c-6f13281dbf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836d890d-f96e-42cc-bc00-f54993eb0e2c", "name": "network-vif-deleted", "tag": "f008a742-4315-456d-903b-76771148e899"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:30.773111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:30.779184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:30.779328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2a5b8ec5-622f-4be6-89cd-258949707091 req-3ef8d78a-9944-4f6a-824c-6f13281dbf8e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.780395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2a5b8ec5-622f-4be6-89cd-258949707091 req-3ef8d78a-9944-4f6a-824c-6f13281dbf8e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.780853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2a5b8ec5-622f-4be6-89cd-258949707091 req-3ef8d78a-9944-4f6a-824c-6f13281dbf8e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.782340 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd81e66a-a880-4011-9d07-1da8c55d7660 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1607 microversion: 2.25 time: 0.666778 Oct 25 03:03:30.784599 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 430/812] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:30 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1607 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:30.793501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:30.794158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:30.822344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=16 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:30.828847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.829398 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2a5b8ec5-622f-4be6-89cd-258949707091 req-3ef8d78a-9944-4f6a-824c-6f13281dbf8e service nova] Creating event network-vif-deleted:f008a742-4315-456d-903b-76771148e899 for instance 836d890d-f96e-42cc-bc00-f54993eb0e2c on n-h1-862355-1 Oct 25 03:03:30.829560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.832134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.832928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.833400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.839855 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2a5b8ec5-622f-4be6-89cd-258949707091 req-3ef8d78a-9944-4f6a-824c-6f13281dbf8e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113171 Oct 25 03:03:30.841215 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 383/813] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:30.842694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.854229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:30.855495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:30.864725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.865995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.866683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.868666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.869437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.870208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.941135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:30.942797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:30.943286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:30.944488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lazy-loading 'fault' on Instance uuid 836d890d-f96e-42cc-bc00-f54993eb0e2c {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:31.025249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:31.036927 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a5ade7a-c799-4e88-ba60-243383c3e7cb tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 200 len: 1303 microversion: 2.1 time: 0.191198 Oct 25 03:03:31.037539 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 384/814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:30 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:31.059009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:31.059519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:31.078995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:31.079494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:31.079939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:31.080658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:31.081707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:31.082143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:31.246446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c78001f8-2e36-4c9d-b517-0f47eb1d8768 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.189229 Oct 25 03:03:31.247111 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 385/815] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 25 03:03:31 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:03:31.252314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1968254769", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "9f081643-3b9b-4dc0-a846-58f41d0a3888"}], "security_groups": [{"name": "tempest-securitygroup--1011297365"}], "key_name": "tempest-keypair-2002187416", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:31.443906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:31.457921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:31.463661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:31.479336 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b468c6f-d97f-49c2-985f-6d74812a326f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.693510 Oct 25 03:03:31.481976 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 431/816] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:30 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:31.675553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] validate_networks() for [('9f081643-3b9b-4dc0-a846-58f41d0a3888', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:03:32.061596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:32.062266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 836d890d-f96e-42cc-bc00-f54993eb0e2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:32.071196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.072015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.072635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.073532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.074175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.074860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.096233 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] HTTP exception thrown: Instance 836d890d-f96e-42cc-bc00-f54993eb0e2c could not be found. Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Request method failure captured: Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c HTTP/1.1 Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F29JHhWQ6UgEdUBVMuXFIhPn2wFe8NQO1bleOX4-c8FmP5WHuJBTUP36-88oGE3DKu5Ro-Uhg1htWN10POQZWESupyowYebGlS170Ij_SEPFtVfUAW3_bFldT7J-lnMF2pF8hasAC8yqDLgbMulVmSoE-YFkBqmP4i48wiUtFjfmg Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: dadc2c982cfd41c695952d8d54ecf314 Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:32.097881 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dadc2c982cfd41c695952d8d54ecf314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dadc2c982cfd41c695952d8d54ecf314"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dadc2c982cfd41c695952d8d54ecf314", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dadc2c982cfd41c695952d8d54ecf314"}]}] Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: dadc2c982cfd41c695952d8d54ecf314 Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminTestJSON-1579060239-project Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 690d08aa8d2a4ee2b5da985308ee130c Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminTestJSON-1579060239-project Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 836d890d-f96e-42cc-bc00-f54993eb0e2c could not be found. Oct 25 03:03:32.099374 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '836d890d-f96e-42cc-bc00-f54993eb0e2c'} Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836d890d-f96e-42cc-bc00-f54993eb0e2c could not be found. Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:32.100148 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836d890d-f96e-42cc-bc00-f54993eb0e2c could not be found. Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836d890d-f96e-42cc-bc00-f54993eb0e2c could not be found. Oct 25 03:03:32.101379 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:32.104367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Returning 404 to user: Instance 836d890d-f96e-42cc-bc00-f54993eb0e2c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:32.104367 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e595c8ce-0cc0-4d89-892a-c37fae8803d3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c" status: 404 len: 111 microversion: 2.1 time: 0.042771 Oct 25 03:03:32.104367 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 432/817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:32 2022] GET /compute/v2.1/servers/836d890d-f96e-42cc-bc00-f54993eb0e2c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:03:32.107712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:32.108487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:32.116801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.118560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.119464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.120421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.121150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.122238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.154580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:03:32.338545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08081c00-d07a-45b6-a006-0e18ab52678e tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 204 len: 0 microversion: 2.1 time: 0.233695 Oct 25 03:03:32.348404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 433/818] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:32 2022] DELETE /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:03:32.357744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:32.359547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:32.375412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.378450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.385507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.390457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.391559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.392671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.835120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:03:32.836436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:03:32.837079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:03:32.837777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:03:32.838392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:03:32.852042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.860958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.861643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.863763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.864252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.864692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.904012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:32.909140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:32.915215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for user f7fc1bae87d741e58f4e2182796f2df3 and project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:32.919974 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-576268e7-1356-46ef-b64a-be8c129a9ce6 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1470 microversion: 2.1 time: 0.568186 Oct 25 03:03:32.921468 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 434/819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:32 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1470 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:32.932197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:32.935515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:32.938102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:32.942390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:03:32.947381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:03:32.957071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.957577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.960711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:32.965981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:32.967433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:32.968283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:33.026875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-674c4aa7-07cf-4f61-b551-59eac7f5e85f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.778573 Oct 25 03:03:33.028149 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 386/820] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:03:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:03:33.044130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-98964f28-f1aa-449f-b5e7-aab282ef70e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:33.046291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-98964f28-f1aa-449f-b5e7-aab282ef70e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:33.133868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:33.146393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:33.149755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:33.184773 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-816f41f2-b6f7-43d1-b1ac-f14891ca6c0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.246716 Oct 25 03:03:33.185803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-98964f28-f1aa-449f-b5e7-aab282ef70e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:33.194245 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 435/821] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:32 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:33.195694 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-98964f28-f1aa-449f-b5e7-aab282ef70e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1235 microversion: 2.1 time: 0.160408 Oct 25 03:03:33.217537 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 387/822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:33 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1235 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:33.959803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:33.961151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:33.969297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:33.970399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:33.971007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:33.972457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:33.973225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:33.974216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:34.231388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:34.231388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:34.243222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:34.245229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:34.246445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:34.247213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:34.252541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:34.253297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:34.279903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:34.295779 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db544d00-7f87-47d8-b1db-fb995b7c2b3a tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1470 microversion: 2.1 time: 0.341165 Oct 25 03:03:34.306894 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 436/823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:33 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:34.317997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:34.319435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:34.331875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:34.332645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:34.334260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:34.335176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:34.335824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:34.336464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:34.467476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:34.483526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:34.499355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:34.502734 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c743137-56c5-4c8a-83df-277c35110fca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1287 microversion: 2.1 time: 0.193750 Oct 25 03:03:34.503873 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 437/824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:34 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1287 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:34.520103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:34.528436 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-461028fe-fb7d-46f2-a055-b8e419e591f9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.312596 Oct 25 03:03:34.540946 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 388/825] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:34 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:34.959708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8dd1169b-756b-4cdc-a0aa-9483389abf58 req-be6ea175-ebcf-4da8-ba90-e571c310888e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6dbd798-ea90-476c-91fc-c466e0b7bd7a", "tag": "65ec2208-6a10-4f7c-be38-2e1cb525e222"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:34.981104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8dd1169b-756b-4cdc-a0aa-9483389abf58 req-be6ea175-ebcf-4da8-ba90-e571c310888e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:34.981588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8dd1169b-756b-4cdc-a0aa-9483389abf58 req-be6ea175-ebcf-4da8-ba90-e571c310888e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:34.999683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8dd1169b-756b-4cdc-a0aa-9483389abf58 req-be6ea175-ebcf-4da8-ba90-e571c310888e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:35.004661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:35.021243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8dd1169b-756b-4cdc-a0aa-9483389abf58 req-be6ea175-ebcf-4da8-ba90-e571c310888e service nova] Creating event network-changed:65ec2208-6a10-4f7c-be38-2e1cb525e222 for instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a on n-h2-862355-1 Oct 25 03:03:35.034892 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8dd1169b-756b-4cdc-a0aa-9483389abf58 req-be6ea175-ebcf-4da8-ba90-e571c310888e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084450 Oct 25 03:03:35.046841 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 438/826] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:35.328805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:35.329696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:35.349514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:35.352942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:35.353273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:35.354168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:35.356025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:35.358268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:35.528386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:35.529170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:35.536587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:35.537484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:35.538179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:35.539090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:35.539748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:35.540375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:35.761014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:35.775534 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ae539e7-9195-46b2-947e-f9e4a93bf5b9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1293 microversion: 2.1 time: 0.252007 Oct 25 03:03:35.793600 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 439/827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:35 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:35.799701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:35.801105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:35.807925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:35.808738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:35.809436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:35.810402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:35.811065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:35.811695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:35.947197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:35.968833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:35.971353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:35.982748 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-143a8d26-2301-4d04-96b0-91655415ff99 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.186452 Oct 25 03:03:35.983151 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 440/828] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:35 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:36.163607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:36.179671 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-63afd191-4f36-49db-b6cc-e3e5cd971561 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 200 len: 1470 microversion: 2.1 time: 0.853988 Oct 25 03:03:36.180505 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 389/829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:35 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 1470 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:36.806054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:36.808193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:36.825221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:36.828246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:36.829851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:36.832477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:36.835827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:36.838061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:36.885111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:36.886202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:36.898311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:36.901623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:36.902299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:36.903497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:36.904116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:36.904707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:36.947501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:03:36.953926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:37.043277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:37.055585 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f7d7142d-25ca-4b8a-8958-7e252b05efeb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1293 microversion: 2.1 time: 0.254328 Oct 25 03:03:37.058422 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 441/830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:36 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1293 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:37.066769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:37.067434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:37.132698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.134647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.138481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.139555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.144324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.145051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.164542 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c24daa73-6009-4fcb-a0c2-b0c8a0a08258 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 204 len: 0 microversion: 2.1 time: 0.282843 Oct 25 03:03:37.169899 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 390/831] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:36 2022] DELETE /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:03:37.184813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:37.196386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:37.207144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.208380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.209041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.210110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.210788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.211691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.434451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:37.468396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:37.479032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:37.514076 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-59487372-56b0-4fb5-9c46-09bb52873ec7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.453757 Oct 25 03:03:37.558271 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 442/832] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:37 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:37.574145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1776d0b3-1f8b-46f1-b086-03305081b0e1 req-ee75e728-63ae-4c73-a21a-35f8658ff56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c98b2f1-4950-4f07-b4dc-23cc9f12beda", "name": "network-vif-deleted", "tag": "d8d06f64-80bb-4036-89bb-ce9c8e323487"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:37.619078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1776d0b3-1f8b-46f1-b086-03305081b0e1 req-ee75e728-63ae-4c73-a21a-35f8658ff56e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.620018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1776d0b3-1f8b-46f1-b086-03305081b0e1 req-ee75e728-63ae-4c73-a21a-35f8658ff56e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.622018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1776d0b3-1f8b-46f1-b086-03305081b0e1 req-ee75e728-63ae-4c73-a21a-35f8658ff56e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.667944 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1776d0b3-1f8b-46f1-b086-03305081b0e1 req-ee75e728-63ae-4c73-a21a-35f8658ff56e service nova] Creating event network-vif-deleted:d8d06f64-80bb-4036-89bb-ce9c8e323487 for instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda on n-h1-862355-1 Oct 25 03:03:37.685255 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1776d0b3-1f8b-46f1-b086-03305081b0e1 req-ee75e728-63ae-4c73-a21a-35f8658ff56e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125194 Oct 25 03:03:37.703421 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 443/833] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:37.723568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:37.729390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: 5c98b2f1-4950-4f07-b4dc-23cc9f12beda] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:37.754960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.756589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.758589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.759527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.761956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.762403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.794929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:37.795156 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] HTTP exception thrown: Instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda could not be found. Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Request method failure captured: Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda HTTP/1.1 Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F29JHhWQ6UgEdUBVMuXFIhPn2wFe8NQO1bleOX4-c8FmP5WHuJBTUP36-88oGE3DKu5Ro-Uhg1htWN10POQZWESupyowYebGlS170Ij_SEPFtVfUAW3_bFldT7J-lnMF2pF8hasAC8yqDLgbMulVmSoE-YFkBqmP4i48wiUtFjfmg Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: dadc2c982cfd41c695952d8d54ecf314 Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:37.796779 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dadc2c982cfd41c695952d8d54ecf314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dadc2c982cfd41c695952d8d54ecf314"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dadc2c982cfd41c695952d8d54ecf314", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dadc2c982cfd41c695952d8d54ecf314"}]}] Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: dadc2c982cfd41c695952d8d54ecf314 Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminTestJSON-1579060239-project Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 690d08aa8d2a4ee2b5da985308ee130c Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminTestJSON-1579060239-project Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda could not be found. Oct 25 03:03:37.798352 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5c98b2f1-4950-4f07-b4dc-23cc9f12beda'} Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda could not be found. Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:37.799272 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda could not be found. Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda could not be found. Oct 25 03:03:37.802205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:37.807870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07265dd9-79f5-4c34-8fc3-d4a74317b51a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1711 microversion: 2.1 time: 0.634600 Oct 25 03:03:37.808805 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 391/834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:37 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1711 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:37.809081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Returning 404 to user: Instance 5c98b2f1-4950-4f07-b4dc-23cc9f12beda could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:37.811162 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30994174-f3ec-4e15-9b29-129349e3bf7b tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda" status: 404 len: 111 microversion: 2.1 time: 0.101434 Oct 25 03:03:37.811731 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 444/835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:37 2022] GET /compute/v2.1/servers/5c98b2f1-4950-4f07-b4dc-23cc9f12beda => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:37.820130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:37.820632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:37.860377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.860885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.861329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.862183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:37.863135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:37.863570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:37.930953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:03:38.087124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:38.098220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:38.112655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.114546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.115195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:38.115929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.116392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.116821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:38.141156 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ebb9511e-ad46-4f67-858e-1218217d62d1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 204 len: 0 microversion: 2.1 time: 0.323774 Oct 25 03:03:38.147488 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 392/836] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:37 2022] DELETE /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:03:38.155343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:38.156052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:38.166819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.169769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.170237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:38.171121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.171594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.172132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:38.460255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:38.493616 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0114169c-2c03-476f-ad15-e83c02460e39 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.406306 Oct 25 03:03:38.498072 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 445/837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:38 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:38.564338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:38.565917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:38.576315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.577923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.579288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:38.583563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.584337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.585788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:38.629173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:38.642086 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6af2c58b-6f7f-4afc-a82b-4957df63ecd3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1469 microversion: 2.1 time: 0.493010 Oct 25 03:03:38.643225 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 393/838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:38 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1469 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:38.734446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:38.748897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:38.754236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:38.760926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8a843702-bc29-47d8-b1ba-629f38b34b63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.205591 Oct 25 03:03:38.762975 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 446/839] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:38 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:38.837497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:38.838141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:38.844824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.845458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.853776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:38.855274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:38.855760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:38.857268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:39.273729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:39.294540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c05566a-1cd2-4136-9ab0-02664c13df57 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1711 microversion: 2.1 time: 0.459696 Oct 25 03:03:39.297086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 394/840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:38 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1711 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:39.519985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:39.521061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:39.548703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:39.549032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:39.549480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:39.550660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:39.551927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:39.553287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:39.674298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:39.675721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:39.686555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:39.687060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:39.687499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:39.688222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:39.688683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:39.689111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:39.969266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:40.050892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:40.080531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70477864-49ab-46cf-822e-9b0c708e5efb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.559621 Oct 25 03:03:40.086682 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 447/841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:39 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:40.102160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:40.104265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:40.122719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:40.130649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:40.132726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:40.136831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:40.137610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:40.138264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:40.361830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:40.385477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:40.388029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:40.399358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b1b30592-5936-40b9-8000-f15442b76c85 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.305458 Oct 25 03:03:40.400470 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 448/842] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:40 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:40.405971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:40.407528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:40.416040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:40.417445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:40.418260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:40.419153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:40.419886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:40.420466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:40.736343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:40.755696 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bef564e9-2727-4d27-bfee-08c62dbe3b6d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1711 microversion: 2.1 time: 0.353718 Oct 25 03:03:40.760015 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 449/843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:40 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1711 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:41.017033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:41.031772 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95bd67e9-68c8-44ac-a784-056193514878 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1469 microversion: 2.1 time: 1.364763 Oct 25 03:03:41.063816 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 395/844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:39 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1469 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:41.100374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:41.101213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:41.115954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:41.119631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:41.120327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:41.126361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:41.127614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:41.129671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:41.436416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:41.437076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:41.447094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:41.448515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:41.449159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:41.452562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:41.456102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:41.456862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:41.495158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:41.509398 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c7e43de-13be-4743-8e8b-27eb09a4e2bd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.416671 Oct 25 03:03:41.524773 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 450/845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:41 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:41.783820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:41.790424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:41.791878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:41.794765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:41.803996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:41.808828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:41.809847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:41.811248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:41.815811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:41.819823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:41.822957 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-40cbafb4-391a-45bf-b70a-a7dae6b93f42 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.396829 Oct 25 03:03:41.824670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:41.833978 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 396/846] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:41 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:41.975628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-094b755a-2083-413e-8f18-dab3c141051f req-50878691-4c1f-4e7d-8928-5c53cefee558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b07198c-8cd6-4c96-a6eb-b19cd147f6a6", "tag": "fd266ab4-1299-454f-9ad2-48aea8b010d0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:42.021175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-094b755a-2083-413e-8f18-dab3c141051f req-50878691-4c1f-4e7d-8928-5c53cefee558 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:42.024740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-094b755a-2083-413e-8f18-dab3c141051f req-50878691-4c1f-4e7d-8928-5c53cefee558 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:42.029200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-094b755a-2083-413e-8f18-dab3c141051f req-50878691-4c1f-4e7d-8928-5c53cefee558 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:42.058374 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-094b755a-2083-413e-8f18-dab3c141051f req-50878691-4c1f-4e7d-8928-5c53cefee558 service nova] Creating event network-changed:fd266ab4-1299-454f-9ad2-48aea8b010d0 for instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 on n-h1-862355-1 Oct 25 03:03:42.074497 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-094b755a-2083-413e-8f18-dab3c141051f req-50878691-4c1f-4e7d-8928-5c53cefee558 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103631 Oct 25 03:03:42.078349 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 397/847] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:42.090376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:42.094794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:42.110439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:42.112607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:42.114330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:42.115866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:42.118583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:42.119901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:42.438121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:42.451530 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50a624c4-2435-406f-b44b-1af2acc6f3ed tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1711 microversion: 2.1 time: 0.668496 Oct 25 03:03:42.452137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 451/848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:41 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1711 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:42.535073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:42.536455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:42.543423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:42.543927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:42.544371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:42.545080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:42.545537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:42.545990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:42.838006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:42.851475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2050ae99-dbb4-4b8e-84cc-51978a10725d tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1469 microversion: 2.1 time: 0.770798 Oct 25 03:03:42.855650 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 398/849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:42 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1469 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:42.867426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:42.870463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:42.884939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:42.890646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:42.891938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:42.894260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:42.895373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:42.897177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:42.899243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:43.176026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:43.188115 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3cd3812d-c0b9-453a-88d2-3b27e12e5a55 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.659248 Oct 25 03:03:43.190512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=18 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:43.222461 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 452/850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:42 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:43.476758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:43.479664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:43.493288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:43.493490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:43.494056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:43.495139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:43.510788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:43.515259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:43.525224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:43.526066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:43.543233 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-815dfb02-70d3-4219-8335-871e552ad677 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.686145 Oct 25 03:03:43.545940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:43.553376 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 399/851] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:42 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:43.873913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:43.892049 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8cbbacc5-5802-417e-a7dd-380de6ed231f tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1645 microversion: 2.1 time: 0.420848 Oct 25 03:03:43.898455 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 453/852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:43 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1645 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:43.912351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:43.912987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:43.923083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:43.923574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:43.924023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:43.924806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:43.925764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:43.931483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:44.088599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1502021931", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "385d0b29-fab5-4e63-9127-a294e08d4c17"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:44.184285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:44.187012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] validate_networks() for [('385d0b29-fab5-4e63-9127-a294e08d4c17', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:03:44.196386 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6e481316-577c-4106-a73b-39db5682a4c1 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1427 microversion: 2.1 time: 0.293255 Oct 25 03:03:44.197127 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 454/853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:43 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1427 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:44.208317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a816b533-ee8e-4fe8-873e-4d2f384abb87 req-616ef1b1-5659-4807-9f55-7119615770b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c6eb87-b6da-475c-97c0-c5e9a437235e", "name": "network-vif-deleted", "tag": "95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:44.231159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a816b533-ee8e-4fe8-873e-4d2f384abb87 req-616ef1b1-5659-4807-9f55-7119615770b0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:44.231808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a816b533-ee8e-4fe8-873e-4d2f384abb87 req-616ef1b1-5659-4807-9f55-7119615770b0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:44.232383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a816b533-ee8e-4fe8-873e-4d2f384abb87 req-616ef1b1-5659-4807-9f55-7119615770b0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:44.257645 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a816b533-ee8e-4fe8-873e-4d2f384abb87 req-616ef1b1-5659-4807-9f55-7119615770b0 service nova] Creating event network-vif-deleted:95c5d60c-437e-4ecc-aff0-a8ea6ad72d8f for instance a0c6eb87-b6da-475c-97c0-c5e9a437235e on n-h1-862355-1 Oct 25 03:03:44.264333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a816b533-ee8e-4fe8-873e-4d2f384abb87 req-616ef1b1-5659-4807-9f55-7119615770b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064422 Oct 25 03:03:44.266192 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 455/854] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:44.272150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:44.273165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:44.295292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:44.295881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:44.296740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:44.297547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:44.307257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:44.308053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:44.586494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:44.618677 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1aa5279b-e05d-4099-b6a1-fef7358140a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.350566 Oct 25 03:03:44.620521 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 456/855] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:44 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:44.627119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:44.628950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:44.674430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:44.679367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:44.679967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:44.680754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:44.681232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:44.681695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:44.760242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:44.943948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:44.967563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:44.975434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:45.002847 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e83cb4d-f39c-4fd8-b978-4f6468ee2a8c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.369330 Oct 25 03:03:45.024707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 457/856] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:44 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:45.029849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:45.037965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:45.057720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.058225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.058663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.060006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.060467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.060891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.144151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.146036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.146482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.146941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lazy-loading 'fault' on Instance uuid c1953a61-1d9b-4e63-9233-39bd0365c53d {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:45.242404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:03:45.245908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:03:45.245908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:03:45.245908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:03:45.245908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:03:45.256458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefa869da4ec498e985174e256f92ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b75865acf94a8a9a7899e766b10666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:45.263959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.274157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.275794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.276172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1950295f-e18e-48e9-91a6-dfc9a07d1c8a tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 200 len: 1354 microversion: 2.1 time: 0.250051 Oct 25 03:03:45.277141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.277819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.279591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.282251 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 458/857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:45 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 1354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:45.294825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:45.295487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:45.320619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.330980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.332550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.333853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.334472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.335052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.344883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:45.352432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for user 438a56b0a79647f6bb195b7e0c42b089 and project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:45.420554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:03:45.426520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:03:45.460744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:45.461438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:45.462135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:45.462733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lazy-loading 'fault' on Instance uuid a0c6eb87-b6da-475c-97c0-c5e9a437235e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:03:45.576619 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-028475f4-5d86-4a4c-8182-c4a01ce734e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.929213 Oct 25 03:03:45.582101 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 400/858] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:03:45.598894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1dd3677e-bad5-48ec-a210-97cfb394b14c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:45.599933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1dd3677e-bad5-48ec-a210-97cfb394b14c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:46.248953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690d08aa8d2a4ee2b5da985308ee130c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadc2c982cfd41c695952d8d54ecf314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:46.259110 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5ea902f-07c3-468f-88f2-7579d44aa319 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 200 len: 1303 microversion: 2.1 time: 0.975441 Oct 25 03:03:46.280413 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 459/859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:45 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 1303 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:46.295624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:46.296326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:46.308909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:46.311261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:46.315180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:46.318315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:46.320332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:46.322213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:46.324039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:46.572179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1dd3677e-bad5-48ec-a210-97cfb394b14c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:46.583496 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1dd3677e-bad5-48ec-a210-97cfb394b14c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1208 microversion: 2.1 time: 0.993483 Oct 25 03:03:46.586876 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 401/860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:45 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1208 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:46.601861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:46.602823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:46.612087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:46.614995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:46.615923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:46.618625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:46.619330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:46.619994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:46.736331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:46.754357 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c752d944-5d10-4dda-bef2-30ba37c357c7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.469908 Oct 25 03:03:46.759289 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 460/861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:46 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:46.779009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:46.780800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:46.802199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:46.802973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:46.804544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:46.805584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:46.807840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:46.814057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:46.878384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:46.881780 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] HTTP exception thrown: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Request method failure captured: Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d HTTP/1.1 Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FP9keM1pYvsiYGz-eWx9CpOAeX12qUhbvv-mkv_VWf4ZkXKMjz-ZqmXYgAv5f-oIh7G815yiAQH3cciHNDrWAS9Jw404mDrSZDkmIOI93LSCP_4YlxBeY917CF7O3rMUrIAW3qZ9pXqDBZQ3g3wQDXg_pPpSfki2RAmCMeTlR9qf4 Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:46.883683 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b8b75865acf94a8a9a7899e766b10666", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b8b75865acf94a8a9a7899e766b10666"}]}] Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fefa869da4ec498e985174e256f92ada Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:46.885271 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'c1953a61-1d9b-4e63-9233-39bd0365c53d'} Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:46.886208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:46.887672 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:46.889618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Returning 404 to user: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:46.890675 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-86f4de53-feb7-44a3-b9e8-e7e8ff40d585 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 404 len: 111 microversion: 2.1 time: 0.127687 Oct 25 03:03:46.891850 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 461/862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:46 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:46.899594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:46.901572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:46.929014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c3e4ec79-0d8b-401d-ab59-325ac4f32e9f req-ddee7ca3-09de-4a8c-ac9e-9ec7188f5a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1953a61-1d9b-4e63-9233-39bd0365c53d", "name": "network-vif-deleted", "tag": "ad1e4435-87ae-47e9-a050-7348e0f7d986"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:46.939954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c3e4ec79-0d8b-401d-ab59-325ac4f32e9f req-ddee7ca3-09de-4a8c-ac9e-9ec7188f5a37 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:46.940901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c3e4ec79-0d8b-401d-ab59-325ac4f32e9f req-ddee7ca3-09de-4a8c-ac9e-9ec7188f5a37 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:46.941616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c3e4ec79-0d8b-401d-ab59-325ac4f32e9f req-ddee7ca3-09de-4a8c-ac9e-9ec7188f5a37 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:46.960593 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c3e4ec79-0d8b-401d-ab59-325ac4f32e9f req-ddee7ca3-09de-4a8c-ac9e-9ec7188f5a37 service nova] Creating event network-vif-deleted:ad1e4435-87ae-47e9-a050-7348e0f7d986 for instance c1953a61-1d9b-4e63-9233-39bd0365c53d on n-h1-862355-1 Oct 25 03:03:46.960908 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5e85543-a3ff-4a8e-b756-c5ccba9e76a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.365462 Oct 25 03:03:46.973661 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 402/863] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:46 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:46.978539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:46.979517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:47.005741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c3e4ec79-0d8b-401d-ab59-325ac4f32e9f req-ddee7ca3-09de-4a8c-ac9e-9ec7188f5a37 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112162 Oct 25 03:03:47.009025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.013334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.015236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 462/864] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:47.021497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.022491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.022983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.023423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.070147 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] HTTP exception thrown: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Request method failure captured: Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c HTTP/1.1 Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FP9keM1pYvsiYGz-eWx9CpOAeX12qUhbvv-mkv_VWf4ZkXKMjz-ZqmXYgAv5f-oIh7G815yiAQH3cciHNDrWAS9Jw404mDrSZDkmIOI93LSCP_4YlxBeY917CF7O3rMUrIAW3qZ9pXqDBZQ3g3wQDXg_pPpSfki2RAmCMeTlR9qf4 Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:03:47.072330 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b8b75865acf94a8a9a7899e766b10666", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b8b75865acf94a8a9a7899e766b10666"}]}] Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fefa869da4ec498e985174e256f92ada Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.073943 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '4db3b2e1-cbf3-4bde-bc31-2729770c052c'} Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:47.074917 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.076393 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.079002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Returning 404 to user: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:47.080066 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0a09857-1b4f-413c-8712-ffd2e4f4bc15 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 404 len: 111 microversion: 2.1 time: 0.116855 Oct 25 03:03:47.084828 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 403/865] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:46 2022] DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:47.093046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:47.094855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:47.116570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.117097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.117627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.118630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.119106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.119598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.154179 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] HTTP exception thrown: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Request method failure captured: Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c HTTP/1.1 Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FP9keM1pYvsiYGz-eWx9CpOAeX12qUhbvv-mkv_VWf4ZkXKMjz-ZqmXYgAv5f-oIh7G815yiAQH3cciHNDrWAS9Jw404mDrSZDkmIOI93LSCP_4YlxBeY917CF7O3rMUrIAW3qZ9pXqDBZQ3g3wQDXg_pPpSfki2RAmCMeTlR9qf4 Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:47.157630 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b8b75865acf94a8a9a7899e766b10666", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b8b75865acf94a8a9a7899e766b10666"}]}] Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fefa869da4ec498e985174e256f92ada Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.159790 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '4db3b2e1-cbf3-4bde-bc31-2729770c052c'} Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:47.160711 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:47.162198 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.165428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Returning 404 to user: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:47.166360 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94e70749-e546-47ae-921b-5ddb202b2015 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 404 len: 111 microversion: 2.1 time: 0.080217 Oct 25 03:03:47.171804 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 463/866] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:47 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:03:47.176510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b97af2ce-d0ee-4270-a4f3-9223eb32a3f0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '.version_select at 0x7efd33779430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:47.255813 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b97af2ce-d0ee-4270-a4f3-9223eb32a3f0 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202991637" status: 202 len: 0 microversion: 2.1 time: 0.084180 Oct 25 03:03:47.257291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 404/867] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202991637 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:03:47.288330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:47.289115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] [instance: a0c6eb87-b6da-475c-97c0-c5e9a437235e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:47.301243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.301784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.302227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.302945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.303407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.303839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.368716 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] HTTP exception thrown: Instance a0c6eb87-b6da-475c-97c0-c5e9a437235e could not be found. Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Request method failure captured: Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e HTTP/1.1 Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F29JHhWQ6UgEdUBVMuXFIhPn2wFe8NQO1bleOX4-c8FmP5WHuJBTUP36-88oGE3DKu5Ro-Uhg1htWN10POQZWESupyowYebGlS170Ij_SEPFtVfUAW3_bFldT7J-lnMF2pF8hasAC8yqDLgbMulVmSoE-YFkBqmP4i48wiUtFjfmg Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: dadc2c982cfd41c695952d8d54ecf314 Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:47.374570 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dadc2c982cfd41c695952d8d54ecf314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dadc2c982cfd41c695952d8d54ecf314"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dadc2c982cfd41c695952d8d54ecf314", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dadc2c982cfd41c695952d8d54ecf314"}]}] Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: dadc2c982cfd41c695952d8d54ecf314 Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminTestJSON-1579060239 Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminTestJSON-1579060239-project Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 690d08aa8d2a4ee2b5da985308ee130c Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminTestJSON-1579060239-project Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance a0c6eb87-b6da-475c-97c0-c5e9a437235e could not be found. Oct 25 03:03:47.376431 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a0c6eb87-b6da-475c-97c0-c5e9a437235e'} Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c6eb87-b6da-475c-97c0-c5e9a437235e could not be found. Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:47.377335 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c6eb87-b6da-475c-97c0-c5e9a437235e could not be found. Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c6eb87-b6da-475c-97c0-c5e9a437235e could not be found. Oct 25 03:03:47.379209 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:47.380362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] Returning 404 to user: Instance a0c6eb87-b6da-475c-97c0-c5e9a437235e could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:47.380362 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e3b909d-a9b2-4535-bc12-40034e1c15b3 tempest-ServersAdminTestJSON-1579060239 tempest-ServersAdminTestJSON-1579060239-project] 10.222.0.36 "GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e" status: 404 len: 111 microversion: 2.1 time: 0.093744 Oct 25 03:03:47.400652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 464/868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:47 2022] GET /compute/v2.1/servers/a0c6eb87-b6da-475c-97c0-c5e9a437235e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:47.613786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:47.614933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:47.632436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.632949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.633825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.634131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.634594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.638516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.786972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:47.788671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:47.802408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.804169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.804801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.806666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:47.808480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:47.810295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:47.844861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:47.859411 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6dfae3a2-e41c-41b2-b86e-7a33915688c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1260 microversion: 2.1 time: 0.250865 Oct 25 03:03:47.862836 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 405/869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:47 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:47.996221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:47.996846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:48.012398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:48.013138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:48.013779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:48.016196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:48.019865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:48.021414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:48.378267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:48.386815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:48.388284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:48.406761 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4812717e-7ebe-45d5-a3eb-73e0f3c3e7c6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.414851 Oct 25 03:03:48.417704 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 406/870] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:47 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:48.471290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:48.482567 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9c77d20-0395-4611-b629-d96e13a8dcbe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.700197 Oct 25 03:03:48.485386 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 465/871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:47 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:48.879641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7558bd42-27c8-4c44-a6d5-e9075e59c598 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:48.887134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:48.887752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:48.902535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:48.903276 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7558bd42-27c8-4c44-a6d5-e9075e59c598 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1809440273" status: 202 len: 0 microversion: 2.1 time: 0.027753 Oct 25 03:03:48.903648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:48.904093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:48.904804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:48.908279 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 407/872] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:03:48 2022] DELETE /compute/v2.1/flavors/1809440273 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:48.908439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:48.908439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:48.915702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ac36305-d1d8-4003-b737-4973a0dc5918 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:48.964160 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ac36305-d1d8-4003-b737-4973a0dc5918 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.053116 Oct 25 03:03:48.994356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 408/873] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:03:48 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:48.999408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e622ecc-ba10-4d8b-8d63-6394c7d337b4 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.015951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:49.074752 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e622ecc-ba10-4d8b-8d63-6394c7d337b4 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1988608484" status: 202 len: 0 microversion: 2.1 time: 0.078929 Oct 25 03:03:49.075349 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 409/874] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:03:48 2022] DELETE /compute/v2.1/flavors/1988608484 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:03:49.096336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-62eef7a9-69d2-426b-b456-5c72d359e740 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.137487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:49.154925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b83a52e0-239b-45f0-9f4d-6fe583db5b42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1266 microversion: 2.1 time: 0.273991 Oct 25 03:03:49.160147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 466/875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:48 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:49.160654 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-62eef7a9-69d2-426b-b456-5c72d359e740 tempest-ServersWithSpecificFlavorTestJSON-1618455423 tempest-ServersWithSpecificFlavorTestJSON-1618455423-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067922 Oct 25 03:03:49.171041 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 410/876] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:03:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:49.194522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.196694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:49.224013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.229638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.230269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.232037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.234839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.235608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.280777 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] HTTP exception thrown: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Request method failure captured: Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d HTTP/1.1 Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FP9keM1pYvsiYGz-eWx9CpOAeX12qUhbvv-mkv_VWf4ZkXKMjz-ZqmXYgAv5f-oIh7G815yiAQH3cciHNDrWAS9Jw404mDrSZDkmIOI93LSCP_4YlxBeY917CF7O3rMUrIAW3qZ9pXqDBZQ3g3wQDXg_pPpSfki2RAmCMeTlR9qf4 Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:49.290964 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b8b75865acf94a8a9a7899e766b10666", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b8b75865acf94a8a9a7899e766b10666"}]}] Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fefa869da4ec498e985174e256f92ada Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.292646 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'c1953a61-1d9b-4e63-9233-39bd0365c53d'} Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:49.293390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.295376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.306238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Returning 404 to user: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:49.309303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bdd0d2e4-7089-4c3c-b2a5-164802313009 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 404 len: 111 microversion: 2.1 time: 0.119445 Oct 25 03:03:49.314346 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 467/877] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:49 2022] DELETE /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:49.319835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.320466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: c1953a61-1d9b-4e63-9233-39bd0365c53d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:49.329134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.329635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.330439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.330819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.332012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.332940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.371017 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] HTTP exception thrown: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Request method failure captured: Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d HTTP/1.1 Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1FP9keM1pYvsiYGz-eWx9CpOAeX12qUhbvv-mkv_VWf4ZkXKMjz-ZqmXYgAv5f-oIh7G815yiAQH3cciHNDrWAS9Jw404mDrSZDkmIOI93LSCP_4YlxBeY917CF7O3rMUrIAW3qZ9pXqDBZQ3g3wQDXg_pPpSfki2RAmCMeTlR9qf4 Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:03:49.372626 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b8b75865acf94a8a9a7899e766b10666", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b8b75865acf94a8a9a7899e766b10666"}]}] Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fefa869da4ec498e985174e256f92ada Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.374151 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c1953a61-1d9b-4e63-9233-39bd0365c53d'} Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:49.375037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. Oct 25 03:03:49.376458 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.377787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Returning 404 to user: Instance c1953a61-1d9b-4e63-9233-39bd0365c53d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:49.382335 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ed0e1ec-990f-4bde-9387-2bc15299f0cc tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d" status: 404 len: 111 microversion: 2.1 time: 0.059396 Oct 25 03:03:49.385909 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 411/878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:49 2022] GET /compute/v2.1/servers/c1953a61-1d9b-4e63-9233-39bd0365c53d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:49.394596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.395400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:49.413004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.415705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.419787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.422118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.422972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.427184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.452777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.453372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:49.472164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] HTTP exception thrown: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Request method failure captured: Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c HTTP/1.1 Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FP9keM1pYvsiYGz-eWx9CpOAeX12qUhbvv-mkv_VWf4ZkXKMjz-ZqmXYgAv5f-oIh7G815yiAQH3cciHNDrWAS9Jw404mDrSZDkmIOI93LSCP_4YlxBeY917CF7O3rMUrIAW3qZ9pXqDBZQ3g3wQDXg_pPpSfki2RAmCMeTlR9qf4 Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:49.475029 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b8b75865acf94a8a9a7899e766b10666", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b8b75865acf94a8a9a7899e766b10666"}]}] Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fefa869da4ec498e985174e256f92ada Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.476689 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '4db3b2e1-cbf3-4bde-bc31-2729770c052c'} Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:49.477583 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.479018 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.480850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.480850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.480850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.480850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.481393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.481906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.488322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Returning 404 to user: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:49.490239 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1018bc25-4130-4b3b-958f-8c0c02cfa267 tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 404 len: 111 microversion: 2.1 time: 0.102959 Oct 25 03:03:49.496912 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 468/879] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:03:49 2022] DELETE /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:49.508315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.514804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] [instance: 4db3b2e1-cbf3-4bde-bc31-2729770c052c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:49.533390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.538198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.539531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.543510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.545696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.546733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.570199 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] HTTP exception thrown: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Request method failure captured: Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c HTTP/1.1 Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1FP9keM1pYvsiYGz-eWx9CpOAeX12qUhbvv-mkv_VWf4ZkXKMjz-ZqmXYgAv5f-oIh7G815yiAQH3cciHNDrWAS9Jw404mDrSZDkmIOI93LSCP_4YlxBeY917CF7O3rMUrIAW3qZ9pXqDBZQ3g3wQDXg_pPpSfki2RAmCMeTlR9qf4 Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:49.572117 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b8b75865acf94a8a9a7899e766b10666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b8b75865acf94a8a9a7899e766b10666", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b8b75865acf94a8a9a7899e766b10666"}]}] Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b8b75865acf94a8a9a7899e766b10666 Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515 Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fefa869da4ec498e985174e256f92ada Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-779859515-project Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.573664 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '4db3b2e1-cbf3-4bde-bc31-2729770c052c'} Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:49.574517 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. Oct 25 03:03:49.576275 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:49.579109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] Returning 404 to user: Instance 4db3b2e1-cbf3-4bde-bc31-2729770c052c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:49.580251 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-314113df-5fe9-469a-b913-7639240c673d tempest-ServersWithSpecificFlavorTestJSON-779859515 tempest-ServersWithSpecificFlavorTestJSON-779859515-project] 10.222.0.36 "GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c" status: 404 len: 111 microversion: 2.1 time: 0.082341 Oct 25 03:03:49.585011 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 469/880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:49 2022] GET /compute/v2.1/servers/4db3b2e1-cbf3-4bde-bc31-2729770c052c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:49.592458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:49.593473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:49.601148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.601659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.602126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.603204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:49.603674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:49.604117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:49.876178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:49.881357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:49.892510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:49.908534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:49.929103 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13e775cc-86f6-40cf-87e1-8735a19938b9 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.480139 Oct 25 03:03:49.930276 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 412/881] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:49 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:50.073163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:50.094832 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af6ca5cc-fb2e-4904-8d7b-3a1eff87d77b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.500190 Oct 25 03:03:50.111295 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 470/882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:49 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:50.183885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:50.184612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:50.203604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:50.204460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:50.205142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:50.211138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:50.215670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:50.216645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:50.880238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:50.897219 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03062b07-536e-43ee-9eb8-0b0278faa2c2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 0.719644 Oct 25 03:03:50.911370 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 413/883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:50 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:50.967798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:50.969069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:50.984658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:50.985541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:50.986209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:50.987160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:50.991706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:50.992410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:51.123916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:51.124687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:51.134901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:51.136083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:51.140055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:51.140638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:51.146493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:51.147119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:51.149567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:51.151255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:51.156714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:51.176595 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-14ecc270-e770-4120-8371-430b9f9eaed3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.218798 Oct 25 03:03:51.182575 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 471/884] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:50 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:51.928191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:51.928820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:51.958393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:51.958918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:51.959368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:51.960109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:51.985989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:51.990459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:52.240778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:52.259829 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9364411-5699-4a0f-84ca-8f25b193d936 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 1.139653 Oct 25 03:03:52.267328 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 414/885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:51 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:52.290954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b3df9f39-5572-4f9e-ab86-efec019fa30b req-9b673b0a-c205-4a41-81cb-9cf62995e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b07198c-8cd6-4c96-a6eb-b19cd147f6a6", "name": "network-vif-plugged", "status": "completed", "tag": "fd266ab4-1299-454f-9ad2-48aea8b010d0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:52.332249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b3df9f39-5572-4f9e-ab86-efec019fa30b req-9b673b0a-c205-4a41-81cb-9cf62995e8f3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:52.336306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b3df9f39-5572-4f9e-ab86-efec019fa30b req-9b673b0a-c205-4a41-81cb-9cf62995e8f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:52.339097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b3df9f39-5572-4f9e-ab86-efec019fa30b req-9b673b0a-c205-4a41-81cb-9cf62995e8f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:52.374782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b3df9f39-5572-4f9e-ab86-efec019fa30b req-9b673b0a-c205-4a41-81cb-9cf62995e8f3 service nova] Creating event network-vif-plugged:fd266ab4-1299-454f-9ad2-48aea8b010d0 for instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 on n-h1-862355-1 Oct 25 03:03:52.392559 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b3df9f39-5572-4f9e-ab86-efec019fa30b req-9b673b0a-c205-4a41-81cb-9cf62995e8f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107042 Oct 25 03:03:52.394875 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 415/886] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:52.421424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:52.424621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:52.442505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:52.447822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:52.448753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:52.450456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:52.451228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:52.451847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:52.623116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:52.634636 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8573c618-4d5e-467b-aa50-8915e0f38d4a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 0.711257 Oct 25 03:03:52.652572 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 472/887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:51 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:52.734327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:52.747560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:52.751461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:52.767070 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f810e242-b878-4ce8-afee-832cc5af5739 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.369494 Oct 25 03:03:52.774636 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 416/888] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:52 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:53.292447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:53.293052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:53.309526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:53.310326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:53.310914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:53.311793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:53.312402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:53.312978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:53.914772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:53.919236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:53.919729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:53.920168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:53.920897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:53.924547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:53.925700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:53.960167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:54.005618 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d5079c1-45f1-4d78-8903-69132b9bad68 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1361 microversion: 2.1 time: 0.707850 Oct 25 03:03:54.025478 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 473/889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:53 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1361 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:54.072808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:54.073622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:54.093522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:54.094042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:54.094482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:54.095192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:54.095645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:54.096067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:54.137962 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e31b7f4-0797-42e9-b5e9-a47627cb1530 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.672605 Oct 25 03:03:54.172761 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 417/890] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:03:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:03:54.185585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:54.187171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:54.203660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:54.204154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:54.207754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:54.210521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:54.212191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:54.212830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:54.377447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:54.387841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:54.390097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:54.399771 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca897ed8-140d-48e9-b328-ee77008441a0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.225624 Oct 25 03:03:54.429850 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 418/891] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:54 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:54.435446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:54.439651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:54.440479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:54.441255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:54.442294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:54.442936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:54.443612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:54.523354 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-040e38b2-deab-4b1b-ae5e-89f56f373789 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091658 Oct 25 03:03:54.523970 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 419/892] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 25 03:03:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:54.658559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-663570709", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "e0ea67ab-c38a-414b-8017-3e9f6482a61c"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:54.765856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] validate_networks() for [('e0ea67ab-c38a-414b-8017-3e9f6482a61c', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:03:55.004353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:55.019299 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-68955dd5-502c-4df7-98d4-93796432dd3b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 0.990990 Oct 25 03:03:55.038270 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 474/893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:54 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:55.060755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-06b9f451-1218-4106-92d7-aab798aae38e req-7e083743-6c55-4a9f-9731-796693ebb1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73a5304-6eac-4d37-9205-152d9fb4a87d", "tag": "4752f89e-e695-436d-a624-66f72709fa7f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:55.073751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-06b9f451-1218-4106-92d7-aab798aae38e req-7e083743-6c55-4a9f-9731-796693ebb1c7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.076601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-06b9f451-1218-4106-92d7-aab798aae38e req-7e083743-6c55-4a9f-9731-796693ebb1c7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.077324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-06b9f451-1218-4106-92d7-aab798aae38e req-7e083743-6c55-4a9f-9731-796693ebb1c7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.091864 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-06b9f451-1218-4106-92d7-aab798aae38e req-7e083743-6c55-4a9f-9731-796693ebb1c7 service nova] Creating event network-changed:4752f89e-e695-436d-a624-66f72709fa7f for instance e73a5304-6eac-4d37-9205-152d9fb4a87d on n-h1-862355-1 Oct 25 03:03:55.098000 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-06b9f451-1218-4106-92d7-aab798aae38e req-7e083743-6c55-4a9f-9731-796693ebb1c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043355 Oct 25 03:03:55.099197 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 475/894] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:55.104834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:55.109799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.110491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.111103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.112085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.112850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.116942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.170449 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-afbe2125-f440-4991-bdf1-dde03dbb8e7b tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.069712 Oct 25 03:03:55.178912 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 476/895] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:03:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:55.185174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:55.186150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:55.193888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.194826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.195488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.196511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.197127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.197733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.622208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:55.639753 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2db5a80-3885-4bf0-8a98-546c0679f3ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1544 microversion: 2.1 time: 0.459015 Oct 25 03:03:55.641186 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 477/896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:55 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1544 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:55.648356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:55.654673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.655443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.656148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.657586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.659173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.662575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.713772 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8dcd956f-a613-453e-886b-ece1870d2031 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-862355-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.069880 Oct 25 03:03:55.716022 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 478/897] 10.222.0.36 () {58 vars in 1194 bytes} [Tue Oct 25 03:03:55 2022] GET /compute/v2.1/os-services?host=n-d-862355-1&binary=xxx => generated 16 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:03:55.732562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:55.735357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:55.756385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.758232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.759889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:55.762169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:55.763402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:55.764924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.053423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:56.078487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:56.083986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:56.094533 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d6617a0-a623-48bc-ba9f-d9722296fd60 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.376434 Oct 25 03:03:56.095876 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 479/898] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:55 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:56.101952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:56.102936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:56.111547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.115073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.116342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.118059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.118806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.119459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.126309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:03:56.266596 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d391168e-7e97-4a85-a1c2-9dabf1e30d18 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169226 Oct 25 03:03:56.268440 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 480/899] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:03:56 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:56.286212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:56.291721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.293193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.293856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.295757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.296994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.298216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.371965 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aa24320c-c81c-42d1-ac50-94dda1143246 tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.100793 Oct 25 03:03:56.374209 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 481/900] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:03:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:56.388505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:56.390303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:56.406132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.408424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.410328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.411080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.414228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.414868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.443693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:03:56.444280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:03:56.445291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:03:56.445911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:03:56.446431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:03:56.463843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.464674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.465234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.467520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.468922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.473244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.511376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Getting quotas for project acad00293a7142e69ff2d93e90e21c2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:03:56.517330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Getting quotas for user f8536b5ac2ca46778e739e36b8dca81c and project acad00293a7142e69ff2d93e90e21c2b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:03:56.531992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:03:56.535014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:03:56.611997 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-646f7399-33f3-4e85-9a3d-e42182d29d25 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.086123 Oct 25 03:03:56.613585 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 420/901] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:03:56.622979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:56.627309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.628725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.629394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.642868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:56.643740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:56.644629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:56.719453 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c4a891c-83aa-4c73-b79c-c2bb5398f9ec tempest-ServicesAdminNegativeTestJSON-384130431 tempest-ServicesAdminNegativeTestJSON-384130431-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.104487 Oct 25 03:03:56.720224 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 421/902] 10.222.0.36 () {58 vars in 1198 bytes} [Tue Oct 25 03:03:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:03:56.731567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ccb024a-b456-4932-b0d1-37ca87416871 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:56.732968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0ccb024a-b456-4932-b0d1-37ca87416871 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:56.744977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:56.757157 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9d99abbd-e5e4-4237-ae51-d8847d905a7c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 0.378506 Oct 25 03:03:56.774842 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 482/903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:56 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:56.894440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0ccb024a-b456-4932-b0d1-37ca87416871 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:56.904676 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ccb024a-b456-4932-b0d1-37ca87416871 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1215 microversion: 2.1 time: 0.180668 Oct 25 03:03:56.908394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 422/904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:56 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:57.015781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d0d987f-afc1-4456-8f52-cce754af7b63 tempest-ServicesAdminNegativeTestJSON-1149335885 tempest-ServicesAdminNegativeTestJSON-1149335885-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:57.019712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9d0d987f-afc1-4456-8f52-cce754af7b63 tempest-ServicesAdminNegativeTestJSON-1149335885 tempest-ServicesAdminNegativeTestJSON-1149335885-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '354244d65537435db77eb8259df1937d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1797c34d531847d1b736d1749dbde09f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d0d987f-afc1-4456-8f52-cce754af7b63 tempest-ServicesAdminNegativeTestJSON-1149335885 tempest-ServicesAdminNegativeTestJSON-1149335885-project] Request method failure captured: Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IXct7I1-jqHacat07OoF0HY1_uMhh2_k8cehVpICSIPQsNps44_9y5GQL1HmpI7JoTsVQVxBVEG7dVjJE5PW2SDCXz-mvbeXl7epYD-QyPU265YUNZRgSG7fHg4IqQZQfG-YQzJBkB6QUj26WTIsL8INE1h1QgjaNZQob5sciCZJU Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 1797c34d531847d1b736d1749dbde09f Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1149335885 Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:03:57.021182 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1797c34d531847d1b736d1749dbde09f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1797c34d531847d1b736d1749dbde09f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1797c34d531847d1b736d1749dbde09f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1797c34d531847d1b736d1749dbde09f"}]}] Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1149335885 Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 1797c34d531847d1b736d1749dbde09f Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1149335885 Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServicesAdminNegativeTestJSON-1149335885-project Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 354244d65537435db77eb8259df1937d Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1149335885-project Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 25 03:03:57.022560 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:03:57.023373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 25 03:03:57.025422 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:03:57.028542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d0d987f-afc1-4456-8f52-cce754af7b63 tempest-ServicesAdminNegativeTestJSON-1149335885 tempest-ServicesAdminNegativeTestJSON-1149335885-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:03:57.028542 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9d0d987f-afc1-4456-8f52-cce754af7b63 tempest-ServicesAdminNegativeTestJSON-1149335885 tempest-ServicesAdminNegativeTestJSON-1149335885-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.250775 Oct 25 03:03:57.035435 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 483/905] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:03:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:03:57.132000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:57.132985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:57.151367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:57.154705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:57.155404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:57.157284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:57.158768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:57.159495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:57.358537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:57.376134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:57.378532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:57.391177 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-772bf5d2-c943-4cf1-abaa-deca21af6101 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.263861 Oct 25 03:03:57.392400 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 423/906] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:57 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:03:57.782155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:57.784246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:57.799337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:57.801435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:57.803846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:57.806614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:57.808524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:57.809419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:57.935118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:57.936452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:57.948382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:57.948891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:57.949328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:57.950079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:57.950715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:57.951411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:58.120217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:58.143151 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d9edc49-4b86-4cb4-b3d5-ba7263b2a66a tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1267 microversion: 2.1 time: 0.212087 Oct 25 03:03:58.145622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 424/907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:57 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:58.185885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:58.194979 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f769921f-9cee-4f56-88fd-d9e136e133f1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 0.418125 Oct 25 03:03:58.217511 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 484/908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:57 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:03:58.404884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-23bab114-a658-485e-8ea8-b21074461547 req-b4d344be-19c0-433c-9744-90c943566203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b07198c-8cd6-4c96-a6eb-b19cd147f6a6", "tag": "fd266ab4-1299-454f-9ad2-48aea8b010d0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:58.425306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-23bab114-a658-485e-8ea8-b21074461547 req-b4d344be-19c0-433c-9744-90c943566203 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:58.425820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-23bab114-a658-485e-8ea8-b21074461547 req-b4d344be-19c0-433c-9744-90c943566203 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:58.426259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-23bab114-a658-485e-8ea8-b21074461547 req-b4d344be-19c0-433c-9744-90c943566203 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:58.426870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:58.427718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:58.434645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:58.438750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:58.445230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:58.446141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:58.447288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:58.449741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:58.462528 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-23bab114-a658-485e-8ea8-b21074461547 req-b4d344be-19c0-433c-9744-90c943566203 service nova] Creating event network-changed:fd266ab4-1299-454f-9ad2-48aea8b010d0 for instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 on n-h1-862355-1 Oct 25 03:03:58.475517 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-23bab114-a658-485e-8ea8-b21074461547 req-b4d344be-19c0-433c-9744-90c943566203 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074417 Oct 25 03:03:58.476144 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 425/909] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:03:58.571644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:58.584258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:58.596717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:58.596717 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-992f96d9-3547-4439-aed7-55dc7d40eafa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.171024 Oct 25 03:03:58.596717 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 485/910] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:03:58 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:03:58.663033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-679668334", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7f04b87f-408a-4da5-864a-e6cfc5fcb8cb"}], "security_groups": [{"name": "tempest-securitygroup--1469914491"}], "key_name": "tempest-keypair-554582342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2881b813-ace2-4ada-968b-cce89a0bb005", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:03:59.168315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:59.168976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:59.181663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:59.184941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:59.185486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:59.186345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:59.186745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:59.187182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:59.382731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] validate_networks() for [('7f04b87f-408a-4da5-864a-e6cfc5fcb8cb', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:03:59.401994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:03:59.419591 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b44bff2-d60e-48fb-ab5f-2a54a50af6a4 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1273 microversion: 2.1 time: 0.255002 Oct 25 03:03:59.426437 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 486/911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:59 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:03:59.438307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:03:59.440876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:03:59.469510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:59.472527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:59.472854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:03:59.474187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:03:59.474661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:03:59.475097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:00.056141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:00.065338 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-68372ec8-cbe5-4512-ab43-32232d6d6e8c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 0.637538 Oct 25 03:04:00.078650 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 487/912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:03:59 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:00.089473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:00.090412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:00.096964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:00.097920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:00.098683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:00.099615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:00.100282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:00.100933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:00.245571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:00.299985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:00.311983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:00.322509 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d06ca471-b084-455e-9596-2237b1edce22 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.242291 Oct 25 03:04:00.336621 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 488/913] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:00 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:00.446360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:00.447420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:00.457805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:00.458828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:00.459530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:00.461545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:00.463344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:00.464024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:00.564843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:00.582018 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ac5fcd9-193e-4a0c-b5f4-2a804953247f tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1273 microversion: 2.1 time: 0.139278 Oct 25 03:04:00.593755 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 489/914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:00 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:00.690206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Getting quotas for project 38e7ec3d31bd45fcb2c568a0e02cf399. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:00.707935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Getting quotas for user 3e6d4ed5c63e4f98b72f26a0404d496e and project 38e7ec3d31bd45fcb2c568a0e02cf399. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:00.737166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:04:00.737636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:04:00.738170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:04:00.738586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:04:00.739000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:04:00.758330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:00.759078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:00.759689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:00.761364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:00.762251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:00.763008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:00.796325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Getting quotas for project 38e7ec3d31bd45fcb2c568a0e02cf399. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:00.804714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Getting quotas for user 3e6d4ed5c63e4f98b72f26a0404d496e and project 38e7ec3d31bd45fcb2c568a0e02cf399. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:00.881118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:04:00.884398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2881b813-ace2-4ada-968b-cce89a0bb005',volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:04:01.094843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:01.095628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:01.108323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:01.114097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:01.116229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:01.120999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:01.121608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:01.124744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:01.288951 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eddab95d-7b96-41ad-85c9-b4520070128e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.633998 Oct 25 03:04:01.297729 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 426/915] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:03:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:04:01.305111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8231266d-169c-44c2-99a0-e0e0074c8aad tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:01.308280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8231266d-169c-44c2-99a0-e0e0074c8aad tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:01.475864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8231266d-169c-44c2-99a0-e0e0074c8aad tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:01.487622 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8231266d-169c-44c2-99a0-e0e0074c8aad tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1120 microversion: 2.1 time: 0.188659 Oct 25 03:04:01.488221 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 427/916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:01 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1120 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:01.495539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:01.498681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:01.511206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:01.511942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:01.512578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:01.513467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:01.514132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:01.514724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:01.639200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:01.649416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:01.651297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:01.656884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:01.658832 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c308e5e2-4845-4be4-9894-6f8887e6f8fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.169269 Oct 25 03:04:01.660246 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 428/917] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:01 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:01.687510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:01.688133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:01.698095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:01.698715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:01.699123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:01.700040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:01.700743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:01.701358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:02.120893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:02.132749 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f3ec89bd-2e31-488b-91ad-159d3bda2aa6 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 0.471009 Oct 25 03:04:02.136854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 429/918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:01 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:02.141626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-63e865ff-19ff-4f1e-94d9-b4d065a89dd0 req-1d66ebb6-ec51-4e89-8caa-548ce69913da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73a5304-6eac-4d37-9205-152d9fb4a87d", "name": "network-vif-plugged", "status": "completed", "tag": "4752f89e-e695-436d-a624-66f72709fa7f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:02.142062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:02.152532 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6cf5b26d-45f9-4a0a-86b0-7db71fc370e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 1.061891 Oct 25 03:04:02.157232 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 490/919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:01 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:02.180720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-63e865ff-19ff-4f1e-94d9-b4d065a89dd0 req-1d66ebb6-ec51-4e89-8caa-548ce69913da service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:02.181215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-63e865ff-19ff-4f1e-94d9-b4d065a89dd0 req-1d66ebb6-ec51-4e89-8caa-548ce69913da service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:02.181646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-63e865ff-19ff-4f1e-94d9-b4d065a89dd0 req-1d66ebb6-ec51-4e89-8caa-548ce69913da service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:02.203227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-63e865ff-19ff-4f1e-94d9-b4d065a89dd0 req-1d66ebb6-ec51-4e89-8caa-548ce69913da service nova] Creating event network-vif-plugged:4752f89e-e695-436d-a624-66f72709fa7f for instance e73a5304-6eac-4d37-9205-152d9fb4a87d on n-h1-862355-1 Oct 25 03:04:02.216577 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-63e865ff-19ff-4f1e-94d9-b4d065a89dd0 req-1d66ebb6-ec51-4e89-8caa-548ce69913da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078219 Oct 25 03:04:02.219210 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 430/920] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:02.472673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33756b04-14fe-45f1-ba90-a656a900c61a tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:02.486997 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33756b04-14fe-45f1-ba90-a656a900c61a tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.250081 Oct 25 03:04:02.501858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 491/921] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:04:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:02.515443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:02.516507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:02.530062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:02.530942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:02.531735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:02.532984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:02.534069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:02.535128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:02.648704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:02.662744 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da790c3f-7693-4d2c-a95e-5e900da62f11 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1162 microversion: 2.1 time: 0.152294 Oct 25 03:04:02.667668 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 431/922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:02 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1162 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:02.689773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:02.691718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:02.704587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:02.707862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:02.708733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:02.709836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:02.710577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:02.712378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:02.780562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ceff9972-8fb7-4c0f-a7e8-fc8129a7ed73 req-bc0c35ad-81b5-4e66-838c-33265abd6d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1befd924-e3d6-4785-92c2-90de330d26e4", "tag": "5e9c7816-8518-4b51-824f-b306c79b1254"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:02.827502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ceff9972-8fb7-4c0f-a7e8-fc8129a7ed73 req-bc0c35ad-81b5-4e66-838c-33265abd6d03 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:02.828300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ceff9972-8fb7-4c0f-a7e8-fc8129a7ed73 req-bc0c35ad-81b5-4e66-838c-33265abd6d03 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:02.828957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ceff9972-8fb7-4c0f-a7e8-fc8129a7ed73 req-bc0c35ad-81b5-4e66-838c-33265abd6d03 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:02.864415 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ceff9972-8fb7-4c0f-a7e8-fc8129a7ed73 req-bc0c35ad-81b5-4e66-838c-33265abd6d03 service nova] Creating event network-changed:5e9c7816-8518-4b51-824f-b306c79b1254 for instance 1befd924-e3d6-4785-92c2-90de330d26e4 on n-h2-862355-1 Oct 25 03:04:02.869984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ceff9972-8fb7-4c0f-a7e8-fc8129a7ed73 req-bc0c35ad-81b5-4e66-838c-33265abd6d03 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102828 Oct 25 03:04:02.870838 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 432/923] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:02.970257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:02.988491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:02.990263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:03.009867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-125d06b6-53da-4922-bc0f-e57fc4b7fd8d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.322178 Oct 25 03:04:03.011290 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 492/924] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:02 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:03.165544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:03.166353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:03.183440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:03.184075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:03.191682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:03.192183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:03.192626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:03.193343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:03.193832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:03.194261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:03.200683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:03.201451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:03.202384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:03.205596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:03.207865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:03.208736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:04.045580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:04.060545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-78b66fef-777a-46d7-b5e8-094409d6ecd1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1308 microversion: 2.1 time: 0.880976 Oct 25 03:04:04.083175 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 493/925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:03 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1308 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:04.091737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:04.092369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:04.099897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:04.100651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:04.101926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:04.102816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:04.103428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:04.104004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:04.308701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:04.318489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d4d73e7a-67d0-479d-b386-1e3b6a7dd519 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1218 microversion: 2.1 time: 0.232840 Oct 25 03:04:04.330193 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 494/926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:04 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:04.341648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96a68d5e-e706-473b-b6ef-c0ec52fc8b35 tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2126911502", "imageRef": "0ec0b36e-ad92-4933-a9ce-b6cf759b9938", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:04.453108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:04.467444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-96a68d5e-e706-473b-b6ef-c0ec52fc8b35 tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:04:04.476308 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-28ca9950-8b35-4ac9-91d2-2968e5b2bc26 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 1.319884 Oct 25 03:04:04.486245 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 433/927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:03 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:04.523352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:04.531921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:04.570419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:04.572625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:04.574350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:04.575355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:04.576017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:04.576888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:04.740638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:04.760275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:04.764315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:04.772254 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-df73afb2-4b56-4d63-8f12-db3e3bcaff92 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.274883 Oct 25 03:04:04.773488 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 434/928] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:04 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:05.040343 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-96a68d5e-e706-473b-b6ef-c0ec52fc8b35 tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96a68d5e-e706-473b-b6ef-c0ec52fc8b35 tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] Request method failure captured: Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 143 Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IiXbGoPRke-dy2sIwEvtct9_exw3RLmY5Pgh-gP05A8IX_J9n5r6wQNsHfXej0tZk6isAEcj0m9rOpyK7j_ipOBZSqUdm77i-e4Ob-LVlQ0tUVo43xYWbxpJixw0qcmT0b47fDm-Kn2eV9WM-kT7j12QkHCcP3OM_Vv54v71mbfSM Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 916f8934b923414098867f853447b28e Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FlavorsV2NegativeTest-1033578808 Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:05.042501 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/916f8934b923414098867f853447b28e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/916f8934b923414098867f853447b28e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_916f8934b923414098867f853447b28e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/916f8934b923414098867f853447b28e"}]}] Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FlavorsV2NegativeTest-1033578808 Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 916f8934b923414098867f853447b28e Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1033578808 Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FlavorsV2NegativeTest-1033578808-project Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 1505c5c36ec64103a77d1413e64444a2 Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FlavorsV2NegativeTest-1033578808-project Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2126911502", "imageRef": "0ec0b36e-ad92-4933-a9ce-b6cf759b9938", "flavorRef": "452"}} Oct 25 03:04:05.043750 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: exception: Flavor's memory is too small for requested image. Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2126911502', 'imageRef': '0ec0b36e-ad92-4933-a9ce-b6cf759b9938', 'flavorRef': '452'}}} Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:05.044486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:05.045768 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96a68d5e-e706-473b-b6ef-c0ec52fc8b35 tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-96a68d5e-e706-473b-b6ef-c0ec52fc8b35 tempest-FlavorsV2NegativeTest-1033578808 tempest-FlavorsV2NegativeTest-1033578808-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.707663 Oct 25 03:04:05.046982 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 495/929] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:04:04 2022] POST /compute/v2.1/servers => generated 93 bytes in 713 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:04:05.099225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:05.116272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:05.150188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.150796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.151181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.155314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.155814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.156368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.354217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:05.355729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:05.368558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.369183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.369761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.373395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.374078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.374639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.545557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:05.556846 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4bce53e-72e0-4fd2-b46c-7a2a0b2f88bb tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1236 microversion: 2.1 time: 0.207734 Oct 25 03:04:05.564155 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 496/930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:05 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1236 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:05.587177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:05.587814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:05.604733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.605239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.605706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.606437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.606895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.607324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.820645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:05.843423 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f44ce09e-59b7-4531-9140-021608b56d27 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1487 microversion: 2.1 time: 0.749462 Oct 25 03:04:05.846321 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 435/931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:05 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1487 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:05.869864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:05.875051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:05.912170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.916018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:05.916842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.917297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.924302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.924690 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4dda7eef-3c34-4355-8983-f63ba95f2645 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 0.357734 Oct 25 03:04:05.924849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.925883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.929194 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 497/932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:05 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:05.942878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:05.954614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:05.978476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.983866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.985302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:05.989529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:05.991902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:05.992473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:06.197325 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-315d1e3a-5bbc-474d-9393-29a9a68297df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d/action" status: 202 len: 0 microversion: 2.1 time: 0.265874 Oct 25 03:04:06.200050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 498/933] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:04:05 2022] POST /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:04:06.211984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:06.214074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:06.224847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:06.226637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:06.227359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:06.236740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:06.238012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:06.238881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:06.303759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:06.330457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:06.332619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:06.339308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:06.358079 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5bdcca8-d6e9-4881-a57e-187da421c275 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.507094 Oct 25 03:04:06.368818 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 436/934] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:05 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:06.588725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:06.589719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:06.606855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:06.610101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:06.610554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:06.611295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:06.618462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:06.618955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:06.695403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:06.905991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:06.916568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:06.921479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00d4edfb-8632-4faf-b6bb-c018ce2b69c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1492 microversion: 2.1 time: 0.717758 Oct 25 03:04:06.928389 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 499/935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:06 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1492 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:06.953246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:06.955427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:06.971065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:06.973128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:06.976532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:06.978133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:06.978852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:06.982321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:07.249315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:07.264311 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bf03fe66-7c3f-4ded-a385-8ef3f3647b79 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 0.315548 Oct 25 03:04:07.284686 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 500/936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:06 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:07.402170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:07.403051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:07.420879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:07.421387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:07.421865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:07.429521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:07.430087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:07.430544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:07.590714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:07.604646 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5ba9e4a-dd2b-4f98-bda7-2b03178a8825 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1304 microversion: 2.1 time: 1.017916 Oct 25 03:04:07.605268 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 437/937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:06 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1304 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:07.617706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:07.635295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:07.637092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:07.650533 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c5731166-c92c-45f5-a280-52cd179f46e2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.255594 Oct 25 03:04:07.653590 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 501/938] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:07 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:04:07.948685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:07.949556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:07.956427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:07.966982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:07.967729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:07.968638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:07.969257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:07.969890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:08.290600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:08.291230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:08.297571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:08.299720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:08.300969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:08.301776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:08.302901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:08.304607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:08.306486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:08.716187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:08.730497 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd09f118-8171-4a20-8e67-2a4f0a162646 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 0.442148 Oct 25 03:04:08.731235 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 502/939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:08 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:08.744197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:08.745338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:08.763504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:08.764826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:08.767054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:08.769898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:08.770771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:08.773299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:08.877517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:08.888683 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a99ee84-c5ff-43cb-ad1d-5151b29ce173 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 200 len: 1472 microversion: 2.1 time: 0.943892 Oct 25 03:04:08.890824 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 438/940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:07 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 1472 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:08.897540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:08.901668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:08.919627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:08.920129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:08.920755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:08.921854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:08.922472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:08.923058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:09.025449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:09.040774 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-caa08659-9232-4a23-bbdd-cbf62d635974 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1304 microversion: 2.1 time: 0.305047 Oct 25 03:04:09.042371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 503/941] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:08 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1304 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:09.047316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-117650875"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:09.063914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:09.076542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:09.077291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:09.077940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:09.080042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:09.082330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:09.086210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:09.144187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:09.156136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:09.157894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:09.171438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-80ddfd61-909f-4333-a62e-7083cebfef46 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.279329 Oct 25 03:04:09.179813 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 439/942] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:08 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:09.757224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:09.758135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:09.768179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:09.771580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:09.772235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:09.774220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:09.775466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:09.776651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:10.300931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:10.309195 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea81ce50-4982-4da5-8eb0-73217b097bef tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 0.555920 Oct 25 03:04:10.310170 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 440/943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:09 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:10.317626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b7fa38b9-f234-4280-86d9-83ad43b8ac2c req-9dec85ca-1648-427b-a2bb-0c5b68135bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a34089b-d23c-457c-bcdc-ccf220f6f099", "tag": "32be58c6-6e9b-46be-afd4-f6e81b24be78"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:10.340012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b7fa38b9-f234-4280-86d9-83ad43b8ac2c req-9dec85ca-1648-427b-a2bb-0c5b68135bd2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:10.340415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b7fa38b9-f234-4280-86d9-83ad43b8ac2c req-9dec85ca-1648-427b-a2bb-0c5b68135bd2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:10.340852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b7fa38b9-f234-4280-86d9-83ad43b8ac2c req-9dec85ca-1648-427b-a2bb-0c5b68135bd2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:10.380562 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b7fa38b9-f234-4280-86d9-83ad43b8ac2c req-9dec85ca-1648-427b-a2bb-0c5b68135bd2 service nova] Creating event network-changed:32be58c6-6e9b-46be-afd4-f6e81b24be78 for instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 on n-h1-862355-1 Oct 25 03:04:10.397432 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b7fa38b9-f234-4280-86d9-83ad43b8ac2c req-9dec85ca-1648-427b-a2bb-0c5b68135bd2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083377 Oct 25 03:04:10.399043 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 441/944] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:10.406828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:10.408124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:10.422328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:10.423280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:10.423885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:10.424811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:10.426452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:10.427219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:10.735114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:10.750574 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3a52eba-93aa-4e58-9a8d-08523f93af1a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1304 microversion: 2.1 time: 0.349264 Oct 25 03:04:10.751613 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 442/945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:10 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1304 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:10.757713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:10.758508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:10.765746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:10.766344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:10.767526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:10.768752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:10.769974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:10.770710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:10.791994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:10.824933 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b633b22-82e1-4b0d-8b25-683d38f0312b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d/action" status: 202 len: 0 microversion: 2.1 time: 1.780849 Oct 25 03:04:10.827073 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 504/946] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:04:09 2022] POST /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d/action => generated 0 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:04:10.834295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-960a0f9c-6230-4e28-a782-acaa9fa6bbef tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd337368b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:10.925487 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-960a0f9c-6230-4e28-a782-acaa9fa6bbef tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd" status: 200 len: 637 microversion: 2.1 time: 0.096704 Oct 25 03:04:10.928899 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 505/947] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:10 2022] GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd => generated 637 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:10.942598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-689562a7-a327-4709-ad83-d30479675e4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33736700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:11.042932 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-689562a7-a327-4709-ad83-d30479675e4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.112179 Oct 25 03:04:11.044592 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 506/948] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:10 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:11.049250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:11.067454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:11.069912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-147912bb-bb56-4224-80e0-6d43d473f413 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update_all', calling method: .version_select at 0x7efd3374e040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:11.078202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:11.102154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b44bb315-a62b-4424-9b04-363007ab0cb0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.349334 Oct 25 03:04:11.104113 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 443/949] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:10 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:11.189529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-147912bb-bb56-4224-80e0-6d43d473f413 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:11.199804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-147912bb-bb56-4224-80e0-6d43d473f413 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:11.334373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:11.335099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:11.370010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:11.372801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:11.373248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:11.378568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:11.379050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:11.379486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:11.482439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=28 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:11.855298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-147912bb-bb56-4224-80e0-6d43d473f413 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.797303 Oct 25 03:04:11.861384 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 507/950] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:04:11 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 61 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:11.875333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-218c4090-4849-4be4-bcda-1f7b8406fb36 req-5451a039-abf0-4609-a833-f58060552616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1befd924-e3d6-4785-92c2-90de330d26e4", "name": "network-vif-plugged", "status": "completed", "tag": "5e9c7816-8518-4b51-824f-b306c79b1254"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:11.904709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-218c4090-4849-4be4-bcda-1f7b8406fb36 req-5451a039-abf0-4609-a833-f58060552616 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:11.910121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-218c4090-4849-4be4-bcda-1f7b8406fb36 req-5451a039-abf0-4609-a833-f58060552616 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:11.912807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-218c4090-4849-4be4-bcda-1f7b8406fb36 req-5451a039-abf0-4609-a833-f58060552616 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:11.928925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-218c4090-4849-4be4-bcda-1f7b8406fb36 req-5451a039-abf0-4609-a833-f58060552616 service nova] Creating event network-vif-plugged:5e9c7816-8518-4b51-824f-b306c79b1254 for instance 1befd924-e3d6-4785-92c2-90de330d26e4 on n-h2-862355-1 Oct 25 03:04:11.949270 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-218c4090-4849-4be4-bcda-1f7b8406fb36 req-5451a039-abf0-4609-a833-f58060552616 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086172 Oct 25 03:04:11.950233 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 508/951] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:11.959839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:11.977108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:11.989985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:11.991110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:11.992061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:11.993497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:11.994637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:11.995236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:12.281178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:12.298658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ac516d89-41cc-415a-b69d-62572d47f466 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1304 microversion: 2.1 time: 0.341643 Oct 25 03:04:12.304779 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 509/952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:11 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1304 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:12.327666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-402545f0-f6ef-402b-a28e-8caa074dcf99 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd3374e1f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:12.334371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:12.378878 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-adb857da-3bb1-4b4c-b032-ab3f37595442 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 1.050222 Oct 25 03:04:12.379491 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 444/953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:11 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:12.404274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fd977826-2264-4933-abb4-250a06d804fe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd335a9af0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:12.528716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fd977826-2264-4933-abb4-250a06d804fe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.135799 Oct 25 03:04:12.529656 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 445/954] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:12 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:12.543219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:12.543835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:12.576348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:12.580109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:12.580845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:12.583963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:12.584963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:12.586314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:12.737298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:12.754885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:12.760240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:12.777749 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e21a1c6-471a-41b3-a97a-48d3c7a756ce tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.241578 Oct 25 03:04:12.783481 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 446/955] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:12 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:12.892542 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-402545f0-f6ef-402b-a28e-8caa074dcf99 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "DELETE /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.586346 Oct 25 03:04:12.893744 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 510/956] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 25 03:04:12 2022] DELETE /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata/os_version => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:04:12.902860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a161994f-18ff-46d1-915e-61d0bf99c737 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd3356d310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:12.969062 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a161994f-18ff-46d1-915e-61d0bf99c737 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 37 microversion: 2.1 time: 0.070351 Oct 25 03:04:12.970077 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 447/957] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:04:12 2022] GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 37 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:04:12.983007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f94e92a-2318-450c-8414-231eac8bd8af tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update_all', calling method: .version_select at 0x7efd33714550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:13.063667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0f94e92a-2318-450c-8414-231eac8bd8af tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:13.070733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0f94e92a-2318-450c-8414-231eac8bd8af tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:13.439799 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f94e92a-2318-450c-8414-231eac8bd8af tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.460663 Oct 25 03:04:13.440925 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 511/958] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:04:12 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 61 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:13.449275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:13.450251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:13.458606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:13.459377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:13.459973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:13.460867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:13.461487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:13.462907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:13.516901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f7ad819-54c0-4c15-b285-17de4fb007fe tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1112895504", "ram": 512, "vcpus": 1, "disk": 10, "id": 818235302, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:13.550809 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f7ad819-54c0-4c15-b285-17de4fb007fe tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.256339 Oct 25 03:04:13.551797 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 448/959] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:04:13 2022] POST /compute/v2.1/flavors => generated 413 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:04:13.568243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:13.574081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:13.593307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:13.593843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:13.594291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:13.595012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:13.595477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:13.595903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:13.756418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:13.767580 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33f1b406-6b99-4f74-8d91-d0cc9ce66367 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1304 microversion: 2.1 time: 0.324924 Oct 25 03:04:13.768172 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 512/960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:13 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1304 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:13.790074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc34a321-2e5f-40f1-9095-20bbe0d1fb6a tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd3374ec10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:13.904821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc34a321-2e5f-40f1-9095-20bbe0d1fb6a tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.133083 Oct 25 03:04:13.906858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 513/961] 10.222.0.36 () {58 vars in 1290 bytes} [Tue Oct 25 03:04:13 2022] GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata/os_distro => generated 33 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:13.913844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:13.914626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd5893b4-a639-4f09-83b7-9078ea1c44d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd337bf160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:13.927131 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-784ba59b-0703-46fb-a45d-5d27fc45dedd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1315 microversion: 2.1 time: 0.374213 Oct 25 03:04:13.929920 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 449/962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:13 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:13.961882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-beb90ae9-e0fb-4578-b099-7674dd5c853c tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:14.037422 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-beb90ae9-e0fb-4578-b099-7674dd5c853c tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/818235302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.093288 Oct 25 03:04:14.038070 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 450/963] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 25 03:04:13 2022] POST /compute/v2.1/flavors/818235302/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.051736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:14.052758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:14.071431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:14.072295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:14.073087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:14.074037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:14.074684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:14.077617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:14.228440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:14.244788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:14.246790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:14.252304 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd5893b4-a639-4f09-83b7-9078ea1c44d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.343312 Oct 25 03:04:14.254693 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db25c4a1-b4ac-48ea-abe2-84dfd5b0fc3c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.213914 Oct 25 03:04:14.255652 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 451/965] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:14 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:14.257652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 514/965] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:13 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:14.276157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-de31cce8-246a-4ed0-8358-587bc1e17e3c tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update_all', calling method: .version_select at 0x7efd336e69d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:14.468845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44c37a22-cbfc-4fec-a30c-96cd5443a4cf tempest-FlavorsExtraSpecsTestJSON-538925245 tempest-FlavorsExtraSpecsTestJSON-538925245-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:14.480922 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-44c37a22-cbfc-4fec-a30c-96cd5443a4cf tempest-FlavorsExtraSpecsTestJSON-538925245 tempest-FlavorsExtraSpecsTestJSON-538925245-project] 10.222.0.36 "GET /compute/v2.1/flavors/818235302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.216851 Oct 25 03:04:14.502742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 452/966] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 25 03:04:14 2022] GET /compute/v2.1/flavors/818235302/os-extra_specs => generated 66 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.511723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a08a7fe-ee51-46b5-9806-4c11de98559b tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:14.544872 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a08a7fe-ee51-46b5-9806-4c11de98559b tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/818235302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036952 Oct 25 03:04:14.546699 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 453/967] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 25 03:04:14 2022] POST /compute/v2.1/flavors/818235302/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.558154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ae09f7b-676e-4136-8157-27e8c81d7e81 tempest-FlavorsExtraSpecsTestJSON-538925245 tempest-FlavorsExtraSpecsTestJSON-538925245-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:14.569774 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ae09f7b-676e-4136-8157-27e8c81d7e81 tempest-FlavorsExtraSpecsTestJSON-538925245 tempest-FlavorsExtraSpecsTestJSON-538925245-project] 10.222.0.36 "GET /compute/v2.1/flavors/818235302/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016722 Oct 25 03:04:14.577218 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 454/968] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:04:14 2022] GET /compute/v2.1/flavors/818235302/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.591764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86a691f4-8f35-4579-aea5-af60ae2f33b0 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:14.633657 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86a691f4-8f35-4579-aea5-af60ae2f33b0 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/818235302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054342 Oct 25 03:04:14.634446 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 455/969] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Oct 25 03:04:14 2022] POST /compute/v2.1/flavors/818235302/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.646312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-828da243-a3bc-4348-81a0-4c3507d35679 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:14.654716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-828da243-a3bc-4348-81a0-4c3507d35679 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/818235302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012670 Oct 25 03:04:14.655497 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 456/970] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 25 03:04:14 2022] GET /compute/v2.1/flavors/818235302/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.667788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c0b67248-b387-476c-ba71-d9b8dad7a078 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:14.689000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:SAVEPOINT=8,nova_api:RELEASE=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:14.708499 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c0b67248-b387-476c-ba71-d9b8dad7a078 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/818235302/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.046663 Oct 25 03:04:14.709292 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 457/971] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:04:14 2022] PUT /compute/v2.1/flavors/818235302/os-extra_specs/hw:numa_nodes => generated 22 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.719625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbcc6dd4-df4c-4284-95c4-b8d5d645e90e tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:14.728872 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dbcc6dd4-df4c-4284-95c4-b8d5d645e90e tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/818235302/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014181 Oct 25 03:04:14.742160 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 458/972] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 25 03:04:14 2022] GET /compute/v2.1/flavors/818235302/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:14.748327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c925d3c-85c5-4a80-a4b8-878b2e902aa5 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:14.792715 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c925d3c-85c5-4a80-a4b8-878b2e902aa5 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/818235302/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.049281 Oct 25 03:04:14.793597 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 459/973] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:04:14 2022] DELETE /compute/v2.1/flavors/818235302/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:04:14.806730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:14.807444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:14.816738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:14.817283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:14.818008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:14.818738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:14.819072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:14.819407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:15.031647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:15.040313 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bcc3afa7-d64f-4f26-92b7-82d96a438968 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1292 microversion: 2.1 time: 0.245380 Oct 25 03:04:15.045148 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 460/974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:14 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1292 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:15.051734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bad31bdb-c727-4ff3-9201-eff9ce1b91f6 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:15.105490 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bad31bdb-c727-4ff3-9201-eff9ce1b91f6 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/818235302/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.061406 Oct 25 03:04:15.109404 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 461/975] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:04:15 2022] DELETE /compute/v2.1/flavors/818235302/os-extra_specs/hw:cpu_policy => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:04:15.119340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:15.125978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:15.140286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:15.142191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:15.142724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:15.147721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:15.163904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:15.165972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:15.424384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:15.436514 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a798ac61-1789-4656-8e92-f4a307e88adf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1503 microversion: 2.1 time: 0.324712 Oct 25 03:04:15.446060 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 462/976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:15 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:15.451422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef2d0002-6529-40cf-985e-4e6396ee4653 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:15.469632 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef2d0002-6529-40cf-985e-4e6396ee4653 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/818235302/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021912 Oct 25 03:04:15.475092 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 463/977] 10.222.0.36 () {58 vars in 1200 bytes} [Tue Oct 25 03:04:15 2022] GET /compute/v2.1/flavors/818235302/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:15.485082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b81db90-f6c8-47a9-865b-8f3de01f3d28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd335a9040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.491951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-de31cce8-246a-4ed0-8358-587bc1e17e3c tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:20.499859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-de31cce8-246a-4ed0-8358-587bc1e17e3c tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:20.534182 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b81db90-f6c8-47a9-865b-8f3de01f3d28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 5.057728 Oct 25 03:04:20.544731 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 464/978] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:15 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 5069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:20.549866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.551386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:20.559426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.560102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.560721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.561592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.562581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.563395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.642557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:20.653128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:20.654600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:20.661608 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-72673ce9-1af8-4698-9d6f-52e6665897e3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.115694 Oct 25 03:04:20.662488 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 465/979] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:20 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:20.668646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.669328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:20.676962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.677900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.678880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.679736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.680335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.680901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.701147 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-de31cce8-246a-4ed0-8358-587bc1e17e3c tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 61 microversion: 2.1 time: 6.441070 Oct 25 03:04:20.702107 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 515/980] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:04:14 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 61 bytes in 6444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:20.709078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80e03a70-fe31-4025-b54e-79674f8ef620 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.732665 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80e03a70-fe31-4025-b54e-79674f8ef620 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/818235302" status: 202 len: 0 microversion: 2.1 time: 0.029603 Oct 25 03:04:20.733932 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 516/981] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:04:20 2022] DELETE /compute/v2.1/flavors/818235302 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:04:20.742098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ab2a3f0a-1b56-402f-9ef3-bb481f0ad6c4 req-511d2b07-5255-4c6a-88a9-9e8113fde050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73a5304-6eac-4d37-9205-152d9fb4a87d", "name": "network-vif-plugged", "status": "completed", "tag": "4752f89e-e695-436d-a624-66f72709fa7f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:20.754079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab2a3f0a-1b56-402f-9ef3-bb481f0ad6c4 req-511d2b07-5255-4c6a-88a9-9e8113fde050 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.754556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab2a3f0a-1b56-402f-9ef3-bb481f0ad6c4 req-511d2b07-5255-4c6a-88a9-9e8113fde050 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.755275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab2a3f0a-1b56-402f-9ef3-bb481f0ad6c4 req-511d2b07-5255-4c6a-88a9-9e8113fde050 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.761724 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2af12a4-44d1-4463-b3a1-89060a4468c3 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.096745 Oct 25 03:04:20.762367 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 466/982] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 25 03:04:20 2022] DELETE /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4/os-server-password => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:04:20.768526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.769186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:20.774615 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ab2a3f0a-1b56-402f-9ef3-bb481f0ad6c4 req-511d2b07-5255-4c6a-88a9-9e8113fde050 service nova] Creating event network-vif-plugged:4752f89e-e695-436d-a624-66f72709fa7f for instance e73a5304-6eac-4d37-9205-152d9fb4a87d on n-h1-862355-1 Oct 25 03:04:20.775964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.776462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.776898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.777666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.778138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.778562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.780459 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ab2a3f0a-1b56-402f-9ef3-bb481f0ad6c4 req-511d2b07-5255-4c6a-88a9-9e8113fde050 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045161 Oct 25 03:04:20.786986 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 517/983] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:20.792842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e814679-2f72-47a1-b058-9ac808a4c7fa tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd3368b550>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.837959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e814679-2f72-47a1-b058-9ac808a4c7fa tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.049504 Oct 25 03:04:20.838787 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 518/984] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:04:20 2022] GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 61 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:20.845263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d965eafc-aec6-4dcc-a7f6-6546934b9ed8 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.867470 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d965eafc-aec6-4dcc-a7f6-6546934b9ed8 tempest-FlavorsExtraSpecsTestJSON-1950477711 tempest-FlavorsExtraSpecsTestJSON-1950477711-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027114 Oct 25 03:04:20.868175 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 519/985] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:04:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:20.873138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:20.874139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:20.881546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.882447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.883137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.884561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:20.885244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:20.885925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:20.919956 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30f8d684-3b0f-4d53-b834-b2c9278820cf tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.050312 Oct 25 03:04:20.921292 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 520/986] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 25 03:04:20 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4/os-server-password => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:20.927660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fda01f67-d9c1-4962-a240-e0bc3941a870 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update_all', calling method: .version_select at 0x7efd3374eb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:21.012439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-fda01f67-d9c1-4962-a240-e0bc3941a870 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:21.018378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:21.019204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-fda01f67-d9c1-4962-a240-e0bc3941a870 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:21.030561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-194aa5c5-2285-413b-a4a1-0863d9f0b003 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1292 microversion: 2.1 time: 0.267129 Oct 25 03:04:21.031888 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 467/987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:20 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1292 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:21.047415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:21.048430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:21.056648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:21.057525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:21.058242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:21.059152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:21.059793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:21.061118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:21.105657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:21.130858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:04:21.268589 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd03184e-beb1-445f-b38b-e5723ac62a52 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 204 len: 0 microversion: 2.1 time: 0.235227 Oct 25 03:04:21.269836 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 468/988] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:04:21 2022] DELETE /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:04:21.278143 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fda01f67-d9c1-4962-a240-e0bc3941a870 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.354816 Oct 25 03:04:21.278889 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 521/989] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:04:20 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 61 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:21.299265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03af139e-1220-4b02-a205-7773ce1029f0 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update_all', calling method: .version_select at 0x7efd336e64c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:21.306747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:21.307498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:21.322503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:21.324230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:21.324840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:21.325752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:21.326610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:21.327332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:21.400741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-03af139e-1220-4b02-a205-7773ce1029f0 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:21.413515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-03af139e-1220-4b02-a205-7773ce1029f0 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:21.574542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:21.597972 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02a9aef8-7f87-43a8-8447-a1eb4172bea8 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1509 microversion: 2.1 time: 0.308523 Oct 25 03:04:21.597972 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 469/990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:21 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:21.597972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-392c6dba-dddb-4718-8b1c-0696f951123e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33618c10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:21.896622 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-392c6dba-dddb-4718-8b1c-0696f951123e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.306731 Oct 25 03:04:21.897219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 470/991] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:21 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:21.903926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:21.910865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:21.918517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:21.920752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:21.924230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:21.924985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:21.926218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:21.926664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:21.926918 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03af139e-1220-4b02-a205-7773ce1029f0 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.639725 Oct 25 03:04:21.932138 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 522/992] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:04:21 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 64 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:21.939863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-699afb2a-85ff-4bb9-a104-e16a28e3f377 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd339e9dc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:22.002265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-699afb2a-85ff-4bb9-a104-e16a28e3f377 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.068098 Oct 25 03:04:22.003253 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 523/993] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:04:21 2022] GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 64 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:22.014400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c225717-8d73-4c97-ad25-11d767412191 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update_all', calling method: .version_select at 0x7efd33686f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:22.024867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:22.039856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:22.042675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:22.054995 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-33519084-f9a2-4611-afa0-c7acedb79322 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1537 microversion: 2.91 time: 0.151509 Oct 25 03:04:22.056448 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 471/994] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:21 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1537 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:22.064737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:22.066556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:22.074158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:22.074719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:22.086211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:22.087330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:22.089056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:22.091370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:22.125379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4c225717-8d73-4c97-ad25-11d767412191 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:22.136058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4c225717-8d73-4c97-ad25-11d767412191 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:22.301349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:22.311084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3cc37d88-f1e1-4442-b5e1-50d6ad164180 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1292 microversion: 2.1 time: 0.249437 Oct 25 03:04:22.312081 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 472/995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:22 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1292 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:22.590015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c225717-8d73-4c97-ad25-11d767412191 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.580214 Oct 25 03:04:22.590710 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 524/996] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:04:22 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 61 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:04:22.601184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6cd2baff-c0eb-4b60-b9db-977ff738d889 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update', calling method: .version_select at 0x7efd33738940>, body: {"meta": {"os_version": "alt"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:22.617967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:22.619037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:22.628051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:22.629089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:22.629775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:22.630673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:22.631286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:22.631909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:22.672751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6cd2baff-c0eb-4b60-b9db-977ff738d889 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:22.681642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6cd2baff-c0eb-4b60-b9db-977ff738d889 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:22.828416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:22.841943 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-759dba8f-ec34-48d7-a209-e3c5dd6da044 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1509 microversion: 2.1 time: 0.228027 Oct 25 03:04:22.842973 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 525/997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:22 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:22.914558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18094bbb-b306-4041-a5c5-e57e4dcf22e5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3382c9d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:23.087920 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6cd2baff-c0eb-4b60-b9db-977ff738d889 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.491674 Oct 25 03:04:23.089592 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 473/998] 10.222.0.36 () {60 vars in 1313 bytes} [Tue Oct 25 03:04:22 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata/os_version => generated 31 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:04:23.106214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:23.107044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:23.107600 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18094bbb-b306-4041-a5c5-e57e4dcf22e5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.195853 Oct 25 03:04:23.109729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 526/999] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:22 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:23.118450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e0ef4b68-a7c0-4f0d-9be8-dfb85145696a tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd336f3790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:23.122542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:23.123030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:23.123713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:23.125623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:23.130059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:23.130674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:23.190995 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e0ef4b68-a7c0-4f0d-9be8-dfb85145696a tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 58 microversion: 2.1 time: 0.079372 Oct 25 03:04:23.197848 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 527/1000] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:04:23 2022] GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 58 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:23.203970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-067eebee-d0e4-4616-90cf-06e3d3954898 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'update_all', calling method: .version_select at 0x7efd336e60d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:23.258513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:23.279226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:23.281319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:23.288102 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4998e7e5-e464-4d59-b52e-19313ada02f8 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1537 microversion: 2.91 time: 0.193097 Oct 25 03:04:23.288692 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 474/1001] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:23 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:23.289660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-067eebee-d0e4-4616-90cf-06e3d3954898 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:23.295324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-067eebee-d0e4-4616-90cf-06e3d3954898 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:23.337563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:23.338212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:23.344910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:23.345404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:23.346088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:23.347654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:23.348470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:23.349091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:23.555728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:23.567526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2429ec67-a26b-42d1-8992-b9b055e2b80a tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1292 microversion: 2.1 time: 0.232282 Oct 25 03:04:23.574839 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 475/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:23 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1292 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:23.762642 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-067eebee-d0e4-4616-90cf-06e3d3954898 tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.562994 Oct 25 03:04:23.768374 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 528/1003] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:04:23 2022] PUT /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 61 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:23.772984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95bd80f5-fd4c-4d30-a652-0c7710dc40ca tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Action: 'create', calling method: .version_select at 0x7efd337385e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:23.833161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-95bd80f5-fd4c-4d30-a652-0c7710dc40ca tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:23.841242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-95bd80f5-fd4c-4d30-a652-0c7710dc40ca tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Getting quotas for user 7371ee3f93114c66a69665014a623797 and project 18e1ec85ec9145fcb27697c2e6b044c0. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:23.868742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:23.869311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:23.878552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:23.879111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:23.879550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:23.888725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:23.889238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:23.889803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:24.123047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:24.150781 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6892b86-3160-4b4f-9735-fecb7b8c8c09 tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1509 microversion: 2.1 time: 0.285739 Oct 25 03:04:24.151625 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 529/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:23 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:24.164543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4faf0d39-16be-4b80-a7dc-fda21910600f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33688d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:24.463232 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95bd80f5-fd4c-4d30-a652-0c7710dc40ca tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "POST /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.693657 Oct 25 03:04:24.463953 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 476/1005] 10.222.0.36 () {60 vars in 1281 bytes} [Tue Oct 25 03:04:23 2022] POST /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 85 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:04:24.472051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:24.472696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:24.484005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:24.484504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:24.484941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:24.485643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:24.486125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:24.486550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:24.489344 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4faf0d39-16be-4b80-a7dc-fda21910600f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.334707 Oct 25 03:04:24.490038 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 530/1006] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:24 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:24.507688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1983a88-0caf-4261-a2af-29f7731d8d8e tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] Calling method '.version_select at 0x7efd336e6670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:24.571138 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1983a88-0caf-4261-a2af-29f7731d8d8e tempest-ImagesMetadataTestJSON-1090385908 tempest-ImagesMetadataTestJSON-1090385908-project] 10.222.0.36 "GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.076751 Oct 25 03:04:24.571743 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 531/1007] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:04:24 2022] GET /compute/v2.1/images/b31d771a-7e46-4306-a702-1d82451cbadd/metadata => generated 85 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:04:24.592227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:24.592859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:24.604120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:24.604626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:24.608326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:24.609229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:24.610537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:24.611902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:24.645667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:24.663854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:24.673756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:24.699393 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89812e11-1654-4aa9-950c-f18b456f38da tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1540 microversion: 2.91 time: 0.234371 Oct 25 03:04:24.702034 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 477/1008] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:24 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1540 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:24.732322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862355-1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:24.735275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:24.750356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:24.752024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:24.752686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:24.755830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:24.756698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:24.758125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:24.929551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:24.949253 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec9f96d0-e671-448a-928a-e7a8e889c64d tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1292 microversion: 2.1 time: 0.362291 Oct 25 03:04:24.962350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 532/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:24 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1292 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:24.982380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862355-1". {{(pid=120563) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 25 03:04:25.139182 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ece43285-c4db-46ba-8fda-fa91fb9dfd1b tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action" status: 202 len: 0 microversion: 2.91 time: 0.410743 Oct 25 03:04:25.139814 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 478/1010] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:04:24 2022] POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:04:25.152323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:25.153299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:25.168047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:25.173377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:25.174483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:25.176119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:25.179241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:25.179392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:25.179715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:25.180544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:25.188812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:25.190488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:25.191857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:25.193290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:25.194193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:25.194939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:25.325141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8536b5ac2ca46778e739e36b8dca81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acad00293a7142e69ff2d93e90e21c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:25.358993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:25.371298 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-666e1cbe-0442-4fc7-99f9-dbc664363f5d tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 200 len: 1467 microversion: 2.1 time: 0.194142 Oct 25 03:04:25.372076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 479/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:25 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 1467 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:25.373346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:25.375931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:25.391203 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d92600a-57a0-49ec-8ae8-cb63c959802b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1488 microversion: 2.91 time: 0.244364 Oct 25 03:04:25.395251 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 533/1012] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:25 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1488 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:04:25.512757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a4816e82-cc49-4278-ac55-7cd1d7f7f8ed req-911ac2c8-bfe4-410b-9306-63dd1a34964e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1befd924-e3d6-4785-92c2-90de330d26e4", "name": "network-vif-deleted", "tag": "5e9c7816-8518-4b51-824f-b306c79b1254"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:25.513867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2c9b712-e73d-4d07-a47c-64e7b08cfb12 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd336f38b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:25.538600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4816e82-cc49-4278-ac55-7cd1d7f7f8ed req-911ac2c8-bfe4-410b-9306-63dd1a34964e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:25.540174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4816e82-cc49-4278-ac55-7cd1d7f7f8ed req-911ac2c8-bfe4-410b-9306-63dd1a34964e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:25.540467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4816e82-cc49-4278-ac55-7cd1d7f7f8ed req-911ac2c8-bfe4-410b-9306-63dd1a34964e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:25.587820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a4816e82-cc49-4278-ac55-7cd1d7f7f8ed req-911ac2c8-bfe4-410b-9306-63dd1a34964e service nova] Creating event network-vif-deleted:5e9c7816-8518-4b51-824f-b306c79b1254 for instance 1befd924-e3d6-4785-92c2-90de330d26e4 on n-h2-862355-1 Oct 25 03:04:25.599966 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2c9b712-e73d-4d07-a47c-64e7b08cfb12 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.096686 Oct 25 03:04:25.613235 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 534/1013] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:25 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:25.617328 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a4816e82-cc49-4278-ac55-7cd1d7f7f8ed req-911ac2c8-bfe4-410b-9306-63dd1a34964e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122590 Oct 25 03:04:25.624276 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 480/1014] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:25.988352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:25.989260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:26.004257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.005608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.007811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.008695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.010284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.013276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.140506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d30d5107-f06b-4e1c-85b0-a1d46ff930df tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Calling method '.version_select at 0x7efd33714dc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.143082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d30d5107-f06b-4e1c-85b0-a1d46ff930df tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '548cffe01f1f4d5993cc33907e8320ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b3d54df68b422b9254ac24f15d617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d30d5107-f06b-4e1c-85b0-a1d46ff930df tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Request method failure captured: Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1I4c3ZHMqUp_OKDJg5LiGq-n6I2OXxnneot9P2EV_07tlb5mV-v4Yplm5c7fdwtZjswqQzZdUoZuklJu_q4g21JeMJ2NPQ2V0UrNRms_CN_u-QjgXMVPew9xOSZ1yfU1HTJzCMxvtb10HTAkLmIbgqpWFXC0HYkHAy6zVxduY2HZQQ Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:26.147177 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2b3d54df68b422b9254ac24f15d617c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2b3d54df68b422b9254ac24f15d617c"}]}] Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 548cffe01f1f4d5993cc33907e8320ac Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:04:26.149606 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:04:26.150665 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 25 03:04:26.153816 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.155727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d30d5107-f06b-4e1c-85b0-a1d46ff930df tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.155727 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d30d5107-f06b-4e1c-85b0-a1d46ff930df tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.467801 Oct 25 03:04:26.158042 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 535/1015] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 25 03:04:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 477 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:26.163806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e44106a3-daad-485f-922c-ae39b49ffd20 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Calling method '.version_select at 0x7efd337bf3a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.168405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e44106a3-daad-485f-922c-ae39b49ffd20 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '548cffe01f1f4d5993cc33907e8320ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b3d54df68b422b9254ac24f15d617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e44106a3-daad-485f-922c-ae39b49ffd20 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Request method failure captured: Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1I4c3ZHMqUp_OKDJg5LiGq-n6I2OXxnneot9P2EV_07tlb5mV-v4Yplm5c7fdwtZjswqQzZdUoZuklJu_q4g21JeMJ2NPQ2V0UrNRms_CN_u-QjgXMVPew9xOSZ1yfU1HTJzCMxvtb10HTAkLmIbgqpWFXC0HYkHAy6zVxduY2HZQQ Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:26.172039 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2b3d54df68b422b9254ac24f15d617c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2b3d54df68b422b9254ac24f15d617c"}]}] Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 548cffe01f1f4d5993cc33907e8320ac Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:04:26.174940 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:04:26.180128 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 25 03:04:26.182236 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.187089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e44106a3-daad-485f-922c-ae39b49ffd20 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.190218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e44106a3-daad-485f-922c-ae39b49ffd20 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.030971 Oct 25 03:04:26.200420 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 536/1016] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:26.209486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16bdf5c2-fcd5-412d-9f06-ccc3d7af31e1 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Calling method '.version_select at 0x7efd33714a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.212345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16bdf5c2-fcd5-412d-9f06-ccc3d7af31e1 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '548cffe01f1f4d5993cc33907e8320ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b3d54df68b422b9254ac24f15d617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16bdf5c2-fcd5-412d-9f06-ccc3d7af31e1 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Request method failure captured: Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1I4c3ZHMqUp_OKDJg5LiGq-n6I2OXxnneot9P2EV_07tlb5mV-v4Yplm5c7fdwtZjswqQzZdUoZuklJu_q4g21JeMJ2NPQ2V0UrNRms_CN_u-QjgXMVPew9xOSZ1yfU1HTJzCMxvtb10HTAkLmIbgqpWFXC0HYkHAy6zVxduY2HZQQ Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:26.214299 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2b3d54df68b422b9254ac24f15d617c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2b3d54df68b422b9254ac24f15d617c"}]}] Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 548cffe01f1f4d5993cc33907e8320ac Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:04:26.216014 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:04:26.217253 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 25 03:04:26.221858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.226104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16bdf5c2-fcd5-412d-9f06-ccc3d7af31e1 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.226104 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16bdf5c2-fcd5-412d-9f06-ccc3d7af31e1 tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020009 Oct 25 03:04:26.230840 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 537/1017] 10.222.0.36 () {58 vars in 1179 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:26.402206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.414895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Calling method '.version_select at 0x7efd336cadc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.419901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.422243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.424310 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0bc065a3-7942-4562-a28c-b6f09a8ec6b5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1292 microversion: 2.1 time: 0.447826 Oct 25 03:04:26.424893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.441869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 481/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:25 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1292 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:26.454005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2421f923-9b36-4d29-bbfd-a94d0745112a req-10f8cc5f-a7c4-4ff0-af09-b9a02c279110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a34089b-d23c-457c-bcdc-ccf220f6f099", "name": "network-vif-plugged", "status": "completed", "tag": "32be58c6-6e9b-46be-afd4-f6e81b24be78"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:26.474640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.478404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.479128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.482326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2421f923-9b36-4d29-bbfd-a94d0745112a req-10f8cc5f-a7c4-4ff0-af09-b9a02c279110 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.484624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2421f923-9b36-4d29-bbfd-a94d0745112a req-10f8cc5f-a7c4-4ff0-af09-b9a02c279110 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.486688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2421f923-9b36-4d29-bbfd-a94d0745112a req-10f8cc5f-a7c4-4ff0-af09-b9a02c279110 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.507549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.508657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.512790 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2421f923-9b36-4d29-bbfd-a94d0745112a req-10f8cc5f-a7c4-4ff0-af09-b9a02c279110 service nova] Creating event network-vif-plugged:32be58c6-6e9b-46be-afd4-f6e81b24be78 for instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 on n-h1-862355-1 Oct 25 03:04:26.513426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.529480 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2421f923-9b36-4d29-bbfd-a94d0745112a req-10f8cc5f-a7c4-4ff0-af09-b9a02c279110 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085952 Oct 25 03:04:26.530504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 482/1019] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:26.533738 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f4dd4c7-0f1c-4e48-9adf-e59ce8675f89 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.301267 Oct 25 03:04:26.548548 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 538/1020] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:26.549922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.553934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] [instance: 1befd924-e3d6-4785-92c2-90de330d26e4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:26.557281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.560697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:26.568161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.569955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.570980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.571658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.572417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.573299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.574020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.574157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.574825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.574943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.575325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.575755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.609924 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] HTTP exception thrown: Instance 1befd924-e3d6-4785-92c2-90de330d26e4 could not be found. Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Request method failure captured: Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 HTTP/1.1 Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1IZgjMrA85eLlQXxZ2ygo0EOxaQsZYJfCrRRM2ZlXKt1kG68eKGwtQo3d9DMc3J5JmKF6d1_tgz4gOAwPjbJvTX1CM1PC3KzoAbkdKzZYLuymNjSrLLRdF-O3Aw5urxnSdgWN-EDtnUEMcgVDHljXBt0GEBlNYSV-CmDBfYzQUYpMY Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: acad00293a7142e69ff2d93e90e21c2b Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerPasswordTestJSON-1595303403 Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:04:26.611325 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acad00293a7142e69ff2d93e90e21c2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acad00293a7142e69ff2d93e90e21c2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acad00293a7142e69ff2d93e90e21c2b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acad00293a7142e69ff2d93e90e21c2b"}]}] Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerPasswordTestJSON-1595303403 Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: acad00293a7142e69ff2d93e90e21c2b Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1595303403 Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerPasswordTestJSON-1595303403-project Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: f8536b5ac2ca46778e739e36b8dca81c Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerPasswordTestJSON-1595303403-project Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 1befd924-e3d6-4785-92c2-90de330d26e4 could not be found. Oct 25 03:04:26.613598 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1befd924-e3d6-4785-92c2-90de330d26e4'} Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1befd924-e3d6-4785-92c2-90de330d26e4 could not be found. Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.614769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1befd924-e3d6-4785-92c2-90de330d26e4 could not be found. Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1befd924-e3d6-4785-92c2-90de330d26e4 could not be found. Oct 25 03:04:26.616319 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.617662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] Returning 404 to user: Instance 1befd924-e3d6-4785-92c2-90de330d26e4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.626185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb93aeb8-65d9-4884-88e5-b48e5b2877fd tempest-ServerPasswordTestJSON-1595303403 tempest-ServerPasswordTestJSON-1595303403-project] 10.222.0.36 "GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4" status: 404 len: 111 microversion: 2.1 time: 0.081239 Oct 25 03:04:26.626829 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 483/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/servers/1befd924-e3d6-4785-92c2-90de330d26e4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:26.632722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9b00823-97ef-48a1-8fed-04b2bd34d0ef tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Calling method '.version_select at 0x7efd3351caf0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.634691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e9b00823-97ef-48a1-8fed-04b2bd34d0ef tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '548cffe01f1f4d5993cc33907e8320ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b3d54df68b422b9254ac24f15d617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9b00823-97ef-48a1-8fed-04b2bd34d0ef tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Request method failure captured: Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1I4c3ZHMqUp_OKDJg5LiGq-n6I2OXxnneot9P2EV_07tlb5mV-v4Yplm5c7fdwtZjswqQzZdUoZuklJu_q4g21JeMJ2NPQ2V0UrNRms_CN_u-QjgXMVPew9xOSZ1yfU1HTJzCMxvtb10HTAkLmIbgqpWFXC0HYkHAy6zVxduY2HZQQ Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:04:26.636233 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2b3d54df68b422b9254ac24f15d617c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2b3d54df68b422b9254ac24f15d617c"}]}] Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 548cffe01f1f4d5993cc33907e8320ac Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1'} Oct 25 03:04:26.637950 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:04:26.638960 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 25 03:04:26.640435 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.641594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9b00823-97ef-48a1-8fed-04b2bd34d0ef tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.641594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9b00823-97ef-48a1-8fed-04b2bd34d0ef tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009537 Oct 25 03:04:26.646795 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 484/1022] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:26.651913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc3b269c-c6be-456d-90b0-dca07fafd1cd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33555280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.722571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.737039 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc3b269c-c6be-456d-90b0-dca07fafd1cd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.088762 Oct 25 03:04:26.746293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.747745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.748233 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 485/1023] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:26.753822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5747273-b590-4775-aca4-dba7b0146646 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Calling method '.version_select at 0x7efd3351c9d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.755972 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-d5747273-b590-4775-aca4-dba7b0146646 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] HTTP exception thrown: Hypervisor with ID '0858d316-5bb0-4f38-a5a0-86f6e4baa934' could not be found. Oct 25 03:04:26.766959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5926f8e9-c517-445c-9be9-cdfe0d51c9d0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1488 microversion: 2.91 time: 0.216884 Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5747273-b590-4775-aca4-dba7b0146646 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Request method failure captured: Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hypervisors/0858d316-5bb0-4f38-a5a0-86f6e4baa934/uptime HTTP/1.1 Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1I5QZwfd8z4orPdej2HFIOB8UV8ShnLV7UH_LW0qGA4EetT0M8Wb4_j9Mgs9ubz8yvG4P4Rsxjkyy60ZOZKG8639Vf1qjlZhq3nkcAO3JLojTUbXu8zEUI5qJcYeedcx5lnjdLwZbQq3Dk_p24sWcStc1NzBTSAl3Cpho2a8PLTq-I Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6466664e543f42e6ae14cf5f534cd278 Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1875533932 Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:04:26.767908 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6466664e543f42e6ae14cf5f534cd278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6466664e543f42e6ae14cf5f534cd278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6466664e543f42e6ae14cf5f534cd278", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6466664e543f42e6ae14cf5f534cd278"}]}] Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1875533932 Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6466664e543f42e6ae14cf5f534cd278 Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1875533932 Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4bec1484f2a4488fb45b8156f5280fc4 Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: exception: Hypervisor with ID '0858d316-5bb0-4f38-a5a0-86f6e4baa934' could not be found. Oct 25 03:04:26.769298 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0858d316-5bb0-4f38-a5a0-86f6e4baa934'} Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0858d316-5bb0-4f38-a5a0-86f6e4baa934' Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 25 03:04:26.770122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0858d316-5bb0-4f38-a5a0-86f6e4baa934' could not be found. Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.771443 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.772709 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.772709 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.772709 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.772709 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:26.772709 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:26.772709 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0858d316-5bb0-4f38-a5a0-86f6e4baa934' could not be found. Oct 25 03:04:26.772709 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.773138 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 539/1024] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1488 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:26.777948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5747273-b590-4775-aca4-dba7b0146646 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Returning 404 to user: Hypervisor with ID '0858d316-5bb0-4f38-a5a0-86f6e4baa934' could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.779222 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5747273-b590-4775-aca4-dba7b0146646 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/0858d316-5bb0-4f38-a5a0-86f6e4baa934/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029732 Oct 25 03:04:26.780036 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 486/1025] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors/0858d316-5bb0-4f38-a5a0-86f6e4baa934/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:26.799661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Calling method '.version_select at 0x7efd33686b80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.806168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.806724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.807150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.855232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.856547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.857657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.883367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:26.884713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:26.890369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:26.891139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:26.901192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:26.912748 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c847a1fe-1d70-4c8c-bb56-91b7001da14c tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.121696 Oct 25 03:04:26.921597 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 540/1026] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:26.928098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b37ce04-a976-47c0-8027-a834a074d32b tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Calling method '.version_select at 0x7efd334ced30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.930218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4b37ce04-a976-47c0-8027-a834a074d32b tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '548cffe01f1f4d5993cc33907e8320ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b3d54df68b422b9254ac24f15d617c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b37ce04-a976-47c0-8027-a834a074d32b tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Request method failure captured: Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1I4c3ZHMqUp_OKDJg5LiGq-n6I2OXxnneot9P2EV_07tlb5mV-v4Yplm5c7fdwtZjswqQzZdUoZuklJu_q4g21JeMJ2NPQ2V0UrNRms_CN_u-QjgXMVPew9xOSZ1yfU1HTJzCMxvtb10HTAkLmIbgqpWFXC0HYkHAy6zVxduY2HZQQ Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:04:26.931969 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2b3d54df68b422b9254ac24f15d617c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2b3d54df68b422b9254ac24f15d617c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2b3d54df68b422b9254ac24f15d617c"}]}] Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e2b3d54df68b422b9254ac24f15d617c Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554 Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 548cffe01f1f4d5993cc33907e8320ac Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1026205554-project Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1'} Oct 25 03:04:26.933439 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:04:26.934408 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 25 03:04:26.935714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.937850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b37ce04-a976-47c0-8027-a834a074d32b tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.939355 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4b37ce04-a976-47c0-8027-a834a074d32b tempest-HypervisorAdminNegativeTestJSON-1026205554 tempest-HypervisorAdminNegativeTestJSON-1026205554-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015704 Oct 25 03:04:26.950073 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 487/1027] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:26.951690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b0cc28d-b286-4f53-b4f4-6c620b888241 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Calling method '.version_select at 0x7efd33686d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:26.953493 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-9b0cc28d-b286-4f53-b4f4-6c620b888241 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] HTTP exception thrown: Hypervisor with ID '90afb73b-425e-430a-9862-c90b9adfa8a1' could not be found. Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b0cc28d-b286-4f53-b4f4-6c620b888241 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Request method failure captured: Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-hypervisors/90afb73b-425e-430a-9862-c90b9adfa8a1 HTTP/1.1 Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1I5QZwfd8z4orPdej2HFIOB8UV8ShnLV7UH_LW0qGA4EetT0M8Wb4_j9Mgs9ubz8yvG4P4Rsxjkyy60ZOZKG8639Vf1qjlZhq3nkcAO3JLojTUbXu8zEUI5qJcYeedcx5lnjdLwZbQq3Dk_p24sWcStc1NzBTSAl3Cpho2a8PLTq-I Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6466664e543f42e6ae14cf5f534cd278 Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1875533932 Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:04:26.956202 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6466664e543f42e6ae14cf5f534cd278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6466664e543f42e6ae14cf5f534cd278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6466664e543f42e6ae14cf5f534cd278", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6466664e543f42e6ae14cf5f534cd278"}]}] Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1875533932 Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6466664e543f42e6ae14cf5f534cd278 Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1875533932 Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 4bec1484f2a4488fb45b8156f5280fc4 Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: exception: Hypervisor with ID '90afb73b-425e-430a-9862-c90b9adfa8a1' could not be found. Oct 25 03:04:26.958545 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '90afb73b-425e-430a-9862-c90b9adfa8a1'} Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '90afb73b-425e-430a-9862-c90b9adfa8a1' Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 25 03:04:26.959461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:04:26.960955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '90afb73b-425e-430a-9862-c90b9adfa8a1' could not be found. Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '90afb73b-425e-430a-9862-c90b9adfa8a1' could not be found. Oct 25 03:04:26.962364 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:26.963922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b0cc28d-b286-4f53-b4f4-6c620b888241 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] Returning 404 to user: Hypervisor with ID '90afb73b-425e-430a-9862-c90b9adfa8a1' could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:26.964988 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b0cc28d-b286-4f53-b4f4-6c620b888241 tempest-HypervisorAdminNegativeTestJSON-1875533932 tempest-HypervisorAdminNegativeTestJSON-1875533932-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/90afb73b-425e-430a-9862-c90b9adfa8a1" status: 404 len: 123 microversion: 2.1 time: 0.017613 Oct 25 03:04:26.969883 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 541/1028] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 25 03:04:26 2022] GET /compute/v2.1/os-hypervisors/90afb73b-425e-430a-9862-c90b9adfa8a1 => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:27.470443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:27.471279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:27.498422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:27.499287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:27.499973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:27.501089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:27.502142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:27.502805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:27.758930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f90fddd-2eae-4168-a8d7-fe77c8051fc2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd337305e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:27.873796 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f90fddd-2eae-4168-a8d7-fe77c8051fc2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1413 microversion: 2.1 time: 0.119635 Oct 25 03:04:27.874895 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 542/1029] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:27 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:27.889898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:27.891417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:27.911023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:27.911857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:27.912310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:27.922482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:27.923047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:27.923428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:28.043475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:28.055286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fd256802-fb9f-4bcc-a7e7-3c06ea37e859 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1292 microversion: 2.1 time: 0.591277 Oct 25 03:04:28.056501 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 488/1030] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:27 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1292 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:28.102048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:28.115424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:28.117191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:28.143056 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a023d273-9a03-4d1a-bc34-a84547641b17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.262974 Oct 25 03:04:28.147213 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 543/1031] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:27 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:28.893289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13e50e77-ec06-4db0-a1f3-f8267515c55d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3351c550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:28.989499 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13e50e77-ec06-4db0-a1f3-f8267515c55d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1422 microversion: 2.1 time: 0.101185 Oct 25 03:04:29.000570 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 489/1032] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:28 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:29.007062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d74d5159-bcab-44dd-bdca-2621cce7a7b0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3370d040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:29.087009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:29.088047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:29.106720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:29.107484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:29.110739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:29.114637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d74d5159-bcab-44dd-bdca-2621cce7a7b0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 200 len: 1422 microversion: 2.1 time: 0.113683 Oct 25 03:04:29.116581 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 544/1033] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:04:28 2022] GET /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:29.116978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:29.117750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:29.120227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:29.161071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bbd085d8-4969-487b-850b-8d5ca98c6756 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3373ae50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:29.688902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:29.701428 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6293e82a-6072-4497-b35c-e3455da7c93b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1482 microversion: 2.1 time: 0.622621 Oct 25 03:04:29.702049 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 490/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:29 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1482 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:29.718723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:29.720785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:29.725716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:UPDATE=3,nova_api:RELEASE=2,nova_api:SELECT=92,nova_api:SAVEPOINT=1,nova_api:DELETE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:29.741553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:29.744306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:29.745441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:29.752145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:29.754561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:29.756163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:29.981612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:29.994089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:30.010469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:30.032347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d1724e7-3d90-452b-8e49-bc5fc5d1f25d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.311608 Oct 25 03:04:30.033329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 491/1035] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:29 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:30.044045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:30.046240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:30.079880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:30.080400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:30.080840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:30.082307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:30.082932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:30.083522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:30.088384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:30.332952 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0315c0df-bccf-4255-a384-999f3821a717 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.296631 Oct 25 03:04:30.333847 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 492/1036] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:04:30 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:30.630866 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bbd085d8-4969-487b-850b-8d5ca98c6756 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 204 len: 0 microversion: 2.1 time: 1.504608 Oct 25 03:04:30.631837 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 545/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:29 2022] DELETE /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 0 bytes in 1506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:04:30.639920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:30.640429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:30.655851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:30.661714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:30.662349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:30.663127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:30.663781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:30.664397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:30.739732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:04:30.905347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d949f0b3-29c8-435d-bfff-da9fbaa40f3f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 204 len: 0 microversion: 2.1 time: 0.269165 Oct 25 03:04:30.906243 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 493/1038] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:04:30 2022] DELETE /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:04:31.073119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:31.074032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:31.088026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:31.088806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:31.089461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:31.092620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:31.093311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:31.093940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:31.145939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-727597173", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "385d0b29-fab5-4e63-9127-a294e08d4c17"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:31.282453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] validate_networks() for [('385d0b29-fab5-4e63-9127-a294e08d4c17', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:04:31.729367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:31.739746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:31.745390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:31.761724 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-85cb0f3c-bddd-4bf3-bad4-f8aeba8f7ae0 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.694649 Oct 25 03:04:31.766828 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 546/1039] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:31 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:32.355399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:04:32.355830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:04:32.356487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:04:32.357061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:04:32.357664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:04:32.385499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:32.386914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:32.388979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:32.391935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:32.411382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:32.412756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:32.496855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:32.514640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for user 438a56b0a79647f6bb195b7e0c42b089 and project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:32.552077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:04:32.557750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:04:32.675993 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c42a8a65-823b-4922-8ddf-494ed3f9b2f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534389 Oct 25 03:04:32.676671 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 494/1040] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:04:32.694880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6c8b691-a81c-41c2-b47b-46fccaa2dda0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:32.695540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6c8b691-a81c-41c2-b47b-46fccaa2dda0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:32.800155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:32.800955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:32.820927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:32.821909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:32.822371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:32.828234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:32.828816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:32.829462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:33.011746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a6c8b691-a81c-41c2-b47b-46fccaa2dda0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:33.022598 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6c8b691-a81c-41c2-b47b-46fccaa2dda0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1207 microversion: 2.1 time: 0.334958 Oct 25 03:04:33.028793 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 547/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:32 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1207 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:33.441754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:33.442403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:33.450599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:33.462087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:33.462531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:33.463303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:33.463774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:33.464211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:33.751973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:33.782470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:33.790401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:33.803586 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4ed62270-b1a9-4153-b813-b2ba54ffb568 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 1.007376 Oct 25 03:04:33.806391 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 495/1042] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:32 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:33.960528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-9df624b7-6824-414a-aae7-aaa7e1bcdebb req-3e969b95-5949-4ef6-b793-2e7520d47dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73a5304-6eac-4d37-9205-152d9fb4a87d", "name": "network-vif-unplugged", "status": "completed", "tag": "4752f89e-e695-436d-a624-66f72709fa7f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:34.000900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9df624b7-6824-414a-aae7-aaa7e1bcdebb req-3e969b95-5949-4ef6-b793-2e7520d47dc6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:34.002330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9df624b7-6824-414a-aae7-aaa7e1bcdebb req-3e969b95-5949-4ef6-b793-2e7520d47dc6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:34.003035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9df624b7-6824-414a-aae7-aaa7e1bcdebb req-3e969b95-5949-4ef6-b793-2e7520d47dc6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:34.029213 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-9df624b7-6824-414a-aae7-aaa7e1bcdebb req-3e969b95-5949-4ef6-b793-2e7520d47dc6 service nova] Creating event network-vif-unplugged:4752f89e-e695-436d-a624-66f72709fa7f for instance e73a5304-6eac-4d37-9205-152d9fb4a87d on n-h1-862355-1 Oct 25 03:04:34.042081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-9df624b7-6824-414a-aae7-aaa7e1bcdebb req-3e969b95-5949-4ef6-b793-2e7520d47dc6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103777 Oct 25 03:04:34.044279 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 496/1043] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:34.056521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:34.067138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:34.101096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:34.102276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:34.104296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:34.105166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:34.108185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:34.108754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:34.251409 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9d0e2e87-a11a-439b-9ebd-f300997aee3c tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1814 microversion: 2.1 time: 0.814697 Oct 25 03:04:34.254118 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 548/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:33 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1814 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:34.279700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:34.284034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:34.296802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:34.298930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:34.303601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:34.304409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:34.305117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:34.414198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7f735a44-666b-482c-99b6-a4df7231d995 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.134240 Oct 25 03:04:34.415028 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 549/1045] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:04:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:04:34.498688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:34.515977 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-383c9bfd-6993-4cd0-b3c1-357436e55161 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1211 microversion: 2.1 time: 0.463417 Oct 25 03:04:34.524745 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 497/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:34 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1211 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:34.838792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:34.839740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:34.861486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:34.862661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:34.864041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:34.865318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:34.867026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:34.869003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:35.359661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:35.376634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:35.382650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:35.399318 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9232f3fa-17c9-4c69-b16e-09a0843ff848 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.564499 Oct 25 03:04:35.404738 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 550/1047] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:34 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:35.555098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:35.555680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:35.568823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:35.569338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:35.569814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:35.570543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:35.571004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:35.573577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:35.881402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:35.896618 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d76c7c5b-828b-4ec7-a328-8fb80c94a4b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1259 microversion: 2.1 time: 0.345893 Oct 25 03:04:35.921781 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 551/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:35 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1259 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:35.950853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:35.953251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:35.958283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-494912624", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:35.994894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:35.998322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:36.001487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:36.003222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:36.009101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:36.013193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:36.183557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:04:36.936172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:36.958655 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89a2c680-be3d-4ec2-860e-d8be9b8c6ef4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1482 microversion: 2.1 time: 1.033834 Oct 25 03:04:36.960095 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 552/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:35 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1482 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:36.973981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f87b5c94-83b6-488c-a865-d4c8c5b604a3 req-82072a5e-b084-4985-9909-bbf02529c511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a34089b-d23c-457c-bcdc-ccf220f6f099", "tag": "32be58c6-6e9b-46be-afd4-f6e81b24be78"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:37.025363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f87b5c94-83b6-488c-a865-d4c8c5b604a3 req-82072a5e-b084-4985-9909-bbf02529c511 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:37.033712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f87b5c94-83b6-488c-a865-d4c8c5b604a3 req-82072a5e-b084-4985-9909-bbf02529c511 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:37.034447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f87b5c94-83b6-488c-a865-d4c8c5b604a3 req-82072a5e-b084-4985-9909-bbf02529c511 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:37.076484 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f87b5c94-83b6-488c-a865-d4c8c5b604a3 req-82072a5e-b084-4985-9909-bbf02529c511 service nova] Creating event network-changed:32be58c6-6e9b-46be-afd4-f6e81b24be78 for instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 on n-h1-862355-1 Oct 25 03:04:37.098235 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f87b5c94-83b6-488c-a865-d4c8c5b604a3 req-82072a5e-b084-4985-9909-bbf02529c511 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135084 Oct 25 03:04:37.103449 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 553/1050] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:37.124728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:37.126248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:37.155313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:37.156020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:37.156476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:37.157211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:37.157689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:37.166568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:37.376748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:37.391170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:37.399194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:37.413923 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5f6f63b-b58b-43bc-b6bc-65cc26e80cae tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.307917 Oct 25 03:04:37.414571 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 554/1051] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:37 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:37.439893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:37.441572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:37.459551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:37.460493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:37.461434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:37.464687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:37.465357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:37.465993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:37.889655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:37.902984 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a30464d-d920-4328-a93e-7c37cd762add tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1265 microversion: 2.1 time: 0.469857 Oct 25 03:04:37.917131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 555/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:37 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:38.377375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:04:38.377918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:04:38.378215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:04:38.378680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:04:38.379228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:04:38.402765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:38.403261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:38.403706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:38.404437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:38.404894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:38.405338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:38.406580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6a616c58-5f2b-42e5-91e5-2081cc79493d req-4fdacbb7-2ca2-4fa7-88fd-6def36283bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73a5304-6eac-4d37-9205-152d9fb4a87d", "name": "network-vif-deleted", "tag": "4752f89e-e695-436d-a624-66f72709fa7f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:38.434011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6a616c58-5f2b-42e5-91e5-2081cc79493d req-4fdacbb7-2ca2-4fa7-88fd-6def36283bf4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:38.435806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6a616c58-5f2b-42e5-91e5-2081cc79493d req-4fdacbb7-2ca2-4fa7-88fd-6def36283bf4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:38.436263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6a616c58-5f2b-42e5-91e5-2081cc79493d req-4fdacbb7-2ca2-4fa7-88fd-6def36283bf4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:38.486743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Getting quotas for project 8d3bf3aae3394187a839240184105a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:04:38.493761 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6a616c58-5f2b-42e5-91e5-2081cc79493d req-4fdacbb7-2ca2-4fa7-88fd-6def36283bf4 service nova] Creating event network-vif-deleted:4752f89e-e695-436d-a624-66f72709fa7f for instance e73a5304-6eac-4d37-9205-152d9fb4a87d on n-h1-862355-1 Oct 25 03:04:38.507558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Getting quotas for user 461124422d1846e5b04d0d93ece24ded and project 8d3bf3aae3394187a839240184105a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:04:38.518497 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6a616c58-5f2b-42e5-91e5-2081cc79493d req-4fdacbb7-2ca2-4fa7-88fd-6def36283bf4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114810 Oct 25 03:04:38.522862 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 556/1053] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 25 03:04:38.535264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:38.536350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:38.556752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:04:38.560880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:38.561451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:38.563370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:04:38.565086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:38.567430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:38.568468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:38.569999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:38.770239 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d146ba7c-c3b1-4e39-8cf6-994d925d71b4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.259003 Oct 25 03:04:38.773375 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 498/1054] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:04:38.785867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5c72fa87-5385-40ec-8f1d-93d98e985f93 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:38.786502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5c72fa87-5385-40ec-8f1d-93d98e985f93 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:38.853026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:38.869066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:38.870995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:38.897631 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a1e0742-60ef-4cd1-9afc-ddf79e8aed63 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.373046 Oct 25 03:04:38.902553 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 557/1055] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:38 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:38.935302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:38.936321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:38.945952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:38.948570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:38.949341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:38.950816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:38.952597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:38.954075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:39.106618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:39.115281 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb74d5a8-4e64-4fa5-b496-8ee2e48a17b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1265 microversion: 2.1 time: 0.186062 Oct 25 03:04:39.121102 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 558/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:38 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:39.124979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5c72fa87-5385-40ec-8f1d-93d98e985f93 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:39.131939 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5c72fa87-5385-40ec-8f1d-93d98e985f93 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1218 microversion: 2.1 time: 0.350059 Oct 25 03:04:39.154243 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 499/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:38 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:39.595215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b988aedf-c71c-4370-baa8-8ac85247ed65", "device": "/dev/xvdb"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:39.601645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:39.620896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:39.622277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:39.626409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:39.633201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:39.636774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:39.639070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:39.935300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:39.935931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:39.955254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:39.956256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:39.958886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:39.960420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:39.963542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:39.968020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:40.223248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:40.237171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:40.240924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:40.256473 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f91c89f-62f0-4ae3-9607-c9de9a70df59 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.324136 Oct 25 03:04:40.258873 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 500/1058] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:39 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:04:40.275386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:40.276250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:40.289853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:40.290668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:40.291218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:40.292325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:40.293872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:40.294700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:40.305972 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cce2b289-22c7-4632-82c3-e28daae968e5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "POST /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713625 Oct 25 03:04:40.310242 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 559/1059] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:04:39 2022] POST /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:40.356939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:40.358025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:40.407985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:40.409021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:40.410446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:40.411818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:40.413191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:40.414048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:40.904210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:40.918932 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c9a31ee-1a5e-40a0-b06c-0e7bd0b95f0b tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1222 microversion: 2.1 time: 0.605241 Oct 25 03:04:40.923019 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 560/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:40 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1222 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:41.292956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:41.293585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:41.308769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:41.316685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:41.317146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:41.317923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:41.318408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:41.323695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:41.618396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:41.643009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:41.645222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:41.652401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e868cc15-9e81-456f-846c-4f3d380bc91b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.363693 Oct 25 03:04:41.653483 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 561/1061] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:41 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:41.753957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:41.765202 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-053cb025-6225-415a-ac3e-30cdb78eba98 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1265 microversion: 2.1 time: 1.502812 Oct 25 03:04:41.777765 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 501/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:40 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1265 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:41.871959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12aa1517-c51c-4585-a731-0267861b0d0e tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] Calling method '.version_select at 0x7efd3363c820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:41.948144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:41.949338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:41.969502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12aa1517-c51c-4585-a731-0267861b0d0e tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461/defaults" status: 200 len: 371 microversion: 2.1 time: 0.314381 Oct 25 03:04:41.970349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:41.970677 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 562/1063] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:04:41 2022] GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461/defaults => generated 371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:41.970913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:41.971272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:41.971973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:41.972592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:41.973010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:41.991722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-adaf799d-8f8e-4750-be49-f9ed5979e432 tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] Calling method '.version_select at 0x7efd33610940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:42.098691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=31 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:42.142668 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-adaf799d-8f8e-4750-be49-f9ed5979e432 tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461" status: 200 len: 371 microversion: 2.1 time: 0.163791 Oct 25 03:04:42.185867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 563/1064] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:04:41 2022] GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461 => generated 371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:42.217920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5387f55-37b9-42fb-80b7-c2fa9d3e349d tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] Calling method '.version_select at 0x7efd3363bc10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:42.276713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:42.292519 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1f9e414-c8cb-435d-aae7-04bc0e5eca38 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1270 microversion: 2.1 time: 0.345824 Oct 25 03:04:42.313798 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 502/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:41 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1270 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:42.402599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d5387f55-37b9-42fb-80b7-c2fa9d3e349d tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461/defaults" status: 200 len: 371 microversion: 2.1 time: 0.213328 Oct 25 03:04:42.417988 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 564/1066] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:04:42 2022] GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461/defaults => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:42.424433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bad880ce-7096-4c25-adbe-98d144cd2059 tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] Calling method '.version_select at 0x7efd334ce0d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:42.657435 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bad880ce-7096-4c25-adbe-98d144cd2059 tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461" status: 200 len: 371 microversion: 2.1 time: 0.242568 Oct 25 03:04:42.663833 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 503/1067] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:04:42 2022] GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461 => generated 371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:04:42.676838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46909494-9c38-4ea7-9fd2-1555be726f40 tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] Calling method '.version_select at 0x7efd336103a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:42.705697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:42.708660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:42.726789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:42.728308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:42.730619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:42.732884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:42.734043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:42.736150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:42.909781 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46909494-9c38-4ea7-9fd2-1555be726f40 tempest-QuotasTestJSON-329449826 tempest-QuotasTestJSON-329449826-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461?user_id=72010b94cba94e269189f862654c5c29" status: 200 len: 371 microversion: 2.1 time: 0.239205 Oct 25 03:04:42.921631 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 565/1068] 10.222.0.36 () {58 vars in 1323 bytes} [Tue Oct 25 03:04:42 2022] GET /compute/v2.1/os-quota-sets/9a31af2ac3a14d84845426956a4f1461?user_id=72010b94cba94e269189f862654c5c29 => generated 371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:42.930753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:42.933413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:42.945107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:42.959573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:42.961817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:42.962464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:42.964253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:42.964563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:42.965193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:42.967294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:42.970698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:42.989514 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eedc8880-2f92-4d6c-a210-21f5fa9ed75f tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.295825 Oct 25 03:04:42.994264 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 504/1069] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:42 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:43.333164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:43.335507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:43.345741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:43.347182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:43.348234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:43.359199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:43.362304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:43.364753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:43.450338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:43.467417 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ace5b46d-279c-424a-8a28-a2e74eb416b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.550621 Oct 25 03:04:43.484151 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 566/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:42 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:43.763590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:43.776650 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-349137b7-b0e8-4686-827a-4ef626667255 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1276 microversion: 2.1 time: 0.447290 Oct 25 03:04:43.781033 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 505/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:43 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1276 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:44.023556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:44.024457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:44.031375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:44.032101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:44.032706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:44.033879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:44.034485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:44.035782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:44.039014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:44.169385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:44.189204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:44.206106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:44.214481 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f43809d-5299-4b19-94db-fbd2fe1547a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.194890 Oct 25 03:04:44.215920 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 567/1072] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:44 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:44.276906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b9445b81-4c22-4636-9d72-165816159109 req-9b2671ca-c437-4604-95b4-0bc823dbff52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5638e8a-6990-4068-bc45-bd2bbe313310", "tag": "4c9569cd-ff29-48df-8f89-9b9df51c2d75"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:44.299928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b9445b81-4c22-4636-9d72-165816159109 req-9b2671ca-c437-4604-95b4-0bc823dbff52 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:44.303046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b9445b81-4c22-4636-9d72-165816159109 req-9b2671ca-c437-4604-95b4-0bc823dbff52 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:44.303405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b9445b81-4c22-4636-9d72-165816159109 req-9b2671ca-c437-4604-95b4-0bc823dbff52 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:44.324618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b9445b81-4c22-4636-9d72-165816159109 req-9b2671ca-c437-4604-95b4-0bc823dbff52 service nova] Creating event network-changed:4c9569cd-ff29-48df-8f89-9b9df51c2d75 for instance f5638e8a-6990-4068-bc45-bd2bbe313310 on n-h2-862355-1 Oct 25 03:04:44.345787 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b9445b81-4c22-4636-9d72-165816159109 req-9b2671ca-c437-4604-95b4-0bc823dbff52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072758 Oct 25 03:04:44.349975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 506/1073] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:44.495070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:44.498841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:44.509926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:44.513386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:44.514002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:44.514384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:44.515156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:44.520120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:44.520821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:44.808547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:44.810675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:44.826103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:44.826731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:44.827524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:44.828868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:44.829535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:44.830196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:44.957563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:44.967021 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a0ec063-fb71-4e59-a2d9-1a4d91aca9a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.478522 Oct 25 03:04:44.972848 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 568/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:44 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:45.015964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:45.025479 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b1d7926-6f63-4669-93d6-c06e86258b05 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1276 microversion: 2.1 time: 0.223695 Oct 25 03:04:45.030066 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 507/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:44 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1276 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:45.247493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:45.248380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:45.266489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:45.270423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:45.271152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:45.272752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:45.273247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:45.273810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:45.469440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:45.480071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4b79c58-4d8f-47d4-a117-b617031381b7 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd334fbe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1534790840", "description": "tempest-description-814513032"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:45.481728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:45.483242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:45.492167 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f414b933-a8f5-4468-9de1-beb201eea223 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.248559 Oct 25 03:04:45.492765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 569/1076] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:45 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:45.798587 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4b79c58-4d8f-47d4-a117-b617031381b7 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.532500 Oct 25 03:04:45.799856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 508/1077] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:04:45 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:04:45.813496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f54ec110-9792-417f-a996-12f4002eaab2 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd3363bb80>, body: {"security_group_rule": {"parent_group_id": "fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:45.992700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:45.993910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:46.005914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:46.006917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:46.010186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:46.011285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:46.011874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:46.013458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:46.119938 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f54ec110-9792-417f-a996-12f4002eaab2 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.310396 Oct 25 03:04:46.121723 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 570/1078] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:04:46.122910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f54ec110-9792-417f-a996-12f4002eaab2 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:46.123928 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f54ec110-9792-417f-a996-12f4002eaab2 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001249 Oct 25 03:04:46.124415 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 571/1079] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 25 03:04:46 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 25 03:04:46.132268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:46.135859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:46.150862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:46.151876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:46.153864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:46.154815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:46.156216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:46.157507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:46.250589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:46.264018 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cebf3526-b5cb-4a7d-af8e-8a634b45623c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.275027 Oct 25 03:04:46.265580 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 509/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:45 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:46.278598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96670e85-26b1-4fd3-b197-ef9bc96b7698 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd38e57f70>, body: {"security_group_rule": {"parent_group_id": "fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:46.381494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:46.396942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.270524 Oct 25 03:04:46.398647 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 572/1081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:46 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:46.402140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:46.404407 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002692 Oct 25 03:04:46.413519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 573/1082] 10.222.0.36 () {54 vars in 1035 bytes} [Tue Oct 25 03:04:46 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 25 03:04:46.415000 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-96670e85-26b1-4fd3-b197-ef9bc96b7698 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: This rule already exists in group fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8 Oct 25 03:04:46.419340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:46.420897 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004238 Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96670e85-26b1-4fd3-b197-ef9bc96b7698 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 138 Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:04:46.429855 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: {"security_group_rule": {"parent_group_id": "fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 25 03:04:46.431364 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: exception: This rule already exists in group fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8 Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8 Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:46.432658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8 Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8 Oct 25 03:04:46.434201 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:46.435195 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 574/1083] 10.222.0.36 () {54 vars in 1041 bytes} [Tue Oct 25 03:04:46 2022] GET /compute/v2.1/ => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:46.436236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96670e85-26b1-4fd3-b197-ef9bc96b7698 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 400 to user: This rule already exists in group fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8 {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:46.437290 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96670e85-26b1-4fd3-b197-ef9bc96b7698 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.170260 Oct 25 03:04:46.438126 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 510/1084] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:46 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:04:46.442107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:46.443182 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-69d14883-5f50-4ef7-95ec-b41d16009097 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007552 Oct 25 03:04:46.443559 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 575/1085] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 25 03:04:46 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 25 03:04:46.456321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-378fe0af-06e9-430c-9ab1-7998e125f4c9 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '.version_select at 0x7efd33596310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:46.523046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:46.523667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:46.539864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:46.546170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:46.546655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:46.547429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:46.547918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:46.548356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:46.796364 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-378fe0af-06e9-430c-9ab1-7998e125f4c9 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/ce60490d-e844-43cd-b8f4-705199218ca4" status: 202 len: 0 microversion: 2.1 time: 0.352973 Oct 25 03:04:46.798014 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 511/1086] 10.222.0.36 () {58 vars in 1287 bytes} [Tue Oct 25 03:04:46 2022] DELETE /compute/v2.1/os-security-group-rules/ce60490d-e844-43cd-b8f4-705199218ca4 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:04:46.810164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d3b2373-692b-45df-a00b-07920b9cc4a9 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd33d6fe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1456220318", "description": "tempest-description-1667806788"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:46.976092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:46.994548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:46.999276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:47.017303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-484e35ee-8690-46e7-89af-7f4732aaab2d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.499068 Oct 25 03:04:47.020413 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 576/1087] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:46 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:04:47.170463 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d3b2373-692b-45df-a00b-07920b9cc4a9 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.365776 Oct 25 03:04:47.171612 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 512/1088] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:04:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:47.185606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67f0ac69-1968-43c6-8b33-743caa9c8c24 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd33602af0>, body: {"security_group_rule": {"parent_group_id": "d9dd7287-faab-4a7b-9d9a-3d9c9ddb5879", "ip_protocol": "tcp", "from_port": 1154497765, "to_port": 22}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:47.289573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:47.297271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:47.319733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:47.322392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:47.323009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:47.323857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:47.324454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:47.324944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:47.489866 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-67f0ac69-1968-43c6-8b33-743caa9c8c24 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: Invalid port range 1154497765:22. Former value cannot be greater than the later Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67f0ac69-1968-43c6-8b33-743caa9c8c24 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 146 Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:47.493236 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: {"security_group_rule": {"parent_group_id": "d9dd7287-faab-4a7b-9d9a-3d9c9ddb5879", "ip_protocol": "tcp", "from_port": 1154497765, "to_port": 22}} Oct 25 03:04:47.494901 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid port range 1154497765:22. Former value cannot be greater than the later Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd9dd7287-faab-4a7b-9d9a-3d9c9ddb5879', 'ip_protocol': 'tcp', 'from_port': 1154497765, 'to_port': 22}}} Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1154497765:22. Former value cannot be greater than the later Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:47.495808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1154497765:22. Former value cannot be greater than the later Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1154497765:22. Former value cannot be greater than the later Oct 25 03:04:47.497192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.498639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67f0ac69-1968-43c6-8b33-743caa9c8c24 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 400 to user: Invalid port range 1154497765:22. Former value cannot be greater than the later {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:47.498639 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67f0ac69-1968-43c6-8b33-743caa9c8c24 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.313436 Oct 25 03:04:47.498639 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 577/1089] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:47 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:04:47.507222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:47.507909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:47.527149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:47.527649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:47.528094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:47.528802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:47.539119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:47.539811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:47.591987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:47.607112 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa6456fd-f47f-42a3-bfff-6526890eb8e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.321354 Oct 25 03:04:47.608571 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 513/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:47 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:47.618773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2498e614-9185-408e-899c-7046022b2934 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd33d6faf0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1054349964", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:47.625552 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-2498e614-9185-408e-899c-7046022b2934 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: Security group id should be uuid Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2498e614-9185-408e-899c-7046022b2934 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 131 Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:04:47.629411 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1054349964", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:04:47.630750 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group id should be uuid Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1054349964', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:47.631566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 25 03:04:47.632928 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:47.638055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2498e614-9185-408e-899c-7046022b2934 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 400 to user: Security group id should be uuid {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:47.641326 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2498e614-9185-408e-899c-7046022b2934 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.030806 Oct 25 03:04:47.646473 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 514/1091] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:47 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:04:47.661362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1fe15c80-f563-4021-a8aa-b799f36a07af tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd334fb280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2034328853", "description": "tempest-description-1253869592"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:47.865204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:47.886195 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3acc7ba9-be28-4f3c-b144-423b3ff6a55c tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.388999 Oct 25 03:04:47.887164 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 578/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:47 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:47.929084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1fe15c80-f563-4021-a8aa-b799f36a07af tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.276736 Oct 25 03:04:47.939575 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 515/1093] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:04:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:04:47.946957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2177cf28-b829-45f1-8fae-51da77213fe1 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd33674700>, body: {"security_group_rule": {"parent_group_id": "584571e5-d412-468b-a39a-537f8f5cab92", "ip_protocol": "tempest-999-482768196", "from_port": 22, "to_port": 22}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:48.048553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:48.049023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:48.062773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:48.063276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:48.063707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:48.064609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:48.072522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:48.073230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:48.131116 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2177cf28-b829-45f1-8fae-51da77213fe1 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: Invalid IP protocol tempest-999-482768196. Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2177cf28-b829-45f1-8fae-51da77213fe1 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 156 Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:48.134270 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: {"security_group_rule": {"parent_group_id": "584571e5-d412-468b-a39a-537f8f5cab92", "ip_protocol": "tempest-999-482768196", "from_port": 22, "to_port": 22}} Oct 25 03:04:48.135960 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid IP protocol tempest-999-482768196. Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'security_group_rule': {'parent_group_id': '584571e5-d412-468b-a39a-537f8f5cab92', 'ip_protocol': 'tempest-999-482768196', 'from_port': 22, 'to_port': 22}}} Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-482768196. Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:48.136818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-482768196. Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-482768196. Oct 25 03:04:48.138114 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:48.140145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2177cf28-b829-45f1-8fae-51da77213fe1 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 400 to user: Invalid IP protocol tempest-999-482768196. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:48.141209 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2177cf28-b829-45f1-8fae-51da77213fe1 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.201033 Oct 25 03:04:48.142463 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 579/1094] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:47 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 25 03:04:48.152583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d20463b-045f-4c5f-9dd6-5decbc225d5a tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd335dd550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1351133978", "description": "tempest-description-458772008"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:48.183763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:48.192901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:48.193958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:48.218603 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c291814d-057b-4493-ace3-0b0e3e9ec3fe tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.173226 Oct 25 03:04:48.235686 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 516/1095] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:48 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:48.245974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-9d1c5fac-7acf-4ac0-bb21-d5fa399cc34e req-d6881805-f5e0-4bcc-b5cc-e002f83bde65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33386002-6ff6-47ae-8aec-6ecdf27e7fd5", "tag": "3f8403a4-bf81-494a-9867-c037d5dc54a0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:48.259100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9d1c5fac-7acf-4ac0-bb21-d5fa399cc34e req-d6881805-f5e0-4bcc-b5cc-e002f83bde65 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:48.260461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9d1c5fac-7acf-4ac0-bb21-d5fa399cc34e req-d6881805-f5e0-4bcc-b5cc-e002f83bde65 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:48.264271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9d1c5fac-7acf-4ac0-bb21-d5fa399cc34e req-d6881805-f5e0-4bcc-b5cc-e002f83bde65 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:48.277639 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-9d1c5fac-7acf-4ac0-bb21-d5fa399cc34e req-d6881805-f5e0-4bcc-b5cc-e002f83bde65 service nova] Creating event network-changed:3f8403a4-bf81-494a-9867-c037d5dc54a0 for instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 on n-h2-862355-1 Oct 25 03:04:48.288419 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-9d1c5fac-7acf-4ac0-bb21-d5fa399cc34e req-d6881805-f5e0-4bcc-b5cc-e002f83bde65 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051373 Oct 25 03:04:48.290368 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 517/1096] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:48.639927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:48.640647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:48.646818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:48.651005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:48.652080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:48.652306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:48.653156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:48.653655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:48.654613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.102485 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d20463b-045f-4c5f-9dd6-5decbc225d5a tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.953845 Oct 25 03:04:49.103138 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 580/1097] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:04:48 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:04:49.108928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:49.109599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:49.125786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.126260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.126703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.127412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.127869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.128301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.211918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:49.219275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:49.223987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cac1a639-9a43-4d99-9760-2991d0c81315 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.588486 Oct 25 03:04:49.249354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 518/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:48 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:49.259677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-68c52803-e107-4c70-881a-85ac497b09bc tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd334fbd30>, body: {"security_group_rule": {"parent_group_id": "b7728a13-5bdf-47c3-b0c9-ec435f42dd1b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:49.373982 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-68c52803-e107-4c70-881a-85ac497b09bc tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-68c52803-e107-4c70-881a-85ac497b09bc tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 138 Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:04:49.375765 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: {"security_group_rule": {"parent_group_id": "b7728a13-5bdf-47c3-b0c9-ec435f42dd1b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 25 03:04:49.377546 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b7728a13-5bdf-47c3-b0c9-ec435f42dd1b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:49.378345 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 25 03:04:49.380897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:49.382222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-68c52803-e107-4c70-881a-85ac497b09bc tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:49.382222 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-68c52803-e107-4c70-881a-85ac497b09bc tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.126485 Oct 25 03:04:49.384957 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 519/1099] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:49 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:04:49.395075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:49.396993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:49.397974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:49.404322 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c32ab7c2-2dc4-4fb5-a57c-f857636750e5 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.300019 Oct 25 03:04:49.418767 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 581/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:49 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:49.420416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.421360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.422031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.422920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.423553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.424459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.449831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cbdf0632-79ec-4623-8f37-b8e848d62235 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd33674c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1842408366", "description": "tempest-description-1274509975"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:49.596624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:49.614936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:49.617108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:49.625082 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b98414d3-a792-431e-a0f0-d9e1ea6271a3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.238955 Oct 25 03:04:49.626401 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 520/1101] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:49 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:49.632590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:49.633344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:49.657121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.657485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.657956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.658670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.659123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.659540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.821590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:04:49.838207 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9db904c-c392-48cb-bc30-8a6288fe66d5 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 2345 microversion: 2.25 time: 0.210067 Oct 25 03:04:49.838588 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 521/1102] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:49 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 2345 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:49.866776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:49.870978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.871461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.871905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.872674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:49.873174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:49.873731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:49.893221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:49.899467 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cbdf0632-79ec-4623-8f37-b8e848d62235 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.479359 Oct 25 03:04:49.901303 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 582/1103] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:04:49 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:49.915085 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a33a4cb6-53ac-4b8e-8da9-bfbf2d89fbac tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052049 Oct 25 03:04:49.918594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97c9c5e9-776f-4fd6-9598-1d11c55e87c8 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd3363b160>, body: {"security_group_rule": {"parent_group_id": "511f99a5-4ea7-4178-b5e1-fd077b6362fc", "ip_protocol": "tcp", "from_port": 22, "to_port": 1842687664}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:49.924008 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 522/1104] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 25 03:04:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:04:50.038467 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-97c9c5e9-776f-4fd6-9598-1d11c55e87c8 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: Invalid port range 22:1842687664. Valid TCP ports should be between 1-65535 Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97c9c5e9-776f-4fd6-9598-1d11c55e87c8 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 146 Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:50.044886 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: {"security_group_rule": {"parent_group_id": "511f99a5-4ea7-4178-b5e1-fd077b6362fc", "ip_protocol": "tcp", "from_port": 22, "to_port": 1842687664}} Oct 25 03:04:50.046812 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid port range 22:1842687664. Valid TCP ports should be between 1-65535 Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'security_group_rule': {'parent_group_id': '511f99a5-4ea7-4178-b5e1-fd077b6362fc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1842687664}}} Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1842687664. Valid TCP ports should be between 1-65535 Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:50.047756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1842687664. Valid TCP ports should be between 1-65535 Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1842687664. Valid TCP ports should be between 1-65535 Oct 25 03:04:50.049263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.051195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97c9c5e9-776f-4fd6-9598-1d11c55e87c8 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 400 to user: Invalid port range 22:1842687664. Valid TCP ports should be between 1-65535 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:50.051195 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97c9c5e9-776f-4fd6-9598-1d11c55e87c8 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.137435 Oct 25 03:04:50.057474 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 583/1105] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:49 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:04:50.063119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-98c7ee49-f536-4e8d-a2c2-9a697451a5ce tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Action: 'create', calling method: .version_select at 0x7efd335a9af0>, body: {"security_group_rule": {"parent_group_id": "12065459-1f72-4f8c-9a44-8ef1fe019927", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:50.119416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-98c7ee49-f536-4e8d-a2c2-9a697451a5ce tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:04:50.120070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-98c7ee49-f536-4e8d-a2c2-9a697451a5ce tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Neutron security group 12065459-1f72-4f8c-9a44-8ef1fe019927 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:04:50.120691 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-98c7ee49-f536-4e8d-a2c2-9a697451a5ce tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist Oct 25 03:04:50.120691 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-9d62b317-5043-4c71-89f9-b6d672952458'] Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-98c7ee49-f536-4e8d-a2c2-9a697451a5ce tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 138 Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:04:50.126058 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: {"security_group_rule": {"parent_group_id": "12065459-1f72-4f8c-9a44-8ef1fe019927", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 25 03:04:50.127803 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-9d62b317-5043-4c71-89f9-b6d672952458'] Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'security_group_rule': {'parent_group_id': '12065459-1f72-4f8c-9a44-8ef1fe019927', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:04:50.128710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d62b317-5043-4c71-89f9-b6d672952458'] Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 25 03:04:50.130093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d62b317-5043-4c71-89f9-b6d672952458'] Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d62b317-5043-4c71-89f9-b6d672952458'] Oct 25 03:04:50.131559 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d62b317-5043-4c71-89f9-b6d672952458'] Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-98c7ee49-f536-4e8d-a2c2-9a697451a5ce tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 404 to user: Security group 12065459-1f72-4f8c-9a44-8ef1fe019927 does not exist Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-9d62b317-5043-4c71-89f9-b6d672952458'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:50.139569 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-98c7ee49-f536-4e8d-a2c2-9a697451a5ce tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.072216 Oct 25 03:04:50.140587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 523/1106] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:04:50 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:50.145082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d70c114-6a1a-401e-a23e-1319c04fd298 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '.version_select at 0x7efd33610940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:50.214303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-1d70c114-6a1a-401e-a23e-1319c04fd298 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:04:50.215107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.security_group_api [None req-1d70c114-6a1a-401e-a23e-1319c04fd298 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Neutron security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea not found {{(pid=120562) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 25 03:04:50.216123 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1d70c114-6a1a-401e-a23e-1319c04fd298 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] HTTP exception thrown: Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist Oct 25 03:04:50.216123 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-0c849761-fb7e-4933-9d92-6aa9bdc4e07d'] Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d70c114-6a1a-401e-a23e-1319c04fd298 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Request method failure captured: Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-security-group-rules/1b19671a-f0eb-441e-8cdd-0bb1cec43cea HTTP/1.1 Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1JNJswb1AbEVvDV5j9XzVS-ZfNcl_KbubH-KN23qoKL3zD9u82va-lJ2uYtTxajsooEHdTErvF1av8dXipuxQjA8KlmY6tWblGE9yWIOaVZxJX1h7u29d30h8KdPC5UKpfJtp8hty2s4U5d72NHlpLaWDtJi2_EMJ14a08X2T8eBsQ Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:04:50.219295 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/07ccdb9a32854ca8aea0979b9bece7a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_07ccdb9a32854ca8aea0979b9bece7a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/07ccdb9a32854ca8aea0979b9bece7a9"}]}] Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 07ccdb9a32854ca8aea0979b9bece7a9 Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779 Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 432f514cb44b4fe78d1dbf76d5cb2204 Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-769524779-project Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: exception: Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist Oct 25 03:04:50.221274 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-0c849761-fb7e-4933-9d92-6aa9bdc4e07d'] Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '1b19671a-f0eb-441e-8cdd-0bb1cec43cea'} Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.222343 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c849761-fb7e-4933-9d92-6aa9bdc4e07d'] Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 25 03:04:50.223509 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c849761-fb7e-4933-9d92-6aa9bdc4e07d'] Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c849761-fb7e-4933-9d92-6aa9bdc4e07d'] Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.225239 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c849761-fb7e-4933-9d92-6aa9bdc4e07d'] Oct 25 03:04:50.226767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:04:50.228271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d70c114-6a1a-401e-a23e-1319c04fd298 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Returning 404 to user: Security group rule 1b19671a-f0eb-441e-8cdd-0bb1cec43cea does not exist Oct 25 03:04:50.228271 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-0c849761-fb7e-4933-9d92-6aa9bdc4e07d'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:04:50.229651 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d70c114-6a1a-401e-a23e-1319c04fd298 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/1b19671a-f0eb-441e-8cdd-0bb1cec43cea" status: 404 len: 199 microversion: 2.1 time: 0.089222 Oct 25 03:04:50.231053 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 584/1107] 10.222.0.36 () {58 vars in 1287 bytes} [Tue Oct 25 03:04:50 2022] DELETE /compute/v2.1/os-security-group-rules/1b19671a-f0eb-441e-8cdd-0bb1cec43cea => generated 199 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:04:50.244365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0773db3-f803-426b-b9cd-8f037faf0757 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '.version_select at 0x7efd33413e50>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:50.267036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:50.267895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:50.279943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:50.280627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:50.282046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:50.284239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:50.284973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:50.285771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:50.630660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:50.645637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b24a0d58-d0bd-4ba1-bbec-4a0660d881d7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.393220 Oct 25 03:04:50.649171 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 585/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:50 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:50.657324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:50.657987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:50.665836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:50.666709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:50.667396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:50.668223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:50.668938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:50.669516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:51.023026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:51.034817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb514d8b-e7c9-46b2-948e-bd7575f60b7d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.384404 Oct 25 03:04:51.040454 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 586/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:50 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:51.054132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:51.058115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:51.078539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:51.085769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:51.087839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:51.088621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:51.093026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:51.093556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:51.120650 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0773db3-f803-426b-b9cd-8f037faf0757 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/511f99a5-4ea7-4178-b5e1-fd077b6362fc" status: 202 len: 0 microversion: 2.1 time: 0.884206 Oct 25 03:04:51.121590 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 524/1110] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:04:50 2022] DELETE /compute/v2.1/os-security-groups/511f99a5-4ea7-4178-b5e1-fd077b6362fc => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:04:51.130451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82af5a81-39c3-4778-b890-99e543ca6703 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '.version_select at 0x7efd3343c430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:51.196427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:51.209612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:51.211667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:51.218534 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad6e2ad9-1cf2-4f21-9a3f-8deb63e3e5b3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.176697 Oct 25 03:04:51.219179 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 587/1111] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:51 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:51.538860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82af5a81-39c3-4778-b890-99e543ca6703 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/b7728a13-5bdf-47c3-b0c9-ec435f42dd1b" status: 202 len: 0 microversion: 2.1 time: 0.413282 Oct 25 03:04:51.544578 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 525/1112] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:04:51 2022] DELETE /compute/v2.1/os-security-groups/b7728a13-5bdf-47c3-b0c9-ec435f42dd1b => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:04:51.549852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cde79cdc-62ab-4184-b064-c4b95a847cbc tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '.version_select at 0x7efd3363b4c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:51.699221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:51.699956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:51.715916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:51.716647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:51.717203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:51.718046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:51.718609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:51.719385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:51.841470 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cde79cdc-62ab-4184-b064-c4b95a847cbc tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/584571e5-d412-468b-a39a-537f8f5cab92" status: 202 len: 0 microversion: 2.1 time: 0.295631 Oct 25 03:04:51.842927 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 588/1113] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:04:51 2022] DELETE /compute/v2.1/os-security-groups/584571e5-d412-468b-a39a-537f8f5cab92 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:04:51.860520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03fb9add-5152-4492-9bfa-7d21e07aa763 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '.version_select at 0x7efd33624ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:52.061208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:52.075875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a1defc6f-66f8-41f3-bf48-d198c23e5c44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.381486 Oct 25 03:04:52.077086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 526/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:51 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:52.083266 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03fb9add-5152-4492-9bfa-7d21e07aa763 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/d9dd7287-faab-4a7b-9d9a-3d9c9ddb5879" status: 202 len: 0 microversion: 2.1 time: 0.235367 Oct 25 03:04:52.084967 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 589/1115] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:04:51 2022] DELETE /compute/v2.1/os-security-groups/d9dd7287-faab-4a7b-9d9a-3d9c9ddb5879 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:04:52.088028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:52.088807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:52.098037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d2d1f6a-7cd1-4a5c-8da9-e00ba28e9e44 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] Calling method '.version_select at 0x7efd335a0d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:52.099804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:52.100457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:52.100890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:52.101904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:52.102837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:52.104075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:52.306480 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d2d1f6a-7cd1-4a5c-8da9-e00ba28e9e44 tempest-SecurityGroupRulesNegativeTestJSON-769524779 tempest-SecurityGroupRulesNegativeTestJSON-769524779-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8" status: 202 len: 0 microversion: 2.1 time: 0.215135 Oct 25 03:04:52.307398 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 590/1116] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:04:52 2022] DELETE /compute/v2.1/os-security-groups/fdfdcc00-46f5-4fcc-894e-31c30f1f1fb8 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:04:52.312453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:52.313229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:52.322659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:52.323716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:52.324686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:52.326557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:52.327805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:52.329243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:52.415566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:52.423837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4bb7241-f55e-4f7b-8218-1fdac74be088 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.344898 Oct 25 03:04:52.424952 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 527/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:52 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:52.472100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:52.481629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:52.484234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:52.490677 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-124247e9-2e95-4ea8-b1c6-025dda5c7e2e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.182082 Oct 25 03:04:52.511480 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 591/1118] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:52 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:52.661237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=24 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:52.666414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87755014-72eb-47d0-83d8-577428450a1c", "device": "/dev/xvdb"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:52.669759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:52.676835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:52.677422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:52.677938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:52.678844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:52.679441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:52.680187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.101245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:53.102092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:53.105941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:53.106858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:53.123325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.124219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.125807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.126962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.127620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.128309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.374966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:53.386064 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6f9cc74-beed-4bb5-9863-3cd31de1b43b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.288603 Oct 25 03:04:53.387354 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 592/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:53 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:53.448241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:53.448866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:53.455296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.455781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.456217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.457928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.458570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.459373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.661258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:53.670231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab1396c5-3316-4493-be97-56c0e70d6423 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.227233 Oct 25 03:04:53.672077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 593/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:53 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:04:53.681088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:53.682064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:53.693018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.694081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.694745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.695618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.696228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.697367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.833086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:53.841906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:53.843299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:53.852253 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16830817-560c-46e3-aff7-9b7fa11f9b43 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1533 microversion: 2.91 time: 0.178800 Oct 25 03:04:53.864710 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 594/1121] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:53 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1533 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:53.887823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:53.892105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:53.903793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.904451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.904892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:53.905634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:53.906233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:53.906704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:54.138102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lazy-loading 'services' on Instance uuid afaa770c-434c-4b63-8193-cbdf552be58a {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:04:54.179290 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f4df678a-fd50-464c-9c11-ebb8ea1b1c54 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1938 microversion: 2.91 time: 0.297643 Oct 25 03:04:54.192084 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 595/1122] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:53 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1938 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:54.217307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:54.218764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:54.228497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:54.229552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:54.230395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:54.231684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:54.232434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:54.233544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:54.268344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lazy-loading 'flavor' on Instance uuid afaa770c-434c-4b63-8193-cbdf552be58a {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:04:54.349495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:54.589575 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8be323f0-2336-4d7c-87a6-bee13b95e7f6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action" status: 202 len: 0 microversion: 2.91 time: 0.376618 Oct 25 03:04:54.594830 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 596/1123] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:04:54 2022] POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:04:54.603683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:54.605298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:54.621723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:54.622274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:54.622738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:54.623563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:54.624025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:54.624687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:55.352666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:55.362529 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff137b0e-7222-4d7b-9260-4aaf2892d24f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.766120 Oct 25 03:04:55.378024 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 597/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:54 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:55.378024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:55.378024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:55.390588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:55.391537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:55.392202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:55.393155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:55.394337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:55.397059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:55.602018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:55.612375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:55.614757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:55.632639 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f6aa924-0329-4936-bc3d-cb97b0309244 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.265217 Oct 25 03:04:55.633260 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 598/1125] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:55 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:55.649534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:55.650215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:55.661520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:55.663526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:55.663987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:55.664729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:55.665197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:55.665626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:55.715882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-314617f4-3a7e-4c41-8ccf-05a9fd17db25 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "POST /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 3.055186 Oct 25 03:04:55.739120 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 528/1126] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Oct 25 03:04:52 2022] POST /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 194 bytes in 3075 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:04:56.377224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:56.378640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:56.383701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:56.396112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:56.397004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:56.397628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:56.398530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:56.399676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:56.400254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:56.401576 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7f31a51-85fe-4c3c-93ea-28cda8db6cc4 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.767144 Oct 25 03:04:56.402248 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 599/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:55 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:56.429643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:56.435586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:56.458663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:56.459528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:56.460121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:56.461140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:56.461897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:56.462475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:56.810713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:56.821188 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5d1e821-bf1e-4212-8441-e6228ed08ac0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.417876 Oct 25 03:04:56.827085 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 600/1128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:56 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:56.839998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:56.846674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:56.866459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:56.868734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:56.869212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:56.871405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:56.874446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:56.876827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:56.953596 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0bd3c83-8678-43bf-a742-f0beb4111392 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1860 microversion: 2.1 time: 0.580903 Oct 25 03:04:56.961719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 529/1129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:56 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1860 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:56.994531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862355-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:56.999443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:57.007221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:57.008077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:57.008675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:57.009544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:57.010191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:57.010778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:57.108875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:57.123496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lazy-loading 'flavor' on Instance uuid 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:04:57.128419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:57.136133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:57.145999 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd2f677c-7bb8-4126-b093-f1c2bf2e0401 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.315711 Oct 25 03:04:57.158230 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 601/1130] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:56 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:57.174236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Going to try to live migrate instance to n-h2-862355-1 {{(pid=120563) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:04:57.428002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:57.430905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:57.443404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:57.468528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:57.470684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:57.471455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:57.473539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:57.474020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:57.967559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:57.981514 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-26982d39-6526-4d96-9a42-1e6efd059807 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.558983 Oct 25 03:04:57.982445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 602/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:57 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:57.991752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:57.992620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:58.004203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:58.005937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:58.006714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:58.007756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:58.008378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:58.008956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:58.623186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:58.641415 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45b88ba0-e24b-4997-8b01-10f5427087eb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.657806 Oct 25 03:04:58.642045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 603/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:57 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:58.647327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:58.652145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:58.670753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:58.671500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:58.672109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:58.673034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:58.673650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:58.674265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:58.983071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:59.004607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:59.006403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:59.022887 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d54c98a-e798-471b-bf19-9d3b627602d7 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.379570 Oct 25 03:04:59.023498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 604/1133] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:04:58 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:04:59.029635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-05ec81f3-a085-44e1-89ea-501b3c7b0ac9 req-0bddc68f-fe34-45a3-a2d6-20f4a2371bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5638e8a-6990-4068-bc45-bd2bbe313310", "name": "network-vif-plugged", "status": "completed", "tag": "4c9569cd-ff29-48df-8f89-9b9df51c2d75"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:04:59.051357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-05ec81f3-a085-44e1-89ea-501b3c7b0ac9 req-0bddc68f-fe34-45a3-a2d6-20f4a2371bcd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:59.051857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-05ec81f3-a085-44e1-89ea-501b3c7b0ac9 req-0bddc68f-fe34-45a3-a2d6-20f4a2371bcd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:59.052360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-05ec81f3-a085-44e1-89ea-501b3c7b0ac9 req-0bddc68f-fe34-45a3-a2d6-20f4a2371bcd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:59.074245 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-05ec81f3-a085-44e1-89ea-501b3c7b0ac9 req-0bddc68f-fe34-45a3-a2d6-20f4a2371bcd service nova] Creating event network-vif-plugged:4c9569cd-ff29-48df-8f89-9b9df51c2d75 for instance f5638e8a-6990-4068-bc45-bd2bbe313310 on n-h2-862355-1 Oct 25 03:04:59.090305 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-05ec81f3-a085-44e1-89ea-501b3c7b0ac9 req-0bddc68f-fe34-45a3-a2d6-20f4a2371bcd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064864 Oct 25 03:04:59.090899 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 605/1134] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:04:59.096634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:59.110793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:04:59.119138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:59.119837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:59.120458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:59.121399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:04:59.122106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:04:59.122699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:04:59.745647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:04:59.754792 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-033af940-9160-4209-a858-756d1a768f54 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.662361 Oct 25 03:04:59.760922 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 606/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:59 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:04:59.883780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:04:59.963576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e7bdbd42-2a31-4373-a4f7-91733e57e297 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/action" status: 202 len: 0 microversion: 2.1 time: 2.977101 Oct 25 03:04:59.964692 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 530/1136] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:04:56 2022] POST /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/action => generated 0 bytes in 2979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:04:59.974026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:04:59.975055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:00.006625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.012587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.013127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.014191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.014691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.022863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.284174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-392eb120-2c79-454f-bfd2-d1f86e45e0be tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'create', calling method: .version_select at 0x7efd33536d30>, body: {"keypair": {"name": "tempest-keypair-1117660121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1B7vWOUwQi8Lb8vp391nkujS4D/9TuYnuFgEtokPoc8uDJak7aP8kj4PKCfquCFCqjsf8RPWphLccRqw2DoQvlGyTdYMg/xa4ZC6j+A1I9nUJ7wURUmFeyewElngLz0g=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:00.335347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:00.335911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-392eb120-2c79-454f-bfd2-d1f86e45e0be tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for project 493ac819082a42af8d6e3c702c510a3b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:00.344104 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08510311-dfe3-4e8f-bb97-a12a9462e19c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1307 microversion: 2.1 time: 0.378057 Oct 25 03:05:00.352268 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 531/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:04:59 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1307 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:00.354899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-392eb120-2c79-454f-bfd2-d1f86e45e0be tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for user 6a6e67c6afc74b39bb5cfac771f3e7d7 and project 493ac819082a42af8d6e3c702c510a3b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:00.359078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:00.367697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:00.390844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.391407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.391872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.392636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.393365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.402274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.433811 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-392eb120-2c79-454f-bfd2-d1f86e45e0be tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.670228 Oct 25 03:05:00.441793 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 607/1138] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:04:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:00.447620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:00.448165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:00.455303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.456235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.456902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.457927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.458598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.459129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.639405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:00.651161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:00.658159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:00.678170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66c1e192-8674-4ebb-9cc5-dce9b4e2a34b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.234906 Oct 25 03:05:00.687790 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 608/1139] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:00 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:00.789842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:00.790452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:00.803622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.805123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.806504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.808381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:00.810018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:00.811701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:00.877286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:00.899874 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba99c316-e293-4347-b289-5f41c0c93071 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.543863 Oct 25 03:05:00.914166 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 532/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:00 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:01.136881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:01.149462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a92d7977-b41a-4f41-936e-1b6c2874c2fd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.366823 Oct 25 03:05:01.151386 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 609/1141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:00 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:01.203683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e1ee2bcb-0671-4a5b-ae6e-c85dbf27bf59 req-f26ce707-6f74-4e38-a035-d96471dffcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33386002-6ff6-47ae-8aec-6ecdf27e7fd5", "name": "network-vif-plugged", "status": "completed", "tag": "3f8403a4-bf81-494a-9867-c037d5dc54a0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:01.232246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e1ee2bcb-0671-4a5b-ae6e-c85dbf27bf59 req-f26ce707-6f74-4e38-a035-d96471dffcac service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.236711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e1ee2bcb-0671-4a5b-ae6e-c85dbf27bf59 req-f26ce707-6f74-4e38-a035-d96471dffcac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.239123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e1ee2bcb-0671-4a5b-ae6e-c85dbf27bf59 req-f26ce707-6f74-4e38-a035-d96471dffcac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:01.269068 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e1ee2bcb-0671-4a5b-ae6e-c85dbf27bf59 req-f26ce707-6f74-4e38-a035-d96471dffcac service nova] Creating event network-vif-plugged:3f8403a4-bf81-494a-9867-c037d5dc54a0 for instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 on n-h2-862355-1 Oct 25 03:05:01.285149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e1ee2bcb-0671-4a5b-ae6e-c85dbf27bf59 req-f26ce707-6f74-4e38-a035-d96471dffcac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084933 Oct 25 03:05:01.287403 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 533/1142] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:01.371406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:01.375405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:01.397854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.408704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.414696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:01.415686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.420174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.424464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:01.709407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:01.710499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:01.740223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.741488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.742018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:01.742923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.743672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:01.749629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.751720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:01.755526 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a72830b-11ce-4d13-8450-0cc3047523ee tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1486 microversion: 2.1 time: 0.387691 Oct 25 03:05:01.757728 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 610/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:01 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1486 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:01.782439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6dace853-3049-41ea-9be6-6bca337b713b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:01.790694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dace853-3049-41ea-9be6-6bca337b713b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.791408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dace853-3049-41ea-9be6-6bca337b713b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.791634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dace853-3049-41ea-9be6-6bca337b713b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:01.905307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:01.922987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:01.925589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:01.943334 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a75d264-89de-4c27-a497-0994ca3a6aa5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.239255 Oct 25 03:05:01.948076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 534/1144] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:01 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:01.953735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6dace853-3049-41ea-9be6-6bca337b713b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:05:01.960443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:01.963991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:01.986220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.986975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.987641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:01.988842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:01.990793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:01.991241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:02.072554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6dace853-3049-41ea-9be6-6bca337b713b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310/action" status: 202 len: 0 microversion: 2.1 time: 0.293488 Oct 25 03:05:02.073216 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 611/1145] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:05:01 2022] POST /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:05:02.083172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:02.083782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:02.114717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:02.115454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:02.116088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:02.117160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:02.118315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:02.119031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:02.321095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:02.324005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:02.324945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:02.339050 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41ab2117-b521-491e-9074-e5bf0e3e2eb1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.388758 Oct 25 03:05:02.339545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8af5e7ff-9d7e-4831-a984-9650a979476c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.258344 Oct 25 03:05:02.340384 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 535/1146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:01 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:02.342034 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 612/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:02 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:02.357927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:02.358944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:02.368505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:02.369481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:02.370542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:02.371563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:02.372246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:02.373122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:02.706396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:02.726987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89c3857e-9548-4a7e-a938-678c7980c67e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1318 microversion: 2.1 time: 0.385433 Oct 25 03:05:02.729705 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 536/1148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:02 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:02.983639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:02.984304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:03.013906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.015178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.015629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:03.016369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.019041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.019564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:03.202935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:03.220402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:03.223299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:03.230897 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8a2b9e6b-5fe9-4f22-84da-93c5e218bd17 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.251790 Oct 25 03:05:03.233285 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 613/1149] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:02 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:03.384396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:03.385423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:03.386722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:03.389781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:03.395497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.399231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.400754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:03.403151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.404580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.407836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:03.408642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.409208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.412774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:03.413535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.414791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.417062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:03.431706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:03.750998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:03.756941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:03.764599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d5b5717-3cab-450f-8c39-fab18d8c0d95 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.386430 Oct 25 03:05:03.767997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 614/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:03 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:03.779852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:03.779852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:03.791338 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-455cc66c-9248-470a-8c9d-93c5dce9a239 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.410827 Oct 25 03:05:03.805136 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 537/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:03 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:03.806981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.807515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.808255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:03.810308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:03.811048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:03.811840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.093784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-260638831", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de479dae-f122-4afa-92d4-4fbfe6f8f2ce"}], "security_groups": [{"name": "tempest-securitygroup--240429129"}], "key_name": "tempest-keypair-1117660121", "user_data": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:04.151804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:04.164099 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0dad6d8c-3090-4109-9dc2-564707740c1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1467 microversion: 2.1 time: 0.392263 Oct 25 03:05:04.165899 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 615/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:03 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1467 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:04.272857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] validate_networks() for [('de479dae-f122-4afa-92d4-4fbfe6f8f2ce', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:05:04.593385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-579211327", "block_migration": true, "disk_over_commit": false}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:04.596435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:04.604689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.605530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:04.606260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.607489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.608170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:04.608820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.640282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lazy-loading 'flavor' on Instance uuid 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:04.657140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Going to try to live migrate instance to tempest-host-579211327 {{(pid=120562) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:05:04.667177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] HTTP exception thrown: Compute host tempest-host-579211327 could not be found. Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Request method failure captured: Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5/action HTTP/1.1 Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 106 Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1JDhhrJeChAQYpMUAMmGAjEkEfx2x4JFW4n_bYciI-BXXG3mOO2MJMcAlCB5zqRrc6qCDrbNwvVuLsZJlXKU-YbovkzxGaKLtKicaow5WDIlahxQbo6UR3nPf8i7PPlbH63xBkl7_-xYdC-Hpk8JxGV69mTvXrlPXHmIbgMyV4dTX4 Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e4e8c1a66559441bb9e138a88d28905d Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-LiveMigrationNegativeTest-400562880 Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:05:04.703536 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e4e8c1a66559441bb9e138a88d28905d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e4e8c1a66559441bb9e138a88d28905d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e4e8c1a66559441bb9e138a88d28905d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e4e8c1a66559441bb9e138a88d28905d"}]}] Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-LiveMigrationNegativeTest-400562880 Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e4e8c1a66559441bb9e138a88d28905d Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-400562880 Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-LiveMigrationNegativeTest-400562880-project-admin Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 6dab8f81419b4880b288673bd481bd55 Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-LiveMigrationNegativeTest-400562880-project-admin Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: {"os-migrateLive": {"host": "tempest-host-579211327", "block_migration": true, "disk_over_commit": false}} Oct 25 03:05:04.705221 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: exception: Compute host tempest-host-579211327 could not be found. Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '33386002-6ff6-47ae-8aec-6ecdf27e7fd5', 'body': {'os-migrateLive': {'host': 'tempest-host-579211327', 'block_migration': True, 'disk_over_commit': False}}} Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:05:04.706245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-579211327 could not be found. Oct 25 03:05:04.708445 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-579211327 could not be found. Oct 25 03:05:04.709968 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-579211327 could not be found. Oct 25 03:05:04.711452 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:04.712962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Returning 400 to user: Compute host tempest-host-579211327 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:05:04.713753 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-171072c5-fd9a-4568-bfd2-52d46f1d4e53 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5/action" status: 400 len: 99 microversion: 2.1 time: 0.528644 Oct 25 03:05:04.718351 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 616/1153] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 25 03:05:04 2022] POST /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5/action => generated 99 bytes in 534 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:05:04.725839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:04.726606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:04.761116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.761942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:04.763098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.766929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.772200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:04.772880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.904075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:04.920533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:04.924872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:04.938200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-95f75363-f2db-48e9-9152-e99801a298d1 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.218247 Oct 25 03:05:04.942477 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 617/1154] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:04 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:04.966295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:04.967023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:04.969494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:05:04.971927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:05:04.974235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:05:04.974861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:05:04.975437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:05:04.978477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.981527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:04.982292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.983124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.984724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:04.985259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.993490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.996608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:04.997254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:04.998221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:04.998846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:05.001505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:05.045718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for project 493ac819082a42af8d6e3c702c510a3b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:05.056608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for user 6a6e67c6afc74b39bb5cfac771f3e7d7 and project 493ac819082a42af8d6e3c702c510a3b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:05.081625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:05:05.084844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:05:05.192025 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1475c93c-46a2-4da2-ab4c-35d4724c1de7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.103454 Oct 25 03:05:05.193119 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 538/1155] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:05:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:05:05.203332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:05.203947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:05.221819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:05.222512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:05.223697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:05.224684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:05.225301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:05.228147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:05.526886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:05.532243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:05.540154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d926d77d-ac3c-48ec-aca1-92488d03ae67 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.345820 Oct 25 03:05:05.541126 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 539/1156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:05 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:05.552306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:05.553175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:05.560917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:05.562013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:05.562607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:05.563592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:05.563718 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97121717-a80b-4215-8f2b-ee3894664102 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1467 microversion: 2.1 time: 0.618769 Oct 25 03:05:05.564670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:05.564820 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 618/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:04 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1467 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:05.565499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:05.587641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4806752a-12b7-447a-b456-de18f868b546 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:05.588424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4806752a-12b7-447a-b456-de18f868b546 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:05.775621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:05.788614 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ccf4507c-5c99-4e5a-8d8a-722c552bc328 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.245275 Oct 25 03:05:05.802394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4806752a-12b7-447a-b456-de18f868b546 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:05.803249 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 540/1158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:05 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:05.812672 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4806752a-12b7-447a-b456-de18f868b546 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1237 microversion: 2.1 time: 0.246522 Oct 25 03:05:05.813275 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 619/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:05 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1237 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:05.845886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-485994536", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:05.958387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:05:05.977634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:05.981236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:05.990213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:05.990714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:05.991156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:05.992463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:05.996496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:05.997178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:06.104395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:06.117206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:06.120825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:06.128467 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4bd8d72-85c4-489d-8a17-263f04a9528a tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.154677 Oct 25 03:05:06.152784 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 620/1160] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:05 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:06.344795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:05:06.345782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:05:06.346420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:05:06.346993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:05:06.348891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:05:06.363874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:06.364376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:06.368174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:06.369493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:06.370423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:06.372220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:06.399618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Getting quotas for project 8d3bf3aae3394187a839240184105a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:06.405136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Getting quotas for user 461124422d1846e5b04d0d93ece24ded and project 8d3bf3aae3394187a839240184105a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:06.418592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:05:06.420784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:05:06.476086 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-308721bb-c035-4e46-96c2-bb81dfadfe20 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637224 Oct 25 03:05:06.477336 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 541/1161] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:05:06.488725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-330cb133-14dd-455e-a0df-e43c396f53f7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:06.490110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-330cb133-14dd-455e-a0df-e43c396f53f7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:06.561042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-330cb133-14dd-455e-a0df-e43c396f53f7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:06.570030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:06.572720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:06.579536 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-330cb133-14dd-455e-a0df-e43c396f53f7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1218 microversion: 2.1 time: 0.094621 Oct 25 03:05:06.580141 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 621/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:06 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:06.596093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:06.596774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:06.597428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:06.598336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:06.599089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:06.599699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:06.817200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:06.817858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:06.839441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:06.841805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:06.842301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:06.843046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:06.843514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:06.843947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:07.008121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:07.016900 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b2d7083-eb5a-4e79-8ae2-f781751084ce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.452854 Oct 25 03:05:07.026446 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 542/1163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:06 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:07.033460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:07.034205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:07.048366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:07.049702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:07.050239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:07.052250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:07.054112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:07.055747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:07.168236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:07.179887 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95ec77ad-e48e-4ee2-89e2-28aa05b8869a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1289 microversion: 2.1 time: 0.152218 Oct 25 03:05:07.183313 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 543/1164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:07 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:07.196505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:07.204682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:07.223868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:07.225141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:07.225781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:07.226681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:07.227299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:07.227887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:07.416663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:07.434156 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24fb4a64-2316-4973-87e9-8f939f9c9098 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.622890 Oct 25 03:05:07.438164 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 622/1165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:06 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:07.606799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:07.607433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:07.619700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:07.620506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:07.621106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:07.622056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:07.622667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:07.623239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:07.759640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:07.774236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:07.779247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:07.783164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-538d60ff-7cd7-458c-9343-65c3985f6491 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1214 microversion: 2.1 time: 0.180160 Oct 25 03:05:07.784380 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 623/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:07 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:07.787086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:07.810816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dfcaac00-81fc-4a49-afab-50689f0a1397 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.624775 Oct 25 03:05:07.815095 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 544/1167] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:07 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:08.052847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:08.053477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:08.064800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.070448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.071033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:08.075598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.078281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.078914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:08.211665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:08.212566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:08.240628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.241137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.241567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:08.242513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.243132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.243713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:08.434279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:08.446793 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8de09947-8380-484e-ab33-639851d54191 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1295 microversion: 2.1 time: 0.240059 Oct 25 03:05:08.464799 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 545/1168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:08 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1295 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:08.474958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:08.477703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:08.507052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.515945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.523693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:08.524782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.525482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.526619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:08.822922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:08.831706 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea59da7a-eb4e-47bb-ad52-5bd7b0172170 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.786199 Oct 25 03:05:08.832361 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 624/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:08 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:08.852826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:08.862554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:08.884631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.893647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.899118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:08.900262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:08.900842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:08.902300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:09.012520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:09.024078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6937b551-3880-4cf2-8ffa-40a223222b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.557598 Oct 25 03:05:09.025039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 546/1170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:08 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:09.035883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:09.038514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:09.053419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:09.053964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:09.054409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:09.055136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:09.055672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:09.057483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:09.125809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:09.138392 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92bf2072-2031-4693-b85b-31a05373231f tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1288 microversion: 2.1 time: 0.296668 Oct 25 03:05:09.139453 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 625/1171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:08 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1288 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:09.195414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:09.215517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:09.221930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:09.240884 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7022a87f-fd92-4fe5-9c0c-73b6fa479c8b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.210268 Oct 25 03:05:09.245949 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 547/1172] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:09 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:09.473181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:09.475016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:09.482050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:09.484633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:09.485443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:09.486180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:09.487177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:09.487843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:09.491035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:09.836912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:09.849937 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-672c7730-a4a0-44d5-9ea7-b1d535a5b946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1362 microversion: 2.1 time: 0.383150 Oct 25 03:05:09.851146 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 626/1173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:09 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:09.877821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:09.880105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:09.935822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:09.936641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:09.938069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:09.941287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:09.942720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:09.945358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.051632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:10.052256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:10.070371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.078131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.078964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.079731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.080206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.080628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.274790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:10.290121 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cef49f36-2b17-4b8c-9339-3de4479db0c8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.422075 Oct 25 03:05:10.292953 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 548/1174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:09 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:10.307224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:10.308316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:10.320784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.321575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.323454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.324538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.325325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.325963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.508366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:10.522417 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f69dee3d-72bb-4605-b1fc-4b177932153d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.475727 Oct 25 03:05:10.523042 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 627/1175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:10 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:10.538971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:10.541350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:10.556540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.557040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.557487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.558233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.558698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.559130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.677447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:10.690711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-abfbace9-dea2-4462-90fb-1e80937cd18e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1276 microversion: 2.1 time: 0.394378 Oct 25 03:05:10.692662 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 549/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:10 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1276 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:10.749038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:10.767724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:10.769203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:10.775721 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79f2a69a-39f9-4a36-b4c5-144a9d83a21c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.246235 Oct 25 03:05:10.776328 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 628/1177] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:10 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:10.875495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-fcc2c901-60bd-4b50-9840-b34a6e1610ce req-3546db63-ebca-4e53-9da7-139140545f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faa7633-59e1-4162-803d-193a945d6472", "tag": "939590e7-8279-4561-834e-1a7792cfe022"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:10.881532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:10.882192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:10.893197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.894031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.895294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.899122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.899624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.900105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.904193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fcc2c901-60bd-4b50-9840-b34a6e1610ce req-3546db63-ebca-4e53-9da7-139140545f37 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:10.904683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fcc2c901-60bd-4b50-9840-b34a6e1610ce req-3546db63-ebca-4e53-9da7-139140545f37 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:10.906016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fcc2c901-60bd-4b50-9840-b34a6e1610ce req-3546db63-ebca-4e53-9da7-139140545f37 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:10.935333 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-fcc2c901-60bd-4b50-9840-b34a6e1610ce req-3546db63-ebca-4e53-9da7-139140545f37 service nova] Creating event network-changed:939590e7-8279-4561-834e-1a7792cfe022 for instance 6faa7633-59e1-4162-803d-193a945d6472 on n-h1-862355-1 Oct 25 03:05:10.947153 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-fcc2c901-60bd-4b50-9840-b34a6e1610ce req-3546db63-ebca-4e53-9da7-139140545f37 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076072 Oct 25 03:05:10.952615 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 550/1178] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:11.321223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:11.322399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:11.334265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:11.336075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:11.336795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:11.337851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:11.338588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:11.339228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:11.516090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:11.543489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-26a69457-fe81-4075-a790-a2db586e2fe9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1362 microversion: 2.1 time: 0.663014 Oct 25 03:05:11.565177 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 629/1179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:10 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1362 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:11.581554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:11.585818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:11.611794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:11.614425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:11.615424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:11.616367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:11.621059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:11.621862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:11.768504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:11.800913 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35afb511-edcd-4b53-8b57-b470201465c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.481549 Oct 25 03:05:11.816941 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 551/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:11 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:11.827861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:11.830536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:11.847947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:11.851596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:11.852173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:11.853048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:11.855715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:11.856278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.183860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:12.209698 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b96e69d0-2a00-4be2-ac99-78bd832a94ab tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.404772 Oct 25 03:05:12.221929 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 552/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:11 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:12.242813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:12.246025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:12.262812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.263311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.264196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.265651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.266513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.272859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.408647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:12.419672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:12.423626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:12.438030 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93d3cb23-f5e8-495a-990f-9cee76e343a6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.217638 Oct 25 03:05:12.439019 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 553/1182] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:12 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:12.446415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:12.447485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:12.460242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.460839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.461290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.462061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.462527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.463134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.606070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:12.633089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-69196f58-6e75-46ec-ba3e-3a6130db3757 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 1.065736 Oct 25 03:05:12.634736 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 630/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:11 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:12.642354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:12.649376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:12.650115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:12.657993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.658758 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6a1baa43-f971-43af-976e-0d63313570ad tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 2423 microversion: 2.25 time: 0.218350 Oct 25 03:05:12.659659 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 554/1184] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:12 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 2423 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:12.659798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.661630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.662582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.663298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.664039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.667612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:12.688093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862355-1", "block_migration": "auto"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:12.694909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:12.701390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:12.703250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.703955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.704549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.705611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:12.706294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:12.706986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:12.729765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:12.739842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'flavor' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:12.757665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Going to try to live migrate instance to n-h1-862355-1 {{(pid=120563) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:05:13.023528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:13.037432 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-313138fb-c3df-4c26-92d7-c45867e0f2f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1362 microversion: 2.1 time: 0.398335 Oct 25 03:05:13.040771 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 631/1185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:12 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:13.052728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:13.063593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:13.068692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Searching by: {'deleted': False, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:05:13.085557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:13.086252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:13.086981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:13.088217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:13.089017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:13.089754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:13.516780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:05:13.623268 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc7c3487-9d33-4df1-a1ff-3613418c5e4b tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.581225 Oct 25 03:05:13.623924 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 632/1186] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:05:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:13.630744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:13.631514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:13.640910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:13.641558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:13.642128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:13.643068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:13.643850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:13.644499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:13.849939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:13.860265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf72a95c-02ab-4d78-9c11-e0cff816b506 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.235124 Oct 25 03:05:13.860858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 633/1187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:13 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:13.867194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:13.868234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:13.882341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:13.882890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:13.884033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:13.884808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:13.885278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:13.885952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:14.196594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:14.209925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66a2f3c0-4587-45fe-9636-33164ab1d045 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.346971 Oct 25 03:05:14.211734 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 634/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:13 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:14.221512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:14.223357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:14.230057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:14.230699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:14.231146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:14.231852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:14.232303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:14.232725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:14.381560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:14.392400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:14.394065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:14.406548 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21df8f13-0e6d-4f80-ba79-cbcff3560039 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.189888 Oct 25 03:05:14.408952 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 635/1189] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:14 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:14.499027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8104d86-40d0-4edd-90b3-d751f575e54a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Action: 'create', calling method: .version_select at 0x7efd33610310>, body: {"keypair": {"name": "tempest-keypair-425588197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRZzC6rZEgSaVDmcC3MxrlgeEJu97AxsUrbPKaTnFvAYbIBmoOdyISgBanTNXBEIAwAIH5nK1J+SNbL5k9vaFDtfWkaFdvFFC48qhRxSw95s2CkyiVQ/54TdyZWRL1BZw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:14.521092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e8104d86-40d0-4edd-90b3-d751f575e54a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Getting quotas for project 3aaf5660aeb9490eb3667e3f17c3b369. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:14.528321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e8104d86-40d0-4edd-90b3-d751f575e54a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Getting quotas for user d409dbcd29454c9291a6fb6c5db01575 and project 3aaf5660aeb9490eb3667e3f17c3b369. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:14.558375 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8104d86-40d0-4edd-90b3-d751f575e54a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149004 Oct 25 03:05:14.559104 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 636/1190] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:05:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:14.564436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:14.574032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:14.575474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Searching by: {'deleted': False, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:05:14.589036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:14.590739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:14.591746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:14.593053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:14.593813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:14.594763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:14.635607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:05:14.689841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:14.699763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:14.700521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:14.701008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.054966 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92ee39b7-04b0-4b6b-ac35-9465ddb4ada0 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.494206 Oct 25 03:05:15.055598 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 637/1191] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:05:14 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:15.081573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.082835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:15.090104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.090888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.091504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.092678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.093323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.094012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.245595 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6fd38fd7-e21c-4349-b773-4e0aa504b694 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/action" status: 202 len: 0 microversion: 2.25 time: 2.562844 Oct 25 03:05:15.246443 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 555/1192] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:05:12 2022] POST /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/action => generated 0 bytes in 2565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:05:15.252694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.254367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:15.273488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.274232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.274883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.276218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.277102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.277806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.432048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.449703 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-25707d07-008c-407a-88b8-6c9de4d1e4b4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.372099 Oct 25 03:05:15.451682 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 638/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:15 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:15.453411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.458952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-63b0a6e9-b61d-4737-acd3-dda4793af072 req-ff8db000-08ec-4780-93b2-7f97e3faddec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0e27dc-9774-483b-9574-f3a78c80d828", "tag": "08b5aa40-3702-4265-bc11-8671bbdba48d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:15.464428 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-561a8b43-4b34-4954-9475-80e183f27a92 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1362 microversion: 2.1 time: 0.215590 Oct 25 03:05:15.473752 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 556/1194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:15 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:15.473752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.474076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:15.480242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.480843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.481633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.483648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.484248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.484968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.489219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-63b0a6e9-b61d-4737-acd3-dda4793af072 req-ff8db000-08ec-4780-93b2-7f97e3faddec service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.489768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-63b0a6e9-b61d-4737-acd3-dda4793af072 req-ff8db000-08ec-4780-93b2-7f97e3faddec service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.490213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-63b0a6e9-b61d-4737-acd3-dda4793af072 req-ff8db000-08ec-4780-93b2-7f97e3faddec service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.502519 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-63b0a6e9-b61d-4737-acd3-dda4793af072 req-ff8db000-08ec-4780-93b2-7f97e3faddec service nova] Creating event network-changed:08b5aa40-3702-4265-bc11-8671bbdba48d for instance db0e27dc-9774-483b-9574-f3a78c80d828 on n-h2-862355-1 Oct 25 03:05:15.508772 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-63b0a6e9-b61d-4737-acd3-dda4793af072 req-ff8db000-08ec-4780-93b2-7f97e3faddec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055449 Oct 25 03:05:15.509387 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 639/1195] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:15.514546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-679c5723-7cc8-4a22-86d4-42b3ddbd94f3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.523118 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-679c5723-7cc8-4a22-86d4-42b3ddbd94f3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012487 Oct 25 03:05:15.523971 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 640/1196] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:05:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:15.538983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.540168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:15.551386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.552376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.552986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.553910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.554538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.555156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.638376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.647282 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3578e161-b730-4fc5-8ae0-1dc3576a5a66 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.178863 Oct 25 03:05:15.660608 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 557/1197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:15 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:15.666000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.666813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:15.674246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.675018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.675812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.676882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.677539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.678072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.792903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.809421 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-26d2c5a4-9943-4a55-87bb-a1568860ae1e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.276056 Oct 25 03:05:15.810376 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 641/1198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:15 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:15.817783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.819137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:15.827635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.828392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.829015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.830351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.830981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.831578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.899766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.910853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.913753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.915169 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd91fa0a-2252-4ba1-9462-82e40eceb225 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.254704 Oct 25 03:05:15.915895 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 558/1199] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:15 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:15.920576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:15.921276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:15.924079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.935990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.938237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:15.939197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.939849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.940505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.941839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:15.943707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:15.944337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:15.958154 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b16d42ce-a755-4e57-84f3-0665bb2ea0aa tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.143913 Oct 25 03:05:15.959023 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 642/1200] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:15 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:15.983504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:05:16.091626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1a140adc-a218-4d74-b49b-0a723b3cb1f4 req-4f42426d-1b1d-4ba9-b23d-4d087f5f53ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faa7633-59e1-4162-803d-193a945d6472", "name": "network-vif-plugged", "status": "completed", "tag": "939590e7-8279-4561-834e-1a7792cfe022"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:16.128266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a140adc-a218-4d74-b49b-0a723b3cb1f4 req-4f42426d-1b1d-4ba9-b23d-4d087f5f53ac service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.129525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a140adc-a218-4d74-b49b-0a723b3cb1f4 req-4f42426d-1b1d-4ba9-b23d-4d087f5f53ac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.131419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a140adc-a218-4d74-b49b-0a723b3cb1f4 req-4f42426d-1b1d-4ba9-b23d-4d087f5f53ac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.134741 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-afa101f7-7b7b-4cfd-b625-4d07af7772b4 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 204 len: 0 microversion: 2.1 time: 0.215620 Oct 25 03:05:16.135504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 559/1201] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:05:15 2022] DELETE /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:05:16.150795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:16.151144 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1a140adc-a218-4d74-b49b-0a723b3cb1f4 req-4f42426d-1b1d-4ba9-b23d-4d087f5f53ac service nova] Creating event network-vif-plugged:939590e7-8279-4561-834e-1a7792cfe022 for instance 6faa7633-59e1-4162-803d-193a945d6472 on n-h1-862355-1 Oct 25 03:05:16.154076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:16.160493 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1a140adc-a218-4d74-b49b-0a723b3cb1f4 req-4f42426d-1b1d-4ba9-b23d-4d087f5f53ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075475 Oct 25 03:05:16.161824 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 643/1202] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:05:16.166560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.170497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.171155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.172889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.173563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.175747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.357947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:16.373626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f28efdc6-040e-46bd-90e3-f2e921f84644 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1606 microversion: 2.1 time: 0.229040 Oct 25 03:05:16.374738 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 560/1203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:16 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1606 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:16.476794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:16.477524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:16.487251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.487251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.487251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.487251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.487800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.487800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.492310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:16.492920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:16.496656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:16.497761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:16.502518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.503456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.503970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.504946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.505585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.506224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.656512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:16.666986 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e21b25c3-7320-467f-8fa7-2405837fdf19 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.196015 Oct 25 03:05:16.667792 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 644/1204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:16 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:16.667938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:16.675238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1471189091", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "371b1d63-926f-445d-bc7f-42ba779410ad"}], "security_groups": [{"name": "tempest-securitygroup--500007299"}], "key_name": "tempest-keypair-425588197", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:16.680398 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1265c14f-e861-4b17-9d53-7dc1aae5d662 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1362 microversion: 2.1 time: 0.191693 Oct 25 03:05:16.691509 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 561/1205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:16 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:16.691509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:16.691509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:16.695006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.695689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.696223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.697539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.698491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.699016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.820183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] validate_networks() for [('371b1d63-926f-445d-bc7f-42ba779410ad', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:05:16.859195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:16.871032 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e22f0211-8b7a-4920-af40-2e7101a177a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.188352 Oct 25 03:05:16.886577 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 562/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:16 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:16.893831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:16.895473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:16.902440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.903267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.903930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:16.904727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:16.905390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:16.906073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.088759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.097471 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-913d6efd-8fb5-4347-bd70-afa4850abe5d tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.209490 Oct 25 03:05:17.099976 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 563/1207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:16 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:17.104781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:17.105408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:17.111977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.112442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.112883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.114191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.114657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.115083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.279602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.290738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.292368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Getting quotas for project 3aaf5660aeb9490eb3667e3f17c3b369. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:17.292500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.293754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fafbcb92-497b-4410-9984-3888192f7f86 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.193903 Oct 25 03:05:17.297900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Getting quotas for user d409dbcd29454c9291a6fb6c5db01575 and project 3aaf5660aeb9490eb3667e3f17c3b369. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:17.305226 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 564/1208] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:17 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:17.311721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:17.312499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:17.312743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:05:17.313215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:05:17.313955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:05:17.314370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:05:17.314783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:05:17.320496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.321191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.321887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.322591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.323296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.323716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.324409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.324880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.325489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.326558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.327026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.327490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.346603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Getting quotas for project 3aaf5660aeb9490eb3667e3f17c3b369. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:17.352231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Getting quotas for user d409dbcd29454c9291a6fb6c5db01575 and project 3aaf5660aeb9490eb3667e3f17c3b369. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:17.366146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:05:17.368576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:05:17.395807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.405154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.406632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.411680 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a329aeae-f2e6-4781-bc94-0472a06057fb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.105235 Oct 25 03:05:17.425054 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 565/1209] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:17 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:17.425054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:17.425054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:17.425054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.425481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.425481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.425481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.425481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.426384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.429202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0c2ecb9b-f6aa-4bbd-a7ad-e68a472eb62c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760035 Oct 25 03:05:17.436439 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 645/1210] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:05:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:05:17.443152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4bd21595-702f-4e60-9a88-85f00bed3112 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:17.443799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4bd21595-702f-4e60-9a88-85f00bed3112 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:17.524471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4bd21595-702f-4e60-9a88-85f00bed3112 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.532429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4bd21595-702f-4e60-9a88-85f00bed3112 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1269 microversion: 2.1 time: 0.094852 Oct 25 03:05:17.533494 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 646/1211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:17 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:17.583701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.597046 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48a303a8-6f2a-4f09-95a3-847bfec442a3 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1606 microversion: 2.1 time: 0.183375 Oct 25 03:05:17.598593 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 566/1212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:17 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1606 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:17.694235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:17.695482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:17.704262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.705140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:17.705485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.705812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:17.706436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.708686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.709382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.710202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.717803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.722793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.723346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.724155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.725505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.726374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.892523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.905039 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5eb67409-02c5-4e5a-a3d8-3827f43957a7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1362 microversion: 2.1 time: 0.205625 Oct 25 03:05:17.906071 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 567/1213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:17 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:17.911290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:17.912812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:17.919172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.920463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.921603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.922800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:17.924939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:17.926174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:17.949086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:17.954819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:17.972935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8190068c-851e-40fb-ace5-7875e79afad1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.285439 Oct 25 03:05:17.974482 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 647/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:17 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:18.127869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:18.128782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:18.138517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.146212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.147232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.148276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.149087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.150308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.198343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.209446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b8584e9-8398-4a0f-8292-f236dd907045 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.301701 Oct 25 03:05:18.210455 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 568/1215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:17 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:18.295621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.304013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ea6b202-1658-4bba-be68-81e6f1987131 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.182432 Oct 25 03:05:18.304596 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 648/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:18 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:18.325081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:18.325362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:18.331787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.332324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.332805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.333502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.333991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.334420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.440589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:18.441472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:18.447661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.448477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.448991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.449813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.450275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.450706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.515124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.523534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.524978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.529862 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44d9392b-1be3-405b-a187-f8b74520081b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.093261 Oct 25 03:05:18.530439 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 649/1217] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:18 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:18.557120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:18.558065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:18.565016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.565810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.566480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.567378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.568004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.568597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.652317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.667355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.672790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.674135 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43f52be2-c8bf-4ff9-b43b-76af1522ce3a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.353814 Oct 25 03:05:18.685744 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 569/1218] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:18 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:18.685744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:18.685744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:18.688315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.688947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.689393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.690138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.690593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.691019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.716359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:18.725561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cec09423-6880-49bb-a782-4499601a1419 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1265 microversion: 2.1 time: 0.172633 Oct 25 03:05:18.730241 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 650/1219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:18 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:18.930248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:18.931243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:18.941398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.944852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.945496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:18.947622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:18.948699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:18.950306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.104987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:19.114296 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d7df1ea3-424f-4ae9-a29e-ad8959f0c29c tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1606 microversion: 2.1 time: 0.437607 Oct 25 03:05:19.115554 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 570/1220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:18 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1606 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:19.120479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:19.121150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:19.129577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.130300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.130581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.131298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.131768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.132199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.169521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:19.172590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:19.183900 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17b9c5ac-aca8-4f86-8b89-57da04c65143 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1548 microversion: 2.1 time: 0.259049 Oct 25 03:05:19.186266 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 651/1221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:18 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1548 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:19.211583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:19.212082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:19.218006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.218708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.218909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.219878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.220336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.220763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.299295 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12ad1765-b7de-4a40-acb3-f36a598e18cc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093583 Oct 25 03:05:19.299900 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 652/1222] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:05:19 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:05:19.306368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:19.306988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:19.308861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:19.315295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.315649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.317617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.317617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.318085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.318571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.436441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:19.447101 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f362414-d56c-42a6-8b59-e2404d133708 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.330066 Oct 25 03:05:19.447725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 571/1223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:19 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:19.457463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:19.458600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:19.466716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.467586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.468243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.469227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.470071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.470722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.716058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:19.725169 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73208cf6-fd14-4fae-abfa-f1060be4167c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.418973 Oct 25 03:05:19.726201 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 653/1224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:19 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:19.747860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:19.748836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:19.756356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.757018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.757638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:19.758624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:19.759246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:19.760350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.190874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.201431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.203155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.208904 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0bf0b174-c637-4135-bb9d-6e9acbbb0ef3 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.466149 Oct 25 03:05:20.209633 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 654/1225] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:19 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:20.215176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:20.216155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:20.224206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.224962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.226345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.227311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.227996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.228641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.388874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.406181 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a30ee4c2-f496-42e4-9b7d-56a58fa69f06 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.953183 Oct 25 03:05:20.407521 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 572/1226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:19 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:20.413600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:20.414383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:20.430365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.435395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.436190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.437213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.437922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.443028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.534231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.547406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.548921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.550275 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea58d733-79c4-471f-9ffe-21a283b5499d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.338855 Oct 25 03:05:20.551563 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 655/1227] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:20 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:20.575977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:20.578085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:20.599835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.605207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.606127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.609882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.612913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.613975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.688703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.703699 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ffdb93be-5e66-459a-9b16-94143983a8ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1329 microversion: 2.1 time: 0.294757 Oct 25 03:05:20.706369 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 573/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:20 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1329 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:20.713464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:20.714353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:20.734925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:20.745231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-74cdd736-4a56-4580-b59c-6a139892e07f tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1251 microversion: 2.1 time: 0.192387 Oct 25 03:05:20.751076 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 656/1229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:20 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1251 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:20.758695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-45069ed1-6fba-428d-aced-01f544fa0276 req-ab1bb764-1eac-4c6f-bbf7-30a5182f0e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a34089b-d23c-457c-bcdc-ccf220f6f099", "name": "network-vif-deleted", "tag": "32be58c6-6e9b-46be-afd4-f6e81b24be78"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:20.762700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.764623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.765172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.768508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.772933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.773471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.789860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-45069ed1-6fba-428d-aced-01f544fa0276 req-ab1bb764-1eac-4c6f-bbf7-30a5182f0e78 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.790627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-45069ed1-6fba-428d-aced-01f544fa0276 req-ab1bb764-1eac-4c6f-bbf7-30a5182f0e78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.792472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-45069ed1-6fba-428d-aced-01f544fa0276 req-ab1bb764-1eac-4c6f-bbf7-30a5182f0e78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.818945 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-45069ed1-6fba-428d-aced-01f544fa0276 req-ab1bb764-1eac-4c6f-bbf7-30a5182f0e78 service nova] Creating event network-vif-deleted:32be58c6-6e9b-46be-afd4-f6e81b24be78 for instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 on n-h1-862355-1 Oct 25 03:05:20.833023 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-45069ed1-6fba-428d-aced-01f544fa0276 req-ab1bb764-1eac-4c6f-bbf7-30a5182f0e78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079611 Oct 25 03:05:20.835818 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 657/1230] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:20.850707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:20.851835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:20.866380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.868487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.869379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:20.871743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:20.874254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:20.874711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.215419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.230563 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6c7350a-c237-43fc-a82b-579e596d08ca tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.389741 Oct 25 03:05:21.233147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 658/1231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:20 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:21.251627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:21.254607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:21.272806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.276028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.278683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.279877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.281814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.282344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.369999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.384194 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c96ff09-808c-406b-9e54-162473ee6116 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.674375 Oct 25 03:05:21.386785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.398198 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 574/1232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:20 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:21.414676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.417403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.432921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:21.433820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:21.443063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4317678-4fca-4ce7-8996-57d563647b0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.203493 Oct 25 03:05:21.444967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.445384 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 659/1233] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:21 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:21.446093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.446718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.447620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.448481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.449200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.579981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:21.580702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:21.593286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.593822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.594270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.595053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.595514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.595950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.919427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.929785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.931141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:21.932358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b00ce775-e811-4513-93be-7000c04390aa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.356304 Oct 25 03:05:21.933144 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 660/1234] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:21 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:21.952371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:21.953386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:21.963655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.964289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.964887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:21.966536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:21.967189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:21.967711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.053400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:22.064490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08878119-bdf6-4acc-acb3-024df4bb30fe tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1327 microversion: 2.1 time: 0.123336 Oct 25 03:05:22.065300 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 661/1235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:21 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:22.071378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:22.072007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:22.079231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.080101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.080556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.081345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.081923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.082966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.146974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:22.162418 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb14959d-72df-46cc-a256-c475cf94b3cd tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.733757 Oct 25 03:05:22.163356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 575/1236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:21 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:22.175221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a64f4d3e-8f28-43d4-bed8-448c88190b67 req-38c58c26-cef8-4c7e-9259-a7122b92a949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faa7633-59e1-4162-803d-193a945d6472", "tag": "939590e7-8279-4561-834e-1a7792cfe022"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:22.190662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a64f4d3e-8f28-43d4-bed8-448c88190b67 req-38c58c26-cef8-4c7e-9259-a7122b92a949 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.191142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a64f4d3e-8f28-43d4-bed8-448c88190b67 req-38c58c26-cef8-4c7e-9259-a7122b92a949 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.192137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a64f4d3e-8f28-43d4-bed8-448c88190b67 req-38c58c26-cef8-4c7e-9259-a7122b92a949 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.206244 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a64f4d3e-8f28-43d4-bed8-448c88190b67 req-38c58c26-cef8-4c7e-9259-a7122b92a949 service nova] Creating event network-changed:939590e7-8279-4561-834e-1a7792cfe022 for instance 6faa7633-59e1-4162-803d-193a945d6472 on n-h1-862355-1 Oct 25 03:05:22.210106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:22.219415 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e11b67c-3994-49b9-8afd-a4c77056f174 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1251 microversion: 2.1 time: 0.152987 Oct 25 03:05:22.220155 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a64f4d3e-8f28-43d4-bed8-448c88190b67 req-38c58c26-cef8-4c7e-9259-a7122b92a949 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054864 Oct 25 03:05:22.228840 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 662/1237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:22 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1251 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:22.230800 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 576/1238] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:22.261584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:22.262805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:22.272835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.273480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.274876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.275740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.276300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.276811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.414471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:22.415351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:22.433109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.434014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.435405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.439085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.439573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.442153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.502257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:22.514476 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-04cba9d9-2e32-4257-97fe-77866ca7be4c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.255901 Oct 25 03:05:22.532739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 663/1239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:22 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:22.558399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:22.559197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:22.577261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.577261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.577584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.578365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.578843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.579290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.708662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:22.725320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:22.738010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:22.745395 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7125414b-0b51-415f-8104-e2fd2ac72dd5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.211468 Oct 25 03:05:22.746400 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 664/1240] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:22 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:22.898999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ff73a5a4-4291-4080-bc17-f669c175053d req-962f2b7d-1cdd-41c8-a80e-80db5cc4d761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b07198c-8cd6-4c96-a6eb-b19cd147f6a6", "name": "network-vif-unplugged", "status": "completed", "tag": "fd266ab4-1299-454f-9ad2-48aea8b010d0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:22.921524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ff73a5a4-4291-4080-bc17-f669c175053d req-962f2b7d-1cdd-41c8-a80e-80db5cc4d761 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:22.922314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ff73a5a4-4291-4080-bc17-f669c175053d req-962f2b7d-1cdd-41c8-a80e-80db5cc4d761 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:22.926246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ff73a5a4-4291-4080-bc17-f669c175053d req-962f2b7d-1cdd-41c8-a80e-80db5cc4d761 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:22.956322 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ff73a5a4-4291-4080-bc17-f669c175053d req-962f2b7d-1cdd-41c8-a80e-80db5cc4d761 service nova] Creating event network-vif-unplugged:fd266ab4-1299-454f-9ad2-48aea8b010d0 for instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 on n-h1-862355-1 Oct 25 03:05:22.969845 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ff73a5a4-4291-4080-bc17-f669c175053d req-962f2b7d-1cdd-41c8-a80e-80db5cc4d761 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076094 Oct 25 03:05:22.970739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 665/1241] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:05:22.984859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:22.990612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:23.006895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.007649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.010314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.011283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.011909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.017034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.059187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.073274 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4c8f5891-993e-4d35-8319-13449aaf2068 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.665133 Oct 25 03:05:23.074343 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 577/1242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:22 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:23.091754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:23.097433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:23.108709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.109502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.113001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.114525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.121326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.122088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.286986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.302008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.303556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.311197 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9116765c-330d-46f7-b17c-ec61d3ee1563 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.337127 Oct 25 03:05:23.311943 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 666/1243] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:22 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:23.344081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:23.344719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:23.353332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.353876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.354378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.355112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.355629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.356064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.433768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.447896 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1bd0d16b-b33b-4e32-825c-95306cb177ac tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1327 microversion: 2.1 time: 0.359845 Oct 25 03:05:23.462837 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 578/1244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:23 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1327 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:23.495323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:23.496583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:23.510721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.511770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.512487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.513467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.514298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.515038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.582097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.592918 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2818896f-2935-4656-b6b8-88808decbe45 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.265829 Oct 25 03:05:23.594379 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 667/1245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:23 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:23.599928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:23.600551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:23.612720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.612969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.614186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.617414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.617955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.618564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.870771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.898841 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50809ee2-98c5-4e2f-9f8c-5e132691a489 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.302044 Oct 25 03:05:23.899459 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 668/1246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:23 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:23.920520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:23.922133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:23.938198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:23.942469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.942890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.947525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.948620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:23.949106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:23.949546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:23.955591 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b44ae3bc-5d9d-4b30-88bf-adbed08c5340 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1251 microversion: 2.1 time: 0.490367 Oct 25 03:05:23.965707 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 579/1247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:23 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1251 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:23.975299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a157b9fb-d13c-493f-9002-9f452993a7ff req-650873a2-352a-423b-ba03-dcea48492343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0e27dc-9774-483b-9574-f3a78c80d828", "name": "network-vif-plugged", "status": "completed", "tag": "08b5aa40-3702-4265-bc11-8671bbdba48d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:24.027318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a157b9fb-d13c-493f-9002-9f452993a7ff req-650873a2-352a-423b-ba03-dcea48492343 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.027799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a157b9fb-d13c-493f-9002-9f452993a7ff req-650873a2-352a-423b-ba03-dcea48492343 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.028240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a157b9fb-d13c-493f-9002-9f452993a7ff req-650873a2-352a-423b-ba03-dcea48492343 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.058730 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a157b9fb-d13c-493f-9002-9f452993a7ff req-650873a2-352a-423b-ba03-dcea48492343 service nova] Creating event network-vif-plugged:08b5aa40-3702-4265-bc11-8671bbdba48d for instance db0e27dc-9774-483b-9574-f3a78c80d828 on n-h2-862355-1 Oct 25 03:05:24.068397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a157b9fb-d13c-493f-9002-9f452993a7ff req-650873a2-352a-423b-ba03-dcea48492343 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101041 Oct 25 03:05:24.074053 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 580/1248] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:24.099888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:24.100600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:24.114676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.114996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.115601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.116203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.117100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.117744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.118326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.128639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.160947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.193987 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fc512cce-a561-4e87-960e-2056089f63cc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.292871 Oct 25 03:05:24.194669 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 669/1249] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:23 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:24.342128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:24.342780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:24.349559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.350091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.350538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.351249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.351714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.352152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.356749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:24.554146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.564239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.565716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.568710 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c6cde18-d1ac-4941-8f37-b7eb85385491 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.229593 Oct 25 03:05:24.582591 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 670/1250] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:24 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:24.592461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.592973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:24.593375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:24.599949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.600433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.601058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.601955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.602565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.603146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.607573 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-78ee9c12-7c9f-4eae-bccf-05ba6b630001 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.511951 Oct 25 03:05:24.608250 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 581/1251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:24 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:24.620215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:24.621157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:24.629315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.630878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.631709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.632768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.633380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.634052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.786080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:24.794413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ea774de-9a99-45d7-a992-cd411811ed22 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.210476 Oct 25 03:05:24.795007 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 671/1252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:24 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:24.922787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:24.923431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:24.930880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.931475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.932011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:24.932808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:24.933336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:24.933882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.080896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.089474 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db9124b7-7194-4f0f-8e25-87364fcd2cb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.170854 Oct 25 03:05:25.090356 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 672/1253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:24 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:25.110621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:25.111237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:25.117702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.118853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.118853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.119456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.119884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.120313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.190547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.202015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81783800-3fb7-4603-b8d9-67b72e06f3e5 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1251 microversion: 2.1 time: 0.094987 Oct 25 03:05:25.217464 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 673/1254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:25 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1251 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:25.217464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-fb596f45-9c45-4e29-9d94-96e275d61d8b req-7af64e9a-8f11-4e7d-86de-565cb6d82bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b07198c-8cd6-4c96-a6eb-b19cd147f6a6", "tag": "fd266ab4-1299-454f-9ad2-48aea8b010d0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:25.220846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fb596f45-9c45-4e29-9d94-96e275d61d8b req-7af64e9a-8f11-4e7d-86de-565cb6d82bdd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.221334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fb596f45-9c45-4e29-9d94-96e275d61d8b req-7af64e9a-8f11-4e7d-86de-565cb6d82bdd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.222098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fb596f45-9c45-4e29-9d94-96e275d61d8b req-7af64e9a-8f11-4e7d-86de-565cb6d82bdd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.237704 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-fb596f45-9c45-4e29-9d94-96e275d61d8b req-7af64e9a-8f11-4e7d-86de-565cb6d82bdd service nova] Creating event network-changed:fd266ab4-1299-454f-9ad2-48aea8b010d0 for instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 on n-h1-862355-1 Oct 25 03:05:25.243873 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-fb596f45-9c45-4e29-9d94-96e275d61d8b req-7af64e9a-8f11-4e7d-86de-565cb6d82bdd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038430 Oct 25 03:05:25.244532 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 674/1255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:25.250776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:25.252285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:25.259845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.260361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.260811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.261532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.262029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.262467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.337109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.346318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.347953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.355309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.355763 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a753ad98-10f4-4b0e-b5ee-328e23b4306b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.109964 Oct 25 03:05:25.356483 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 675/1256] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:25 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:25.369593 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac114d21-e0bc-4789-9c0b-52a40940dece tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.753038 Oct 25 03:05:25.370847 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 582/1257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:24 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:25.599025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:25.599649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:25.606298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.606490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.606786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.607500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.607960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.608387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.632488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:25.633875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:25.640789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.641599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.642297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.643236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.643916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.645183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.759491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.768409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.770031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.771539 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cde0105a-1394-4020-9d31-54f24fa23690 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.177038 Oct 25 03:05:25.776188 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 676/1258] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:25 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:25.818945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:25.819592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:25.826018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.826511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.826943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.827758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:25.828215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:25.828638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:25.987582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:25.990014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.002811 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5860da5c-4ccd-4f53-a4d0-d1999c9ae20c tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.184994 Oct 25 03:05:26.009127 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad4c799b-2e2e-4e2d-9f1a-c71fc7b2d229 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.380576 Oct 25 03:05:26.009753 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 583/1259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:25 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:26.014788 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 677/1260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:25 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:26.114016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:26.115091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:26.121321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.121841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.122275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.122975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.123428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.123845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.226226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:26.227245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:26.234125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.234850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.235466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.236423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.237749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.238609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.277191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.288728 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91e5fc9b-aee9-4d03-83ad-2d88599c0bfa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.178966 Oct 25 03:05:26.289537 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 678/1261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:26 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:26.345927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.354761 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f4cce74-681d-45f5-bf61-76cd00ba84bc tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1251 microversion: 2.1 time: 0.132971 Oct 25 03:05:26.355644 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 584/1262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:26 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1251 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:26.387751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:26.388346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:26.397173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:26.398195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:26.405147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.405639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.406095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.406977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.407426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.408029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.414688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.415887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.416619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.417744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.418572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.419168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.536850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.550360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.554013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.564896 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e672741-f42c-4e15-a097-e325f310f155 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.180369 Oct 25 03:05:26.579510 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 679/1263] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:26 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:26.734402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.743619 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-741e3a53-591f-4be2-8d54-fb50c655b3c7 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1318 microversion: 2.1 time: 0.351192 Oct 25 03:05:26.758676 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 585/1264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:26 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:26.799088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:26.799989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:26.808752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.809252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.809714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.810437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:26.810873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:26.811315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:26.966142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.975057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.976503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:26.977705 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-487f5fb6-7873-43b2-bebc-2d24422cf999 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.182500 Oct 25 03:05:26.978281 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 680/1265] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:26 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:27.030886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:27.032076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:27.042335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:27.042957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:27.047305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.047797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.048238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.048976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.049433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.049888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.058711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.059205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.059645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.060349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.060805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.061231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.081856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:27.211641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.226127 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4de7b6b2-7d5e-415f-b677-c8ac6a830a79 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.187374 Oct 25 03:05:27.241306 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 681/1266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:27 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:27.288034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-27fe3575-89bb-4a99-8dae-7fa08003b796 req-961e4089-2efd-442d-b8c9-31d1e82933f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a3c693e-9810-4626-a56a-79c3426c7db2", "tag": "e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:27.299719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27fe3575-89bb-4a99-8dae-7fa08003b796 req-961e4089-2efd-442d-b8c9-31d1e82933f4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.300630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27fe3575-89bb-4a99-8dae-7fa08003b796 req-961e4089-2efd-442d-b8c9-31d1e82933f4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.301060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27fe3575-89bb-4a99-8dae-7fa08003b796 req-961e4089-2efd-442d-b8c9-31d1e82933f4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.319115 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-27fe3575-89bb-4a99-8dae-7fa08003b796 req-961e4089-2efd-442d-b8c9-31d1e82933f4 service nova] Creating event network-changed:e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4 for instance 9a3c693e-9810-4626-a56a-79c3426c7db2 on n-h1-862355-1 Oct 25 03:05:27.324713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-27fe3575-89bb-4a99-8dae-7fa08003b796 req-961e4089-2efd-442d-b8c9-31d1e82933f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042268 Oct 25 03:05:27.325007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.325533 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 682/1267] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:05:27.331111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:27.332175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:27.334056 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c14215f-8395-4a6f-a39b-af37dbf6c2de tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.309187 Oct 25 03:05:27.334760 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 586/1268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:27 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:27.343225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:27.348885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.349380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.349851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.350736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.351190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.351617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.378666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:27.379803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:27.386350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.386847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.387284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.387996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.388668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.389097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.423611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.424106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.424669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.424970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lazy-loading 'fault' on Instance uuid 8a34089b-d23c-457c-bcdc-ccf220f6f099 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:27.470849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.479707 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5938ccff-e6ec-4970-8272-27ea3fc3fb47 tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1256 microversion: 2.1 time: 0.105170 Oct 25 03:05:27.480835 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 587/1269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:27 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1256 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:27.497132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.506394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57a3065b-0e2e-4e14-b41e-49a1a754f2e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.179826 Oct 25 03:05:27.507265 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 683/1270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:27 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:27.594826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:27.594931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:27.601545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.602083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.602518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.603221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.603684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.604089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.673303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.683045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.684507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.689361 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8aeeed92-fe13-43a8-9875-5e98a2cfdfde tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.098873 Oct 25 03:05:27.689901 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 588/1271] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:27 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:27.768503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:27.769259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:27.771938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=26 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:27.777473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.778071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.778508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.779202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.779652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.780081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.920228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:27.928830 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32a25088-0c80-4701-8493-388bca6f4870 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1467 microversion: 2.1 time: 0.164227 Oct 25 03:05:27.929472 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 684/1272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:27 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1467 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:27.951990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:27.952744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:27.959437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.959986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.960429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.961153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:27.961612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:27.962057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:27.985493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lazy-loading 'flavor' on Instance uuid db0e27dc-9774-483b-9574-f3a78c80d828 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:28.010772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:28.011775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:28.024481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.025292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.025457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.027955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.028447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.029003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.085845 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13f51a26-ad1f-4c9b-96b0-553078584d31 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828/action" status: 202 len: 0 microversion: 2.1 time: 0.137696 Oct 25 03:05:28.087678 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 589/1273] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:05:27 2022] POST /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:05:28.097486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:28.098483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:28.107926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.108810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.110608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.111435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.111954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.112475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.190650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.203526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.205294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.206557 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d8bb23d-6a25-4f21-872e-4756ad0593cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.206463 Oct 25 03:05:28.208145 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 685/1274] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:27 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:28.251657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:28.252331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:28.259512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.259886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.260331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.261386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.261490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.261967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.271939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.282354 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b2fb903-3b8c-4dde-a30d-3847e09242b6 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1475 microversion: 2.1 time: 0.190307 Oct 25 03:05:28.283149 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 590/1275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:28 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:28.358437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:28.359052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:28.367064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.368658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.369102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.369849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.370308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.370731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.446693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.456880 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8611cbec-5368-409b-98a3-e61ffce72e0a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.209108 Oct 25 03:05:28.469739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 686/1276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:28 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:28.504491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:28.505295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:28.513211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.513211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.513579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.514289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.514745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.515178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.549792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.550279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.551265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.552125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lazy-loading 'fault' on Instance uuid 8a34089b-d23c-457c-bcdc-ccf220f6f099 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:28.598456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e6d4ed5c63e4f98b72f26a0404d496e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e7ec3d31bd45fcb2c568a0e02cf399', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.600788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:28.606109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.608903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b2fad53-b11b-49cc-b462-ba646debf3af tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 200 len: 1256 microversion: 2.1 time: 0.109366 Oct 25 03:05:28.609844 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 687/1277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:28 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 1256 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:28.615060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:28.615680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:28.621526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.622067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.622509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.623207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.623667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.624098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.631951 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52179af6-9337-4960-8a99-cfd9afb2beca tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.277833 Oct 25 03:05:28.639081 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 591/1278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:28 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:28.718108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:28.718725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:28.726117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.726533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.726974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.727677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:28.728137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:28.728565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:28.763181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.772332 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-012a9b6d-dab7-44c3-85d6-99ff1911d1f8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.161444 Oct 25 03:05:28.773118 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 688/1279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:28 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:28.809490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.818869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.820598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:28.829718 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e04770b-7c88-4f58-9842-0e53f743d005 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.115041 Oct 25 03:05:28.833813 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 592/1280] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:28 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:29.234277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.234928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.242648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.243215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.243659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.244361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.244896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.245421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.307568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.308868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.318461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.319338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.324224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.325226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.328206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.328870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.411163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:29.421070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:29.421988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:29.423433 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b876455-b380-4f87-bd8a-4fc6d901d883 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.193336 Oct 25 03:05:29.429732 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 689/1281] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:29.483259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.483920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.489990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:29.496691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.497194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.497638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.498171 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec4f232a-1640-45e2-93a8-3ca68c4924b2 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1458 microversion: 2.1 time: 0.194610 Oct 25 03:05:29.498374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.498764 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 593/1282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1458 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:29.499181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.499801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.522526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.523390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.529616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.530144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.530730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.531442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.531971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.532420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.643235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:29.655178 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a82db3f1-b4be-4af2-88d4-602dc01c2fa4 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.176316 Oct 25 03:05:29.656631 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 690/1283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:29.661398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.662047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] [instance: 8a34089b-d23c-457c-bcdc-ccf220f6f099] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.668080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.668571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.669011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.669721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.670349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.670936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.685610 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] HTTP exception thrown: Instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 could not be found. Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Request method failure captured: Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 HTTP/1.1 Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1H2q9IVPcUrPXzv9zT08NHtApVXcmcQwh88u1gQo3JlgoRdU25knJEujR0gqODlWTs0aPnlxVZjCbVN1P5LKc0S9oktbH7iY3hdGoLNpIm_-pyOxVbu0IpZudN7xukJ9biKV7nG5P1-Ex-IqMUr2gvrUI3YfnhtCV2T8J3JGiQxhv8 Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 38e7ec3d31bd45fcb2c568a0e02cf399 Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestBootFromVolume-646251157 Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:05:29.687424 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38e7ec3d31bd45fcb2c568a0e02cf399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38e7ec3d31bd45fcb2c568a0e02cf399"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38e7ec3d31bd45fcb2c568a0e02cf399", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38e7ec3d31bd45fcb2c568a0e02cf399"}]}] Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestBootFromVolume-646251157 Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 38e7ec3d31bd45fcb2c568a0e02cf399 Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestBootFromVolume-646251157 Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestBootFromVolume-646251157-project Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3e6d4ed5c63e4f98b72f26a0404d496e Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestBootFromVolume-646251157-project Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 could not be found. Oct 25 03:05:29.688835 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8a34089b-d23c-457c-bcdc-ccf220f6f099'} Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 could not be found. Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:05:29.689638 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 could not be found. Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 could not be found. Oct 25 03:05:29.692207 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:29.695964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Returning 404 to user: Instance 8a34089b-d23c-457c-bcdc-ccf220f6f099 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:05:29.695964 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-355ce72a-3d04-4231-a861-f01e3ce45f9e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099" status: 404 len: 111 microversion: 2.1 time: 0.031124 Oct 25 03:05:29.695964 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 691/1284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/8a34089b-d23c-457c-bcdc-ccf220f6f099 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:05:29.697220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.697974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.704915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.705446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.706288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.706657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.707917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.708486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.790738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a981463f-c051-43aa-aec8-2b025834740f tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1609 microversion: 2.1 time: 0.272725 Oct 25 03:05:29.791659 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 594/1285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1609 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:29.796265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87913c92-01d5-4117-8b3b-d6d6d7872f7e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] Calling method '.version_select at 0x7efd333ced30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.820022 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87913c92-01d5-4117-8b3b-d6d6d7872f7e tempest-ServersTestBootFromVolume-646251157 tempest-ServersTestBootFromVolume-646251157-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554582342" status: 202 len: 0 microversion: 2.1 time: 0.027003 Oct 25 03:05:29.822654 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 595/1286] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554582342 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:05:29.834021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.836920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.844849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:29.850867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.851485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.852048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.853261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.854425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.855159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.883401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:29.898783 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e65045e6-2782-4a75-b552-cc04840bf4e5 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.208302 Oct 25 03:05:29.899829 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 692/1287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:29.907050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.913722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.918881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.919459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.920751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.921294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.921851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.954199 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4bf6af07-9355-4334-9a7e-336272b8e563 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052884 Oct 25 03:05:29.955369 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 693/1288] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:29.962569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:29.963206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:29.970448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.971215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.971710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:29.972709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:29.973952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:29.974915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.080031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.093416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.095192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.101301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:30.104255 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fbc3cac-a02c-4596-98e0-5939e3a4dd25 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.147637 Oct 25 03:05:30.115546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.126613 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47041021-2d23-4d30-b9b9-46edeee1d4db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.302929 Oct 25 03:05:30.127859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 596/1289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:30.134530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862355-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:30.138282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:30.139593 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 694/1290] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:29 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:30.148071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.149017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.149554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.161496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.162425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.164724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.213251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Lazy-loading 'flavor' on Instance uuid db0e27dc-9774-483b-9574-f3a78c80d828 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:30.236306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance db0e27dc-9774-483b-9574-f3a78c80d828 while it is in vm_state suspended Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Request method failure captured: Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828/action HTTP/1.1 Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 97 Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1JDhhrJeChAQYpMUAMmGAjEkEfx2x4JFW4n_bYciI-BXXG3mOO2MJMcAlCB5zqRrc6qCDrbNwvVuLsZJlXKU-YbovkzxGaKLtKicaow5WDIlahxQbo6UR3nPf8i7PPlbH63xBkl7_-xYdC-Hpk8JxGV69mTvXrlPXHmIbgMyV4dTX4 Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e4e8c1a66559441bb9e138a88d28905d Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-LiveMigrationNegativeTest-400562880 Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:05:30.238520 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e4e8c1a66559441bb9e138a88d28905d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e4e8c1a66559441bb9e138a88d28905d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e4e8c1a66559441bb9e138a88d28905d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e4e8c1a66559441bb9e138a88d28905d"}]}] Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-LiveMigrationNegativeTest-400562880 Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e4e8c1a66559441bb9e138a88d28905d Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-400562880 Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-LiveMigrationNegativeTest-400562880-project-admin Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 6dab8f81419b4880b288673bd481bd55 Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-LiveMigrationNegativeTest-400562880-project-admin Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: {"os-migrateLive": {"host": "n-h1-862355-1", "block_migration": true, "disk_over_commit": false}} Oct 25 03:05:30.240030 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: exception: Cannot 'os-migrateLive' instance db0e27dc-9774-483b-9574-f3a78c80d828 while it is in vm_state suspended Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'db0e27dc-9774-483b-9574-f3a78c80d828', 'body': {'os-migrateLive': {'host': 'n-h1-862355-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 25 03:05:30.240922 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db0e27dc-9774-483b-9574-f3a78c80d828 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:05:30.243120 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance db0e27dc-9774-483b-9574-f3a78c80d828 while it is in vm_state suspended Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance db0e27dc-9774-483b-9574-f3a78c80d828 while it is in vm_state suspended Oct 25 03:05:30.245834 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:30.248774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance db0e27dc-9774-483b-9574-f3a78c80d828 while it is in vm_state suspended {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:05:30.248774 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a65dbceb-251e-45d1-b6b6-60b1afeafbd6 tempest-LiveMigrationNegativeTest-400562880 tempest-LiveMigrationNegativeTest-400562880-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828/action" status: 409 len: 155 microversion: 2.1 time: 0.119161 Oct 25 03:05:30.250873 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 597/1291] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:05:30 2022] POST /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828/action => generated 155 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:05:30.263063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:30.263580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:30.272696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.273211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.273661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.274409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.274873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.275304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.306255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:05:30.405771 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-550ed58e-e7e7-4d15-9c16-2a5cba11ae11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 204 len: 0 microversion: 2.1 time: 0.145890 Oct 25 03:05:30.407212 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 695/1292] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:05:30 2022] DELETE /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:05:30.416920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:30.418525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:30.429058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.430985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.431697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.435110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.436919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.437937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.453134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:30.454443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:30.477785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.480218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.481436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.483522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.484272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.487596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.703504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.716734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.718489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.719967 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-990616c9-1349-4d1b-baad-93586867f937 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.273280 Oct 25 03:05:30.721074 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 696/1293] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:30 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:30.727639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:30.728546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:30.734712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.752949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8b9af66-c408-40d8-a145-071a44e64d4e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1464 microversion: 2.1 time: 0.340169 Oct 25 03:05:30.754788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.756903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.757915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.758410 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 598/1294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:30 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:30.759239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.759977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.760512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.924021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:30.924620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:30.937573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:30.937852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.938210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.938927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.939872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:30.940552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:30.941430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:30.949978 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-929b0e53-5d67-4153-8c2d-3ba9628ad157 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.226660 Oct 25 03:05:30.965711 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 697/1295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:30 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:31.142741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:31.143779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:31.152267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.153126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.153864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.154854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.155554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.156210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.193362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:31.202442 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a093ff93-d661-454f-a62c-2ee9b493b07f tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.283691 Oct 25 03:05:31.204622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 599/1296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:30 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:31.209599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:31.210518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:31.216988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.217823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.218592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.219598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.220276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.220922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.254611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:31.263441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:31.267880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:31.277285 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16963593-fbbe-4fe9-b165-5e1a9e1ebebc tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.139207 Oct 25 03:05:31.290003 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 698/1297] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:31 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:31.486184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:31.495411 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-049076f1-95c2-40de-bc72-a3a5ab16bb32 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.289562 Oct 25 03:05:31.496201 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 600/1298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:31 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:31.748865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:31.749446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:31.760366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.761273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.761860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.762863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.763421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.763984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.780255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:31.780969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:31.792394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.792990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.796019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.796855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:31.797424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:31.798043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:31.980554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:31.997273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.006733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.011236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1773183f-7216-4d69-98ca-cce93c708382 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.265583 Oct 25 03:05:32.013272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 699/1299] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:31 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:32.022709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:32.023502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:32.030626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.031678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.032228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.033031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.033586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.034173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.251301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.264300 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-208f8602-8121-4dc3-988c-261a2193b570 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.249330 Oct 25 03:05:32.270024 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 700/1300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:32 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:32.272157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-57127370-7dcd-40a4-80df-6eaa3819cc9f req-adb4621d-9f15-47fe-98f3-7fe76056c848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3c693e-9810-4626-a56a-79c3426c7db2", "name": "network-vif-plugged", "status": "completed", "tag": "e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:32.283158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.304550 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d008cbfa-0013-4479-80df-36739755086a tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1464 microversion: 2.1 time: 0.527994 Oct 25 03:05:32.305160 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 601/1301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:31 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1464 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:32.326886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-57127370-7dcd-40a4-80df-6eaa3819cc9f req-adb4621d-9f15-47fe-98f3-7fe76056c848 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.327389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-57127370-7dcd-40a4-80df-6eaa3819cc9f req-adb4621d-9f15-47fe-98f3-7fe76056c848 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.327835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-57127370-7dcd-40a4-80df-6eaa3819cc9f req-adb4621d-9f15-47fe-98f3-7fe76056c848 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.338626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:32.339274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:32.345644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.346169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.346614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.347340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.354694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.355291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.360852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-57127370-7dcd-40a4-80df-6eaa3819cc9f req-adb4621d-9f15-47fe-98f3-7fe76056c848 service nova] Creating event network-vif-plugged:e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4 for instance 9a3c693e-9810-4626-a56a-79c3426c7db2 on n-h1-862355-1 Oct 25 03:05:32.366736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:32.369639 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-57127370-7dcd-40a4-80df-6eaa3819cc9f req-adb4621d-9f15-47fe-98f3-7fe76056c848 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102489 Oct 25 03:05:32.370557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 701/1302] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:32.376073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:32.376828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:32.395732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.397011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.398499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.400345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.401728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.403322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.512084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.523226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.524949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.531139 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81245ac3-d7ae-45c0-ae70-9e1c883d7aec tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.159355 Oct 25 03:05:32.531771 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 702/1303] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:32 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:32.546821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:32.548049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:32.555387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.555913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.556351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.557072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:32.557527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:32.557981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:32.728195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:32.741554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0dff145e-78ae-4bb1-91ee-1f9e14566585 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1496 microversion: 2.1 time: 0.208584 Oct 25 03:05:32.742728 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 703/1304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:32 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1496 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:33.046625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:33.047984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:33.057293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.058112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.058990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.059713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.060337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.060762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.062596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.072222 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f91ff79-34d8-4821-a3fb-0b3334cad107 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.753034 Oct 25 03:05:33.072823 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 602/1305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:32 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:33.208024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.210310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:33.219774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.221531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.224190 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45665106-c2f4-452a-803c-c18b7ba5dc77 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.180624 Oct 25 03:05:33.225040 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 704/1306] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:33 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:33.291849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:33.292628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:33.306050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.306814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.307246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.308187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.308673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.309105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.334489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:33.335658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:33.342989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.343696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.344358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.345241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.345900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.346497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.532898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.542094 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f94da644-b17a-4829-9534-b934332a83ae tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1464 microversion: 2.1 time: 0.213376 Oct 25 03:05:33.542597 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 705/1307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:33 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1464 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:33.568645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:33.569608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:33.576665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.578370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.579037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.580490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.581110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.581716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.615892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.632326 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f3e67c27-b74c-4cc4-9bf9-12aeaae28aca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.341847 Oct 25 03:05:33.634805 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 603/1308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:33 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:33.696395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.705202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.708531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:33.715332 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-de519b2d-c58f-4af8-b37e-484382fc0b2c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.155503 Oct 25 03:05:33.716452 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 706/1309] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:33 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:33.766101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:33.767000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:33.774023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.774520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.774958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:33.776068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:33.776736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:33.777385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.058148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b50fb7af-e7e8-4682-9588-5c0278f9d264 req-a66a1cbb-4ee1-4d0a-8039-49c7c7af9d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0e27dc-9774-483b-9574-f3a78c80d828", "name": "network-vif-deleted", "tag": "08b5aa40-3702-4265-bc11-8671bbdba48d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:34.075131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b50fb7af-e7e8-4682-9588-5c0278f9d264 req-a66a1cbb-4ee1-4d0a-8039-49c7c7af9d6d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.075912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b50fb7af-e7e8-4682-9588-5c0278f9d264 req-a66a1cbb-4ee1-4d0a-8039-49c7c7af9d6d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.076336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b50fb7af-e7e8-4682-9588-5c0278f9d264 req-a66a1cbb-4ee1-4d0a-8039-49c7c7af9d6d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.095244 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b50fb7af-e7e8-4682-9588-5c0278f9d264 req-a66a1cbb-4ee1-4d0a-8039-49c7c7af9d6d service nova] Creating event network-vif-deleted:08b5aa40-3702-4265-bc11-8671bbdba48d for instance db0e27dc-9774-483b-9574-f3a78c80d828 on n-h2-862355-1 Oct 25 03:05:34.104001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:34.112662 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea836e2a-c40d-439f-b319-78387d36020e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 200 len: 1473 microversion: 2.1 time: 0.350817 Oct 25 03:05:34.114959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b50fb7af-e7e8-4682-9588-5c0278f9d264 req-a66a1cbb-4ee1-4d0a-8039-49c7c7af9d6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065977 Oct 25 03:05:34.116504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 604/1310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:33 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:34.118610 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 707/1311] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:34.122672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:34.125135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:34.132212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.134127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.138008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.138778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.139890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.140359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.143570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1185947514"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:34.147691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:34.154457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.155263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.156072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.157768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.158821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.159883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.425644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:34.436443 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa1b5f8e-dea8-49f5-b161-b8d8eae1f417 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1394 microversion: 2.1 time: 0.318324 Oct 25 03:05:34.437854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 605/1312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:34 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1394 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:34.444002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:34.445723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:34.454038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.454902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.455643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.456739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.457990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.458638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.745762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:34.755839 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7513c6b0-8ac8-4a36-8cf0-f3547feaf01f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310/action" status: 202 len: 0 microversion: 2.1 time: 0.616842 Oct 25 03:05:34.756935 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 708/1313] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:05:34 2022] POST /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:05:34.759472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:34.761671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:34.762313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:34.763111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:34.763711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b03cb7a-d14b-4a95-953e-c7988068fe5f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.324398 Oct 25 03:05:34.764482 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 606/1314] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:34 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:34.771234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:34.772076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:34.781828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.782163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.782403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.782843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.782997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.783552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.783675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.784008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.784549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.785076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.787102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.787792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.825512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.826295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.826496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.826919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lazy-loading 'fault' on Instance uuid db0e27dc-9774-483b-9574-f3a78c80d828 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:34.884736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:34.893220 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65fdc783-6711-4ed3-98df-fb8e2c785aea tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 200 len: 1308 microversion: 2.1 time: 0.134894 Oct 25 03:05:34.897786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 709/1315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:34 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 1308 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:34.904424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:34.907835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:34.921040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.921542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.922012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:34.922724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:34.927373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:34.933362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.104917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:35.130086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:35.132735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:35.139794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ab00873-3802-4686-9158-ccbafa2b8e95 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1560 microversion: 2.91 time: 0.243937 Oct 25 03:05:35.140928 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 710/1316] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:34 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1560 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:35.150064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-23064a19-a367-4cc9-be67-dad12e62f79d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3376a4c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:35.169007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:35.177847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a82b2607-8489-49f4-8c89-3dc35ba04f6f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.411967 Oct 25 03:05:35.178670 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 607/1317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:34 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:35.229544 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-23064a19-a367-4cc9-be67-dad12e62f79d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.085585 Oct 25 03:05:35.230329 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 711/1318] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:35 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:35.466516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:35.467134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:35.480055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.480433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.480871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.481793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.482673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.483356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.656578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:35.665811 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f40679c-7302-4e82-9f57-092149cd872a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1575 microversion: 2.1 time: 0.203486 Oct 25 03:05:35.666907 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 608/1319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:35 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:35.694724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:35.695308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:35.702268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.702756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.703194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.703897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.704351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.704772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.793813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:35.795153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:35.803334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.804195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.804940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.805958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.806671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.807369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.843814 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c20fe8ff-c168-4d72-ad7c-9082e44b549a tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153053 Oct 25 03:05:35.844424 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 712/1320] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:05:35 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:05:35.920196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:35.920845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: db0e27dc-9774-483b-9574-f3a78c80d828] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:35.936115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.936654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.943928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.944917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:35.945629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:35.946351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:35.975957 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] HTTP exception thrown: Instance db0e27dc-9774-483b-9574-f3a78c80d828 could not be found. Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Request method failure captured: Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 HTTP/1.1 Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1JBQBPmIMFN3bXdegGMktk7aZ1fz0BA4ijRSERHuhhCJyZipalfRK40rKpo8l0rGmMX-oyqb-SmTKGiDocomxhglpA07oObS7DdWZmF6np0snK_TkuP0HzrDfacWu5-pc0NC93No-UD5rB3Xz9MGVF7YGzVp0p_YNEPAPAEX9zmJ_c Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8d3bf3aae3394187a839240184105a32 Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-LiveMigrationNegativeTest-255364982 Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:05:35.977664 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d3bf3aae3394187a839240184105a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d3bf3aae3394187a839240184105a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d3bf3aae3394187a839240184105a32", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d3bf3aae3394187a839240184105a32"}]}] Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-LiveMigrationNegativeTest-255364982 Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8d3bf3aae3394187a839240184105a32 Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-255364982 Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-LiveMigrationNegativeTest-255364982-project Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 461124422d1846e5b04d0d93ece24ded Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-LiveMigrationNegativeTest-255364982-project Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance db0e27dc-9774-483b-9574-f3a78c80d828 could not be found. Oct 25 03:05:35.979381 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'db0e27dc-9774-483b-9574-f3a78c80d828'} Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0e27dc-9774-483b-9574-f3a78c80d828 could not be found. Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:05:35.980315 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0e27dc-9774-483b-9574-f3a78c80d828 could not be found. Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0e27dc-9774-483b-9574-f3a78c80d828 could not be found. Oct 25 03:05:35.981818 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:05:35.983915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Returning 404 to user: Instance db0e27dc-9774-483b-9574-f3a78c80d828 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:05:35.984950 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b534070-7524-497f-b3ff-428080409d28 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828" status: 404 len: 111 microversion: 2.1 time: 0.068756 Oct 25 03:05:35.994264 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 713/1321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:35 2022] GET /compute/v2.1/servers/db0e27dc-9774-483b-9574-f3a78c80d828 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:05:36.007863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:36.008371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:36.018874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.019381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.020002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.020719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.026394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.028424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.076167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:05:36.119102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:36.138520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:36.143669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:36.146492 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ff32968-521d-458a-807d-d3b126769df9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.356665 Oct 25 03:05:36.156368 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 609/1322] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:35 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:36.172149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:36.172853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:36.187079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.187938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.188595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.189498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.190566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.192378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.242212 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-483ba44e-40c9-46b2-9ce4-adfde5c304cb tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "DELETE /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 204 len: 0 microversion: 2.1 time: 0.238749 Oct 25 03:05:36.245821 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 714/1323] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:05:35 2022] DELETE /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:05:36.255718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:36.259356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:36.290055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.291799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.296337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.297410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.299618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.300252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.394051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:36.411543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:36.416691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:36.435552 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a0795fc-654f-43fb-9cb8-168f9077f173 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.268702 Oct 25 03:05:36.441057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 610/1324] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:36 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:36.446863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3c6c506-dd07-4ae3-bbcb-edaeb1cd1b6e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33363820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:36.541369 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3c6c506-dd07-4ae3-bbcb-edaeb1cd1b6e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.096571 Oct 25 03:05:36.541369 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 611/1325] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:36 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:36.554748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:36.555678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:36.569146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.569653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.572705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.572705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:36.572705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:36.572705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:36.885572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:36.923248 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e152422c-acb4-4801-808a-2750b3c3df66 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1473 microversion: 2.1 time: 0.382498 Oct 25 03:05:36.923778 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 612/1326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:36 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1473 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:37.052895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:37.063462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-345611fc-f827-4395-8f48-1fcab60e3988 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.816026 Oct 25 03:05:37.064065 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 715/1327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:36 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:37.177968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:37.179174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:37.190864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:37.201980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:37.202588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:37.205662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:37.206260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:37.206702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:37.474567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:37.475180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:37.501202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:37.505196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:37.507902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:37.508854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:37.510253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:37.511804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:37.524287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:37.537073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:37.542777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:37.544004 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a0b8663-169e-49d8-abf8-e90c9821d733 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.370736 Oct 25 03:05:37.544574 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 613/1328] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:37 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:37.558155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08602b26-a6ca-4458-b88f-4a27e6a57b2f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd333cef70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:37.648015 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08602b26-a6ca-4458-b88f-4a27e6a57b2f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.090571 Oct 25 03:05:37.656385 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 614/1329] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:37 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:37.707566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:37.720619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:37.724332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:37.737148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-000c8414-8aae-4991-9b98-91ba8190069d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.267504 Oct 25 03:05:37.741739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 716/1330] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:37 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:37.953350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:37.955168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:37.973597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:37.975748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:37.976455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:37.977440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:37.978348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:37.979339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.089026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:38.090062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:38.099363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:38.104403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:38.105137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.106172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:38.110471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:38.111160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.379754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:38.394329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d763f401-4d2e-475a-b46b-19c26dbcba11 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1473 microversion: 2.1 time: 0.446098 Oct 25 03:05:38.398860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 615/1331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:37 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:38.464760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:38.465619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:38.474683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:38.479749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:38.480462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.481647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:38.482632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:38.483283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.632154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:38.649078 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c473a216-96c4-43eb-9243-6d6428e12341 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.561007 Oct 25 03:05:38.650421 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 717/1332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:38 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:38.672047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dad78704-87c2-433b-afc7-041fa1dea419 req-35f0bd27-1f8e-4e5e-9666-c1654db239dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a3c693e-9810-4626-a56a-79c3426c7db2", "tag": "e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:38.694727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dad78704-87c2-433b-afc7-041fa1dea419 req-35f0bd27-1f8e-4e5e-9666-c1654db239dd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:38.702169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dad78704-87c2-433b-afc7-041fa1dea419 req-35f0bd27-1f8e-4e5e-9666-c1654db239dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:38.703288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dad78704-87c2-433b-afc7-041fa1dea419 req-35f0bd27-1f8e-4e5e-9666-c1654db239dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.739397 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dad78704-87c2-433b-afc7-041fa1dea419 req-35f0bd27-1f8e-4e5e-9666-c1654db239dd service nova] Creating event network-changed:e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4 for instance 9a3c693e-9810-4626-a56a-79c3426c7db2 on n-h1-862355-1 Oct 25 03:05:38.750905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dad78704-87c2-433b-afc7-041fa1dea419 req-35f0bd27-1f8e-4e5e-9666-c1654db239dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098856 Oct 25 03:05:38.752276 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 718/1333] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:38.776372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:38.782390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:38.810859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:38.811593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:38.812367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.814342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:38.818711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:38.819429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:38.916006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:38.938711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47ac63bd-30b4-42f0-8edc-72868a60e5ff tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1575 microversion: 2.1 time: 0.478382 Oct 25 03:05:38.943248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 616/1334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:38 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1575 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:38.950669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6e6d295-b0a7-414e-a164-834ae0f81653 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3334caf0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:39.037421 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6e6d295-b0a7-414e-a164-834ae0f81653 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.092753 Oct 25 03:05:39.046194 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 617/1335] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:38 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:39.052194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:39.053136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:39.059680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:39.060395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:39.061023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:39.062528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:39.063274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:39.063876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:39.281991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:39.293129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:39.300220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:39.313268 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7760e04-fea5-4433-8f75-da412f1990c2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.265741 Oct 25 03:05:39.334216 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 618/1336] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:39 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:39.344553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:39.362763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:39.376289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:39.378019 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f24a2f1-c1a2-4c31-a6b7-010ac0c319e3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.621032 Oct 25 03:05:39.394371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 719/1337] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:38 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:39.422899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:39.426531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:39.442384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:39.446013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:39.451010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:39.451175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2fe9325c-43db-48d3-8d97-92cc778025c5 req-6a47f531-3a2d-4a40-b84f-dfd952ecf80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5638e8a-6990-4068-bc45-bd2bbe313310", "name": "network-vif-plugged", "status": "completed", "tag": "4c9569cd-ff29-48df-8f89-9b9df51c2d75"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:39.452112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:39.455091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:39.455716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:39.478057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2fe9325c-43db-48d3-8d97-92cc778025c5 req-6a47f531-3a2d-4a40-b84f-dfd952ecf80d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:39.481054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2fe9325c-43db-48d3-8d97-92cc778025c5 req-6a47f531-3a2d-4a40-b84f-dfd952ecf80d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:39.483096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2fe9325c-43db-48d3-8d97-92cc778025c5 req-6a47f531-3a2d-4a40-b84f-dfd952ecf80d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:39.553294 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2fe9325c-43db-48d3-8d97-92cc778025c5 req-6a47f531-3a2d-4a40-b84f-dfd952ecf80d service nova] Creating event network-vif-plugged:4c9569cd-ff29-48df-8f89-9b9df51c2d75 for instance f5638e8a-6990-4068-bc45-bd2bbe313310 on n-h2-862355-1 Oct 25 03:05:39.566036 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2fe9325c-43db-48d3-8d97-92cc778025c5 req-6a47f531-3a2d-4a40-b84f-dfd952ecf80d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122125 Oct 25 03:05:39.569081 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 720/1338] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:05:39.680230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:39.681097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:39.693350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:39.696103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:39.699020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:39.699903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:39.701250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:39.702257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:39.934083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:40.023309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:40.041270 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e063f73a-2481-4802-a38a-2fdd84adc79c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.365963 Oct 25 03:05:40.056882 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 721/1339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:39 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:40.072245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fce0fbfb-ada0-4215-ac62-051b15b683fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33ee7d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:40.186975 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fce0fbfb-ada0-4215-ac62-051b15b683fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.120893 Oct 25 03:05:40.191335 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 722/1340] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:40 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:40.352870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:40.353624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:40.370212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:40.370724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:40.371166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:40.372268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:40.372402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:40.372760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:40.387170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:40.492144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:40.506567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:40.516100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:40.531646 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-daa6425e-4660-45f6-b879-b6f15a3f8cc6 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.184202 Oct 25 03:05:40.546430 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 723/1341] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:40 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:40.557718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0e8a4800-5efc-4a03-b06f-78aea51adde0 req-de0781d4-55aa-4f39-8bf1-d7f69615d8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6dbd798-ea90-476c-91fc-c466e0b7bd7a", "name": "network-vif-unplugged", "status": "completed", "tag": "65ec2208-6a10-4f7c-be38-2e1cb525e222"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:40.576670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0e8a4800-5efc-4a03-b06f-78aea51adde0 req-de0781d4-55aa-4f39-8bf1-d7f69615d8c0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:40.577472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0e8a4800-5efc-4a03-b06f-78aea51adde0 req-de0781d4-55aa-4f39-8bf1-d7f69615d8c0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:40.578091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0e8a4800-5efc-4a03-b06f-78aea51adde0 req-de0781d4-55aa-4f39-8bf1-d7f69615d8c0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:40.595854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0e8a4800-5efc-4a03-b06f-78aea51adde0 req-de0781d4-55aa-4f39-8bf1-d7f69615d8c0 service nova] Creating event network-vif-unplugged:65ec2208-6a10-4f7c-be38-2e1cb525e222 for instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a on n-h2-862355-1 Oct 25 03:05:40.603883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0e8a4800-5efc-4a03-b06f-78aea51adde0 req-de0781d4-55aa-4f39-8bf1-d7f69615d8c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055315 Oct 25 03:05:40.605029 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 724/1342] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:40.612320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:40.613262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:40.623220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:40.624448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:40.625244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:40.628081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:40.628750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:40.629387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:40.793651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:40.805953 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0043d780-5214-4f63-9c2e-43519938be5e tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1473 microversion: 2.1 time: 1.386426 Oct 25 03:05:40.819869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 619/1343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:39 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1473 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:40.997476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:41.020453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:41.040114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:41.041476 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c49cbeac-33ca-4ffe-9e10-05b4be05d1ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.433566 Oct 25 03:05:41.062362 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 725/1344] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:40 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:41.073265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:41.074362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:41.094728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:41.096005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:41.096789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:41.101047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:41.102208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:41.103236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:41.209754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cea29dd3-bc99-438c-976a-2a8e385b076a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33ff1ca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:41.306681 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cea29dd3-bc99-438c-976a-2a8e385b076a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.102349 Oct 25 03:05:41.308542 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 726/1345] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:41 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:41.576925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:41.578968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:41.592393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:41.599723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:41.600665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:41.607705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:41.608590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:41.609342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:41.742859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:41.757320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:41.760196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:41.768438 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a2aedd5f-0f58-4f69-b23d-b9fedfcaff19 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.195716 Oct 25 03:05:41.770732 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 727/1346] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:41 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:41.779796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c65ad67d-e48f-42c4-b356-8a5359c8428a req-1a9689ba-82b1-4655-a350-87400579079f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33386002-6ff6-47ae-8aec-6ecdf27e7fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "3f8403a4-bf81-494a-9867-c037d5dc54a0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:41.800632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c65ad67d-e48f-42c4-b356-8a5359c8428a req-1a9689ba-82b1-4655-a350-87400579079f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:41.801724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c65ad67d-e48f-42c4-b356-8a5359c8428a req-1a9689ba-82b1-4655-a350-87400579079f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:41.803118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c65ad67d-e48f-42c4-b356-8a5359c8428a req-1a9689ba-82b1-4655-a350-87400579079f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:41.834771 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c65ad67d-e48f-42c4-b356-8a5359c8428a req-1a9689ba-82b1-4655-a350-87400579079f service nova] Creating event network-vif-unplugged:3f8403a4-bf81-494a-9867-c037d5dc54a0 for instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 on n-h2-862355-1 Oct 25 03:05:41.846206 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c65ad67d-e48f-42c4-b356-8a5359c8428a req-1a9689ba-82b1-4655-a350-87400579079f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072717 Oct 25 03:05:41.847146 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 728/1347] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:41.856352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:41.857380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:41.868835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:41.869392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:41.869880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:41.871991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:41.872526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:41.873031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:41.990683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:42.007496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-618dc030-518c-47a5-98f1-8682c6b990be tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1431 microversion: 2.1 time: 0.156355 Oct 25 03:05:42.017730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 729/1348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:41 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1431 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:42.076499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:42.077069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:42.099378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:42.099912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:42.100329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:42.104442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:42.104633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:42.105104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:42.212307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:42.226679 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc7529bb-b044-4ffd-b7cf-30c6a03f52e1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 1.158066 Oct 25 03:05:42.229332 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 620/1349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:41 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:42.325469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2efa6908-9614-416f-a12c-3da70ae2b5a9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33368670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:42.405748 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2efa6908-9614-416f-a12c-3da70ae2b5a9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.084106 Oct 25 03:05:42.410109 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 621/1350] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:42 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:42.740376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7129dde3-3484-48e1-b058-47daf09d8ab4 req-159f2642-116a-47c4-89fa-5a0fed954801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33386002-6ff6-47ae-8aec-6ecdf27e7fd5", "name": "network-vif-deleted", "tag": "3f8403a4-bf81-494a-9867-c037d5dc54a0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:42.761760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7129dde3-3484-48e1-b058-47daf09d8ab4 req-159f2642-116a-47c4-89fa-5a0fed954801 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:42.762772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7129dde3-3484-48e1-b058-47daf09d8ab4 req-159f2642-116a-47c4-89fa-5a0fed954801 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:42.763206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7129dde3-3484-48e1-b058-47daf09d8ab4 req-159f2642-116a-47c4-89fa-5a0fed954801 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:42.788220 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7129dde3-3484-48e1-b058-47daf09d8ab4 req-159f2642-116a-47c4-89fa-5a0fed954801 service nova] Creating event network-vif-deleted:3f8403a4-bf81-494a-9867-c037d5dc54a0 for instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 on n-h2-862355-1 Oct 25 03:05:42.799918 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7129dde3-3484-48e1-b058-47daf09d8ab4 req-159f2642-116a-47c4-89fa-5a0fed954801 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063585 Oct 25 03:05:42.802187 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 622/1351] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:42.815919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:42.822616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:42.836516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:42.838805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:42.842215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:42.843164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:42.843793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:42.844375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:42.922212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:42.955332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:42.971692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:42.977837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:42.980451 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a01efde-f5bd-4b42-91ea-63f898a5e507 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.908926 Oct 25 03:05:42.983578 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 730/1352] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:42 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:43.030088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:43.044638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:43.045416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:43.045982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:43.049049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:43.059681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:43.060183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:43.060626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:43.061344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:43.061830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:43.062261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:43.062511 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aece5477-d63b-4e81-aea9-e576d26993a2 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.257135 Oct 25 03:05:43.089903 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 623/1353] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:42 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:43.183537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:43.184600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:43.188312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:43.193415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lazy-loading 'fault' on Instance uuid 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:43.259206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:43.262420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:43.284866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:43.290568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:43.291262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:43.295215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:43.297338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:43.299337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:43.546656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461124422d1846e5b04d0d93ece24ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3bf3aae3394187a839240184105a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:43.556418 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dcae4a80-f35f-48f2-8345-0aebf2e6bf49 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 200 len: 1308 microversion: 2.1 time: 0.527255 Oct 25 03:05:43.560284 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 731/1354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:43 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:43.578166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eca1be92-9df8-44ee-86c3-183c08390de1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3389d670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:43.711521 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eca1be92-9df8-44ee-86c3-183c08390de1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.146839 Oct 25 03:05:43.720108 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 732/1355] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:43 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:43.775413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:43.790763 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f7e7456-e3e1-4bae-be45-f9fc3795c95e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.540094 Oct 25 03:05:43.792223 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 624/1356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:43 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:44.015857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:44.016604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:44.021123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:44.031221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.032116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.033439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:44.034463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.036408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.037368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:44.100240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:44.100854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:44.112209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.112696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.121356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:44.130921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.131795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.132409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:44.304415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:44.316361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:44.321612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:44.338018 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39c64b6d-46d0-4930-b737-304a1eb46d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.240821 Oct 25 03:05:44.338736 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 625/1357] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:44 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:05:44.372367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:44.384524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:44.386000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:44.390228 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8cab6020-641d-455e-b252-64ce1a9c826f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.381297 Oct 25 03:05:44.390829 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 733/1358] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:44 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:44.587562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:44.588175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] [instance: 33386002-6ff6-47ae-8aec-6ecdf27e7fd5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:44.594841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.595564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.596191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:44.597145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.598569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.599192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:44.628765 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] HTTP exception thrown: Instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 could not be found. Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Request method failure captured: Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 HTTP/1.1 Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1JBQBPmIMFN3bXdegGMktk7aZ1fz0BA4ijRSERHuhhCJyZipalfRK40rKpo8l0rGmMX-oyqb-SmTKGiDocomxhglpA07oObS7DdWZmF6np0snK_TkuP0HzrDfacWu5-pc0NC93No-UD5rB3Xz9MGVF7YGzVp0p_YNEPAPAEX9zmJ_c Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8d3bf3aae3394187a839240184105a32 Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-LiveMigrationNegativeTest-255364982 Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:05:44.636212 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d3bf3aae3394187a839240184105a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d3bf3aae3394187a839240184105a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d3bf3aae3394187a839240184105a32", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d3bf3aae3394187a839240184105a32"}]}] Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-LiveMigrationNegativeTest-255364982 Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8d3bf3aae3394187a839240184105a32 Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-255364982 Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-LiveMigrationNegativeTest-255364982-project Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 461124422d1846e5b04d0d93ece24ded Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-LiveMigrationNegativeTest-255364982-project Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 could not be found. Oct 25 03:05:44.638664 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '33386002-6ff6-47ae-8aec-6ecdf27e7fd5'} Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 could not be found. Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:05:44.639701 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 could not be found. Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 could not be found. Oct 25 03:05:44.640953 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:05:44.644203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] Returning 404 to user: Instance 33386002-6ff6-47ae-8aec-6ecdf27e7fd5 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:05:44.650645 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ebbd3097-74a4-4afe-8c2a-1373ced8b738 tempest-LiveMigrationNegativeTest-255364982 tempest-LiveMigrationNegativeTest-255364982-project] 10.222.0.36 "GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5" status: 404 len: 111 microversion: 2.1 time: 0.068394 Oct 25 03:05:44.651736 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 626/1359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:44 2022] GET /compute/v2.1/servers/33386002-6ff6-47ae-8aec-6ecdf27e7fd5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:05:44.734802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8fad747f-de51-4c8c-af5e-ebafc810786f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33835e50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:44.820174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:44.822077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:44.846013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.846949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.847862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:44.851371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:44.852119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:44.852795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:45.365654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:45.378521 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d47a4452-036a-4c3f-95ff-8d79013f2ac9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.563445 Oct 25 03:05:45.382052 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 627/1360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:44 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:45.391570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4913cff5-0438-4afa-8cf4-fa4e1ac70dc7 req-c2f39cbd-005f-4fa5-8543-82ee99ef4280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6dbd798-ea90-476c-91fc-c466e0b7bd7a", "tag": "65ec2208-6a10-4f7c-be38-2e1cb525e222"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:45.417971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4913cff5-0438-4afa-8cf4-fa4e1ac70dc7 req-c2f39cbd-005f-4fa5-8543-82ee99ef4280 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:45.424112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4913cff5-0438-4afa-8cf4-fa4e1ac70dc7 req-c2f39cbd-005f-4fa5-8543-82ee99ef4280 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:45.430891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4913cff5-0438-4afa-8cf4-fa4e1ac70dc7 req-c2f39cbd-005f-4fa5-8543-82ee99ef4280 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:45.473989 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4913cff5-0438-4afa-8cf4-fa4e1ac70dc7 req-c2f39cbd-005f-4fa5-8543-82ee99ef4280 service nova] Creating event network-changed:65ec2208-6a10-4f7c-be38-2e1cb525e222 for instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a on n-h2-862355-1 Oct 25 03:05:45.483204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4913cff5-0438-4afa-8cf4-fa4e1ac70dc7 req-c2f39cbd-005f-4fa5-8543-82ee99ef4280 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099629 Oct 25 03:05:45.489449 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 628/1361] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:45.506520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:45.530303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:45.563640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:45.566270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:45.574073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:45.575176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:45.588200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:45.589047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:45.978804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:45.989448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:46.005360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:46.023688 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6586afc6-ae16-4052-8562-d64bb6d1a90d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.532529 Oct 25 03:05:46.025859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 629/1362] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:45 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:46.040811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:46.057302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:46.080038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:46.089115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:46.089735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:46.090594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:46.091188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:46.096098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:46.760389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:46.798991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:46.807970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:46.817543 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82c75d25-ed84-4f1c-843d-2b0a548d7fb5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.787603 Oct 25 03:05:46.819806 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 630/1363] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:46 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:46.880411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:46.881576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:46.907105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:46.914915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:46.920214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:46.921086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:46.922743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:46.924734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:47.786864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:47.808124 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-505bc021-a751-45d7-8f92-2e78ca27545a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1719 microversion: 2.1 time: 0.961164 Oct 25 03:05:47.826692 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 631/1364] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:46 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1719 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:47.843699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:47.844338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:47.873086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:47.873745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:47.874421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:47.876362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:47.882928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:47.887304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:48.109481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:48.118651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:48.127575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:48.144475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-25b3d2d4-c26d-4399-90df-e79f6b0e754c tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.316593 Oct 25 03:05:48.150770 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 632/1365] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:47 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:48.178935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:48.180370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:48.198037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:48.200290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:48.202576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:48.206555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:48.209306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:48.210519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:48.918566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:48.930683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:48.933244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:48.934882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d7ddad71-aba4-4839-a448-bb672f354731 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.782851 Oct 25 03:05:48.936307 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 633/1366] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:48 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:48.941393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:48.942945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:48.952983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:48.953836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:48.954594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:48.955732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:48.956345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:48.957020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:49.378235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:49.390757 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77b9e9fe-e565-48c4-980f-bab1472d782c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1709 microversion: 2.1 time: 0.453146 Oct 25 03:05:49.397340 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 634/1367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:48 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1709 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:49.404350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:49.407413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:49.424000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:49.424741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:49.425420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:49.427004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:49.431625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:49.447218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:49.672098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:49.687898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:49.696919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:49.716752 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5678778-ac3e-4c23-91d5-a6a3532c4f39 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.317872 Oct 25 03:05:49.719066 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 635/1368] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:49 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:49.732936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-16c367e6-2766-404f-801b-e3769bf54263 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '.version_select at 0x7efd33364790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:49.748195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c367e6-2766-404f-801b-e3769bf54263 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:49.752467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c367e6-2766-404f-801b-e3769bf54263 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:49.753743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c367e6-2766-404f-801b-e3769bf54263 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:49.790629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-16c367e6-2766-404f-801b-e3769bf54263 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2316 microversion: 2.1 time: 0.069974 Oct 25 03:05:49.801868 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 636/1369] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:05:49 2022] GET /compute/v2.1/os-migrations => generated 2316 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:49.812404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:49.814678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:49.835622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:49.847880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:49.848523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:49.850438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:49.857378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:49.858052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:50.228559 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-504c751f-5003-49d4-b07d-e52f22eca483 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1860 microversion: 2.1 time: 0.420415 Oct 25 03:05:50.237843 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 637/1370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:49 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1860 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:05:50.243275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:50.246444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:50.270534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:50.271542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:50.272221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:50.273166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:50.273877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:50.274561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:50.676685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:50.692195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:50.694613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:50.699709 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96b47f67-7847-49b4-9b00-a3e0309a6f20 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.460193 Oct 25 03:05:50.705189 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 638/1371] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:50 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:50.726804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:50.734769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:50.751038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:50.752122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:50.752841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:50.753890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:50.755498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:50.756234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:51.149819 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cda6975d-f61a-4dd9-a09a-85f2469f796f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1860 microversion: 2.1 time: 0.443076 Oct 25 03:05:51.163528 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 639/1372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:50 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1860 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:51.173517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:51.173517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:51.185706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:51.187989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:51.192508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:51.193736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:51.195339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:51.202408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:51.318725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:51.332363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:51.335049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:51.367680 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c202764d-4f05-4535-be16-fe0fe0c5f834 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.212461 Oct 25 03:05:51.368965 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 640/1373] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:51 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:51.386807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:51.387712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:51.405933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:51.407575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:51.412810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:51.414056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:51.417018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:51.417824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:51.857095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lazy-loading 'services' on Instance uuid 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:05:51.985855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:52.116380 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a4a1d05-a76c-4d20-ad0e-b5410402fff8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments/b988aedf-c71c-4370-baa8-8ac85247ed65" status: 202 len: 0 microversion: 2.1 time: 0.739427 Oct 25 03:05:52.116979 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 641/1374] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:05:51 2022] DELETE /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments/b988aedf-c71c-4370-baa8-8ac85247ed65 => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:05:52.139022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:52.139642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:52.221361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:52.222441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:52.224339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:52.230169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:52.231925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:52.233007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:52.609188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:52.619427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:52.620922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:52.622141 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ba0c1db-7ebd-4b2a-9545-f12b7c34305a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1814 microversion: 2.25 time: 0.502493 Oct 25 03:05:52.628248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 642/1375] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:52 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1814 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:53.101974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-663728453", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "4df2c330-762c-4640-94ef-2fa8322d1723"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:53.189157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:54.057359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:54.379794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=47 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:05:58.219078 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8fad747f-de51-4c8c-af5e-ebafc810786f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 13.494279 Oct 25 03:05:58.229035 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 734/1376] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:44 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 13497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:58.229035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:58.232448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] validate_networks() for [('4df2c330-762c-4640-94ef-2fa8322d1723', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:05:58.248951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:58.259027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.261935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.262581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.263404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.265363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.265996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.345134 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89a33e2b-c9f0-481d-8f61-fa6ad7f1819d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123176 Oct 25 03:05:58.348071 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 735/1377] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:05:58 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:58.357916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:58.358806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:58.369356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.370773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.371392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.372301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.372919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.373621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.495136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:58.507110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:58.508783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:58.515227 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b7fdef9-e9a3-4fd7-ad3f-8997fb50fd0d tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1555 microversion: 2.91 time: 0.163908 Oct 25 03:05:58.516884 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 736/1378] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:58 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:58.612916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-944410084", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": "none"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:58.693992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:05:58.694673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:05:58.695482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:05:58.696274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:05:58.697065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:05:58.708185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.709054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.709669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.710820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.711447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.712052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.736084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Getting quotas for project 78b9c86dfd414a989078f237dbb0273d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:58.752122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Getting quotas for user 2525754c957246deb6652896b5efde5a and project 78b9c86dfd414a989078f237dbb0273d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:58.781028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:05:58.783849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:05:58.847985 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2e868e40-a865-47a2-b67c-42891cf600fb tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.329286 Oct 25 03:05:58.855905 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 737/1379] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 338 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:05:58.861438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:58.862289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:58.870133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.870848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.871471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.872479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.873389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.874267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.877428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:05:58.877890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:05:58.878363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:05:58.878770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:05:58.879797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:05:58.893250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.894160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.895511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.914752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:58.915582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:58.916506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:58.955741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Getting quotas for project 426ba714f5c94b12a8b1be75aa6ae9f5. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:05:58.978393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Getting quotas for user 037e5e8325284e84a150158297faa105 and project 426ba714f5c94b12a8b1be75aa6ae9f5. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:05:59.017884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:05:59.022037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:05:59.125809 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a322edd5-72b2-4088-8477-234b19197ad1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.496167 Oct 25 03:05:59.126891 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 643/1380] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 6498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:05:59.139024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f17a751-44cb-4a6d-8449-93e4e2470faf tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:05:59.141608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f17a751-44cb-4a6d-8449-93e4e2470faf tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:59.282959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.313426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f17a751-44cb-4a6d-8449-93e4e2470faf tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.318700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.320282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.321534 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87720511-8e8c-404d-a4d8-cc8230a22d0a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1804 microversion: 2.25 time: 0.464231 Oct 25 03:05:59.322150 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 738/1381] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:58 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1804 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:59.338158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.338920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:59.346831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:59.348854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f17a751-44cb-4a6d-8449-93e4e2470faf tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.350469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f17a751-44cb-4a6d-8449-93e4e2470faf tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.362251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:59.365454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:59.366179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:59.366665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:59.367114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:59.375958 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f17a751-44cb-4a6d-8449-93e4e2470faf tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "PUT /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1358 microversion: 2.75 time: 0.240747 Oct 25 03:05:59.377987 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 644/1382] 10.222.0.36 () {62 vars in 1297 bytes} [Tue Oct 25 03:05:59 2022] PUT /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:59.391197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37a7fe98-0afa-47bd-b97a-c4dca397a1a5 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.392294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-37a7fe98-0afa-47bd-b97a-c4dca397a1a5 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:59.423544 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd909d42-bda0-486c-aa6b-37c194021de3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/ips" status: 200 len: 146 microversion: 2.1 time: 0.099374 Oct 25 03:05:59.430415 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 739/1383] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/ips => generated 146 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:59.435196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-60b980a5-b78f-4434-b544-959dc5d71134 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3815d3a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.511397 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-60b980a5-b78f-4434-b544-959dc5d71134 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.079527 Oct 25 03:05:59.512105 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 740/1384] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:59.527966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6e40140-5c62-4b8b-89f8-42d631a6fb29 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '.version_select at 0x7efd339e9f70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.533954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6e40140-5c62-4b8b-89f8-42d631a6fb29 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:59.541312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6e40140-5c62-4b8b-89f8-42d631a6fb29 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:59.542443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6e40140-5c62-4b8b-89f8-42d631a6fb29 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:59.565429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6e40140-5c62-4b8b-89f8-42d631a6fb29 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2780 microversion: 2.25 time: 0.050417 Oct 25 03:05:59.572114 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 741/1385] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/os-migrations => generated 2780 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:59.586571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.592402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:59.614031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:59.616804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:59.618231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:59.621233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:59.624119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:59.626142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:59.628010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37a7fe98-0afa-47bd-b97a-c4dca397a1a5 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.659533 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37a7fe98-0afa-47bd-b97a-c4dca397a1a5 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1224 microversion: 2.1 time: 0.271057 Oct 25 03:05:59.669107 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 645/1386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1224 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:05:59.673479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43e64829-6f55-4130-a31f-faf5a4c4b2f7 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.674059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43e64829-6f55-4130-a31f-faf5a4c4b2f7 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:59.711996 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b23f895f-2b82-4f17-be76-640e7432188c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136102 Oct 25 03:05:59.713319 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 742/1387] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:05:59.726740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.728588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:05:59.742893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:59.745914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:59.746489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:59.751754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:05:59.752386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:05:59.752946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:05:59.890990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43e64829-6f55-4130-a31f-faf5a4c4b2f7 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.903698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.911219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43e64829-6f55-4130-a31f-faf5a4c4b2f7 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.914620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43e64829-6f55-4130-a31f-faf5a4c4b2f7 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.920752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.922935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:05:59.925084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43e64829-6f55-4130-a31f-faf5a4c4b2f7 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1358 microversion: 2.75 time: 0.259713 Oct 25 03:05:59.926122 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 646/1388] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:59.931114 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2aefc371-d1c7-42f9-985f-2ea4af3f07b5 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1537 microversion: 2.91 time: 0.215297 Oct 25 03:05:59.945797 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 743/1389] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:05:59.971458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:05:59.974549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:00.353042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.377874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.381902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:00.382735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.383231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.385992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:00.536192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-347c42ca-af6c-46f4-b358-f7e504fd865d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33993550>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:00.602078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:00.608583 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-347c42ca-af6c-46f4-b358-f7e504fd865d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.076965 Oct 25 03:06:00.609644 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 744/1390] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:00 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:00.623970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-786a2bef-1393-447b-ac2d-289dda7030e2 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 2423 microversion: 2.25 time: 0.696070 Oct 25 03:06:00.625453 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 647/1391] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:05:59 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 2423 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:00.653478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:00.654544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:00.668160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.668910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.669549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:00.673567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.676791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.677944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:00.702998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:00.704140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:00.725320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.727691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.729188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:00.735118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.735798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.737982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:00.930841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:00.945172 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0492a498-dc64-499d-a01e-f64cdaac0dd1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1228 microversion: 2.1 time: 0.249222 Oct 25 03:06:00.962300 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 648/1392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:00 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1228 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:00.968564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:00.970886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:00.977769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.978389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.978893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:00.979714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:00.980221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:00.980691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.070783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:01.105148 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fd3a43c5-e64d-49c5-bd39-686ed40fa484 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138537 Oct 25 03:06:01.107802 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 649/1393] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:06:00 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:01.117920 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f740cc4-ac33-498a-95d9-511cccf7c4d6 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 2423 microversion: 2.25 time: 0.468732 Oct 25 03:06:01.118522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 745/1394] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:00 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 2423 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:01.125982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:01.125982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:01.132629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:01.133267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:01.135212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.135736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.136473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.137193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.137647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.138099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.146258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.146754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.147195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.147912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.148367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.148794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.258496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:01.270602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:01.272562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:01.285271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:01.291508 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92ece959-738b-4b5d-8f7d-9d2c02509c28 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1537 microversion: 2.91 time: 0.159708 Oct 25 03:06:01.296530 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 746/1395] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:01 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:01.318961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:01.329612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:01.337020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:01.339598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:01.356886 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c88b19b-c78c-4c39-b88d-7daf0d426027 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1362 microversion: 2.75 time: 0.246476 Oct 25 03:06:01.360994 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 650/1396] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:01 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:01.363668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.364739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.365235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.366149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.366606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.367032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.627240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-011f81c0-4077-46a9-b6a0-74e0098bfc3a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33300b80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:01.701464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lazy-loading 'services' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:01.714058 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-011f81c0-4077-46a9-b6a0-74e0098bfc3a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.090860 Oct 25 03:06:01.714933 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 651/1397] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:01 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:01.866138 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e55ee8b4-c98c-4d43-9f68-ae7272d346e4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments/87755014-72eb-47d0-83d8-577428450a1c" status: 202 len: 0 microversion: 2.25 time: 0.549125 Oct 25 03:06:01.868000 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 747/1398] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Oct 25 03:06:01 2022] DELETE /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments/87755014-72eb-47d0-83d8-577428450a1c => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:06:01.877179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:01.880139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:01.891035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.891839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.892361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.893713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.893713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.894191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.933898 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ffee81c9-4b74-4034-bc3c-af712ee69cc3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061173 Oct 25 03:06:01.934622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 652/1399] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:01 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:06:01.973833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:01.973833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:01.989813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.991002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.992798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:01.993739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:01.994411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:01.995153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.085663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:02.095243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb015359-3fa8-4135-9bdd-a8947658fd7d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1220 microversion: 2.1 time: 0.126906 Oct 25 03:06:02.096137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 748/1400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:01 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:02.120277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:02.124179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:02.143967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.151446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.152494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.153483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.154083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.154644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.230762 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48b12343-bde5-46f0-854c-faf0e50c5c36 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115868 Oct 25 03:06:02.241551 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 653/1401] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:06:02 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:06:02.347131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:02.347729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:02.355973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.364365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.364365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.364365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.364365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.364825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.386019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:02.386723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:02.398009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.398512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.398966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.399669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.406374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.407727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.448295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:02.459412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:02.461068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:02.466362 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3904a11f-e274-47e7-a5d8-a6d0270b2a10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1480 microversion: 2.91 time: 0.139276 Oct 25 03:06:02.469729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 749/1402] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:02 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1480 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:02.499668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:02.502330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:02.529414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.530202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.530808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.531684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.533922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.534552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.632829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:02.654051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:02.660106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:02.673231 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8d74e4b-f119-472b-ae90-92912ba93e53 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1410 microversion: 2.75 time: 0.290345 Oct 25 03:06:02.675155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 654/1403] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:02 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1410 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:02.732469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a0effcd-4c05-4742-9965-e9a7de8b975b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3334c8b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:02.758105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862355-1". {{(pid=120562) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 25 03:06:02.815282 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9a0effcd-4c05-4742-9965-e9a7de8b975b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.088855 Oct 25 03:06:02.816312 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 655/1404] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:02 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:02.923270 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f3b0c34-c802-4af2-94ad-7d1b1b6fdb82 tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action" status: 202 len: 0 microversion: 2.91 time: 0.417305 Oct 25 03:06:02.928775 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 750/1405] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:06:02 2022] POST /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:06:02.937953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:02.938711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:02.954308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:02.957278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.963031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.963906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.968454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.969225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.973838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.974107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:02.985522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.986388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.987181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:02.988116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:02.989477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:02.990188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:03.040230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d944e4db-ae0e-4633-9aea-9e5d560743ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095648 Oct 25 03:06:03.041870 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 751/1406] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:02 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:06:03.126283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:03.127319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:03.147957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:03.149389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:03.152166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:03.154638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:03.156361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:03.158890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:03.197475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:03.213315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:03.218084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:03.244940 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8db1a115-390f-45ca-9cf5-e77a151ff088 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1488 microversion: 2.91 time: 0.311460 Oct 25 03:06:03.263421 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 656/1407] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:02 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1488 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:03.309561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:03.317652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:03.320373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51637714-54e0-4cc7-9a89-7c709bbff08f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1276 microversion: 2.1 time: 0.202457 Oct 25 03:06:03.334652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 752/1408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:03 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:03.591061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d25c088-50cf-44f2-afab-3be065fc66dc"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:03.593434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:03.606927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:03.608899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:03.610533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:03.611418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:03.616227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:03.617174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:03.705766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:03.706450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:03.734357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:03.735192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:03.742411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:03.743432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:03.744089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:03.744527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:03.887441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:03.901402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:03.903500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:03.914253 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9d57cff2-7bc4-4012-969c-cc378afe9334 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1416 microversion: 2.75 time: 0.211010 Oct 25 03:06:03.917043 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 753/1409] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:03 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1416 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:03.923311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88f5b4fa-d7c6-4881-a5b3-8545c0cad1ba tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd339e99d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:04.075543 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88f5b4fa-d7c6-4881-a5b3-8545c0cad1ba tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1414 microversion: 2.1 time: 0.156667 Oct 25 03:06:04.084060 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 754/1410] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:03 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1414 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:04.094884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:04.097708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:04.122590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.127069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.127743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:04.130791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.139742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.140204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:04.263306 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dfe049a8-c151-4a45-9110-7b02f2d29b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.182700 Oct 25 03:06:04.272018 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 755/1411] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:04 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:06:04.283949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a1eb809f-521f-471d-b243-ca49bd60b665 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693863 Oct 25 03:06:04.291796 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 657/1412] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:06:03 2022] POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:04.296570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:04.297440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:04.315004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.315514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.318820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:04.319933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.321069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.323320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:04.345969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:04.346690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:04.374742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.375256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.375775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:04.376494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.376956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.377390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:04.475189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:04.486812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:04.489362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:04.501857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e24c5bc-be09-452b-a820-0c97e8fab6cd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1490 microversion: 2.91 time: 0.225710 Oct 25 03:06:04.502807 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 756/1413] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:04 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1490 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:04.543677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:04.558381 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f7157398-6d06-48e6-aeb5-f052724eaf21 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1294 microversion: 2.1 time: 0.215781 Oct 25 03:06:04.559109 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 658/1414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:04 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1294 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:04.949171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:04.950074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:04.968035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.968567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.968926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:04.970646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:04.971111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:04.972924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:05.091093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8762773a-d38d-4097-96f2-3b264263eb04 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd332f5280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:05.178548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:05.193538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:05.199432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:05.217424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e195d7b0-e972-4d72-a2b3-867fd9aa4433 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1416 microversion: 2.75 time: 0.276497 Oct 25 03:06:05.218041 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 757/1415] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:04 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1416 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:05.278185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:05.282822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:05.293820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:05.294554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:05.295155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:05.297232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:05.297915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:05.298492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:05.361026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d421c0a4-336c-4486-a52d-4f8fb5e19721 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.088640 Oct 25 03:06:05.361901 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 758/1416] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:05 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:06:05.542654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:05.544370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:05.557238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:05.559492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:05.568947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:05.569825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:05.570305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:05.575485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:05.704720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:05.719848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:05.721402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:05.742281 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1093e325-c95b-4bd2-8b4f-a35a376f53a4 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.204876 Oct 25 03:06:05.761400 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 759/1417] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:05 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:05.773942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:05.774821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:05.783494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:05.784211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:05.785149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:05.786861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:05.787511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:05.788211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:06.155981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:06.165759 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ddb532ad-ff20-4d66-a52a-1e33247ffcbd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1294 microversion: 2.1 time: 0.398620 Oct 25 03:06:06.171702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 760/1418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:05 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1294 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:06.215845 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8762773a-d38d-4097-96f2-3b264263eb04 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1423 microversion: 2.1 time: 1.128687 Oct 25 03:06:06.218069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 659/1419] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:05 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1423 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:06.233237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55da3913-b8fd-488b-bc99-1b8295d3d65a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33f3aa60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:06.246299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:06.246911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:06.257588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:06.258113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:06.258555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:06.259278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:06.259838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:06.260172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:06.369183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:06.382333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:06.384101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:06.391025 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48575391-0be2-4ef1-bb5a-edce43b06d82 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1416 microversion: 2.75 time: 0.148299 Oct 25 03:06:06.392449 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 660/1420] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:06 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:06.398437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:06.401662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:06.414139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:06.416504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:06.416955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:06.417701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:06.418151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:06.419399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:06.465579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b4589fb-8e83-4475-9c85-2173956a9afa tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071643 Oct 25 03:06:06.466814 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 661/1421] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:06 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:06:06.778369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:06.779381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:06.791069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:06.792054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:06.792655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:06.794440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:06.799118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:06.799820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:07.086763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:07.118669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:07.122605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:07.141710 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50b1cafc-3ad2-4e8a-902a-133893a34b3e tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.367854 Oct 25 03:06:07.156960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 662/1422] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:06 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:07.195369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:07.196761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:07.215831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:07.216479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:07.217121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:07.217838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:07.226073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:07.226810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:07.236075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:07.623997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:07.639554 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d84df36-455e-474b-96fd-67c7c35740ba tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1324 microversion: 2.1 time: 0.448642 Oct 25 03:06:07.654812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 663/1423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:07 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:07.680771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:07.682216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:07.692792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:07.695169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:07.696813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:07.699545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:07.700394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:07.702921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:07.821468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:07.834063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:07.841920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:07.851470 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d46f052e-e24f-48fb-8b92-d82916f84a9e tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1437 microversion: 2.75 time: 0.189158 Oct 25 03:06:07.852976 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 664/1424] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:07 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1437 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:07.871128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:07.880509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:07.893961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:07.897289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:07.900282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:07.901284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:07.903943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:07.904641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:07.974848 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-978ed42f-d7b8-42e8-b4ce-0215d831f7eb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120146 Oct 25 03:06:07.986197 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 665/1425] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:07 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:06:07.992242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:08.003543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:08.018490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:08.019268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:08.020605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:08.021594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:08.022797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:08.023450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:08.723761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:08.767192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:08.929066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:09.898129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:15.783743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:16.121989 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55da3913-b8fd-488b-bc99-1b8295d3d65a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 200 len: 1423 microversion: 2.1 time: 9.892421 Oct 25 03:06:16.125724 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 761/1426] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:06 2022] GET /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 1423 bytes in 9894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:16.128008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:16.128625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:16.135528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.136020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.136664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.137375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.137526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:06:16.138205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.138475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:06:16.138739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.138956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:06:16.139393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:06:16.139776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:06:16.214260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:16.215097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.220731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.221317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.221915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.222703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.223404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.224763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.225055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.227189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.234246 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6421d609-6405-4964-9abc-05c83e6f8d0b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.109404 Oct 25 03:06:16.235431 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 762/1427] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:16 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:16.241985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:16.242598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:16.248653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.249353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.249810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.250506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.250950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.251549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.299539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.309643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.311320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.319658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e68a8a41-ab0b-4cb7-b7c0-f09532296a63 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "POST /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5/action" status: 202 len: 1494 microversion: 2.75 time: 8.331626 Oct 25 03:06:16.330526 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 666/1428] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:06:07 2022] POST /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5/action => generated 1494 bytes in 8334 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 25 03:06:16.426396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.432506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b268f92a-886b-4686-a2c1-cc6281b4541e req-16bac793-5dc4-427a-bec6-9a450194790d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e89584-8d68-406a-bd7a-9551c624c2a2", "tag": "f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:16.440766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-856c37b7-430b-4978-aad5-4516d9d6514f tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1324 microversion: 2.1 time: 0.202811 Oct 25 03:06:16.451927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b268f92a-886b-4686-a2c1-cc6281b4541e req-16bac793-5dc4-427a-bec6-9a450194790d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.451927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b268f92a-886b-4686-a2c1-cc6281b4541e req-16bac793-5dc4-427a-bec6-9a450194790d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.452269 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 763/1429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:16 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:16.452378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b268f92a-886b-4686-a2c1-cc6281b4541e req-16bac793-5dc4-427a-bec6-9a450194790d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.453020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:16.455660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:16.461579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b268f92a-886b-4686-a2c1-cc6281b4541e req-16bac793-5dc4-427a-bec6-9a450194790d service nova] Creating event network-changed:f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a for instance c7e89584-8d68-406a-bd7a-9551c624c2a2 on n-h2-862355-1 Oct 25 03:06:16.464032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.465404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.465969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.466716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b268f92a-886b-4686-a2c1-cc6281b4541e req-16bac793-5dc4-427a-bec6-9a450194790d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143986 Oct 25 03:06:16.467011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.467311 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 667/1430] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:16.467946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.468700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.474605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:16.479822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.481482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Searching by: {'deleted': False, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:06:16.487050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.487543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.487985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.489110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.489528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.489995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.505008 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-511b0aab-fd5b-4a30-868c-a8894c481fb7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057186 Oct 25 03:06:16.510111 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 764/1431] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:16 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:06:16.589990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:06:16.604385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-83cb1bea-1b7e-49a5-bd3b-dbb3e8920c46 req-98c4f181-c4b2-400b-8ceb-2996eb06796e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e89584-8d68-406a-bd7a-9551c624c2a2", "name": "network-vif-plugged", "status": "completed", "tag": "f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:16.622640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-83cb1bea-1b7e-49a5-bd3b-dbb3e8920c46 req-98c4f181-c4b2-400b-8ceb-2996eb06796e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.626982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-83cb1bea-1b7e-49a5-bd3b-dbb3e8920c46 req-98c4f181-c4b2-400b-8ceb-2996eb06796e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.632975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-83cb1bea-1b7e-49a5-bd3b-dbb3e8920c46 req-98c4f181-c4b2-400b-8ceb-2996eb06796e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.656225 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-83cb1bea-1b7e-49a5-bd3b-dbb3e8920c46 req-98c4f181-c4b2-400b-8ceb-2996eb06796e service nova] Creating event network-vif-plugged:f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a for instance c7e89584-8d68-406a-bd7a-9551c624c2a2 on n-h2-862355-1 Oct 25 03:06:16.659311 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4917fe2e-e2e0-44de-b774-6a401f96a630 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.190335 Oct 25 03:06:16.660274 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 668/1432] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:06:16 2022] GET /compute/v2.1/servers => generated 334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:16.665730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58ceebda-4cb5-4f39-a640-8174388ea923 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd332f5160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:16.675096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-83cb1bea-1b7e-49a5-bd3b-dbb3e8920c46 req-98c4f181-c4b2-400b-8ceb-2996eb06796e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160238 Oct 25 03:06:16.677168 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 765/1433] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:16.686045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:16.686754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:16.695273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.695770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.696210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.697568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.698065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.698956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.842093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.862716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.865104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.874931 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8588aaf5-9752-41f6-9def-f8f0c2d40853 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.193493 Oct 25 03:06:16.875856 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 766/1434] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:16 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:16.899485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:16.906787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:16.907866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Searching by: {'deleted': False, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:06:16.917472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.918071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.918613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.919434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:16.919983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:16.920531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:16.965895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:06:17.034008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:17.041955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.042736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.043309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.182191 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a5e80b6b-251b-4e14-9916-be1546b022a6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.294025 Oct 25 03:06:17.183047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 767/1435] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:06:16 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:17.209326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a89077c2-3018-4f9f-ac7d-afe5617ec070 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:17.223182 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a89077c2-3018-4f9f-ac7d-afe5617ec070 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017868 Oct 25 03:06:17.224049 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 768/1436] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:06:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:06:17.266699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:17.267655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:17.277854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.278643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.279282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.280387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.280522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.280871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.299475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58ceebda-4cb5-4f39-a640-8174388ea923 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 204 len: 0 microversion: 2.1 time: 0.637368 Oct 25 03:06:17.301039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 669/1437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:16 2022] DELETE /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:06:17.310032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:17.310887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:17.318598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.319317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.319972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.320797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.321324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.321843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.356950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:06:17.370486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:17.380729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:17.382724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:17.388536 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65ec7d1b-fe19-4ab2-8e2e-bf670e2a0ceb tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.125803 Oct 25 03:06:17.389502 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 769/1438] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:17 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:17.462463 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-270c4fa9-b9fa-4b5b-a89b-0ff221651dce tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 204 len: 0 microversion: 2.1 time: 0.156050 Oct 25 03:06:17.463316 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 670/1439] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:06:17 2022] DELETE /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:06:17.465879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:17.466678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:17.477830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.477830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.481761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.481761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.481761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.481761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.521579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:17.524695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:17.528040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:17.538060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.539174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.540724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.541896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.542519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.543158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.594524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15aaee74-1f4b-415e-9ad9-c901076a6272 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.079792 Oct 25 03:06:17.601767 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 671/1440] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:06:17 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:17.617066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:17.617577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:17.624331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.624778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.625215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.626362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.626952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.627357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.658907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:06:17.676997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:17.695022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6151afdd-233d-45cf-9dac-ef48a7afea8d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1324 microversion: 2.1 time: 0.232568 Oct 25 03:06:17.695922 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 770/1441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:17 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:17.703292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1414249951", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "385d0b29-fab5-4e63-9127-a294e08d4c17"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:17.780147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] validate_networks() for [('385d0b29-fab5-4e63-9127-a294e08d4c17', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:06:17.782197 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1bdd5ad-9cb6-408a-88c8-07f60ad03489 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 204 len: 0 microversion: 2.1 time: 0.181589 Oct 25 03:06:17.783024 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 672/1442] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:06:17 2022] DELETE /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:06:17.792230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:17.793337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:17.799504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.800283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.800659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:17.802239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:17.802877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:17.803465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.056003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.074832 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3bdce5e-bac4-4214-93b9-c707e16466b6 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1699 microversion: 2.1 time: 0.283602 Oct 25 03:06:18.075884 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 673/1443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:17 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1699 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:18.084946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:18.087637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:18.110223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.111765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.113544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.115233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.116062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.116722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.195691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.206462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.208480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.216670 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23d0c68d-96bc-4b50-b8a9-d49dc201bef8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.134481 Oct 25 03:06:18.217354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 674/1444] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:18 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:18.320958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:06:18.321596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:06:18.323101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:06:18.323519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:06:18.323932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:06:18.334912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.335388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.336046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.336851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.337225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.337644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.360065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:06:18.366280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for user 438a56b0a79647f6bb195b7e0c42b089 and project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:06:18.382027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:06:18.384364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:06:18.423466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:18.424087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:18.437718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.442464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.443219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.444219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.444751 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51d46b41-2620-411d-aa0a-54a34ff64c72 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746879 Oct 25 03:06:18.446460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.447092 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 771/1445] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:06:18.447356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.457256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9753a8d0-a8e3-4dcf-84a8-dd4889af1bf0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:18.458486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9753a8d0-a8e3-4dcf-84a8-dd4889af1bf0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:18.512358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:18.528980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9753a8d0-a8e3-4dcf-84a8-dd4889af1bf0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.538107 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9753a8d0-a8e3-4dcf-84a8-dd4889af1bf0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1208 microversion: 2.1 time: 0.085141 Oct 25 03:06:18.539001 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 772/1446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:18 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:18.590046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.599567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.600980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.611005 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9ed609ce-3fd5-4978-8be8-bc9711cc2c10 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.191936 Oct 25 03:06:18.611599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 675/1447] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:18 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:18.731247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:18.732116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:18.738313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.739833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.740883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.741819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:18.742716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:18.743365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:18.932686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:18.943887 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8f9b238-c59b-45e8-92c5-806f80681cf1 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1324 microversion: 2.1 time: 0.215689 Oct 25 03:06:18.944557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 773/1448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:18 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:19.101063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:19.102017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:19.109425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.110028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.110536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.111326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.111830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.112267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.251401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:19.252026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:19.259329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.260231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.260722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.261791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.262262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.262697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.271491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:19.388147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.398408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.407513 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58018191-b86c-4aee-b568-5b3e4b7b2387 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1699 microversion: 2.1 time: 0.310862 Oct 25 03:06:19.409148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.414126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.414450 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 676/1449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:19 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1699 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:19.434979 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-515d38df-91c2-45ab-b159-1b43855d7cad tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.193499 Oct 25 03:06:19.435858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 774/1450] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:19 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:19.478888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-464136e1-e4ab-496c-a701-636dd098537b req-ab10539b-64e4-4ede-8487-3386046f4f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5638e8a-6990-4068-bc45-bd2bbe313310", "name": "network-vif-unplugged", "status": "completed", "tag": "4c9569cd-ff29-48df-8f89-9b9df51c2d75"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:19.492284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-464136e1-e4ab-496c-a701-636dd098537b req-ab10539b-64e4-4ede-8487-3386046f4f9a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.492771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-464136e1-e4ab-496c-a701-636dd098537b req-ab10539b-64e4-4ede-8487-3386046f4f9a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.494232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-464136e1-e4ab-496c-a701-636dd098537b req-ab10539b-64e4-4ede-8487-3386046f4f9a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.516343 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-464136e1-e4ab-496c-a701-636dd098537b req-ab10539b-64e4-4ede-8487-3386046f4f9a service nova] Creating event network-vif-unplugged:4c9569cd-ff29-48df-8f89-9b9df51c2d75 for instance f5638e8a-6990-4068-bc45-bd2bbe313310 on n-h2-862355-1 Oct 25 03:06:19.537347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-464136e1-e4ab-496c-a701-636dd098537b req-ab10539b-64e4-4ede-8487-3386046f4f9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062330 Oct 25 03:06:19.542214 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 677/1451] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:19.561165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:19.562163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:19.570269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.571019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.571678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.572587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.573255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.573906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.641136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:19.642177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:19.655221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.661469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.662239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.665388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.666298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.666739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.732919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.743179 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-735458f8-90b3-4ba7-b7bb-970212ef6ab1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1260 microversion: 2.1 time: 0.185749 Oct 25 03:06:19.744181 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 775/1452] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:19 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:19.872926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.886525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.888548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:19.895452 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9be8adfe-6929-4acf-afb8-ad498b0150fd tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.258614 Oct 25 03:06:19.896042 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 678/1453] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:19 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:19.972076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:19.972076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:19.981748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.982209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.982799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:19.983738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:19.983984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:19.984414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.166766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:20.176825 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5fe66349-0a77-4d57-be9f-f8e7ed2b446d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1521 microversion: 2.1 time: 0.212592 Oct 25 03:06:20.178145 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 776/1454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:19 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:20.204306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.205288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.213500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.214131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.214644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.215582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.216120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.216786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.255117 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] HTTP exception thrown: Action 999 not found Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Request method failure captured: Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2/os-instance-actions/999 HTTP/1.1 Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1KPn_-C6i44VWfdmPckPGaSF4iR56DZhehdgfPjGO15a6R4O-_mkQJSDMdr2hHjz7IP3XohE1un-HuW5POhSqJkxRunvyW_FG4Wej3lqWGmuHYzDGCnN4aJyMaqaaJfP5kV-OPwRSY4MUB67wraakAhQf2lQ0iwXXXPW0mxQqbOClc Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 426ba714f5c94b12a8b1be75aa6ae9f5 Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:06:20.264748 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/426ba714f5c94b12a8b1be75aa6ae9f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/426ba714f5c94b12a8b1be75aa6ae9f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_426ba714f5c94b12a8b1be75aa6ae9f5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/426ba714f5c94b12a8b1be75aa6ae9f5"}]}] Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 426ba714f5c94b12a8b1be75aa6ae9f5 Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-InstanceActionsNegativeTestJSON-1308447195-project Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 037e5e8325284e84a150158297faa105 Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1308447195-project Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: exception: Action 999 not found Oct 25 03:06:20.266516 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'server_id': 'c7e89584-8d68-406a-bd7a-9551c624c2a2', 'id': '999'} Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 25 03:06:20.267468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.269614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Returning 404 to user: Action 999 not found {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:06:20.269614 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5da9b368-8965-4c70-a350-6d2c827b60df tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.067262 Oct 25 03:06:20.272549 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 679/1455] 10.222.0.36 () {58 vars in 1308 bytes} [Tue Oct 25 03:06:20 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2/os-instance-actions/999 => generated 66 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:06:20.277647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51b915d0-e19d-4d9b-9d20-7b56f116cf0d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '.version_select at 0x7efd381ccd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.278344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51b915d0-e19d-4d9b-9d20-7b56f116cf0d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: ce23b002-8f6e-457c-bb5e-ec9ee005b9e7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.284905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-51b915d0-e19d-4d9b-9d20-7b56f116cf0d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] HTTP exception thrown: Instance ce23b002-8f6e-457c-bb5e-ec9ee005b9e7 could not be found. Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51b915d0-e19d-4d9b-9d20-7b56f116cf0d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Request method failure captured: Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/ce23b002-8f6e-457c-bb5e-ec9ee005b9e7/os-instance-actions HTTP/1.1 Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1KPn_-C6i44VWfdmPckPGaSF4iR56DZhehdgfPjGO15a6R4O-_mkQJSDMdr2hHjz7IP3XohE1un-HuW5POhSqJkxRunvyW_FG4Wej3lqWGmuHYzDGCnN4aJyMaqaaJfP5kV-OPwRSY4MUB67wraakAhQf2lQ0iwXXXPW0mxQqbOClc Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 426ba714f5c94b12a8b1be75aa6ae9f5 Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:06:20.288532 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/426ba714f5c94b12a8b1be75aa6ae9f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/426ba714f5c94b12a8b1be75aa6ae9f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_426ba714f5c94b12a8b1be75aa6ae9f5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/426ba714f5c94b12a8b1be75aa6ae9f5"}]}] Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 426ba714f5c94b12a8b1be75aa6ae9f5 Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-InstanceActionsNegativeTestJSON-1308447195-project Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 037e5e8325284e84a150158297faa105 Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1308447195-project Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance ce23b002-8f6e-457c-bb5e-ec9ee005b9e7 could not be found. Oct 25 03:06:20.290251 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': 'ce23b002-8f6e-457c-bb5e-ec9ee005b9e7'} Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce23b002-8f6e-457c-bb5e-ec9ee005b9e7 could not be found. Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:06:20.291171 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce23b002-8f6e-457c-bb5e-ec9ee005b9e7 could not be found. Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce23b002-8f6e-457c-bb5e-ec9ee005b9e7 could not be found. Oct 25 03:06:20.293109 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:20.295170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51b915d0-e19d-4d9b-9d20-7b56f116cf0d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Returning 404 to user: Instance ce23b002-8f6e-457c-bb5e-ec9ee005b9e7 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:06:20.295170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51b915d0-e19d-4d9b-9d20-7b56f116cf0d tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/ce23b002-8f6e-457c-bb5e-ec9ee005b9e7/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019832 Oct 25 03:06:20.296050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 777/1456] 10.222.0.36 () {58 vars in 1296 bytes} [Tue Oct 25 03:06:20 2022] GET /compute/v2.1/servers/ce23b002-8f6e-457c-bb5e-ec9ee005b9e7/os-instance-actions => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:06:20.307753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.308110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.314687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.315192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.315639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.316503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.317095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.317551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.362173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:06:20.445527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.447637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.467820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5495b93-f286-4dd5-b648-5e92bff2b58c tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 204 len: 0 microversion: 2.1 time: 0.166446 Oct 25 03:06:20.469179 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 680/1457] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:06:20 2022] DELETE /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:06:20.477402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.478404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.480325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.480916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.481369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.486248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.486831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.487042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.487525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.488405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.489216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.490733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.491694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.492643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.616843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:20.658853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:20.670103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:20.679411 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-92478938-7ab7-4449-9322-567a5bbb2345 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.208660 Oct 25 03:06:20.680166 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 681/1458] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:20 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:20.686526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.687581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.719053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.719778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.720404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.721597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.721945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.722381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.726467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:20.735220 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-035432c5-e814-4fa2-9677-f161fff9f1b2 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1699 microversion: 2.1 time: 0.299815 Oct 25 03:06:20.752615 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 778/1459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:20 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1699 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:20.771558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.772044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.779350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.779846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.780436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.781164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.781668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.782130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.869714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:20.878032 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-359a26fd-c70e-4cde-98c4-8b3097a1e6f6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1260 microversion: 2.1 time: 0.112752 Oct 25 03:06:20.878872 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 779/1460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:20 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1260 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:20.925219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:20.925780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:20.932841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.933350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.933806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:20.934526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:20.934989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:20.937322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.017937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.030301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.036833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.042238 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66c7c45f-c945-48cc-87be-92408b28e829 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.120896 Oct 25 03:06:21.043439 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 780/1461] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:20 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:21.117358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.135180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-758949df-143c-401b-9704-cbb2e0189f57 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1527 microversion: 2.1 time: 0.452660 Oct 25 03:06:21.141022 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 682/1462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:20 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1527 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:21.384363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d954a69f-d487-4b51-9847-95561115fe5f req-7ea2938a-6395-4be9-ac76-6371f6ab72a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5638e8a-6990-4068-bc45-bd2bbe313310", "name": "network-vif-deleted", "tag": "4c9569cd-ff29-48df-8f89-9b9df51c2d75"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:21.418864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d954a69f-d487-4b51-9847-95561115fe5f req-7ea2938a-6395-4be9-ac76-6371f6ab72a0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:21.421434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d954a69f-d487-4b51-9847-95561115fe5f req-7ea2938a-6395-4be9-ac76-6371f6ab72a0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:21.424131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d954a69f-d487-4b51-9847-95561115fe5f req-7ea2938a-6395-4be9-ac76-6371f6ab72a0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.456148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d954a69f-d487-4b51-9847-95561115fe5f req-7ea2938a-6395-4be9-ac76-6371f6ab72a0 service nova] Creating event network-vif-deleted:4c9569cd-ff29-48df-8f89-9b9df51c2d75 for instance f5638e8a-6990-4068-bc45-bd2bbe313310 on n-h2-862355-1 Oct 25 03:06:21.468284 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d954a69f-d487-4b51-9847-95561115fe5f req-7ea2938a-6395-4be9-ac76-6371f6ab72a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088939 Oct 25 03:06:21.470521 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 781/1463] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:21.715484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:21.716107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:21.724387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:21.725150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:21.725805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.726696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:21.727343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:21.727933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.760320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:21.761584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:21.773724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:21.777238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:21.777925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.779424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:21.780642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:21.782450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.890479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.902208 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-783b5f48-dea6-4115-8935-4dac26d42716 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1632 microversion: 2.1 time: 0.145854 Oct 25 03:06:21.903265 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 782/1464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:21 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1632 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:21.908352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:21.909120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:21.916100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:21.916989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:21.917621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.918724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:21.919362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:21.919977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:21.934617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.950562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.956613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:21.975561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96201522-63d4-46bc-bb3b-68dc613b6070 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.263844 Oct 25 03:06:21.990267 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 683/1465] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:21 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:22.075994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:22.076631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:22.095483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:22.097783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:22.102102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:22.104266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:22.105802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:22.107516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:22.122996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:22.150600 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b04b6ff0-d5e8-4b3c-af24-50a0e5938843 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1266 microversion: 2.1 time: 0.238012 Oct 25 03:06:22.156998 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 783/1466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:21 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:22.188024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:22.188776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:22.204596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:22.205102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:22.208494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:22.209328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:22.209885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:22.210334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:22.614637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:22.622178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:22.624968 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dcfa117c-c2dc-48d1-87ea-e12a385aeedd tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1527 microversion: 2.1 time: 0.452093 Oct 25 03:06:22.636843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:22.640456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:22.648410 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 784/1467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:22 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1527 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:22.655424 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dac05576-b7f9-4176-bb11-00106fd621df tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1546 microversion: 2.91 time: 0.585659 Oct 25 03:06:22.660727 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 684/1468] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:22 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1546 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:22.790310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e3413272-4fbc-4161-8405-1a1b5688e88e tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:22.810735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3413272-4fbc-4161-8405-1a1b5688e88e tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:22.812069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3413272-4fbc-4161-8405-1a1b5688e88e tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:22.814761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3413272-4fbc-4161-8405-1a1b5688e88e tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:22.922338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e3413272-4fbc-4161-8405-1a1b5688e88e tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:06:22.926357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:22.927616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:22.940375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:22.942671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:22.943119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:22.943852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:22.944319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:22.944752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.003274 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e3413272-4fbc-4161-8405-1a1b5688e88e tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action" status: 202 len: 0 microversion: 2.1 time: 0.218280 Oct 25 03:06:23.004908 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 785/1469] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:06:22 2022] POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:06:23.016825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.017522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.017654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:23.018360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:23.018733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.019296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lazy-loading 'fault' on Instance uuid 9a3c693e-9810-4626-a56a-79c3426c7db2 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:23.036206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.036957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.037483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.038247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.039198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.040176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.080090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:23.103877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b5583d32-93cb-4a34-941e-8625f0ab5b43 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1359 microversion: 2.1 time: 0.181137 Oct 25 03:06:23.108076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 685/1470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:22 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:23.116512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:23.117418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:23.136668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.139901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.143935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.146953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.149374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.150258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.179173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:23.193667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:23.201593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:23.234881 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a53b2a0-46b7-4a35-a662-10e7d6a4f10a tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.222633 Oct 25 03:06:23.235476 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 786/1471] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:23 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:23.246907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:23.255853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:23.264161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.265016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.265630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.266606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.267345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.268059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.717262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:23.734689 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ada05519-2e58-4dbc-953c-1dca5e83ee29 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.489403 Oct 25 03:06:23.735789 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 787/1472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:23 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:23.741996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-50b1e57a-0fa5-4f9f-b348-59ba96fce323 req-25bf21b2-0eed-4cee-83ed-11680059cc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e89584-8d68-406a-bd7a-9551c624c2a2", "name": "network-vif-unplugged", "status": "completed", "tag": "f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:23.760885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-50b1e57a-0fa5-4f9f-b348-59ba96fce323 req-25bf21b2-0eed-4cee-83ed-11680059cc34 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.771113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-50b1e57a-0fa5-4f9f-b348-59ba96fce323 req-25bf21b2-0eed-4cee-83ed-11680059cc34 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.771937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-50b1e57a-0fa5-4f9f-b348-59ba96fce323 req-25bf21b2-0eed-4cee-83ed-11680059cc34 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.792683 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-50b1e57a-0fa5-4f9f-b348-59ba96fce323 req-25bf21b2-0eed-4cee-83ed-11680059cc34 service nova] Creating event network-vif-unplugged:f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a for instance c7e89584-8d68-406a-bd7a-9551c624c2a2 on n-h2-862355-1 Oct 25 03:06:23.814524 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-50b1e57a-0fa5-4f9f-b348-59ba96fce323 req-25bf21b2-0eed-4cee-83ed-11680059cc34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076286 Oct 25 03:06:23.821250 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 788/1473] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:23.830889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e444cefe-00d4-47c6-b841-83577688ff16 req-546d8cdd-b4f2-4330-9791-8ba84e4cc7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3c693e-9810-4626-a56a-79c3426c7db2", "name": "network-vif-deleted", "tag": "e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:23.863373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:23.865616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e444cefe-00d4-47c6-b841-83577688ff16 req-546d8cdd-b4f2-4330-9791-8ba84e4cc7df service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.866530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e444cefe-00d4-47c6-b841-83577688ff16 req-546d8cdd-b4f2-4330-9791-8ba84e4cc7df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.867128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e444cefe-00d4-47c6-b841-83577688ff16 req-546d8cdd-b4f2-4330-9791-8ba84e4cc7df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.872795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8e5be6b-f356-4c91-aea2-818e34403495 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.763347 Oct 25 03:06:23.889714 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 686/1474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:23 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:23.898504 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e444cefe-00d4-47c6-b841-83577688ff16 req-546d8cdd-b4f2-4330-9791-8ba84e4cc7df service nova] Creating event network-vif-deleted:e4183cc4-aa1f-49c8-b6ff-c4bafb9b2fd4 for instance 9a3c693e-9810-4626-a56a-79c3426c7db2 on n-h1-862355-1 Oct 25 03:06:23.914979 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e444cefe-00d4-47c6-b841-83577688ff16 req-546d8cdd-b4f2-4330-9791-8ba84e4cc7df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090375 Oct 25 03:06:23.916767 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 789/1475] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:23.919548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:23.920637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:23.933262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:23.934300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:23.941571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.943739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.945259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.946479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.949210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.949617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.951530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.951893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.954659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:23.955456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:23.969842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:23.972000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.180824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.195937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.200891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.218673 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4842dd3-c76b-48d5-843f-eccd663d6296 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1533 microversion: 2.91 time: 0.292749 Oct 25 03:06:24.220326 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 790/1476] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:23 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1533 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:24.229537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:24.232294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:24.250434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.251451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.252131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.253387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.254049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.255186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.297192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.297948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.298538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.299545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lazy-loading 'fault' on Instance uuid 9a3c693e-9810-4626-a56a-79c3426c7db2 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:24.353933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409dbcd29454c9291a6fb6c5db01575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aaf5660aeb9490eb3667e3f17c3b369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.369407 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef5f0d8f-b92c-486f-b35a-8dc594d4917b tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 200 len: 1359 microversion: 2.1 time: 0.147828 Oct 25 03:06:24.370449 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 791/1477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:24 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:24.379992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:24.395084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:24.421433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.423443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.423987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.427366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.427974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.428496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.435600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.456485 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ebcf87a0-57b3-4b8b-99b5-3396d8860396 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1527 microversion: 2.1 time: 0.563012 Oct 25 03:06:24.465935 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 687/1478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:23 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1527 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:24.480514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:24.515832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:24.516903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:24.529397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.530535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.531692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.532751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.533475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.536683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.539783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] Lazy-loading 'services' on Instance uuid afaa770c-434c-4b63-8193-cbdf552be58a {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:24.562067 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6fc56b02-e1de-42eb-b920-e76835eba0ba tempest-UnshelveToHostMultiNodesTest-395758130 tempest-UnshelveToHostMultiNodesTest-395758130-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1938 microversion: 2.91 time: 0.190020 Oct 25 03:06:24.562674 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 792/1479] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:24 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1938 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:24.616400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:24.620012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:24.629120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:24.634663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.635854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.636588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.637561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.638489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.639094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.682725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:06:24.689308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.704730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.714252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:24.741296 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6966d8af-ad65-4f1c-8c4f-8722a026a015 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.226024 Oct 25 03:06:24.746653 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 688/1480] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:24 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:24.773857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:24.774686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:24.781257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.783451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.786840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.787749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.788294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.788777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.859572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-361941bd-839d-460e-9379-e69671e01d78 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "DELETE /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 204 len: 0 microversion: 2.91 time: 0.247440 Oct 25 03:06:24.861424 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 793/1481] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:06:24 2022] DELETE /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:06:24.875390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:24.878637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:24.906198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.906883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.907512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.908558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:24.909179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:24.909795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:24.995357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.010328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.012057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.019068 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e313d9a8-b62c-4cd4-b262-4414c4d9c461 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.150762 Oct 25 03:06:25.033329 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 794/1482] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:24 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:25.033329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:25.033329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:25.033759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.034314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.035024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.040332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.040332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.040332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.302925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.315950 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80a4c308-3f65-4c58-a796-f75ce3045410 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.294780 Oct 25 03:06:25.317644 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 795/1483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:25 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:25.398825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:25.399570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] [instance: 9a3c693e-9810-4626-a56a-79c3426c7db2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:25.408121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.410493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.411828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.413557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.414966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.415478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.435817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] HTTP exception thrown: Instance 9a3c693e-9810-4626-a56a-79c3426c7db2 could not be found. Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Request method failure captured: Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 HTTP/1.1 Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1JpnMcnPbuODdWzf60Czh2CGeDX9y1w8tfbADbaztg7XWxW4paFWgR3Kojif7-vKHlHrJvJNwlN4SgjCg1DK4fx9g5b9FWUjsguXJb0eXNz1KzE9bUSNAVycNVq2NPpz4k0jUiUq5ChBM8Eb2JaHB6dx1f1q_x2Jt8je6P3d43gahM Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3aaf5660aeb9490eb3667e3f17c3b369 Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-1021349698 Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:06:25.438668 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3aaf5660aeb9490eb3667e3f17c3b369"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3aaf5660aeb9490eb3667e3f17c3b369"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3aaf5660aeb9490eb3667e3f17c3b369", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3aaf5660aeb9490eb3667e3f17c3b369"}]}] Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-1021349698 Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3aaf5660aeb9490eb3667e3f17c3b369 Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-1021349698 Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-1021349698-project Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d409dbcd29454c9291a6fb6c5db01575 Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-1021349698-project Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9a3c693e-9810-4626-a56a-79c3426c7db2 could not be found. Oct 25 03:06:25.440095 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9a3c693e-9810-4626-a56a-79c3426c7db2'} Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3c693e-9810-4626-a56a-79c3426c7db2 could not be found. Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:06:25.440928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3c693e-9810-4626-a56a-79c3426c7db2 could not be found. Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3c693e-9810-4626-a56a-79c3426c7db2 could not be found. Oct 25 03:06:25.442641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:25.446509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Returning 404 to user: Instance 9a3c693e-9810-4626-a56a-79c3426c7db2 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:06:25.448047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-462454de-e739-48d3-9207-2e15d5515bba tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2" status: 404 len: 111 microversion: 2.1 time: 0.056807 Oct 25 03:06:25.455438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 796/1484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:25 2022] GET /compute/v2.1/servers/9a3c693e-9810-4626-a56a-79c3426c7db2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:06:25.470079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ee6ef48-8ad4-4b91-84aa-d6d7c9cee2f8 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] Calling method '.version_select at 0x7efd33892af0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:25.514341 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ee6ef48-8ad4-4b91-84aa-d6d7c9cee2f8 tempest-ServersTestJSON-1021349698 tempest-ServersTestJSON-1021349698-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425588197" status: 202 len: 0 microversion: 2.1 time: 0.057391 Oct 25 03:06:25.515612 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 797/1485] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425588197 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:06:25.523019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:25.523849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:25.535205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.537011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.537710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.538476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.539119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.539711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.545571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.565322 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02563f64-2c2e-4ca4-977e-f352014a76e0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.794856 Oct 25 03:06:25.567708 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 689/1486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:24 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:25.709961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e5e8325284e84a150158297faa105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426ba714f5c94b12a8b1be75aa6ae9f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.727046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1be99aae-b545-4968-a8b4-b78dbb40ecc3 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 200 len: 1309 microversion: 2.1 time: 0.208060 Oct 25 03:06:25.728751 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 798/1487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:25 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:25.779153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:25.780466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:25.789217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.790114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.790737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.791674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.792293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.792903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:25.950397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.964294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:25.969766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.977424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-83f79d48-039d-4d40-88f6-f5e434a78098 req-e8026521-5303-4e02-a4ea-b62bc41cbf14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e89584-8d68-406a-bd7a-9551c624c2a2", "name": "network-vif-deleted", "tag": "f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:25.977944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:25.994483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-83f79d48-039d-4d40-88f6-f5e434a78098 req-e8026521-5303-4e02-a4ea-b62bc41cbf14 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:25.994991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-83f79d48-039d-4d40-88f6-f5e434a78098 req-e8026521-5303-4e02-a4ea-b62bc41cbf14 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:25.996714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-83f79d48-039d-4d40-88f6-f5e434a78098 req-e8026521-5303-4e02-a4ea-b62bc41cbf14 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.003663 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-31318728-737c-42c7-9fa2-d21b00ab2cd5 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.230887 Oct 25 03:06:26.015214 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 690/1488] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:25 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:26.023484 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-83f79d48-039d-4d40-88f6-f5e434a78098 req-e8026521-5303-4e02-a4ea-b62bc41cbf14 service nova] Creating event network-vif-deleted:f1ed8f2d-6781-4cf6-b1c8-7e46a0bd7d0a for instance c7e89584-8d68-406a-bd7a-9551c624c2a2 on n-h2-862355-1 Oct 25 03:06:26.031407 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-83f79d48-039d-4d40-88f6-f5e434a78098 req-e8026521-5303-4e02-a4ea-b62bc41cbf14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057676 Oct 25 03:06:26.032267 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 799/1489] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:06:26.055318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:26.060292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:26.077434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.078697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.079494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.080611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.081601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.082284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.217056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:26.230701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:26.232930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ee1b4d10210450fb806f675fbfa8434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b5a4d4bc134bc6ad9680ef8c081889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:26.241315 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d53e2f9d-9a2c-45d3-89e5-3d6600fec652 tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 200 len: 1539 microversion: 2.91 time: 0.191477 Oct 25 03:06:26.242505 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 691/1490] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:26 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:26.341988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:26.344227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:26.354794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.355931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.357785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.360628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.361926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.362860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.586537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:26.603990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:26.606926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:26.618577 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7f12203-2e5c-4f20-8913-4c6063cc195a tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.281291 Oct 25 03:06:26.637870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:26.640585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.641095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.641537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.642477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.643114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.644664 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 800/1491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:26 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:26.649541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.755462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:26.756476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] [instance: c7e89584-8d68-406a-bd7a-9551c624c2a2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:26.772608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.773445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.776917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.778039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:26.778512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:26.778947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:26.805669 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] HTTP exception thrown: Instance c7e89584-8d68-406a-bd7a-9551c624c2a2 could not be found. Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Request method failure captured: Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 HTTP/1.1 Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1KPn_-C6i44VWfdmPckPGaSF4iR56DZhehdgfPjGO15a6R4O-_mkQJSDMdr2hHjz7IP3XohE1un-HuW5POhSqJkxRunvyW_FG4Wej3lqWGmuHYzDGCnN4aJyMaqaaJfP5kV-OPwRSY4MUB67wraakAhQf2lQ0iwXXXPW0mxQqbOClc Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 426ba714f5c94b12a8b1be75aa6ae9f5 Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:06:26.807487 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/426ba714f5c94b12a8b1be75aa6ae9f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/426ba714f5c94b12a8b1be75aa6ae9f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_426ba714f5c94b12a8b1be75aa6ae9f5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/426ba714f5c94b12a8b1be75aa6ae9f5"}]}] Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 426ba714f5c94b12a8b1be75aa6ae9f5 Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1308447195 Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-InstanceActionsNegativeTestJSON-1308447195-project Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 037e5e8325284e84a150158297faa105 Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1308447195-project Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance c7e89584-8d68-406a-bd7a-9551c624c2a2 could not be found. Oct 25 03:06:26.808891 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'c7e89584-8d68-406a-bd7a-9551c624c2a2'} Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e89584-8d68-406a-bd7a-9551c624c2a2 could not be found. Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:06:26.809710 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e89584-8d68-406a-bd7a-9551c624c2a2 could not be found. Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e89584-8d68-406a-bd7a-9551c624c2a2 could not be found. Oct 25 03:06:26.810976 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:06:26.814419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] Returning 404 to user: Instance c7e89584-8d68-406a-bd7a-9551c624c2a2 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:06:26.820212 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f42ed31-4a9a-4c51-b131-cea5a59b3b44 tempest-InstanceActionsNegativeTestJSON-1308447195 tempest-InstanceActionsNegativeTestJSON-1308447195-project] 10.222.0.36 "GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2" status: 404 len: 111 microversion: 2.1 time: 0.068469 Oct 25 03:06:26.825437 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 801/1492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:26 2022] GET /compute/v2.1/servers/c7e89584-8d68-406a-bd7a-9551c624c2a2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:06:26.929176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:26.939251 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84ee6dbd-903f-478c-8051-01bd4e0ac2c1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.347647 Oct 25 03:06:26.939858 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 692/1493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:26 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:27.040601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:27.041883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:27.062959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.065495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.066126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:27.068062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.069959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.071009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:27.214854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:27.235812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:27.237295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:27.259311 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-070db9d2-f590-4ae0-b96a-a7fe72baa37c tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.220672 Oct 25 03:06:27.283176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 802/1494] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:27 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:27.293578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:27.294053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] [instance: afaa770c-434c-4b63-8193-cbdf552be58a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:27.305427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.305988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.306428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:27.307131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.310700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.313508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:27.341073 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] HTTP exception thrown: Instance afaa770c-434c-4b63-8193-cbdf552be58a could not be found. Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Request method failure captured: Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a HTTP/1.1 Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1H3yjdWEDhbcUlXjjOxmfunDzCcN6tPJi3HGIYh-HzN11yh4MbqDQuNaA0lg4FXCtvKpNgUbSJe0EvJD0haFdb7U5klSFNaZn4uDbcFYonLfA7UAgKLsdYvzbDgbDfXoWYg0Lhc6PhKs-OrHG75oHJFpeFrQ2QnMJciWiFYdG6wCDo Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.91 Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 49b5a4d4bc134bc6ad9680ef8c081889 Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1280838926 Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:06:27.351578 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/49b5a4d4bc134bc6ad9680ef8c081889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/49b5a4d4bc134bc6ad9680ef8c081889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_49b5a4d4bc134bc6ad9680ef8c081889", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/49b5a4d4bc134bc6ad9680ef8c081889"}]}] Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1280838926 Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 49b5a4d4bc134bc6ad9680ef8c081889 Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1280838926 Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-UnshelveToHostMultiNodesTest-1280838926-project Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5ee1b4d10210450fb806f675fbfa8434 Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1280838926-project Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance afaa770c-434c-4b63-8193-cbdf552be58a could not be found. Oct 25 03:06:27.353159 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'afaa770c-434c-4b63-8193-cbdf552be58a'} Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afaa770c-434c-4b63-8193-cbdf552be58a could not be found. Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:06:27.354037 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afaa770c-434c-4b63-8193-cbdf552be58a could not be found. Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afaa770c-434c-4b63-8193-cbdf552be58a could not be found. Oct 25 03:06:27.355287 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:06:27.356500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] Returning 404 to user: Instance afaa770c-434c-4b63-8193-cbdf552be58a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:06:27.356500 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58f20a75-5a44-456c-963f-106d1fbdc92b tempest-UnshelveToHostMultiNodesTest-1280838926 tempest-UnshelveToHostMultiNodesTest-1280838926-project] 10.222.0.36 "GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a" status: 404 len: 111 microversion: 2.91 time: 0.065017 Oct 25 03:06:27.356690 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 693/1495] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:27 2022] GET /compute/v2.1/servers/afaa770c-434c-4b63-8193-cbdf552be58a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:06:27.651777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:27.653993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:27.661009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.661955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.662583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:27.663635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.664515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.665155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:27.964301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:27.964915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:27.975109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.976122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.976720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:27.979505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:27.980637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:27.981232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:28.081747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:28.096374 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9a8393f-16a3-49e6-8037-da445b7033b9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.449478 Oct 25 03:06:28.097585 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 803/1496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:27 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:28.105445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a5d2e5de-04da-4f7e-ab48-21921e9b4e56 req-0c3df931-85c3-494a-89e5-d4bd5aed4582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337c82ae-8606-4611-bfdf-90396ac6f490", "tag": "2e3271af-5085-43a4-9ba1-50a718ba284f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:28.115999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a5d2e5de-04da-4f7e-ab48-21921e9b4e56 req-0c3df931-85c3-494a-89e5-d4bd5aed4582 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:28.116843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a5d2e5de-04da-4f7e-ab48-21921e9b4e56 req-0c3df931-85c3-494a-89e5-d4bd5aed4582 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:28.117428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a5d2e5de-04da-4f7e-ab48-21921e9b4e56 req-0c3df931-85c3-494a-89e5-d4bd5aed4582 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:28.138786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a5d2e5de-04da-4f7e-ab48-21921e9b4e56 req-0c3df931-85c3-494a-89e5-d4bd5aed4582 service nova] Creating event network-changed:2e3271af-5085-43a4-9ba1-50a718ba284f for instance 337c82ae-8606-4611-bfdf-90396ac6f490 on n-h1-862355-1 Oct 25 03:06:28.152412 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a5d2e5de-04da-4f7e-ab48-21921e9b4e56 req-0c3df931-85c3-494a-89e5-d4bd5aed4582 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053277 Oct 25 03:06:28.153578 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 804/1497] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:28.291346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:28.291989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:28.302728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:28.305027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:28.305538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:28.306009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:28.306732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:28.307194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:28.307627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:28.318985 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5c8d47b-711b-420e-93ac-022e863e56da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.359018 Oct 25 03:06:28.320299 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 694/1498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:27 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:28.346360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:28.536899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=10 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:28.731258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:28.741397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:28.750373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:28.765870 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-896371ff-6ae5-4c48-b4f3-fea414b568e6 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.479785 Oct 25 03:06:28.780360 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 805/1499] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:28 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:29.120599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:29.121208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:29.133956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:29.134447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:29.134881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:29.135588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:29.140506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:29.144017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:29.344215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:29.345704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:29.356307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:29.360797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:29.361519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:29.363996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:29.365854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:29.366591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:29.372597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:29.388641 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dee50c8a-7698-46de-941a-e7f5ec8a3ddd tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.269215 Oct 25 03:06:29.390452 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 695/1500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:29 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:29.805786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:29.806481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:29.816651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:29.819112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:29.819812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:29.821550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:29.822997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:29.825917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:29.908024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:29.917469 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-49483551-07b6-46c4-a26b-cbaf88204ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.577394 Oct 25 03:06:29.923344 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 806/1501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:29 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:30.220146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:30.233499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:30.238057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:30.251013 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fdbb45c6-1951-4267-91ad-8d7475953f14 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.450547 Oct 25 03:06:30.253493 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 696/1502] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:29 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:30.416457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:30.417908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:30.428145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:30.429469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:30.430322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:30.431364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:30.432287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:30.433189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:30.947666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:30.950211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:30.970859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:30.975188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:30.976307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:30.977476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:30.980517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:30.983334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:31.122866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:31.136083 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b1f2248-4ad3-4453-b0fe-2bb668e93da8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.724938 Oct 25 03:06:31.143712 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 807/1503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:30 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:31.246106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:31.258872 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4244c06-d001-4d0e-a636-1980139e96b7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.317272 Oct 25 03:06:31.259817 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 697/1504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:30 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:31.286936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:31.287914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:31.297440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:31.301486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:31.302723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:31.303801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:31.305111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:31.309792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:31.497297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:31.521041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:31.524202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:31.531818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6f794da-ff8e-4ed4-a8e0-f637228159ba tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.251271 Oct 25 03:06:31.533139 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 808/1505] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:31 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:32.170187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:32.170820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:32.184968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:32.185478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:32.188893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:32.189727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:32.190222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:32.191624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:32.285083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:32.285718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:32.303401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:32.303910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:32.313942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:32.315197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:32.315613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:32.316058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:32.813364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:32.828302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:32.831368 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9f77e04-c5d1-4416-a3f5-55ff0ddc9fc5 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.664054 Oct 25 03:06:32.832785 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 698/1506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:32 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:32.838002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:32.838158 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-938e5538-e1c9-4faf-8ce8-0d5ed1930f76 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.558481 Oct 25 03:06:32.847739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 809/1507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:32 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:32.854292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:32.867495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:32.868002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:32.868443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:32.869197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:32.869610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:32.878588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:33.035651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:33.046883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:33.048346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:33.063077 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d377752-7e1d-44c3-816a-b084aef47d02 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.227267 Oct 25 03:06:33.082204 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 699/1508] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:32 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:33.571047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1322743370", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9f081643-3b9b-4dc0-a846-58f41d0a3888"}], "block_device_mapping_v2": [{"uuid": "1fe0f4d9-c703-4844-9dac-55362e3adc0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:33.687861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a3c26bc3-e053-4d38-be0e-d4667f174d33 req-57df808e-8654-4461-a0cd-710ebc465bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337c82ae-8606-4611-bfdf-90396ac6f490", "name": "network-vif-plugged", "status": "completed", "tag": "2e3271af-5085-43a4-9ba1-50a718ba284f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:33.731556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a3c26bc3-e053-4d38-be0e-d4667f174d33 req-57df808e-8654-4461-a0cd-710ebc465bf2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:33.734682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a3c26bc3-e053-4d38-be0e-d4667f174d33 req-57df808e-8654-4461-a0cd-710ebc465bf2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:33.741781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a3c26bc3-e053-4d38-be0e-d4667f174d33 req-57df808e-8654-4461-a0cd-710ebc465bf2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:33.796849 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a3c26bc3-e053-4d38-be0e-d4667f174d33 req-57df808e-8654-4461-a0cd-710ebc465bf2 service nova] Creating event network-vif-plugged:2e3271af-5085-43a4-9ba1-50a718ba284f for instance 337c82ae-8606-4611-bfdf-90396ac6f490 on n-h1-862355-1 Oct 25 03:06:33.820105 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a3c26bc3-e053-4d38-be0e-d4667f174d33 req-57df808e-8654-4461-a0cd-710ebc465bf2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130430 Oct 25 03:06:33.822997 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 700/1509] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:06:33.863663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] validate_networks() for [('9f081643-3b9b-4dc0-a846-58f41d0a3888', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:06:33.877415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:33.878393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:33.891712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:33.896822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:33.898953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:33.902196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:33.902776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:33.903293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:34.451671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:34.474097 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-979fb073-2c4a-45d4-852d-ab2971252f8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.601825 Oct 25 03:06:34.474962 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 701/1510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:33 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:34.481819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:34.482693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:34.511388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:34.511658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:34.512055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:34.512864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:34.513287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:34.513837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:34.780199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:34.799553 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9eea7a46-4195-486c-9aaf-6f01dc8942f4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1308 microversion: 2.1 time: 0.323306 Oct 25 03:06:34.811811 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 702/1511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:34 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:34.827425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:34.827975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:34.834873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:34.843710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:34.844204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:34.844650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:34.845368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:34.846990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:34.847439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:35.226734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:35.240128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:35.247043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:35.266637 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd56bb98-0e4b-4890-81ed-1575c51ecf8f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.445316 Oct 25 03:06:35.267103 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 703/1512] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:34 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:35.327023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:06:35.327575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:06:35.327910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:06:35.328324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:06:35.328742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:06:35.346071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:35.346567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:35.347012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:35.347743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:35.348204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:35.349465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:35.403463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:06:35.416443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Getting quotas for user f7fc1bae87d741e58f4e2182796f2df3 and project a9eaf27614124019998010f834321c31. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:06:35.582011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-325174559", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:35.588839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:06:35.591196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fe0f4d9-c703-4844-9dac-55362e3adc0d',volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:06:35.703877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:06:35.848280 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c08ba9d-3e0c-46df-84ff-a35441a2674f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.285110 Oct 25 03:06:35.850592 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 810/1513] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:06:35.856079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:35.857940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:35.872461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:35.874888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:35.875438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:35.878608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:35.879187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:35.879772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:35.925225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:36.183300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:36.199469 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b542b71c-9ddf-4f6c-a528-1a8d12ff76f3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.347240 Oct 25 03:06:36.200063 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 811/1514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:35 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:36.213259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:36.214413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:36.229501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.229501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.229501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.229501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.229856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.229856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.293523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:06:36.295687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:06:36.295687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:06:36.295687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:06:36.295687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:06:36.311366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.311981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.312427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.322377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.323721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.324420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.352287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Getting quotas for project 766fb169325c4ab0890e45b58cb01742. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:06:36.360401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Getting quotas for user 00b64159df9c4f3a888e040719474c5f and project 766fb169325c4ab0890e45b58cb01742. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:06:36.382350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:06:36.390130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:06:36.485560 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d1df6976-02cb-42b9-ad1f-660d1d6a6986 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217462 Oct 25 03:06:36.498111 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 704/1515] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:06:36.511316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e367159b-10c1-459f-b568-10639fe76ca8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:36.512209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e367159b-10c1-459f-b568-10639fe76ca8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:36.569903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:36.604529 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-827d899f-0390-488e-b785-fddbec02d37c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1488 microversion: 2.1 time: 0.402251 Oct 25 03:06:36.606333 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 812/1516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:36 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1488 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:36.624074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:36.624344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:36.640810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.642447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.645641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.647434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.650753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e367159b-10c1-459f-b568-10639fe76ca8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:36.654504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.655186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.662855 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e367159b-10c1-459f-b568-10639fe76ca8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1053 microversion: 2.1 time: 0.162907 Oct 25 03:06:36.663909 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 705/1517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:36 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1053 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:36.670339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4eead828-e0ac-4b5a-92d6-5b1ccead9b2a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:36.671293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4eead828-e0ac-4b5a-92d6-5b1ccead9b2a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:36.815517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4eead828-e0ac-4b5a-92d6-5b1ccead9b2a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:36.841193 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4eead828-e0ac-4b5a-92d6-5b1ccead9b2a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1213 microversion: 2.1 time: 0.175792 Oct 25 03:06:36.843739 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 706/1518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:36 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:36.859609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:36.861988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:36.872191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:36.880928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.881905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.882547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.883563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:36.883926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:36.884630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:36.885361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:36.891615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:36.923619 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-71714134-11f8-4f71-9895-b0e7b0ec56ca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.316673 Oct 25 03:06:36.927119 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 813/1519] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:36 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:36.949178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lazy-loading 'flavor' on Instance uuid 337c82ae-8606-4611-bfdf-90396ac6f490 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:37.114959 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3822b71d-79af-4c0b-9176-56107c9258c6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490/action" status: 202 len: 0 microversion: 2.1 time: 0.265815 Oct 25 03:06:37.119737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 707/1520] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:06:36 2022] POST /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:06:37.125406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:37.126446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:37.136378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.136876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.137316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.138077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.138530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.138955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.227147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:37.228547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:37.238327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.242893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.244285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.246578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.247927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.249218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.378529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:37.398883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44a1c667-900d-44ab-8681-d57084189570 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1496 microversion: 2.1 time: 0.278211 Oct 25 03:06:37.402850 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 814/1521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:37 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1496 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:37.492466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:37.507081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3db054df-f1eb-4aa4-8f6e-4ef98c502132 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.287473 Oct 25 03:06:37.508076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 708/1522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:37 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:37.686807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:37.687422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:37.700037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.700550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.701251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.705908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.705908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.705908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.802676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:37.814573 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1c6b1609-b4d1-4481-ae65-5315b85c5b60 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1095 microversion: 2.1 time: 0.131803 Oct 25 03:06:37.816795 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 815/1523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:37 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1095 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:37.867315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:37.868259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:37.889532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.892097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.894195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.895166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.896725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.897387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.956683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:37.957397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:37.977279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.984444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.985612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:37.986818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:37.987444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:37.988037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:38.018073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:38.022204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:38.030419 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0581a6e9-9232-47ae-863a-37142e3bfe63 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1217 microversion: 2.1 time: 0.168895 Oct 25 03:06:38.031022 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 709/1524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:37 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:38.104985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:38.115996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:38.117766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:38.124515 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9d07c4f-3036-4f54-841f-96af7dc4690f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1446 microversion: 2.75 time: 0.172409 Oct 25 03:06:38.125526 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 816/1525] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:37 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:06:38.423087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:38.424204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:38.439406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:38.440234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:38.440744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:38.441633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:38.442228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:38.442664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:38.533087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:38.534051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:38.540787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:38.541589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:38.542497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:38.543606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:38.544614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:38.545172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:38.664801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:38.678121 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b8f5dfc-5f79-47d8-aaa3-74aaa55635ae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 200 len: 1479 microversion: 2.1 time: 0.258656 Oct 25 03:06:38.684434 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 710/1526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:38 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 1479 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:38.713232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1425129070"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:38.717351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:38.733869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:38.736194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:38.739822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:38.744192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:38.745665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:38.747420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:38.747912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:38.763875 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b84bee08-8b69-49cb-9021-93dc5a3c5e6f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.232655 Oct 25 03:06:38.764715 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 817/1527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:38 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:39.253915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6878d5f-56c3-4cf0-b171-c08a57367971 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490/action" status: 202 len: 0 microversion: 2.1 time: 0.547353 Oct 25 03:06:39.262843 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 711/1528] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:06:38 2022] POST /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:06:39.265035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:39.266068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:39.269668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:39.271003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:39.274502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.275289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.276780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:39.276780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.277508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.278197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:39.279298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.279890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.280396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:39.281248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.281753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.282316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:39.367300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:39.387606 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16c2e06a-5cf9-4c52-a47b-658a27dd870d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1159 microversion: 2.1 time: 0.539791 Oct 25 03:06:39.389233 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 818/1529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:38 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1159 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:39.394204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:39.395073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:39.408377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.410624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.413397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:39.414639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.415230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:39.416191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.417849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:39.428676 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b9108ec-78c6-4847-94b9-04b2c0d248db tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1265 microversion: 2.1 time: 0.163565 Oct 25 03:06:39.431509 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 712/1530] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:39 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:39.441104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-acaca913-65c8-4c82-8d35-255891ef694d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd333b1160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:39.524862 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-acaca913-65c8-4c82-8d35-255891ef694d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.091815 Oct 25 03:06:39.525666 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 713/1531] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:39 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:39.585404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:39.594153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:39.595875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:39.602880 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b7f574f4-43e7-4c07-b8f2-83413095b2b4 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1452 microversion: 2.75 time: 0.212355 Oct 25 03:06:39.603609 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 819/1532] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:39 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:39.791946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:39.793394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:39.801187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.802445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.803132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:39.804082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:39.805107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:39.806005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:40.064935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:40.078087 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-246a0b76-66df-4f77-8a9b-ffc87f1f61f7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.290733 Oct 25 03:06:40.079524 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 714/1533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:39 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:40.412265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:40.413608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:40.420426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:40.421174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:40.421863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:40.422782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:40.423473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:40.424114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:40.463432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:40.464369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:40.480113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:40.481818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:40.482405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:40.483635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:40.486282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:40.486752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:40.654109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:40.662706 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7374f4ed-2242-4b3c-9038-706ec1341d93 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1265 microversion: 2.1 time: 0.209363 Oct 25 03:06:40.676037 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 715/1534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:40 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:40.677928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:40.691296 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-11c204ac-c0e4-4fb6-b802-8608ac989e2a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1159 microversion: 2.1 time: 0.282871 Oct 25 03:06:40.691454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa3a89c1-219a-4458-927a-775ba0f6b490 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3351c820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:40.695284 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 820/1535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:40 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1159 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:40.721922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:40.722743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:40.741337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:40.741880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:40.742331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:40.750285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:40.750959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:40.755886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:40.787293 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa3a89c1-219a-4458-927a-775ba0f6b490 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.107926 Oct 25 03:06:40.789951 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 716/1536] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:40 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:40.935301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:40.964161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:40.968462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:40.984828 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-238774a4-3472-46b7-aea8-2036cc76f461 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1452 microversion: 2.75 time: 0.287359 Oct 25 03:06:40.987118 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 821/1537] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:40 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1452 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:41.104929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:41.105806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:41.127087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:41.127863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:41.128435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:41.129282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:41.130469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:41.130966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:41.474716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:41.490734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-24c410e0-9a00-4b01-8838-dec24201f2ec tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.391134 Oct 25 03:06:41.505714 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 717/1538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:41 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:41.691583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:41.693105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:41.712019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:41.713180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:41.715308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:41.718379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:41.719146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:41.720687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:41.722444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:41.723073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:41.738349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:41.739648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:41.742108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:41.743019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:41.744495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:41.744936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:42.340899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:42.354480 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8b6f15fd-b332-4e76-b0d2-c78b98048ba8 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1273 microversion: 2.1 time: 0.666542 Oct 25 03:06:42.356942 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 822/1539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:41 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1273 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:42.361987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ac4a32d-5dc4-477d-8830-730c31f76f2a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33a5aca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:42.463137 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ac4a32d-5dc4-477d-8830-730c31f76f2a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.104877 Oct 25 03:06:42.463730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 823/1540] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:42 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:42.484658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:42.487879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:42.513714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:42.516612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:42.521250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:42.527263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:42.527934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:42.529329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:42.639693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:42.663427 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-918d3210-83d5-4b24-87ef-129724a08ec7 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1211 microversion: 2.1 time: 0.946125 Oct 25 03:06:42.678960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 718/1541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:41 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1211 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:42.688924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:42.689809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:42.706342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:42.707104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:42.708208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:42.709601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:42.711671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:42.720400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:42.839139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:42.861246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:42.863961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:42.887679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:42.916796 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45a3410a-7d87-4c17-86d9-9d149e374cca tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1452 microversion: 2.75 time: 0.440584 Oct 25 03:06:42.918294 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 824/1542] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:42 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1452 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:43.175511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c9115917-627c-4f88-b7a1-924b5cd50e36 req-28c3c912-2aad-44a8-967f-906549d0771b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337c82ae-8606-4611-bfdf-90396ac6f490", "name": "network-vif-plugged", "status": "completed", "tag": "2e3271af-5085-43a4-9ba1-50a718ba284f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:43.198961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c9115917-627c-4f88-b7a1-924b5cd50e36 req-28c3c912-2aad-44a8-967f-906549d0771b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:43.199468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c9115917-627c-4f88-b7a1-924b5cd50e36 req-28c3c912-2aad-44a8-967f-906549d0771b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:43.199918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c9115917-627c-4f88-b7a1-924b5cd50e36 req-28c3c912-2aad-44a8-967f-906549d0771b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:43.226097 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c9115917-627c-4f88-b7a1-924b5cd50e36 req-28c3c912-2aad-44a8-967f-906549d0771b service nova] Creating event network-vif-plugged:2e3271af-5085-43a4-9ba1-50a718ba284f for instance 337c82ae-8606-4611-bfdf-90396ac6f490 on n-h1-862355-1 Oct 25 03:06:43.252759 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c9115917-627c-4f88-b7a1-924b5cd50e36 req-28c3c912-2aad-44a8-967f-906549d0771b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091174 Oct 25 03:06:43.258751 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 825/1543] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:06:43.385919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:43.387188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:43.417698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:43.425749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:43.426212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:43.427350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:43.433054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:43.437310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:44.218556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:44.234432 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03e143c9-aed8-4c1d-9a78-52fb2c77eaf7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1271 microversion: 2.1 time: 0.853980 Oct 25 03:06:44.250434 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 826/1544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:43 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1271 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:44.261251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-156cbf69-1091-498d-848d-27169be5e7a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33ed7670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:44.351020 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-156cbf69-1091-498d-848d-27169be5e7a7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.099339 Oct 25 03:06:44.352177 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 827/1545] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:44 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:44.364805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:44.370255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:44.389038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:44.389549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:44.390239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:44.391108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:44.391851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:44.392505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:44.941887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:44.976049 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c6fcb753-c6e5-4c97-8c5b-97667eea9b41 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 2.294754 Oct 25 03:06:44.978510 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 719/1546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:42 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:44.996891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:45.002616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:45.027698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:45.032709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:45.033374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:45.036392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:45.037096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:45.041943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:45.274308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:45.286891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:45.290406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:45.305529 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b10d04f-6080-4205-8f10-04ce722cdd85 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1437 microversion: 2.75 time: 0.324518 Oct 25 03:06:45.306735 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 720/1547] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:44 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1437 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:45.326157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:45.338155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:45.339221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:45.342040 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed1f59d3-3ae2-42ea-8fd8-066265e62b2e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1211 microversion: 2.1 time: 0.988508 Oct 25 03:06:45.342661 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 828/1548] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:44 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1211 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:45.372551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:45.378045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:45.378556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:45.379264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:45.379400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:45.381013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:45.381609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:45.436516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:45.655440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:45.686936 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-942dde0d-7d70-487a-ba9f-ca1506b12066 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1271 microversion: 2.1 time: 0.367751 Oct 25 03:06:45.691121 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 721/1549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:45 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:45.712143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6232fee-cd50-45fc-9196-3517004e78b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33b0dca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:45.822213 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6232fee-cd50-45fc-9196-3517004e78b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.129694 Oct 25 03:06:45.822807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 722/1550] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:45 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:45.862825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:45.867141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:45.882751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:45.888764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:45.889576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:45.890788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:45.891499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:45.892156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:46.004249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:46.005469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:46.019936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:46.021546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:46.022033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:46.042595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:46.050654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:46.051205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:46.075672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:06:46.079133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:06:46.079653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:06:46.080065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:06:46.080494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:06:46.191416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:46.285360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:46.306584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:46.311069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:46.311576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:46.314507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:46.316645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:46.317140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:46.339304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:46.758086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:46.823161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:46.824831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-829e198a-0422-44f2-895e-6f4c681c2f3e tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5/action" status: 202 len: 1940 microversion: 2.75 time: 1.481084 Oct 25 03:06:46.854259 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 829/1551] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:06:45 2022] POST /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5/action => generated 1940 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 25 03:06:46.875378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:46.876022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:46.896576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:46.902758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:46.903457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:46.904375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:46.905253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:46.906601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:46.939474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:46.952968 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a2334e42-9a49-42c1-ae01-f6e0c59591d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.952778 Oct 25 03:06:46.969818 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 723/1552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:45 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:47.003096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:47.004130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:47.047827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:47.048518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:47.053019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:47.055430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:47.057602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:47.058211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:47.223102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:47.231955 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ea4b162-0c92-4d13-8643-ef41224bec7f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1211 microversion: 2.1 time: 0.376490 Oct 25 03:06:47.240669 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 830/1553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:46 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1211 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:47.269152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:47.276546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9112166a-7bd0-4a68-a596-9467e7eac7a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd382f7ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:47.288966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18bcb997-8bce-49d6-83ef-89c7043f914d tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1271 microversion: 2.1 time: 0.311682 Oct 25 03:06:47.290374 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 724/1554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:46 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1271 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:47.307393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:47.315631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:47.340078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:47.340730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:47.346643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:47.347774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:47.348455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:47.367159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:47.384457 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9112166a-7bd0-4a68-a596-9467e7eac7a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.142238 Oct 25 03:06:47.400880 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 831/1555] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:47 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:47.986514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:47.987133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:48.007526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:48.010287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:48.013072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:48.015582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:48.018807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:48.022530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:48.044331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:48.086771 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e2bfd970-d79f-42f7-bc11-e3ce628b90d0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.793066 Oct 25 03:06:48.090318 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 725/1556] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:47 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:48.261509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:48.262565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:48.283903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:48.285215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:48.288573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:48.295539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:48.298887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:48.303456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:48.408516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:48.423387 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-72606ba3-72c4-4440-ab64-a92078e65bf4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.442775 Oct 25 03:06:48.446645 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 832/1557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:47 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:48.459920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:48.462818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:48.485262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:48.487984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:48.496826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:48.499864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:48.500532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:48.504280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:48.766196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:48.796157 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a55e8b16-d45e-4bfc-a004-256f54d97caa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.341669 Oct 25 03:06:48.799511 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 833/1558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:48 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:48.821003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c70feb9-d5c8-497c-a5f8-293622841cf9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd339f7ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:48.923600 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c70feb9-d5c8-497c-a5f8-293622841cf9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.122689 Oct 25 03:06:48.924200 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 834/1559] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:48 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:48.945300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c1503a61-adbd-4ac1-aa69-6cb8ef8876dc req-e57eb1dc-436f-450f-bdcf-e40999ac1657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc326aa7-64de-4b71-9ae6-29e007d2ae91", "tag": "675a386a-407b-4b7e-adff-05d0c86c1505"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:48.981802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1503a61-adbd-4ac1-aa69-6cb8ef8876dc req-e57eb1dc-436f-450f-bdcf-e40999ac1657 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:48.984739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1503a61-adbd-4ac1-aa69-6cb8ef8876dc req-e57eb1dc-436f-450f-bdcf-e40999ac1657 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:48.985207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1503a61-adbd-4ac1-aa69-6cb8ef8876dc req-e57eb1dc-436f-450f-bdcf-e40999ac1657 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:49.016963 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c1503a61-adbd-4ac1-aa69-6cb8ef8876dc req-e57eb1dc-436f-450f-bdcf-e40999ac1657 service nova] Creating event network-changed:675a386a-407b-4b7e-adff-05d0c86c1505 for instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 on n-h2-862355-1 Oct 25 03:06:49.033198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c1503a61-adbd-4ac1-aa69-6cb8ef8876dc req-e57eb1dc-436f-450f-bdcf-e40999ac1657 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107764 Oct 25 03:06:49.042173 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 835/1560] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:49.141091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:49.147515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:49.173283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:49.176200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:49.177368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:49.183509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:49.184025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:49.184469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:49.445161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:49.501019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:49.513389 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1fcb4bbb-c523-450e-b66c-64553ab72f53 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.396476 Oct 25 03:06:49.515455 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-431d053d-f30a-404c-a9f8-b419f59a77f9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1211 microversion: 2.1 time: 1.252511 Oct 25 03:06:49.516010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 836/1561] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:49 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:49.516796 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 726/1562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:48 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1211 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:49.529157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:49.530130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:49.556141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:49.556650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:49.557087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:49.557833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:49.558292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:49.558717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:49.828154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:49.830321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:49.849876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:49.856443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:49.861546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:49.862665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:49.867568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:49.871106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:50.850134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:50.866751 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b480061c-87cd-411b-9e2b-481dec10d333 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 1.349612 Oct 25 03:06:50.877719 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 837/1563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:49 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:50.877719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe1039c4-f014-4594-a6c6-5c9c9a2e648b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd334925e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:51.021821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe1039c4-f014-4594-a6c6-5c9c9a2e648b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.149959 Oct 25 03:06:51.035493 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 838/1564] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:50 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:51.045652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:51.046299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:51.070579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:51.071073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:51.071511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:51.072223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:51.072678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:51.073105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:51.273933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:51.284194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:51.289237 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99e9dae7-90cf-4519-9f5f-7bf861739d47 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 1.465258 Oct 25 03:06:51.308665 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 727/1565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:49 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:51.316759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:51.320824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:51.337515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:51.338533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:51.339166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:51.339905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:51.340490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:51.340926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:51.465866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:51.476022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d674e0c-30bd-428a-8491-6b8b9e48259c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1211 microversion: 2.1 time: 0.439795 Oct 25 03:06:51.518778 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 839/1566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:51 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1211 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:51.660184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:51.709269 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ed9ae0f-3881-4e3f-af30-ce469aefd21d tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.399378 Oct 25 03:06:51.712191 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 728/1567] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:51 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:51.897165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:51.897865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:51.907478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:51.914171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:51.914705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:51.915672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:51.918644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:51.919466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:52.038516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81309225-ead7-4e4c-90ce-35b3d0656242 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33fb9dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:52.125943 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81309225-ead7-4e4c-90ce-35b3d0656242 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.093023 Oct 25 03:06:52.126879 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 729/1568] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:52 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:52.321770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:52.322525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:52.350206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:52.350679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:52.351129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:52.351860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:52.352466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:52.352768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:52.413211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:52.424666 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b418f17-1b5e-4a34-8967-2ed031a59bdc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1723 microversion: 2.1 time: 0.532183 Oct 25 03:06:52.441239 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 840/1569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:51 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:06:52.527298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:52.528442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:52.544064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:52.562518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:52.563113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:52.563879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:52.564384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:52.564817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:53.613210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:53.622172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df488357-5806-4f30-aec4-35a6ac4b210b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1211 microversion: 2.1 time: 1.101420 Oct 25 03:06:53.655329 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 841/1570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:52 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1211 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:53.676189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:53.677882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:53.727043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:53.736066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:53.740262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:53.748924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:53.752200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:53.756297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:54.047455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:54.129514 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32c9e30d-f90b-4ed3-b6d3-1abdf3a6e75a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.472688 Oct 25 03:06:54.137975 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 842/1571] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:53 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:54.148359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-784deac3-4457-4597-9721-38418f79a039 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd339a3940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:54.256385 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-784deac3-4457-4597-9721-38418f79a039 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.116902 Oct 25 03:06:54.258905 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 843/1572] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:54 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:54.271104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:54.281784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:54.303270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:54.303898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:54.305958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:54.307652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:54.307652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:54.330361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:54.590068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:54.613524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-88be9cfc-dca0-40d7-9fa3-197c9010c9ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 2.296348 Oct 25 03:06:54.614890 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 730/1573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:52 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:54.651879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:54.652670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:54.663712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:54.664166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:54.668600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:54.670328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:54.670989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:54.684690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:54.842064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:54.875165 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47673a84-be27-40d3-9871-5fd21ccb4308 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1700 microversion: 2.1 time: 0.600815 Oct 25 03:06:54.876124 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 844/1574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:54 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1700 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:54.884949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7f8ef6ca-7088-41f1-a430-cd1a387afc84 req-dcca71bc-8038-4028-90f2-d253ef091abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83fe5be-4754-4049-8a60-59531ab84a12", "tag": "e47a20f6-ebd7-4436-9758-de1d150f5e7e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:54.925250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f8ef6ca-7088-41f1-a430-cd1a387afc84 req-dcca71bc-8038-4028-90f2-d253ef091abc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:54.927181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f8ef6ca-7088-41f1-a430-cd1a387afc84 req-dcca71bc-8038-4028-90f2-d253ef091abc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:54.927878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f8ef6ca-7088-41f1-a430-cd1a387afc84 req-dcca71bc-8038-4028-90f2-d253ef091abc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:54.957498 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7f8ef6ca-7088-41f1-a430-cd1a387afc84 req-dcca71bc-8038-4028-90f2-d253ef091abc service nova] Creating event network-changed:e47a20f6-ebd7-4436-9758-de1d150f5e7e for instance c83fe5be-4754-4049-8a60-59531ab84a12 on n-h2-862355-1 Oct 25 03:06:55.005386 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7f8ef6ca-7088-41f1-a430-cd1a387afc84 req-dcca71bc-8038-4028-90f2-d253ef091abc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127217 Oct 25 03:06:55.023324 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 845/1575] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:55.029006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c62acd48-ddce-4162-ace0-54cac7cc3d67 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:55.046814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c62acd48-ddce-4162-ace0-54cac7cc3d67 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:55.047732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c62acd48-ddce-4162-ace0-54cac7cc3d67 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:55.048426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c62acd48-ddce-4162-ace0-54cac7cc3d67 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:55.120508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c62acd48-ddce-4162-ace0-54cac7cc3d67 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Going to try to start instance {{(pid=120562) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 25 03:06:55.215268 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c62acd48-ddce-4162-ace0-54cac7cc3d67 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action" status: 202 len: 0 microversion: 2.1 time: 0.190310 Oct 25 03:06:55.216182 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 846/1576] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:06:55 2022] POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:06:55.361110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb14a376-8324-4eef-bcd3-72aa5f95f80a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Action: 'create', calling method: .version_select at 0x7efd339f7700>, body: {"keypair": {"name": "tempest-keypair-365954930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjzXMeQu/kPsPSFFlcgP4ZK4vQC47L0cBldttyiFpMR+jsfR+exrMRmaxEp9mOlRk2ZxEeV2goWokl5pjrQ7ReIx/3ppAEfNhz/lTpSA5yfkf5LXPyxAH+KmZtyX8klsA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:55.429907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-eb14a376-8324-4eef-bcd3-72aa5f95f80a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Getting quotas for project 3ad24b576dc24c1f8122c207f017242a. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:06:55.445917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-eb14a376-8324-4eef-bcd3-72aa5f95f80a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Getting quotas for user bd5e91b8c87e42d581050ae86062276f and project 3ad24b576dc24c1f8122c207f017242a. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:06:55.532362 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb14a376-8324-4eef-bcd3-72aa5f95f80a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.310489 Oct 25 03:06:55.533248 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 847/1577] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:06:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:06:55.553810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:55.556280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:55.577995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:55.578654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:55.579226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:55.580150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:55.580734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:55.586475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:55.873829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:55.913582 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-601900e2-15c3-4caf-8b84-a577981a8dd8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.370326 Oct 25 03:06:55.915575 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 848/1578] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:55 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:55.937668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:55.938560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:55.949494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:55.950156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:55.950814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:55.952151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:55.952712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:55.953281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:55.959231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:06:56.324522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:56.338149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58ed61fb-9251-4dc4-97cd-eda3401de874 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1211 microversion: 2.1 time: 1.690460 Oct 25 03:06:56.345738 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 731/1579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:54 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1211 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:56.365155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96285960-92c5-40d1-97ad-2a107cf6bb53 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd336065e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:56.449558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:56.468109 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9a8626a-bb7b-43a2-92dd-fd3f1b52985f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1709 microversion: 2.1 time: 0.549637 Oct 25 03:06:56.470046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 849/1580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:55 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1709 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:56.480770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:56.482540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96285960-92c5-40d1-97ad-2a107cf6bb53 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.122435 Oct 25 03:06:56.483414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 732/1581] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:56 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:56.484917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:56.499299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:56.501153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:56.504095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:56.506938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:56.508061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:56.508697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:56.775838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:56.785658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb395d10-156f-40f8-833c-86bb251ae3c2 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.314322 Oct 25 03:06:56.787716 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 850/1582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:56 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:56.944137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:56.944757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:56.962772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:56.964099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:56.965253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:56.966688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:56.967593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:56.968190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:57.163311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:57.194568 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aaa91323-9e24-4652-ad95-44c46c384f1f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.255888 Oct 25 03:06:57.196483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 733/1583] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:56 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:57.289483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1506739286", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "27a0e5b3-962f-476d-8c4b-975eff19a490"}], "block_device_mapping_v2": [{"uuid": "217a936e-e7b8-421d-a7c5-354c2841db73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:06:57.392015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:57.394233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:57.413067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] validate_networks() for [('27a0e5b3-962f-476d-8c4b-975eff19a490', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:06:57.416876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:57.419367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:57.421532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:57.423047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:57.429721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:57.430450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:58.041216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:58.054551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-40323b5d-2f0b-4075-ad97-61fb8ded36d3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 0.680872 Oct 25 03:06:58.070511 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 734/1584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:57 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:58.079409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:58.080673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:58.089889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:58.090912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:58.091618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:58.092598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:58.093298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:58.093991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:58.492883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:06:58.496654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:06:58.498798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:06:58.499648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:06:58.500352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:06:58.523978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:58.524875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:58.525568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:58.528824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:58.529807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:58.531852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:58.541515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:58.555611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-09ad310a-3a14-4772-88cf-f6c4055bbd98 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1709 microversion: 2.1 time: 0.483756 Oct 25 03:06:58.560943 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 735/1585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:58 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1709 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:58.595152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed93b91b-d022-4029-984b-15c153fd48a4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd336063a0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:58.623766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:06:58.631334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Getting quotas for user 54c1fabb546b47cea96d2d70b32f4c69 and project e5e6aa25f05c4cd9bfd8d84eefc36c68. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:06:58.724370 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed93b91b-d022-4029-984b-15c153fd48a4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.147056 Oct 25 03:06:58.725622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 736/1586] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:06:58 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:58.730981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:58.741442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:58.751305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:58.751940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:58.753197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:58.755657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:58.756959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:58.757963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:58.794203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:06:58.796364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='217a936e-e7b8-421d-a7c5-354c2841db73',volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:06:59.035635 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d047de4e-f42c-41b2-a6ec-14fa10547e11 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.750016 Oct 25 03:06:59.036632 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 851/1587] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:06:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:06:59.047611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:59.048239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:59.057063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:59.057555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:59.058021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:59.058718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:59.059312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:59.059717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:59.259770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:06:59.306495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:59.316064 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-72a6ff91-4883-4057-b3e7-938debb9541c tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.588820 Oct 25 03:06:59.328614 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 737/1588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:58 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:06:59.345558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7170fc4b-fd4f-4fd8-81a3-bbb65caa6c16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:59.346221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7170fc4b-fd4f-4fd8-81a3-bbb65caa6c16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:59.348413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8b3621e-7976-42ff-9a13-f4db5360f5b5 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.288123 Oct 25 03:06:59.350496 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 852/1589] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:59 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:59.356356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:59.356982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:59.396040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:59.396547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:59.396997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:59.397743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:59.398202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:59.412031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:59.638306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7170fc4b-fd4f-4fd8-81a3-bbb65caa6c16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:59.656234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7170fc4b-fd4f-4fd8-81a3-bbb65caa6c16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:59.659428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7170fc4b-fd4f-4fd8-81a3-bbb65caa6c16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:06:59.662866 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7170fc4b-fd4f-4fd8-81a3-bbb65caa6c16 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1104 microversion: 2.25 time: 0.333131 Oct 25 03:06:59.680339 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 738/1590] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:06:59 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1104 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:06:59.697534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:06:59.706533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:06:59.724282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:59.731172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:59.733891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:06:59.736823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:06:59.737590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:06:59.750068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:00.053197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:00.062990 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4d14cca-54ca-40df-bd6d-b938029757c5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 0.710301 Oct 25 03:07:00.065720 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 853/1591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:59 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:00.072053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-42709658-36cd-4c40-acfb-0a2a43b2d71c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd339e9280>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:00.193345 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-42709658-36cd-4c40-acfb-0a2a43b2d71c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.125862 Oct 25 03:07:00.210419 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 854/1592] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:00 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:00.219878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:00.255956 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b1adfd0-5bd8-41d1-aa3e-af6c4e08a854 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1713 microversion: 2.1 time: 0.570707 Oct 25 03:07:00.264141 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 739/1593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:06:59 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1713 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:00.294865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-338225672", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "04073e7c-8c19-4dc5-a86c-ada6725f36b8"}], "security_groups": [{"name": "tempest-securitygroup--182835270"}], "key_name": "tempest-keypair-365954930", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:00.342463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1755978986", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c85b48b7-0cdc-4330-97a9-34012e14868d"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:00.462805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] validate_networks() for [('c85b48b7-0cdc-4330-97a9-34012e14868d', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:07:00.625954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] validate_networks() for [('04073e7c-8c19-4dc5-a86c-ada6725f36b8', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:07:01.195510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:07:01.196184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:07:01.202527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:07:01.202961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:07:01.203381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:07:01.235012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:01.235500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:01.236137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:01.236870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:01.237409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:01.237752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:01.284167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Getting quotas for project 48e121439efa409ea63903f5e1a70eb6. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:07:01.295127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Getting quotas for user 3c327bb6e4cb48d1a949e216065aef4c and project 48e121439efa409ea63903f5e1a70eb6. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:07:01.329021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Going to run 3 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:07:01.335593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:07:01.357060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:01.429940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=2b9719fa-95dc-43be-aae9-e842a34efc22,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:07:01.491409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=1afb7116-55e8-497c-b9c8-c12438425f80,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:07:01.745176 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-876cb965-00ac-4ca4-80e9-f3a572fca22b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.477094 Oct 25 03:07:01.745176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 855/1594] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:07:01.745176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:01.745176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:01.745176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:01.747055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:01.747055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:01.747055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:01.747055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:01.747371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.024455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:02.043572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9123734f-b150-4a54-8d1a-8d3518fc9d9b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.353878 Oct 25 03:07:02.049521 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 856/1595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:01 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:02.058949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:02.068869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:02.088024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.094726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.095336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.102144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.103862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.107838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.279710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:02.334993 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fc84c6c2-23e7-4da3-8142-442bfe839b35 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.283838 Oct 25 03:07:02.335623 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 857/1596] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:02 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:02.365820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:02.366858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:02.397960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.402161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.404864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.405619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.408005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.409785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.560992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Getting quotas for project 3ad24b576dc24c1f8122c207f017242a. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:07:02.605574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Getting quotas for user bd5e91b8c87e42d581050ae86062276f and project 3ad24b576dc24c1f8122c207f017242a. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:07:02.630969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:02.663249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:02.676195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:07:02.677795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:02.682484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:07:02.683004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:07:02.683200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:02.683419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:07:02.683838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:07:02.684468 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a555212-fcac-4349-a048-8e0578ae7bc2 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1251 microversion: 2.25 time: 0.343070 Oct 25 03:07:02.691130 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 858/1597] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:02 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1251 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:02.712080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:02.722606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:02.731465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.732243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.733105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.734252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.734711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.735353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.743947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.744172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.753144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.754376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:02.756147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:02.756868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:02.790611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Getting quotas for project 3ad24b576dc24c1f8122c207f017242a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:07:02.815351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Getting quotas for user bd5e91b8c87e42d581050ae86062276f and project 3ad24b576dc24c1f8122c207f017242a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:07:02.857278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:07:02.861126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:07:03.033671 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e2ec62d-0d63-4b48-bbd3-71a888256bde tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.767290 Oct 25 03:07:03.036426 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 740/1598] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:07:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 2771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:07:03.041371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e41077e-ae52-4087-912c-6c952590a0e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33afb9d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:03.096137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:03.109366 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a23ad218-36ca-48d6-a3f9-9e7dea9d4243 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 0.410844 Oct 25 03:07:03.110263 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 859/1599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:02 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:03.116457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:03.121785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:03.122577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:03.150686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:03.151290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:03.151744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:03.152554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:03.153023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:03.153541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:03.200247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Listed batch of 2 results from cell out of 997 limit. Returned 2 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:07:03.232291 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e41077e-ae52-4087-912c-6c952590a0e7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.194169 Oct 25 03:07:03.234488 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 741/1600] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:03 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:03.264197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee5555ed-1619-4e89-aa0f-d1a067931ccb tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:03.264818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ee5555ed-1619-4e89-aa0f-d1a067931ccb tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:03.297423 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1cfbbb66-f447-4c6d-8b44-95275566f9cd tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.186206 Oct 25 03:07:03.303645 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 860/1601] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:07:03 2022] GET /compute/v2.1/servers => generated 1018 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:03.319010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:03.319719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:03.334851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:03.335342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:03.338455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:03.340627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:03.340899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:03.341348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:03.859142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:03.870490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6999f0e-34aa-4b3b-86a3-d44524914171 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.564659 Oct 25 03:07:03.876266 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 861/1602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:03 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:03.883382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:03.884886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:03.898017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:03.898845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:03.899537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:03.900508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:03.905394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:03.906813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:03.981650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee5555ed-1619-4e89-aa0f-d1a067931ccb tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:03.990641 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee5555ed-1619-4e89-aa0f-d1a067931ccb tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1276 microversion: 2.1 time: 0.755062 Oct 25 03:07:03.991342 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 742/1603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:03 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1276 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:03.997069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:04.006733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:04.024705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.025592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.026585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:04.031220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.031925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.032592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:04.107504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:04.127980 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d038b92b-bbc0-4b55-804e-4a15ce074225 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1227 microversion: 2.1 time: 0.250170 Oct 25 03:07:04.128601 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 862/1604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:03 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1227 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:04.173405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:04.174947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:04.196571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.199710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.200486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:04.201435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.204371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.205830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:04.358094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:04.484227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-035d2a24-3c9c-4232-b2c9-4eb575bf8f76 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.491474 Oct 25 03:07:04.488870 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 743/1605] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:03 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:04.494049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:04.512532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:04.565942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.566701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.567166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:04.567978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.568482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.568921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:04.608407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:04.651641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:04.655608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:04.660043 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8f55d8fc-8200-483b-8667-01875592fd36 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1293 microversion: 2.25 time: 0.502630 Oct 25 03:07:04.664089 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 863/1606] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:04 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1293 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:04.673806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8d86cf8-7c08-4cbd-9569-a610e3f91808 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33429ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:04.800301 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8d86cf8-7c08-4cbd-9569-a610e3f91808 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.134612 Oct 25 03:07:04.801326 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 864/1607] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:04 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:04.904298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:04.906180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:04.918812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.922095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.922773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:04.925658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:04.926615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:04.927599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.264325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:05.278845 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2abc0bd0-b33a-4a4e-9391-4521f5425a74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.379227 Oct 25 03:07:05.280890 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 865/1608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:04 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:05.299692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:05.301609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:05.331224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.336432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.337337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.340320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.341437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.345178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.531688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:05.552859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9ea61f6-1bcf-400e-947f-52430ab44ff6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1272 microversion: 2.1 time: 0.269985 Oct 25 03:07:05.556144 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 866/1609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:05 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:05.574292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:05.574958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:05.595496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.604584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.605298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.606286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.607005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.609069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.651535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:05.668120 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-30484362-bcfa-47b2-9584-d9126a653589 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 1.177796 Oct 25 03:07:05.681463 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 744/1610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:04 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:05.686553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:05.689563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:05.715619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.726235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.732699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.733954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.734452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.734906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.820546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:05.829256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44d8a35e-0001-4e53-ba43-f6ed5a40543c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1275 microversion: 2.1 time: 0.271810 Oct 25 03:07:05.835178 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 867/1611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:05 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:05.841417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:05.851474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:05.867620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.868381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.869026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.870109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:05.870748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:05.871348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:05.881937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:06.074506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:06.151729 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fedc0b7b-0430-4f49-9788-ee1f8dcae25a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.461856 Oct 25 03:07:06.152464 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 745/1612] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:05 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:06.180528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-324b3717-c7bf-4721-822d-1b255022decd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd335a9f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:06.250509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:06.260908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:06.262858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:06.264886 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b5e06613-ce3c-4469-8cfc-6482c0f9ba9f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1293 microversion: 2.25 time: 0.428079 Oct 25 03:07:06.266453 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 868/1613] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:05 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1293 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:06.305753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:06.306255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:06.322529 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-324b3717-c7bf-4721-822d-1b255022decd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.166981 Oct 25 03:07:06.325946 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 746/1614] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:06 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:06.327930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:06.328454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:06.328883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:06.329603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:06.330089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:06.330525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:06.580282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:06.581246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:06.595001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:06.595679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:06.596340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:06.599646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:06.600507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:06.601145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:06.621133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:06.635859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44dfb804-ff33-453f-8a79-779e3fd924ea tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.331230 Oct 25 03:07:06.638033 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 869/1615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:06 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:06.712670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:06.713997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:06.735430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:06.736183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:06.738875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:06.742165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:06.744127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:06.747249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.017298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:07.026813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00bd0837-d741-4d35-9c86-1680741a82eb tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 0.322736 Oct 25 03:07:07.030646 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 870/1616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:06 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:07.037467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:07.046825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:07.063816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.064590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.065216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.066129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.066754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.067897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.177942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:07.186522 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c460c991-3960-4adc-ac62-422ca53495ce tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1281 microversion: 2.1 time: 0.154040 Oct 25 03:07:07.187118 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 871/1617] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:07 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:07.205749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:07.206629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:07.223821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.224319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.224768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.225485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.225969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.226398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.266645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:07.276954 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa041126-8bd0-411f-b516-b49c93bce9b9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1328 microversion: 2.1 time: 0.701729 Oct 25 03:07:07.289896 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 747/1618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:06 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1328 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:07.296293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:07.296913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:07.335457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.335874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.338566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.339570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.346845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.351461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.427910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:07.476383 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-756a09e8-db77-42dc-9962-360dd6c674a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.283052 Oct 25 03:07:07.477320 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 872/1619] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:07 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:07.487913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b7311037-b5af-4e80-800f-c8d07c120e77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33624e50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:07.591146 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b7311037-b5af-4e80-800f-c8d07c120e77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.109903 Oct 25 03:07:07.591707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 873/1620] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:07 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:07.667061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:07.667731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:07.676300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.687243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.689571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:07.691102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:07.691768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:07.693893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.310981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:08.322867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-29c09aa7-c773-48cb-8774-9b78da4e2b1e tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 0.659516 Oct 25 03:07:08.323822 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 874/1621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:07 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:08.338492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8eb22413-7b93-42b4-8837-8774606e0fd3 req-46e689f2-9582-4860-8f28-2756a2210e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83fe5be-4754-4049-8a60-59531ab84a12", "name": "network-vif-plugged", "status": "completed", "tag": "e47a20f6-ebd7-4436-9758-de1d150f5e7e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:08.367359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8eb22413-7b93-42b4-8837-8774606e0fd3 req-46e689f2-9582-4860-8f28-2756a2210e19 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.367777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8eb22413-7b93-42b4-8837-8774606e0fd3 req-46e689f2-9582-4860-8f28-2756a2210e19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.369299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8eb22413-7b93-42b4-8837-8774606e0fd3 req-46e689f2-9582-4860-8f28-2756a2210e19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.370515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:08.384984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:08.389433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:08.395332 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41d165c0-d340-40af-9ce9-f4a586f678ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1293 microversion: 2.25 time: 1.102836 Oct 25 03:07:08.398011 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 748/1622] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:07 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1293 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:07:08.400334 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8eb22413-7b93-42b4-8837-8774606e0fd3 req-46e689f2-9582-4860-8f28-2756a2210e19 service nova] Creating event network-vif-plugged:e47a20f6-ebd7-4436-9758-de1d150f5e7e for instance c83fe5be-4754-4049-8a60-59531ab84a12 on n-h2-862355-1 Oct 25 03:07:08.405971 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8eb22413-7b93-42b4-8837-8774606e0fd3 req-46e689f2-9582-4860-8f28-2756a2210e19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080839 Oct 25 03:07:08.406906 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 875/1623] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:08.415341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:08.417455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:08.417609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:08.418287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:08.431411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.433393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.435213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.436122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.437958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.440266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.444759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.445258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.451251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.451907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.458234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.458766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.678662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:08.695752 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd9c8d6a-07d6-49ea-8634-3e78ec78c1e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1281 microversion: 2.1 time: 0.284212 Oct 25 03:07:08.696403 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 876/1624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:08 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:08.709419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:08.710365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:08.730845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.731592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.732233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.733141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.733830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.734428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.858458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:08.867585 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed118e17-3cad-4eb4-a717-7906b0a91c95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1334 microversion: 2.1 time: 0.167591 Oct 25 03:07:08.878272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 877/1625] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:08 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1334 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:08.884308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:08.885209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:08.912720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.914161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.915485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:08.916875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:08.918287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:08.922258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:09.417219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:09.428092 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9543e05d-ee76-4959-847b-b2e8e5c9d08b tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 1.027968 Oct 25 03:07:09.442248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 749/1626] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:08 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:09.462863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a33e7e39-d180-450d-b421-bdf0f6cc64e9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3356da60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:09.469119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:09.516130 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-865c30e2-1eab-40db-aa02-5b60e9d833a7 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.636470 Oct 25 03:07:09.518073 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 878/1627] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:08 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:09.529723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e729da55-410b-4c32-a04c-fc6a05040a70 req-cc1848fc-19a5-42b5-b43d-9173cf089cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ded7945-9647-4ba2-8f58-50aea584fed7", "tag": "2025e32c-5be3-4b07-a237-39e499927e8a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:09.553136 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a33e7e39-d180-450d-b421-bdf0f6cc64e9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.108491 Oct 25 03:07:09.553882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e729da55-410b-4c32-a04c-fc6a05040a70 req-cc1848fc-19a5-42b5-b43d-9173cf089cdf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:09.556786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e729da55-410b-4c32-a04c-fc6a05040a70 req-cc1848fc-19a5-42b5-b43d-9173cf089cdf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:09.557585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e729da55-410b-4c32-a04c-fc6a05040a70 req-cc1848fc-19a5-42b5-b43d-9173cf089cdf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:09.561567 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 750/1628] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:09 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:09.576868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:09.577912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:09.587193 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e729da55-410b-4c32-a04c-fc6a05040a70 req-cc1848fc-19a5-42b5-b43d-9173cf089cdf service nova] Creating event network-changed:2025e32c-5be3-4b07-a237-39e499927e8a for instance 5ded7945-9647-4ba2-8f58-50aea584fed7 on n-h1-862355-1 Oct 25 03:07:09.592516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:09.593266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:09.594014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:09.594984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:09.595667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:09.596332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:09.599740 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e729da55-410b-4c32-a04c-fc6a05040a70 req-cc1848fc-19a5-42b5-b43d-9173cf089cdf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079125 Oct 25 03:07:09.601050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 879/1629] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:09.613762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:09.615298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:09.628490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:09.629230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:09.631300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:09.632070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:09.632567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:09.635355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:10.037571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:10.049502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:10.053988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:10.055418 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-76c90fc9-8d2d-49f4-8137-ea1110da593b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1293 microversion: 2.25 time: 0.453166 Oct 25 03:07:10.059479 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 880/1630] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:09 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1293 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:10.069396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:10.072604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:10.087021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:10.088715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:10.090909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:10.093165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:10.093837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:10.095769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:10.230733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:10.262859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6b5be87f-6f9d-4f89-a7b7-ebd415bd6774 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1281 microversion: 2.1 time: 0.198300 Oct 25 03:07:10.267298 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 881/1631] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:10 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:10.284138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:10.284976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:10.305825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:10.306696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:10.307343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:10.308191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:10.311934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:10.313805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:10.865504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:10.891264 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6be2735f-f864-433f-930f-f92fdaddb042 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.618784 Oct 25 03:07:10.915200 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 882/1632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:10 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:10.934107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-cd48fde9-58c8-4fde-925c-2ca07e9685ae req-36255625-f6d5-4037-b870-a70945ebb8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc326aa7-64de-4b71-9ae6-29e007d2ae91", "name": "network-vif-plugged", "status": "completed", "tag": "675a386a-407b-4b7e-adff-05d0c86c1505"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:10.956590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cd48fde9-58c8-4fde-925c-2ca07e9685ae req-36255625-f6d5-4037-b870-a70945ebb8b3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:10.957371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cd48fde9-58c8-4fde-925c-2ca07e9685ae req-36255625-f6d5-4037-b870-a70945ebb8b3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:10.959805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cd48fde9-58c8-4fde-925c-2ca07e9685ae req-36255625-f6d5-4037-b870-a70945ebb8b3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:10.985288 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-cd48fde9-58c8-4fde-925c-2ca07e9685ae req-36255625-f6d5-4037-b870-a70945ebb8b3 service nova] Creating event network-vif-plugged:675a386a-407b-4b7e-adff-05d0c86c1505 for instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 on n-h2-862355-1 Oct 25 03:07:11.016262 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-cd48fde9-58c8-4fde-925c-2ca07e9685ae req-36255625-f6d5-4037-b870-a70945ebb8b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098761 Oct 25 03:07:11.017461 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 883/1633] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:11.024772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:11.025885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:11.047066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.049304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.050073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:11.051035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.051831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.052627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:11.309546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=16 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:11.439654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:11.447442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:11.463900 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ae97a99-83a9-46b5-904f-a772664f27b5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1313 microversion: 2.1 time: 1.900212 Oct 25 03:07:11.465815 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 751/1634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:09 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1313 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:11.481086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:11.483220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:11.501944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.503151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.504553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:11.506728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.508616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.510239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:11.756820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:11.780471 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-98e377f6-b79b-4498-9d4a-65e1769518bf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 0.761521 Oct 25 03:07:11.784450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 884/1635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:11 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:11.789346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:11.803020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1f793d9-95a4-4dd6-8ab0-06d08d5f6720 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33624d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:11.832882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21acd988-45ea-428d-94b3-ead9a48b4d8f tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.364455 Oct 25 03:07:11.837193 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 752/1636] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:11 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:11.849500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:11.850672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:11.870239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.870953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.872659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:11.874924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.877050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.878193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:11.912226 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1f793d9-95a4-4dd6-8ab0-06d08d5f6720 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1440 microversion: 2.1 time: 0.124064 Oct 25 03:07:11.922149 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 885/1637] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:11 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1440 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:11.935634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:11.936253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:11.959340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.959835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.960275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:11.960986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:11.961443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:11.969188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:12.297918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:12.310453 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fc0d2e61-21fe-4232-83a8-4bc65c8131d9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.387100 Oct 25 03:07:12.312520 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 886/1638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:11 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:12.326507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:12.328900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:12.349395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:12.350229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:12.352351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:12.353588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:12.356563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:12.358370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:12.730686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:12.743942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-543b65fc-23a2-4248-9193-daddd694e5a1 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.430126 Oct 25 03:07:12.744876 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 887/1639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:12 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:12.750794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:12.752100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:12.753075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:12.764538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:12.765176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:12.766772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:12.767630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:12.768194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:12.769009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:12.775640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:12.938956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:12.950531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:12.957818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88d3c33d-2881-460e-960d-8c63754ab253 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1463 microversion: 2.1 time: 0.211117 Oct 25 03:07:12.959031 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 888/1640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:12 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1463 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:12.959963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:12.982630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:12.983821 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-76d6fc7d-5c64-428a-89f0-cae7d052ea50 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1293 microversion: 2.25 time: 1.145580 Oct 25 03:07:12.984395 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 753/1641] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:11 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1293 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:12.990314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:12.990923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:13.004268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.004761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.005856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.012711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.013237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.013700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.059102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1e5d9049-2ba5-4610-95de-b3af72dd2cd6 req-a52a4db3-bd9c-4542-896d-2881db3cf497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d", "tag": "622945fd-e5db-4600-a346-b7d74da64aa5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:13.069023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e5d9049-2ba5-4610-95de-b3af72dd2cd6 req-a52a4db3-bd9c-4542-896d-2881db3cf497 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.069817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e5d9049-2ba5-4610-95de-b3af72dd2cd6 req-a52a4db3-bd9c-4542-896d-2881db3cf497 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.070432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e5d9049-2ba5-4610-95de-b3af72dd2cd6 req-a52a4db3-bd9c-4542-896d-2881db3cf497 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.083768 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1e5d9049-2ba5-4610-95de-b3af72dd2cd6 req-a52a4db3-bd9c-4542-896d-2881db3cf497 service nova] Creating event network-changed:622945fd-e5db-4600-a346-b7d74da64aa5 for instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d on n-h2-862355-1 Oct 25 03:07:13.095977 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1e5d9049-2ba5-4610-95de-b3af72dd2cd6 req-a52a4db3-bd9c-4542-896d-2881db3cf497 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127374 Oct 25 03:07:13.096965 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 889/1642] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:13.104462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.105174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:13.116763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.117177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.117933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.118685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.119139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.119559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.169625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:13.217371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:13.235564 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5aad4b48-a9d1-4f86-b52e-7815d957e9c1 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1927 microversion: 2.75 time: 0.135401 Oct 25 03:07:13.236325 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 890/1643] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1927 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:13.241782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6da54ff4-d356-4852-a752-379d54156a3c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd336888b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.285787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:13.296073 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2040a727-9c06-4790-b7a4-0a8828216c7d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1199 microversion: 2.1 time: 0.309319 Oct 25 03:07:13.309708 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 754/1644] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:12 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1199 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:13.310351 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6da54ff4-d356-4852-a752-379d54156a3c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1449 microversion: 2.1 time: 0.063575 Oct 25 03:07:13.313776 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 891/1645] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1449 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:13.320501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-948dac02-05d4-4c18-8475-0b53ab0b7b37 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd334c85e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.375321 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-948dac02-05d4-4c18-8475-0b53ab0b7b37 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 200 len: 1449 microversion: 2.1 time: 0.060224 Oct 25 03:07:13.376404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 892/1646] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 1449 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:13.382059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.382992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:13.391109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.391817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.392440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.393318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.393960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.394555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.445364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Calling method '.version_select at 0x7efd33b0db80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.457934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.458465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.458916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.475108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.475602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.476042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.494927 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc6e5628-38e8-480d-b4d0-13659a24d0d1 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/766fb169325c4ab0890e45b58cb01742?start=2022-10-24T03%3A07%3A12.976968&end=2022-10-26T03%3A07%3A12.976968" status: 200 len: 693 microversion: 2.1 time: 0.195712 Oct 25 03:07:13.502802 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 755/1647] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/os-simple-tenant-usage/766fb169325c4ab0890e45b58cb01742?start=2022-10-24T03%3A07%3A12.976968&end=2022-10-26T03%3A07%3A12.976968 => generated 693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:13.502802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c725f4fd-0759-4c07-8800-095cc88063be tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd335a9ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.580285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:13.588709 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6b31262a-0a2c-4a9a-b6e8-55dacd033164 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.211129 Oct 25 03:07:13.605234 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 893/1648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:13.610167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '.version_select at 0x7efd381cc790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.622290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.622858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.623375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.642136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.642989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.643537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.665802 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c625c719-652f-48b0-bf4d-1c83ddced2fa tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/766fb169325c4ab0890e45b58cb01742?start=2022-10-24T03%3A07%3A12.976968&end=2022-10-26T03%3A07%3A12.976968" status: 200 len: 693 microversion: 2.1 time: 0.059026 Oct 25 03:07:13.678519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 894/1649] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/os-simple-tenant-usage/766fb169325c4ab0890e45b58cb01742?start=2022-10-24T03%3A07%3A12.976968&end=2022-10-26T03%3A07%3A12.976968 => generated 693 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:13.684791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Calling method '.version_select at 0x7efd33624700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.695316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.695804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.696841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.715171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.716052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.716727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.801352 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e69d0018-46ba-4af9-99fc-df1f0ec925d3 tempest-TenantUsagesTestJSON-50851234 tempest-TenantUsagesTestJSON-50851234-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-24T03%3A07%3A12.976968&end=2022-10-26T03%3A07%3A12.976968&detailed=1" status: 200 len: 17427 microversion: 2.1 time: 0.121168 Oct 25 03:07:13.821460 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 895/1650] 10.222.0.36 () {58 vars in 1335 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-24T03%3A07%3A12.976968&end=2022-10-26T03%3A07%3A12.976968&detailed=1 => generated 17427 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:07:13.837019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:13.837731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:13.846037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.846730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.847361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.848279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:13.849283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:13.849901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:13.986837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=14 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:14.032313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:14.043729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5800c327-52e5-478d-af51-01eb113e7ef5 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.220713 Oct 25 03:07:14.045030 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 896/1651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:13 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:14.059236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:14.059764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:14.066938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.068452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.068922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.069634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.070116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.070925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.075829 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c725f4fd-0759-4c07-8800-095cc88063be tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 204 len: 0 microversion: 2.1 time: 0.578806 Oct 25 03:07:14.076414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 756/1652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:13 2022] DELETE /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:07:14.084193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:14.084953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:14.104955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.105477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.106179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.107225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.107849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.110254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.134609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:07:14.285358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e479bfe3-dd8f-472d-a4a1-f7310ee37d44 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 204 len: 0 microversion: 2.1 time: 0.238739 Oct 25 03:07:14.291521 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 897/1653] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:07:14 2022] DELETE /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:07:14.296618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:14.297334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:14.300912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:14.305712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.307302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.308035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.309206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.309695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.310571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.342438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:07:14.429394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fae00763-b994-4248-bf64-99520db7d6db tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 204 len: 0 microversion: 2.1 time: 0.139444 Oct 25 03:07:14.430259 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 898/1654] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:07:14 2022] DELETE /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:07:14.438555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:14.439244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:14.445726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.446216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.446975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.447682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.448130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.448550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.535673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:14.561357 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c351fc59-9c84-4327-a14f-ab2ab3b5d330 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1933 microversion: 2.75 time: 0.126865 Oct 25 03:07:14.562018 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 899/1655] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:14 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1933 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:14.567114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:14.568492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:14.575487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.575991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.576433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.577341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.578089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.578518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.717791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:14.726531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f99b11f9-1dae-4116-a407-ceaa2bc8d7f7 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1469 microversion: 2.1 time: 0.163296 Oct 25 03:07:14.727122 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 900/1656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:14 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:14.748256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:14.749519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:14.756099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.760497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.761144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.761839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:14.762293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:14.762716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:14.905297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:14.913934 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd699f98-237d-4c14-9493-647e5257c5a8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1383 microversion: 2.1 time: 0.174943 Oct 25 03:07:14.914443 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 901/1657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:14 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1383 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:14.935633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-718272525", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "385d0b29-fab5-4e63-9127-a294e08d4c17"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:14.996334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] validate_networks() for [('385d0b29-fab5-4e63-9127-a294e08d4c17', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:07:15.044164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:15.052809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:15.054427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:15.055630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf2985e4-140e-4c59-bf9c-9695a4b1a365 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.978065 Oct 25 03:07:15.056432 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 757/1658] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:14 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:15.062954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:15.063694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:15.070986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.071931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.072672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.074337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.074974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.075596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.387630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:15.400393 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cdaa58d4-803e-4971-9f4c-0eaa7de37b41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.340503 Oct 25 03:07:15.401117 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 758/1659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:15 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:15.407870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ce1ee861-b52f-40b9-afca-2c8c1e9514f9 req-70c66901-f0fe-46e0-bcbf-0413992f6b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9719fa-95dc-43be-aae9-e842a34efc22", "tag": "f54a25b4-324c-43ce-9f8f-f695eb3588ea"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:15.419213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ce1ee861-b52f-40b9-afca-2c8c1e9514f9 req-70c66901-f0fe-46e0-bcbf-0413992f6b34 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.419814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ce1ee861-b52f-40b9-afca-2c8c1e9514f9 req-70c66901-f0fe-46e0-bcbf-0413992f6b34 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.420243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ce1ee861-b52f-40b9-afca-2c8c1e9514f9 req-70c66901-f0fe-46e0-bcbf-0413992f6b34 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.436175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ce1ee861-b52f-40b9-afca-2c8c1e9514f9 req-70c66901-f0fe-46e0-bcbf-0413992f6b34 service nova] Creating event network-changed:f54a25b4-324c-43ce-9f8f-f695eb3588ea for instance 2b9719fa-95dc-43be-aae9-e842a34efc22 on n-h2-862355-1 Oct 25 03:07:15.441690 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ce1ee861-b52f-40b9-afca-2c8c1e9514f9 req-70c66901-f0fe-46e0-bcbf-0413992f6b34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038091 Oct 25 03:07:15.443039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 759/1660] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:15.518782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:07:15.519392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:07:15.519676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:07:15.520093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:07:15.520511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:07:15.533740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.534231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.534883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.535661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.536125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.537027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.555376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:07:15.561418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for user 438a56b0a79647f6bb195b7e0c42b089 and project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:07:15.572349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:15.573193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:15.575062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:07:15.577385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:07:15.580368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.580953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.581547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.582508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.583122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.585822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.626424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34f5505f-f6ac-42f8-bef0-d29526121bbe tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695606 Oct 25 03:07:15.627084 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 902/1661] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:07:15.636121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:15.636799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:15.643573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.644073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.644512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.645223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.645755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.646195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.795669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:15.809969 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cf66cfa-9c2b-4bfd-b960-dd7a2078f9a0 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.181625 Oct 25 03:07:15.811178 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 903/1662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:15 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:15.817071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:15.818613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:15.824742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.825748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.826503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.828089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.828974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.829505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.835468 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c7c6988-96ea-4f6a-8f97-97a502c17525 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1534 microversion: 2.1 time: 0.390568 Oct 25 03:07:15.836264 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 760/1663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:15 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1534 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:15.841885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66a5cb8f-0fc1-4251-88df-d132bfcc5afd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:15.842829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66a5cb8f-0fc1-4251-88df-d132bfcc5afd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:15.912399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:15.912706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66a5cb8f-0fc1-4251-88df-d132bfcc5afd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:15.921322 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66a5cb8f-0fc1-4251-88df-d132bfcc5afd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1207 microversion: 2.1 time: 0.083710 Oct 25 03:07:15.933786 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 761/1664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:15 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1207 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:15.933786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:15.933786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:15.934713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3e005a8-ea3d-437e-a5a3-4623cbb6bf8a tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1933 microversion: 2.75 time: 0.120137 Oct 25 03:07:15.934713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 904/1665] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:15 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1933 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:15.938113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:15.938566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.939078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.939414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:15.939578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.940310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.940775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.941210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.955965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.956901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.958932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.959771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:15.960315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:15.960975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:15.966420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:16.118466 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9eb8aa82-d8ba-4fa4-ba58-26c30bf5016f tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1534 microversion: 2.1 time: 0.184092 Oct 25 03:07:16.119446 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 905/1666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:15 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1534 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:16.124276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:16.124973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:16.131807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.132340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.132792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.133769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.134220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.134844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.270473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:16.280202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:16.281702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:16.282841 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f1f20e5b-a1f3-4429-a60a-af69186fa209 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.162523 Oct 25 03:07:16.283405 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 906/1667] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:16 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:16.288861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:16.292659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.293143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.293582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.294523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.295040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.295459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.322118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:16.334471 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2445b6c0-ef33-45e0-a16f-c3bbf8b11ca3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1469 microversion: 2.1 time: 0.410157 Oct 25 03:07:16.337629 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 762/1668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:15 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1469 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:16.348355 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-572ebbe0-0b3b-4e51-ad63-60ad7b66fa0d tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063669 Oct 25 03:07:16.349052 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 907/1669] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:07:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:16.369625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862355-1", "block_migration": false, "disk_over_commit": false}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:16.372207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:16.389113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.389839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.390529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.391563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.392219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.392841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.425912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:16.426903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:16.427635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lazy-loading 'flavor' on Instance uuid dc326aa7-64de-4b71-9ae6-29e007d2ae91 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:16.437534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.438116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.438591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.439305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.439823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.444291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Going to try to live migrate instance to n-h1-862355-1 {{(pid=120563) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:07:16.450003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.644381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:16.656756 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5356d242-821c-46e0-9277-fb72c32c4d47 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.233602 Oct 25 03:07:16.657352 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 908/1670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:16 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:16.664189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b65cb27a-3ecf-46db-acb8-b0af7ea2a3b2 req-1df939fe-898a-41c8-84d5-dcd690b573f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337c82ae-8606-4611-bfdf-90396ac6f490", "name": "network-vif-unplugged", "status": "completed", "tag": "2e3271af-5085-43a4-9ba1-50a718ba284f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:16.675163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b65cb27a-3ecf-46db-acb8-b0af7ea2a3b2 req-1df939fe-898a-41c8-84d5-dcd690b573f1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.676115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b65cb27a-3ecf-46db-acb8-b0af7ea2a3b2 req-1df939fe-898a-41c8-84d5-dcd690b573f1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.676549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b65cb27a-3ecf-46db-acb8-b0af7ea2a3b2 req-1df939fe-898a-41c8-84d5-dcd690b573f1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.689559 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b65cb27a-3ecf-46db-acb8-b0af7ea2a3b2 req-1df939fe-898a-41c8-84d5-dcd690b573f1 service nova] Creating event network-vif-unplugged:2e3271af-5085-43a4-9ba1-50a718ba284f for instance 337c82ae-8606-4611-bfdf-90396ac6f490 on n-h1-862355-1 Oct 25 03:07:16.696260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b65cb27a-3ecf-46db-acb8-b0af7ea2a3b2 req-1df939fe-898a-41c8-84d5-dcd690b573f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036571 Oct 25 03:07:16.697262 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 909/1671] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:16.834661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:16.835381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:16.841841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.842417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.842767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:16.843695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:16.844834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:16.845439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.000600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:17.014858 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9e09905-9f2e-4205-bf4d-09bcb0e498b4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.185089 Oct 25 03:07:17.015392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 910/1672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:16 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:17.046180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:17.046800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:17.052871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.053694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.054370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.055318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.056365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.056903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.129284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:17.139321 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-60304939-088e-4bcc-bde8-5b49a19109d4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1259 microversion: 2.1 time: 0.096944 Oct 25 03:07:17.140103 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 911/1673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:17 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1259 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:17.144773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:17.145470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:17.151507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.152278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.152956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.153785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.154526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.155162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.241950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:17.264488 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ddb02d26-48f4-4a8e-ad94-f399f928dbe4 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1933 microversion: 2.75 time: 0.123061 Oct 25 03:07:17.265255 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 912/1674] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:17 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1933 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:17.329555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:17.330120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:17.336562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.337044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.337587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.338338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.338799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.339211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.793407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:17.801770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:17.803947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:17.805071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bf9e48d7-7229-4961-877e-1c4a2b83df7e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.480512 Oct 25 03:07:17.805628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 913/1675] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:17 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:17.810302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:17.810907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:17.816724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.817213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.818267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:17.819054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:17.819513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:17.819942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.014257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:18.025181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f7d4ce0f-c421-4c49-8d35-7e5a667cdddd tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1469 microversion: 2.1 time: 0.218458 Oct 25 03:07:18.025805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 914/1676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:17 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:18.031055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-87575f3b-e493-464b-bf55-18296816e14c req-072137f8-c668-4b08-8a1d-bca6b8803bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afb7116-55e8-497c-b9c8-c12438425f80", "tag": "d4796d15-6c42-40e4-85ea-fac60a1ade46"}, {"name": "network-changed", "server_uuid": "6d308752-b47b-4861-99d9-30456cc3be30", "tag": "2cdcf4c7-17fc-46f2-8c2a-f58cbe02dae7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:18.044484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87575f3b-e493-464b-bf55-18296816e14c req-072137f8-c668-4b08-8a1d-bca6b8803bcf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.044977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87575f3b-e493-464b-bf55-18296816e14c req-072137f8-c668-4b08-8a1d-bca6b8803bcf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.045422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87575f3b-e493-464b-bf55-18296816e14c req-072137f8-c668-4b08-8a1d-bca6b8803bcf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.060103 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-87575f3b-e493-464b-bf55-18296816e14c req-072137f8-c668-4b08-8a1d-bca6b8803bcf service nova] Creating event network-changed:d4796d15-6c42-40e4-85ea-fac60a1ade46 for instance 1afb7116-55e8-497c-b9c8-c12438425f80 on n-h1-862355-1 Oct 25 03:07:18.060620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-87575f3b-e493-464b-bf55-18296816e14c req-072137f8-c668-4b08-8a1d-bca6b8803bcf service nova] Creating event network-changed:2cdcf4c7-17fc-46f2-8c2a-f58cbe02dae7 for instance 6d308752-b47b-4861-99d9-30456cc3be30 on n-h2-862355-1 Oct 25 03:07:18.070914 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-87575f3b-e493-464b-bf55-18296816e14c req-072137f8-c668-4b08-8a1d-bca6b8803bcf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043600 Oct 25 03:07:18.071805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 915/1677] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:18.077279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:18.078269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:18.084798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.085297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.086026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.086805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.087269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.087916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.314927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:18.323088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bdf0523c-22d3-4535-8300-1d8b44f2328f tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.249888 Oct 25 03:07:18.323685 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 916/1678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:18 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:18.328544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:18.329161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:18.335595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.336090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.336532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.337240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.337719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.338155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.472008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:18.480812 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-638ccd7e-f322-4695-9620-536cfde6afcf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.156178 Oct 25 03:07:18.481377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 917/1679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:18 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:18.485838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:18.486435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:18.492949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.493461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.494518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.495210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.495659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.496078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.556692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:18.564291 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d218588-d8b2-4330-b07b-70a9dbea717d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1265 microversion: 2.1 time: 0.081944 Oct 25 03:07:18.564867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 918/1680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:18 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:18.569909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:18.570506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:18.575837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.576312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.576743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.577420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.578159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.578579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.649742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:18.665715 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b127e2e6-11e9-4528-83c7-30cfb3401eb8 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1933 microversion: 2.75 time: 0.099636 Oct 25 03:07:18.666285 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 919/1681] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:18 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1933 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:18.670630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d453a99c-80fb-4eb2-b211-e299a35972f0 req-6eea417d-6fa8-431a-9472-791f46426943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83fe5be-4754-4049-8a60-59531ab84a12", "name": "network-vif-deleted", "tag": "e47a20f6-ebd7-4436-9758-de1d150f5e7e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:18.680339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d453a99c-80fb-4eb2-b211-e299a35972f0 req-6eea417d-6fa8-431a-9472-791f46426943 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.680817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d453a99c-80fb-4eb2-b211-e299a35972f0 req-6eea417d-6fa8-431a-9472-791f46426943 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.681250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d453a99c-80fb-4eb2-b211-e299a35972f0 req-6eea417d-6fa8-431a-9472-791f46426943 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.692183 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d453a99c-80fb-4eb2-b211-e299a35972f0 req-6eea417d-6fa8-431a-9472-791f46426943 service nova] Creating event network-vif-deleted:e47a20f6-ebd7-4436-9758-de1d150f5e7e for instance c83fe5be-4754-4049-8a60-59531ab84a12 on n-h2-862355-1 Oct 25 03:07:18.697906 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d453a99c-80fb-4eb2-b211-e299a35972f0 req-6eea417d-6fa8-431a-9472-791f46426943 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030396 Oct 25 03:07:18.698670 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 920/1682] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:18.831725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:18.832387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:18.838616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.839127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.839559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:18.840246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:18.840701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:18.841129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:19.135729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:19.144641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:19.146990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:19.148398 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57548660-9ffc-44c5-b98b-1d407158b12c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.321291 Oct 25 03:07:19.163382 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 921/1683] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:18 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:07:19.168682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:19.169298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:19.175478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:19.175997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:19.176430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:19.177168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:19.178387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:19.178813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:19.488623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:19.497335 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9576c8c7-7605-41b2-83ae-20dd084aa5c5 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1427 microversion: 2.1 time: 0.332625 Oct 25 03:07:19.498182 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 922/1684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:19 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1427 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:19.502670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:19.503322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:19.510590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:19.510886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:19.511495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:19.512217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:19.512676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:19.513108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:19.856194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:19.861956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:19.868122 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05c8ee7c-90f2-45e9-88c3-ff600de1b743 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.369031 Oct 25 03:07:19.868727 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 923/1685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:19 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:19.890155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:19.891215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:19.900959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:19.902150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:19.902800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:19.904365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:19.904836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:19.905271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.227073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:20.235344 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d4bbde39-d585-45e8-9999-5ca026fcba95 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.350872 Oct 25 03:07:20.251098 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 924/1686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:19 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:20.259807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:20.260785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:20.267772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.269227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.269919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.271565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.272353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.272836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.281896 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-779f680d-42df-478a-aeb7-13f86c7f49a3 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91/action" status: 202 len: 0 microversion: 2.1 time: 3.916018 Oct 25 03:07:20.282850 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 763/1687] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:07:16 2022] POST /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91/action => generated 0 bytes in 3918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:07:20.293194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:20.294541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:20.307364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.307987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.308517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.309417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.310181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.310538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.402035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:20.473281 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87ec3583-c76e-4f1d-a75f-3318ec1265f0 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1933 microversion: 2.75 time: 0.181879 Oct 25 03:07:20.480644 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 764/1688] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:20 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1933 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:20.487213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1f6c6c98-9bdc-4e97-976f-54b32ebd630f req-8bd8a3a4-2b4a-455d-a554-42ecdf6c1283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337c82ae-8606-4611-bfdf-90396ac6f490", "name": "network-vif-deleted", "tag": "2e3271af-5085-43a4-9ba1-50a718ba284f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:20.515266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1f6c6c98-9bdc-4e97-976f-54b32ebd630f req-8bd8a3a4-2b4a-455d-a554-42ecdf6c1283 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.516901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1f6c6c98-9bdc-4e97-976f-54b32ebd630f req-8bd8a3a4-2b4a-455d-a554-42ecdf6c1283 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.517654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1f6c6c98-9bdc-4e97-976f-54b32ebd630f req-8bd8a3a4-2b4a-455d-a554-42ecdf6c1283 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.548120 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1f6c6c98-9bdc-4e97-976f-54b32ebd630f req-8bd8a3a4-2b4a-455d-a554-42ecdf6c1283 service nova] Creating event network-vif-deleted:2e3271af-5085-43a4-9ba1-50a718ba284f for instance 337c82ae-8606-4611-bfdf-90396ac6f490 on n-h1-862355-1 Oct 25 03:07:20.562630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1f6c6c98-9bdc-4e97-976f-54b32ebd630f req-8bd8a3a4-2b4a-455d-a554-42ecdf6c1283 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079478 Oct 25 03:07:20.564901 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 765/1689] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:20.586651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:20.590323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:20.614325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.616884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.617404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.621243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.621777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.622864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.669419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:20.685419 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cba1e28-0ffd-437a-917c-443ade25c93a tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1307 microversion: 2.1 time: 0.433029 Oct 25 03:07:20.686427 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 925/1690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:20 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1307 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:20.691222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:20.691829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:20.710651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.711148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.711585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:20.712293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:20.714456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:20.715098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.039501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:21.048345 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-42181210-e807-4334-bd77-cbecf7ebc770 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.360592 Oct 25 03:07:21.048951 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 926/1691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:20 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:21.078622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:21.079256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:21.098466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.099894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.100506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.101721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.110417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.112349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.154661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.155402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.156005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.156611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lazy-loading 'fault' on Instance uuid c83fe5be-4754-4049-8a60-59531ab84a12 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:21.198586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:21.208668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:21.210583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:21.211820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87582702-8b7d-4604-a87b-af8646a00458 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.642115 Oct 25 03:07:21.212889 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 766/1692] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:20 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:21.221568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:21.222272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:21.224354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:21.232821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.233391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.234221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.235002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.235525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.236018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.237945 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2cc2b8a5-b58e-4dda-a174-68c0b75f0b74 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1303 microversion: 2.1 time: 0.186659 Oct 25 03:07:21.239396 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 927/1693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:21 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1303 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:21.264190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:21.265207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:21.271943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.273022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.273700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.274683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.275286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.275883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.385946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:21.393816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa1a2e82-d02e-4889-8e34-202307385259 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.179345 Oct 25 03:07:21.394412 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 767/1694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:21 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:21.512640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:21.513468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:21.518118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:21.520131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.521083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.521563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.522326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.522785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.523770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.529606 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-abbf7103-2ea9-4f38-8dee-91b58aa17bf4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.269136 Oct 25 03:07:21.545635 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 928/1695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:21 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:21.622939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:21.644005 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a867b96c-68e8-4a4e-97fd-3c343374b426 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1933 microversion: 2.75 time: 0.135328 Oct 25 03:07:21.644601 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 768/1696] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:21 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1933 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:07:21.712446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:21.713892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:21.722866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.724506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.724959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.725696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.726485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.726955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.765053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-5719b465-53dc-471a-a0ad-eaa71928a306 req-3528ba37-509e-44e6-ba71-23afaf2679cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d634c7-bfa9-44d9-92f0-db85353b6c80", "tag": "e0cbe30f-06e7-4571-aba4-e8d45bdbf746"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:21.778518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5719b465-53dc-471a-a0ad-eaa71928a306 req-3528ba37-509e-44e6-ba71-23afaf2679cf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:21.779389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5719b465-53dc-471a-a0ad-eaa71928a306 req-3528ba37-509e-44e6-ba71-23afaf2679cf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:21.780635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5719b465-53dc-471a-a0ad-eaa71928a306 req-3528ba37-509e-44e6-ba71-23afaf2679cf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:21.793757 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-5719b465-53dc-471a-a0ad-eaa71928a306 req-3528ba37-509e-44e6-ba71-23afaf2679cf service nova] Creating event network-changed:e0cbe30f-06e7-4571-aba4-e8d45bdbf746 for instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 on n-h1-862355-1 Oct 25 03:07:21.801669 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-5719b465-53dc-471a-a0ad-eaa71928a306 req-3528ba37-509e-44e6-ba71-23afaf2679cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043517 Oct 25 03:07:21.802798 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 769/1697] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:07:22.017395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.030542 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ac43a96c-1b8f-468d-a151-d724780f3c57 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1307 microversion: 2.1 time: 0.323331 Oct 25 03:07:22.041999 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 929/1698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:21 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:22.074131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:22.074842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:22.082557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.083051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.084333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.085493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.086284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.087119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.094582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:22.240017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:22.240849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:22.247573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.248065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.248499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.249650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.250135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.251955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.253050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.264493 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-118278f1-0eca-498e-88c3-214101333ecf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.194899 Oct 25 03:07:22.265448 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 770/1699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:22 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:22.271889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:22.272968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:22.283619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.284169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.284675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.286399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.287193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.287737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.339608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.340150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.340577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.341031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lazy-loading 'fault' on Instance uuid c83fe5be-4754-4049-8a60-59531ab84a12 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:22.389803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.402139 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6aee5881-59d3-442e-9fc3-40f26f6acf8a tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1303 microversion: 2.1 time: 0.133233 Oct 25 03:07:22.402139 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 771/1700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:22 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:22.414508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.422383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:22.423268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:22.425864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.427834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.429339 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8b6a412-3a25-4b5d-8fd1-4fb7b4dbedc1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.194391 Oct 25 03:07:22.430752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.431248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.431745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.433031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.433208 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 930/1701] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:22 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:22.433937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.434479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.555397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:22.556099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:22.565516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.566196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.566739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.567598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.568249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.568779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.579072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.604994 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cdeab8c4-6765-431e-b5aa-1cd5c5900549 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.181537 Oct 25 03:07:22.606142 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 772/1702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:22 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:22.672746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:22.673466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:22.680509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.681230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.681802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.682625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:22.683751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:22.683751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:22.727800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:22.735775 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e508843-cd35-416a-b137-e77d6ceaf8f3 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.185897 Oct 25 03:07:22.736356 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 931/1703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:22 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:22.761848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:22.784978 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5809362c-a24e-4308-8215-7d08ecbf0937 tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1933 microversion: 2.75 time: 0.116202 Oct 25 03:07:22.789723 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 773/1704] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:22 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1933 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:07:23.066428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:23.068401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:23.079079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:23.081283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.082080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.082927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.084287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.085216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.085875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.291509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:23.292375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:23.298679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.299368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.300049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.300875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.301579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.302343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.365367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:23.374470 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2e164674-d33f-4ca5-a2ab-5c082094b662 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1307 microversion: 2.1 time: 0.311771 Oct 25 03:07:23.375387 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 932/1705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:23 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:23.379943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f42124f7-4fc8-407c-91a7-2dc24e2247cc req-b869156e-3a30-4db8-9dbb-93ac49338966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ded7945-9647-4ba2-8f58-50aea584fed7", "name": "network-vif-plugged", "status": "completed", "tag": "2025e32c-5be3-4b07-a237-39e499927e8a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:23.389394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f42124f7-4fc8-407c-91a7-2dc24e2247cc req-b869156e-3a30-4db8-9dbb-93ac49338966 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.389833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f42124f7-4fc8-407c-91a7-2dc24e2247cc req-b869156e-3a30-4db8-9dbb-93ac49338966 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.390264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f42124f7-4fc8-407c-91a7-2dc24e2247cc req-b869156e-3a30-4db8-9dbb-93ac49338966 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.402282 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f42124f7-4fc8-407c-91a7-2dc24e2247cc req-b869156e-3a30-4db8-9dbb-93ac49338966 service nova] Creating event network-vif-plugged:2025e32c-5be3-4b07-a237-39e499927e8a for instance 5ded7945-9647-4ba2-8f58-50aea584fed7 on n-h1-862355-1 Oct 25 03:07:23.407202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f42124f7-4fc8-407c-91a7-2dc24e2247cc req-b869156e-3a30-4db8-9dbb-93ac49338966 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030651 Oct 25 03:07:23.407811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 933/1706] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:23.438500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:23.441370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:23.455224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.456981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.457687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.461213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.461523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.461987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.463880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:23.471542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:23.475284 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5733eb41-bd61-43b3-9ba5-7f250422de6c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.189234 Oct 25 03:07:23.483233 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 774/1707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:23 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:23.495130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:23.495673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:23.521427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.523043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.523982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.524368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.524928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.525883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lazy-loading 'fault' on Instance uuid c83fe5be-4754-4049-8a60-59531ab84a12 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:23.528620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.529417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.530272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.530701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.632849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:23.645449 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97fd0fe9-f4b8-451e-abef-4702996ffcac tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1303 microversion: 2.1 time: 0.221330 Oct 25 03:07:23.648837 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 934/1708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:23 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:23.657130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:23.657799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:23.664655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.665144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.665585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.667247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.668596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.668728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.870155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:23.884621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:23.886575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:23.887976 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-850e289b-2a17-4e0c-a9f9-1d8482d607a4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.401404 Oct 25 03:07:23.889792 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 775/1709] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:23 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:23.895276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:23.897620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:23.904611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:23.906306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.907601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.908207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.908923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.909384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.909839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.914957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:23.923196 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c724a3a2-96b6-478e-a5a4-b0620298e8aa tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.272292 Oct 25 03:07:23.923916 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 935/1710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:23 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:23.928849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:23.929594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:23.936059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.936632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.937209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:23.938147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:23.938966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:23.939559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.023284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] Lazy-loading 'services' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:24.040799 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7253c819-5766-4d4c-b325-a842422effda tempest-ServersAdmin275Test-678135141 tempest-ServersAdmin275Test-678135141-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1918 microversion: 2.75 time: 0.115543 Oct 25 03:07:24.041404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 936/1711] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:23 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1918 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:24.075518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:24.076926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:24.077440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:24.084800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.085574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.086539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.088498 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4989192-3e0e-4c0c-911b-2c80b9083989 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.197155 Oct 25 03:07:24.089140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.089703 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 776/1712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:23 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:24.094352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.095102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.131670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:07:24.233307 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b8cb9864-59a3-4841-a6c2-37ff10346d64 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 204 len: 0 microversion: 2.75 time: 0.160107 Oct 25 03:07:24.234150 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 937/1713] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:07:24 2022] DELETE /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:07:24.242801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:24.243418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:24.250510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.250981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.251420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.252125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.252575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.253002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.326954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:24.339610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:24.341062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:24.346242 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e91e0232-8769-446f-9a46-5679bebf038f tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1443 microversion: 2.75 time: 0.107994 Oct 25 03:07:24.346951 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 777/1714] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:24 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:24.397876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:24.398623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:24.404570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.405053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.405493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.406279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.406735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.407160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.425021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:24.507555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:24.509057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:24.516965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.517633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.518373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.519440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.520381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.521670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.545514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:24.554912 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a82bc742-c83a-4e3c-9e8a-01420cafb8a2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1307 microversion: 2.1 time: 0.161972 Oct 25 03:07:24.555518 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 938/1715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:24 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:24.660837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:24.672084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07f90fb8-c144-463a-9017-0529c1804e9c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.168883 Oct 25 03:07:24.681705 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 778/1716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:24 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:24.681948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:24.681948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:24.688508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.689258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.689941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.690952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.691946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.693355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.732243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.732636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.733071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.733720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lazy-loading 'fault' on Instance uuid c83fe5be-4754-4049-8a60-59531ab84a12 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:24.803999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b64159df9c4f3a888e040719474c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766fb169325c4ab0890e45b58cb01742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:24.813558 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92c2d35b-86f8-4e54-9232-7c67b9e156e3 tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 200 len: 1303 microversion: 2.1 time: 0.145054 Oct 25 03:07:24.822738 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 939/1717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:24 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:24.916334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:24.917002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:24.923659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.924241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.924800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.925507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.926038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.926471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.951788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:24.953050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:24.960347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.960965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.961353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:24.962302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:24.962977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:24.963612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.112735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.130575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.132558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.134625 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c31a4f2e-2726-4e5d-87cd-a7b54bad90c3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1281 microversion: 2.25 time: 0.223012 Oct 25 03:07:25.135776 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 779/1718] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:24 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:25.156142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:25.157557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:25.171535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.172399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.173017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.174264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.175217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.176143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.212153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.221201 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f253133b-68a4-48ab-93a7-ff72be3874c5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.273517 Oct 25 03:07:25.222234 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 940/1719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:24 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:25.336436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.344611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db2be043-981f-40a0-92b2-bfc47dd6181a tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.207510 Oct 25 03:07:25.356643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 780/1720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:25 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:25.373808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:25.374428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:25.384582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.386195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.386653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.389997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.390570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.391032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.431119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-073a64d8-1537-4c19-a6de-836e273386ea req-66597294-90dd-4d4a-b65a-25fbb52ec1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afb7116-55e8-497c-b9c8-c12438425f80", "name": "network-vif-plugged", "status": "completed", "tag": "d4796d15-6c42-40e4-85ea-fac60a1ade46"}, {"server_uuid": "0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d", "name": "network-vif-plugged", "status": "completed", "tag": "622945fd-e5db-4600-a346-b7d74da64aa5"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:25.462286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-073a64d8-1537-4c19-a6de-836e273386ea req-66597294-90dd-4d4a-b65a-25fbb52ec1de service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.463218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-073a64d8-1537-4c19-a6de-836e273386ea req-66597294-90dd-4d4a-b65a-25fbb52ec1de service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.464307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-073a64d8-1537-4c19-a6de-836e273386ea req-66597294-90dd-4d4a-b65a-25fbb52ec1de service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.506112 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-073a64d8-1537-4c19-a6de-836e273386ea req-66597294-90dd-4d4a-b65a-25fbb52ec1de service nova] Creating event network-vif-plugged:d4796d15-6c42-40e4-85ea-fac60a1ade46 for instance 1afb7116-55e8-497c-b9c8-c12438425f80 on n-h1-862355-1 Oct 25 03:07:25.509456 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-073a64d8-1537-4c19-a6de-836e273386ea req-66597294-90dd-4d4a-b65a-25fbb52ec1de service nova] Creating event network-vif-plugged:622945fd-e5db-4600-a346-b7d74da64aa5 for instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d on n-h2-862355-1 Oct 25 03:07:25.536070 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-073a64d8-1537-4c19-a6de-836e273386ea req-66597294-90dd-4d4a-b65a-25fbb52ec1de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113878 Oct 25 03:07:25.541856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 781/1721] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:07:25.569529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:25.579789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:25.580591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:25.595863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.596421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.596860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.597760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.601136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.601612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.663300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.693151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.693469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:25.704014 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6834518a-4c6a-4e96-8e6c-3acab56734f3 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1443 microversion: 2.75 time: 0.334363 Oct 25 03:07:25.730557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 941/1722] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:25 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1443 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:25.735943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:25.741315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:25.748531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.749414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.750164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.751257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:25.751962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:25.752630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:25.917433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:26.132350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:26.146834 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42ec48d6-4c63-460b-9118-f2a277478493 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1307 microversion: 2.1 time: 0.571424 Oct 25 03:07:26.174007 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 782/1723] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:25 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1307 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:26.187111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:26.187875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] [instance: c83fe5be-4754-4049-8a60-59531ab84a12] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:26.197083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.206054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.206639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.208066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.208585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.209223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.242965 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] HTTP exception thrown: Instance c83fe5be-4754-4049-8a60-59531ab84a12 could not be found. Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Request method failure captured: Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 HTTP/1.1 Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1K4sJr2u2VhjTGl2Zm-WjzdgM32nrI5BFbclcDgP414Sd-WCFqSOgmBmYODNn7NRycWbhjdZYCuuhfDpAIvppBm4_jaRnTq218CS4b2Srx71RVZW-h8-SNLz76voIIAO-J5LVMAgeTitLtSZ2V80wN3-cUmssGNT0qeWoJlKIh1Ct0 Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 766fb169325c4ab0890e45b58cb01742 Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TenantUsagesTestJSON-1270182636 Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:07:26.246038 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/766fb169325c4ab0890e45b58cb01742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/766fb169325c4ab0890e45b58cb01742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_766fb169325c4ab0890e45b58cb01742", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/766fb169325c4ab0890e45b58cb01742"}]}] Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TenantUsagesTestJSON-1270182636 Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 766fb169325c4ab0890e45b58cb01742 Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1270182636 Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TenantUsagesTestJSON-1270182636-project Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 00b64159df9c4f3a888e040719474c5f Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TenantUsagesTestJSON-1270182636-project Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c83fe5be-4754-4049-8a60-59531ab84a12 could not be found. Oct 25 03:07:26.247989 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c83fe5be-4754-4049-8a60-59531ab84a12'} Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83fe5be-4754-4049-8a60-59531ab84a12 could not be found. Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:26.249183 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83fe5be-4754-4049-8a60-59531ab84a12 could not be found. Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83fe5be-4754-4049-8a60-59531ab84a12 could not be found. Oct 25 03:07:26.250967 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:26.253308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] Returning 404 to user: Instance c83fe5be-4754-4049-8a60-59531ab84a12 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:26.254263 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1189fa3b-b9f4-4f80-954a-5cecddd81d0b tempest-TenantUsagesTestJSON-1270182636 tempest-TenantUsagesTestJSON-1270182636-project] 10.222.0.36 "GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12" status: 404 len: 111 microversion: 2.1 time: 0.079109 Oct 25 03:07:26.255293 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 783/1724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:26 2022] GET /compute/v2.1/servers/c83fe5be-4754-4049-8a60-59531ab84a12 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:07:26.261545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:26.262236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:26.268417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.269112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.276323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.277104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.277585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.278064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.304356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:26.410001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:26.418976 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d71ad92b-56d1-4ba2-849a-b3e6c3c42508 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.686514 Oct 25 03:07:26.419613 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 942/1725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:25 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:26.424795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:26.425568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:26.432148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.432862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.433462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.434447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.435058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.435658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.520033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:26.533530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:26.540818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:26.542261 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-673a893f-141e-4514-a07f-04f159bcb90a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1477 microversion: 2.25 time: 0.285695 Oct 25 03:07:26.545307 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 784/1726] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:26 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1477 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:26.553401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:26.558729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:26.572898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.575182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.577429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.579218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.580938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.582534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.599430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:26.609430 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09a6a811-c154-4f52-bb00-3cd28687e998 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.188095 Oct 25 03:07:26.610638 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 943/1727] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:26 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:26.884920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:26.894313 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39348c81-401e-4f70-b239-4bcf0b249c06 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.347476 Oct 25 03:07:26.895953 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 785/1728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:26 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:26.907578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:26.912039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:26.921348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:26.922048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:26.925018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.925855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.926531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.928203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.928899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.929562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.934207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.934709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.935251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:26.935975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:26.938161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:26.938649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.018308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:27.028617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:27.030204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:27.036089 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-61dfb438-55dc-4083-9822-032ef04eb8a8 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1443 microversion: 2.75 time: 0.138693 Oct 25 03:07:27.045851 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 786/1729] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:26 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:27.182445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:27.183266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:27.190038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.190683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.191238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.192055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.192716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.193768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.214307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:27.326377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 5ded7945-9647-4ba2-8f58-50aea584fed7 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:27.344671 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df4d4fce-910b-480f-8e2d-efc8d8c23180 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1970 microversion: 2.25 time: 0.732757 Oct 25 03:07:27.346245 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 944/1730] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:26 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1970 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:27.378203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:27.381999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:27.397295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.398978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.399665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.402032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.403417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.404907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.424474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:27.434885 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1480858f-767a-4b52-8f13-95994f28fda4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1307 microversion: 2.1 time: 0.256316 Oct 25 03:07:27.436001 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 787/1731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:27 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:27.452250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:27.454492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:27.471039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.471920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.472590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.474383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.475430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.476179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.641586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 5ded7945-9647-4ba2-8f58-50aea584fed7 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:27.660716 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f01e58ed-7849-4765-bf3c-d4ad764c2537 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1970 microversion: 2.25 time: 0.293210 Oct 25 03:07:27.662871 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 945/1732] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:27 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1970 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:07:27.670295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-76067cac-3acd-4a55-81c8-11c15b8761c0 req-f911f639-4f4c-46bb-b1bd-7fb7fcb2e6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d634c7-bfa9-44d9-92f0-db85353b6c80", "name": "network-vif-plugged", "status": "completed", "tag": "e0cbe30f-06e7-4571-aba4-e8d45bdbf746"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:27.687315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76067cac-3acd-4a55-81c8-11c15b8761c0 req-f911f639-4f4c-46bb-b1bd-7fb7fcb2e6d3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.687807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76067cac-3acd-4a55-81c8-11c15b8761c0 req-f911f639-4f4c-46bb-b1bd-7fb7fcb2e6d3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.688247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76067cac-3acd-4a55-81c8-11c15b8761c0 req-f911f639-4f4c-46bb-b1bd-7fb7fcb2e6d3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.694199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:27.701379 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-76067cac-3acd-4a55-81c8-11c15b8761c0 req-f911f639-4f4c-46bb-b1bd-7fb7fcb2e6d3 service nova] Creating event network-vif-plugged:e0cbe30f-06e7-4571-aba4-e8d45bdbf746 for instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 on n-h1-862355-1 Oct 25 03:07:27.704628 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1614c247-cc09-45b1-83a6-592d3bb4971d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.257128 Oct 25 03:07:27.707130 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-76067cac-3acd-4a55-81c8-11c15b8761c0 req-f911f639-4f4c-46bb-b1bd-7fb7fcb2e6d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042835 Oct 25 03:07:27.713043 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 946/1733] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:27.718071 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 788/1734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:27 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:27.719734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:27.720630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:27.728742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:27.732889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.733379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.733849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.734587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.735033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.735665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.736001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.736598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.737053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.737809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.738279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.739966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.766480 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-520a41eb-fa93-4841-b073-f876382fac70 tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047255 Oct 25 03:07:27.767736 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 789/1735] 10.222.0.36 () {60 vars in 1217 bytes} [Tue Oct 25 03:07:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:07:27.784291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862355-1", "block_migration": "auto"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:27.788807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:27.801026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.801521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.802502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.803862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:27.804320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:27.804749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:27.837840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'flavor' on Instance uuid 5ded7945-9647-4ba2-8f58-50aea584fed7 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:27.862590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Going to try to live migrate instance to n-h2-862355-1 {{(pid=120563) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:07:28.043411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:28.055473 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0d63ec2-602b-4424-acb5-33eb7fd177cb tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.340915 Oct 25 03:07:28.056325 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 947/1736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:27 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:28.079035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:28.079932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:28.088361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.088853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.089474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:28.090217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.090672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.091247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:28.423827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:28.432504 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d7f930a-a70b-4067-9eb6-36275ce347a9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1401 microversion: 2.1 time: 0.360522 Oct 25 03:07:28.433461 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 948/1737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:28 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1401 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:28.438249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:28.438860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:28.444967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.445544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.446020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:28.446741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.449932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.450427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:28.542638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:28.551540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:28.553636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:28.558974 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46cb702b-bd48-47a7-ae08-79359340f793 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1443 microversion: 2.75 time: 0.124198 Oct 25 03:07:28.559871 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 949/1738] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:28 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1443 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:28.564540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:28.565147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:28.571591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.572087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.572705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:28.573398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.573883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.574496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:28.756772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:28.768106 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-093d690d-94ff-4dc5-b682-1019db865992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1307 microversion: 2.1 time: 0.206235 Oct 25 03:07:28.783221 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 950/1739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:28 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:28.798544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:28.802132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:28.821503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.823905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.826076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:28.827080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:28.827558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:28.830602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.038976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:29.049859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-866238a8-7d10-45d3-87ac-e3e1faa86f1f tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.263051 Oct 25 03:07:29.072539 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 951/1740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:28 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:29.086666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:29.087527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:29.095809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.096888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.097336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.098094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.098558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.100457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.279091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:29.290336 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-926cf16b-8846-46de-aa48-554cf6ac6a58 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.209748 Oct 25 03:07:29.297887 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 952/1741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:29 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:29.457351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:29.459372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:29.467895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.469039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.469717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.470628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.471248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.471888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.656036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:29.665512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5293afb4-9030-47e5-8831-df9dafac0785 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1589 microversion: 2.1 time: 0.214088 Oct 25 03:07:29.666124 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 953/1742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:29 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1589 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:29.680867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:29.681710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:29.689269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.690135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.691040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.692292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.693347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.693855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.737740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.738484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.739337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.740638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lazy-loading 'fault' on Instance uuid ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:29.744597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:29.795204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:29.804929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:29.806418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2525754c957246deb6652896b5efde5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9c86dfd414a989078f237dbb0273d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:29.812793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6661adbd-4927-434e-bd70-3fdd4a80ce18 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 200 len: 1448 microversion: 2.75 time: 0.144540 Oct 25 03:07:29.828843 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 954/1743] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:29 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:29.841068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:29.845455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:29.858011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.858796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.859502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:29.860602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:29.861242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:29.861863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.050882 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8367d62-dd9c-402f-a3f7-5ea477de9377 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220633 Oct 25 03:07:30.051499 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 955/1744] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:07:29 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:30.057746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-76883a51-c7ee-4e7d-acb4-ab30c69629e4 req-4e5998a4-d127-4905-b37b-31d3fbc7b628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9719fa-95dc-43be-aae9-e842a34efc22", "name": "network-vif-plugged", "status": "completed", "tag": "f54a25b4-324c-43ce-9f8f-f695eb3588ea"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:30.080852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76883a51-c7ee-4e7d-acb4-ab30c69629e4 req-4e5998a4-d127-4905-b37b-31d3fbc7b628 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.083873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76883a51-c7ee-4e7d-acb4-ab30c69629e4 req-4e5998a4-d127-4905-b37b-31d3fbc7b628 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.084597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76883a51-c7ee-4e7d-acb4-ab30c69629e4 req-4e5998a4-d127-4905-b37b-31d3fbc7b628 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.115609 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-76883a51-c7ee-4e7d-acb4-ab30c69629e4 req-4e5998a4-d127-4905-b37b-31d3fbc7b628 service nova] Creating event network-vif-plugged:f54a25b4-324c-43ce-9f8f-f695eb3588ea for instance 2b9719fa-95dc-43be-aae9-e842a34efc22 on n-h2-862355-1 Oct 25 03:07:30.125342 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-76883a51-c7ee-4e7d-acb4-ab30c69629e4 req-4e5998a4-d127-4905-b37b-31d3fbc7b628 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069595 Oct 25 03:07:30.126542 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 956/1745] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:30.138481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:30.143085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:30.158002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.158507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.158958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.159665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.160126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.163294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.416510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:30.434721 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-560a903e-104c-4225-aafb-00c590e1ffcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 200 len: 1486 microversion: 2.1 time: 0.305595 Oct 25 03:07:30.436315 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 957/1746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:30 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 1486 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:30.451886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:30.454135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:30.466186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.471306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.471996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.472965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.473648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.474915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.700195 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f8290a2-5cbc-4dea-a21f-1e3e720f631a tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7/action" status: 202 len: 0 microversion: 2.25 time: 2.920815 Oct 25 03:07:30.707067 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 790/1747] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:07:27 2022] POST /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7/action => generated 0 bytes in 2928 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:07:30.716467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:30.718205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:30.728758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.730257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.731069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.732095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.732859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.733548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.761666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:30.774958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a969023b-da78-41c3-bf3b-d3bf71d8be21 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.336263 Oct 25 03:07:30.790967 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 958/1748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:30 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:30.797446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1425027994"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:30.800329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:30.811803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.812695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.813364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:30.814366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:30.815023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:30.815643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:31.083540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:31.094145 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9ae034ca-be72-44e3-8e7b-e191ab28fb53 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.383461 Oct 25 03:07:31.098390 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 791/1749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:30 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:31.110189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:31.111614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:31.127772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:31.128138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:31.128649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:31.129382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:31.129890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:31.130863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:31.150862 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-11e15dcf-ee53-4953-8e8f-4b691d5716da tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80/action" status: 202 len: 0 microversion: 2.1 time: 0.357724 Oct 25 03:07:31.152600 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 959/1750] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:07:30 2022] POST /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:07:31.160363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:31.162635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] [instance: ef4ea68d-8db6-4e04-983d-bdc8fa8809a5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:31.174597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:31.175119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:31.175568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:31.176283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:31.176744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:31.177519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:31.203405 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] HTTP exception thrown: Instance ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 could not be found. Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Request method failure captured: Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 HTTP/1.1 Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1KPEL3Q7Tpe4NFNAJp7S_DuZ7I_3qxugCKnharJcfyCKMH_flnuYMr3sAqQrVTDDT1XKTD-PawBpGzgoywh2vWlV731UNlepwrkaNXzQNZfu3z8CIUpCUyfI8zUPMHuUiMbsrgd8ZgTwIF38r5rSWFItHSEUvxMvZFQqEsK1nXKZHM Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.75 Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 78b9c86dfd414a989078f237dbb0273d Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdmin275Test-1086022649 Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:07:31.205284 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/78b9c86dfd414a989078f237dbb0273d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/78b9c86dfd414a989078f237dbb0273d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_78b9c86dfd414a989078f237dbb0273d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/78b9c86dfd414a989078f237dbb0273d"}]}] Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdmin275Test-1086022649 Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 78b9c86dfd414a989078f237dbb0273d Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdmin275Test-1086022649 Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdmin275Test-1086022649-project Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 2525754c957246deb6652896b5efde5a Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdmin275Test-1086022649-project Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 could not be found. Oct 25 03:07:31.207136 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'ef4ea68d-8db6-4e04-983d-bdc8fa8809a5'} Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 could not be found. Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:31.208149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 could not be found. Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 could not be found. Oct 25 03:07:31.211061 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.213361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] Returning 404 to user: Instance ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:31.213361 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-84b95aab-860a-4a2c-bdde-92cc60422206 tempest-ServersAdmin275Test-1086022649 tempest-ServersAdmin275Test-1086022649-project] 10.222.0.36 "GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5" status: 404 len: 111 microversion: 2.75 time: 0.052938 Oct 25 03:07:31.213361 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 960/1751] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:31 2022] GET /compute/v2.1/servers/ef4ea68d-8db6-4e04-983d-bdc8fa8809a5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:07:31.391202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:31.404523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:31.406035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:31.409382 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87b86bde-4f94-45c7-b444-def5e1cdb9c5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.309169 Oct 25 03:07:31.410226 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 792/1752] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:31 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:31.422467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aecf9c53-c2c8-456c-a952-eb0371ffda59 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd333630d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:31.428279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1251cd10-19d9-4524-9f20-5df97ffb8f9e tempest-TenantUsagesNegativeTestJSON-742300677 tempest-TenantUsagesNegativeTestJSON-742300677-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-24T03%3A07%3A31.135333&end=2022-10-26T03%3A07%3A31.135333" status: 404 len: 112 microversion: - time: 0.216029 Oct 25 03:07:31.430161 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 961/1753] 10.222.0.36 () {58 vars in 1316 bytes} [Tue Oct 25 03:07:31 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-24T03%3A07%3A31.135333&end=2022-10-26T03%3A07%3A31.135333 => generated 112 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 25 03:07:31.439965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-345c9d78-e5ba-479d-864a-6bafade49004 tempest-TenantUsagesNegativeTestJSON-742300677 tempest-TenantUsagesNegativeTestJSON-742300677-project-admin] Calling method '.version_select at 0x7efd3b7da3a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:31.451327 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-345c9d78-e5ba-479d-864a-6bafade49004 tempest-TenantUsagesNegativeTestJSON-742300677 tempest-TenantUsagesNegativeTestJSON-742300677-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-345c9d78-e5ba-479d-864a-6bafade49004 tempest-TenantUsagesNegativeTestJSON-742300677 tempest-TenantUsagesNegativeTestJSON-742300677-project-admin] Request method failure captured: Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-simple-tenant-usage/a0189a1e18804da2a4962a3d586cc67c?start=2022-10-26T03%3A07%3A31.135333&end=2022-10-24T03%3A07%3A31.135333 HTTP/1.1 Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1LytieyLuXh05hCkFYHEx4aJql7YzJw6e8C-6HixkW9KP48RaUZ8daCTsw3rPPmPTNRqtRuOQdM8WPXmskmuYovd4JnrywVOKIqk3O7lzLSf6yiibwi2bVgSp8XGZNT70urtTTFaUAruNRYQjVOSxLfw-bN4GqRgtm4nVHGLjyeNEw Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: daedfea1bafc4d0dbf43360f1e6bf772 Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-742300677 Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:07:31.463569 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/daedfea1bafc4d0dbf43360f1e6bf772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/daedfea1bafc4d0dbf43360f1e6bf772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_daedfea1bafc4d0dbf43360f1e6bf772", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/daedfea1bafc4d0dbf43360f1e6bf772"}]}] Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-742300677 Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: daedfea1bafc4d0dbf43360f1e6bf772 Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-742300677 Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TenantUsagesNegativeTestJSON-742300677-project-admin Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f2cf5b3ec2174c879a49aee054d191e7 Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-742300677-project-admin Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid start time. The start time cannot occur after the end time. Oct 25 03:07:31.465226 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a0189a1e18804da2a4962a3d586cc67c'} Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 25 03:07:31.466192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-345c9d78-e5ba-479d-864a-6bafade49004 tempest-TenantUsagesNegativeTestJSON-742300677 tempest-TenantUsagesNegativeTestJSON-742300677-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:31.468089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-345c9d78-e5ba-479d-864a-6bafade49004 tempest-TenantUsagesNegativeTestJSON-742300677 tempest-TenantUsagesNegativeTestJSON-742300677-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/a0189a1e18804da2a4962a3d586cc67c?start=2022-10-26T03%3A07%3A31.135333&end=2022-10-24T03%3A07%3A31.135333" status: 400 len: 111 microversion: 2.1 time: 0.029846 Oct 25 03:07:31.468970 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 962/1754] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Oct 25 03:07:31 2022] GET /compute/v2.1/os-simple-tenant-usage/a0189a1e18804da2a4962a3d586cc67c?start=2022-10-26T03%3A07%3A31.135333&end=2022-10-24T03%3A07%3A31.135333 => generated 111 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:07:31.500438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aecf9c53-c2c8-456c-a952-eb0371ffda59 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.089157 Oct 25 03:07:31.501027 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 793/1755] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:31 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:31.707843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c67ecf4f-ec69-4ce2-abad-a5c1612e42a7 tempest-TenantUsagesNegativeTestJSON-977970441 tempest-TenantUsagesNegativeTestJSON-977970441-project] Calling method '.version_select at 0x7efd3b8415e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:31.714271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c67ecf4f-ec69-4ce2-abad-a5c1612e42a7 tempest-TenantUsagesNegativeTestJSON-977970441 tempest-TenantUsagesNegativeTestJSON-977970441-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0220bd25d7b949128159e06073471357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0189a1e18804da2a4962a3d586cc67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c67ecf4f-ec69-4ce2-abad-a5c1612e42a7 tempest-TenantUsagesNegativeTestJSON-977970441 tempest-TenantUsagesNegativeTestJSON-977970441-project] Request method failure captured: Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-24T03%3A07%3A31.135333&end=2022-10-26T03%3A07%3A31.135333&detailed=1 HTTP/1.1 Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Lx8LR_uTEZhz82X4Mi3A2-lDWVre3u1ix0exMdewnXWeA4_e7a-_UHfLCx3muYzbETPnGcC61e3MTS_wmkvA3qGmvkfTseFhTtnWDjp2HGySfaa63lcedofqeRXN3SqVjB2KYD0BF6JcVO4SUzV5kignfa6NGhpJ0PZE9NEs4O5Aw Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a0189a1e18804da2a4962a3d586cc67c Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-977970441 Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:07:31.716238 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a0189a1e18804da2a4962a3d586cc67c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a0189a1e18804da2a4962a3d586cc67c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a0189a1e18804da2a4962a3d586cc67c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a0189a1e18804da2a4962a3d586cc67c"}]}] Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-977970441 Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a0189a1e18804da2a4962a3d586cc67c Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-977970441 Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TenantUsagesNegativeTestJSON-977970441-project Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0220bd25d7b949128159e06073471357 Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-977970441-project Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: action_args: {} Oct 25 03:07:31.717802 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:07:31.718770 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:07:31.720149 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:07:31.721463 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 25 03:07:31.721463 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:31.723418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c67ecf4f-ec69-4ce2-abad-a5c1612e42a7 tempest-TenantUsagesNegativeTestJSON-977970441 tempest-TenantUsagesNegativeTestJSON-977970441-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:31.725412 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c67ecf4f-ec69-4ce2-abad-a5c1612e42a7 tempest-TenantUsagesNegativeTestJSON-977970441 tempest-TenantUsagesNegativeTestJSON-977970441-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-24T03%3A07%3A31.135333&end=2022-10-26T03%3A07%3A31.135333&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.253806 Oct 25 03:07:31.731996 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 963/1756] 10.222.0.36 () {58 vars in 1335 bytes} [Tue Oct 25 03:07:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-24T03%3A07%3A31.135333&end=2022-10-26T03%3A07%3A31.135333&detailed=1 => generated 123 bytes in 261 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:07:31.799643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:31.800294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:31.812475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:31.813036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:31.813546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:31.814369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:31.815119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:31.815562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.126844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:32.127842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:32.170614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.183733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.184578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.189294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.189847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.192520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.290623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:32.303310 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e1b5f1b3-fb45-4d50-a8a3-927b903dc402 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.506364 Oct 25 03:07:32.303919 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 794/1757] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:31 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:32.311882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f76f679f-372c-4ec2-a42f-d2683b491aad req-6844acc1-b261-4901-bff8-1f2aff65e45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d308752-b47b-4861-99d9-30456cc3be30", "name": "network-vif-plugged", "status": "completed", "tag": "2cdcf4c7-17fc-46f2-8c2a-f58cbe02dae7"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:32.347050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f76f679f-372c-4ec2-a42f-d2683b491aad req-6844acc1-b261-4901-bff8-1f2aff65e45f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.348063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f76f679f-372c-4ec2-a42f-d2683b491aad req-6844acc1-b261-4901-bff8-1f2aff65e45f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.348743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f76f679f-372c-4ec2-a42f-d2683b491aad req-6844acc1-b261-4901-bff8-1f2aff65e45f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.366559 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f76f679f-372c-4ec2-a42f-d2683b491aad req-6844acc1-b261-4901-bff8-1f2aff65e45f service nova] Creating event network-vif-plugged:2cdcf4c7-17fc-46f2-8c2a-f58cbe02dae7 for instance 6d308752-b47b-4861-99d9-30456cc3be30 on n-h2-862355-1 Oct 25 03:07:32.373053 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f76f679f-372c-4ec2-a42f-d2683b491aad req-6844acc1-b261-4901-bff8-1f2aff65e45f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065993 Oct 25 03:07:32.374353 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 795/1758] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:32.444441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:32.446401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:32.453864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:32.455314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.455886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.456401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.458128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.458877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.459562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.462689 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18eecb75-021a-45c8-b554-71d60dc4998b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.342429 Oct 25 03:07:32.463825 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 964/1759] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:32 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:32.517913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-82614b42-ad73-43f8-a4b2-bb704f9e7b03 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33c28af0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:32.589611 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-82614b42-ad73-43f8-a4b2-bb704f9e7b03 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.076084 Oct 25 03:07:32.592721 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 965/1760] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:32 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:32.602979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:32.604920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:32.621319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.623738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.624430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.627737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.628015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.628466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.830140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:32.840405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:32.853004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:32.855100 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-61fd0728-ce0b-4cad-b246-7b50862558cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.422393 Oct 25 03:07:32.869775 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 796/1761] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:32 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:32.875840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-31afe0fc-ba8f-454c-ab6b-1b895dfba2f3 req-1612545e-f984-4fac-829e-65916319a45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d", "tag": "622945fd-e5db-4600-a346-b7d74da64aa5"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:32.902383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:32.916124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-31afe0fc-ba8f-454c-ab6b-1b895dfba2f3 req-1612545e-f984-4fac-829e-65916319a45b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:32.916776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-31afe0fc-ba8f-454c-ab6b-1b895dfba2f3 req-1612545e-f984-4fac-829e-65916319a45b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:32.917234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-31afe0fc-ba8f-454c-ab6b-1b895dfba2f3 req-1612545e-f984-4fac-829e-65916319a45b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:32.917825 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f02781b-0529-40f0-90fb-3b80545f8308 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1589 microversion: 2.1 time: 0.322518 Oct 25 03:07:32.918765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 966/1762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:32 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1589 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:32.939370 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-31afe0fc-ba8f-454c-ab6b-1b895dfba2f3 req-1612545e-f984-4fac-829e-65916319a45b service nova] Creating event network-changed:622945fd-e5db-4600-a346-b7d74da64aa5 for instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d on n-h2-862355-1 Oct 25 03:07:32.949503 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-31afe0fc-ba8f-454c-ab6b-1b895dfba2f3 req-1612545e-f984-4fac-829e-65916319a45b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078316 Oct 25 03:07:32.950368 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 797/1763] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:33.332929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:33.334635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:33.342821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:33.344239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:33.345002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:33.345749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:33.346509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:33.347109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:33.490536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:33.492175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:33.504389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:33.505962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:33.517953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:33.519926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:33.521446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:33.524239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:33.539228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:33.552711 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4fe19d25-2f1d-4684-b16f-a90df04d5613 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.222730 Oct 25 03:07:33.554187 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 967/1764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:33 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:33.607595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09c37a80-834e-45af-943c-a2896833a117 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b8414c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:33.761778 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09c37a80-834e-45af-943c-a2896833a117 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.159130 Oct 25 03:07:33.785192 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 968/1765] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:33 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:33.896479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:33.898449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:33.925497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:33.926353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:33.929387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:33.930638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:33.931434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:33.938724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:33.951157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:33.963816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5dfe8bfe-b5e0-49eb-ba94-528983460c21 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1323 microversion: 2.1 time: 0.478393 Oct 25 03:07:33.964712 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 798/1766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:33 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1323 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:34.387596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:34.397859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:34.399439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:34.404179 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1332893-8874-4e96-8a3f-c52fc4630e24 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.514888 Oct 25 03:07:34.405135 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 969/1767] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:33 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:34.578845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:34.579628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:34.594309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:34.595263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:34.595581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:34.596373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:34.596937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:34.597993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:34.793348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-609d1451-a6ab-45ff-b539-5281c262ac6c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b7ece50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:34.850606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:34.861316 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6346a2c2-a28e-47db-b3bc-b018ce34d9b1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.286645 Oct 25 03:07:34.864789 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 799/1768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:34 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:34.893158 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-609d1451-a6ab-45ff-b539-5281c262ac6c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.103997 Oct 25 03:07:34.893989 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 970/1769] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:34 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:34.983482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b50d2c70-0422-467d-ba15-0a5c2b674a3d req-640fd5f9-1297-4e9a-ae7a-b6e26b18c5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d634c7-bfa9-44d9-92f0-db85353b6c80", "name": "network-vif-plugged", "status": "completed", "tag": "e0cbe30f-06e7-4571-aba4-e8d45bdbf746"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:34.990513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:34.991632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:35.003715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b50d2c70-0422-467d-ba15-0a5c2b674a3d req-640fd5f9-1297-4e9a-ae7a-b6e26b18c5ac service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.007800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.010416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b50d2c70-0422-467d-ba15-0a5c2b674a3d req-640fd5f9-1297-4e9a-ae7a-b6e26b18c5ac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.011104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b50d2c70-0422-467d-ba15-0a5c2b674a3d req-640fd5f9-1297-4e9a-ae7a-b6e26b18c5ac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.016324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.017052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.018671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.022484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.024630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.057286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b50d2c70-0422-467d-ba15-0a5c2b674a3d req-640fd5f9-1297-4e9a-ae7a-b6e26b18c5ac service nova] Creating event network-vif-plugged:e0cbe30f-06e7-4571-aba4-e8d45bdbf746 for instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 on n-h1-862355-1 Oct 25 03:07:35.072925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b50d2c70-0422-467d-ba15-0a5c2b674a3d req-640fd5f9-1297-4e9a-ae7a-b6e26b18c5ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095039 Oct 25 03:07:35.075874 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 800/1770] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:35.121857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:35.122631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:35.131568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.132523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.133246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.134675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.135384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.136281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.285218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lazy-loading 'services' on Instance uuid 6faa7633-59e1-4162-803d-193a945d6472 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:35.303068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:35.313471 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db92ae0c-e590-4ab3-82ba-5330b24f1423 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 200 len: 1516 microversion: 2.1 time: 0.328048 Oct 25 03:07:35.314702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 971/1771] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:34 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:35.342652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:35.343404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:35.352928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.353788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.354473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.355532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.356306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.356951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.405959 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f7e8fb06-e2f4-4be1-8296-685af034506f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-volume_attachments/2d25c088-50cf-44f2-afab-3be065fc66dc" status: 202 len: 0 microversion: 2.1 time: 0.288273 Oct 25 03:07:35.406602 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 801/1772] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:07:35 2022] DELETE /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-volume_attachments/2d25c088-50cf-44f2-afab-3be065fc66dc => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:07:35.436366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:35.437068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:35.451120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.457117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.457598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.460061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.460550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.460985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.777449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:35.791469 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5ec9988-8ebc-4217-b3ef-398a2ef15ee9 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80" status: 200 len: 1515 microversion: 2.1 time: 0.454963 Oct 25 03:07:35.803261 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 972/1773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:35 2022] GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80 => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:35.823607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:35.824516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:35.838484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.840633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.841290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:35.842975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:35.844650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:35.846229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:36.033922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:36.051663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:36.053762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:36.071185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73de8533-c7db-485a-a691-2eb01c21b56b tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.640039 Oct 25 03:07:36.071799 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 802/1774] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:35 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:36.107779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.108465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:36.134817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:36.135321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:36.135765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:36.136489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:36.136948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:36.137383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:36.175972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:36.192334 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-de4074ca-3d6d-46c6-8ae7-999e2d72763d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 200 len: 1515 microversion: 2.1 time: 0.378874 Oct 25 03:07:36.207985 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 973/1775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:35 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 1515 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:36.227356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d9727073-8850-4431-a5e2-69ca5518bcc6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b7fd430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.347067 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d9727073-8850-4431-a5e2-69ca5518bcc6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.137175 Oct 25 03:07:36.349754 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 974/1776] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:36.360861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.373633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:36.385040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:36.385891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:36.386587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:36.387355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:36.394312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:36.394964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:36.451538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:36.463278 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba876239-9133-4ac8-9337-920e41c07bcf tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.367967 Oct 25 03:07:36.464163 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 803/1777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:36.487417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:07:36.662172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a82d3e98-2f95-46fb-879f-86f871754af4 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 204 len: 0 microversion: 2.1 time: 0.308479 Oct 25 03:07:36.664083 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 975/1778] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:07:36 2022] DELETE /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:07:36.676887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.680833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:36.692601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:36.701396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:36.702195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:36.704543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:36.705833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:36.709267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:36.709987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:36.784491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-880ef812-4a7e-4cc0-81b4-c6e5414e163f tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.798678 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-880ef812-4a7e-4cc0-81b4-c6e5414e163f tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.251267 Oct 25 03:07:36.805909 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 804/1779] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:07:36.821591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb25847d-bf37-42e6-9014-4e707dfb3d5e tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.849637 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb25847d-bf37-42e6-9014-4e707dfb3d5e tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.033306 Oct 25 03:07:36.850866 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 805/1780] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:36.868289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcab07d9-9cf5-4c9e-b6bd-16c35bb9056e tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.879178 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dcab07d9-9cf5-4c9e-b6bd-16c35bb9056e tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017872 Oct 25 03:07:36.881100 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 806/1781] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:07:36.908405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c113e26-2eb6-449c-968f-09c4158a28dc tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.942798 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c113e26-2eb6-449c-968f-09c4158a28dc tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039065 Oct 25 03:07:36.944039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 807/1782] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:36.957179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e225f12b-5d06-4296-a294-c3682c762205 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:36.996468 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e225f12b-5d06-4296-a294-c3682c762205 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.044233 Oct 25 03:07:36.998167 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 808/1783] 10.222.0.36 () {58 vars in 1165 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.023548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5f4dedd-5837-4a43-90a3-6139eb7dd5a8 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.036906 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5f4dedd-5837-4a43-90a3-6139eb7dd5a8 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021847 Oct 25 03:07:37.038761 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 809/1784] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:07:37.053446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3adf5ea4-1ec8-4c7f-9b12-b5b1fe99eee3 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.096854 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3adf5ea4-1ec8-4c7f-9b12-b5b1fe99eee3 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.049579 Oct 25 03:07:37.104488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:37.109885 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 810/1785] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.111790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:37.118041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.119245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:37.127191 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-658f4b91-b422-4df8-8d2c-11e8d20b1e41 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 200 len: 1521 microversion: 2.1 time: 0.458793 Oct 25 03:07:37.127676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:37.128365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:37.129207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:37.129766 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 976/1786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:36 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.139362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:37.142413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:37.143126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:37.147072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-385ca268-cb77-409f-abf7-839f940b6587 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.162665 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-385ca268-cb77-409f-abf7-839f940b6587 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.030386 Oct 25 03:07:37.163710 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 977/1787] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:37.180235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e06d99a3-7e8e-41fd-94a5-63d98c798678 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.192004 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e06d99a3-7e8e-41fd-94a5-63d98c798678 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017581 Oct 25 03:07:37.194323 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 978/1788] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:37.209893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ba7a731-7210-4604-96aa-15565747f830 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.323657 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ba7a731-7210-4604-96aa-15565747f830 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.121104 Oct 25 03:07:37.338299 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 979/1789] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:37.346525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09500f33-1801-4307-b6b5-d3ba77d27277 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.374951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09500f33-1801-4307-b6b5-d3ba77d27277 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034908 Oct 25 03:07:37.384135 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 980/1790] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:37.394549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d52462e7-104c-4264-9f2d-90e3f1eb5ef5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b7da310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.426821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:37.438246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:37.439798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:37.441764 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-38fba792-f1d0-4b0c-a9d9-7a0b4bb64b08 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.330136 Oct 25 03:07:37.443341 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 811/1791] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:37.449005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b63f36a-6906-4c51-ba4d-c3919c91da53 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.470937 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b63f36a-6906-4c51-ba4d-c3919c91da53 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.025939 Oct 25 03:07:37.477172 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 812/1792] 10.222.0.36 () {58 vars in 1144 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.493070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.493896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:37.501888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:37.502434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:37.502885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:37.503652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:37.504131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:37.504567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:37.511040 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d52462e7-104c-4264-9f2d-90e3f1eb5ef5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.125352 Oct 25 03:07:37.515380 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 981/1793] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.532874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:37.539821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-490d8489-9d40-41ca-bccb-f56d375b9173 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.554810 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-490d8489-9d40-41ca-bccb-f56d375b9173 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027468 Oct 25 03:07:37.559839 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 982/1794] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:37.572603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e534b169-1891-4915-9672-2df8a7d5cea9 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.641658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e534b169-1891-4915-9672-2df8a7d5cea9 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.073470 Oct 25 03:07:37.642936 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 983/1795] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.657214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7c03d61f-1b67-4eef-9cb7-0fb6a04d29f1 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.696108 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7c03d61f-1b67-4eef-9cb7-0fb6a04d29f1 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.038515 Oct 25 03:07:37.699376 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 984/1796] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:07:37.717956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6cd5300-d510-46b4-b036-a48a82c16c4c tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.733283 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d6cd5300-d510-46b4-b036-a48a82c16c4c tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025728 Oct 25 03:07:37.738459 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 985/1797] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:37.745510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:37.752094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d0d60b2-b9b1-46f7-b2c9-5a555f2f2755 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.807170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d0d60b2-b9b1-46f7-b2c9-5a555f2f2755 tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.059865 Oct 25 03:07:37.813355 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 986/1798] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.836106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3902cbc6-e5d7-44a6-9c5c-a57a34c9511c tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.846266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:37.862214 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3aadd0de-a34f-4464-a637-a5a7ac885215 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.373612 Oct 25 03:07:37.864204 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 813/1799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.904832 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3902cbc6-e5d7-44a6-9c5c-a57a34c9511c tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080566 Oct 25 03:07:37.909059 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 987/1800] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:37.929026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c9c2af7-a507-4325-b766-4d17eb2dce1f tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:37.943720 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c9c2af7-a507-4325-b766-4d17eb2dce1f tempest-FlavorsV2TestJSON-263562167 tempest-FlavorsV2TestJSON-263562167-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017825 Oct 25 03:07:37.948761 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 814/1801] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:07:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:38.156760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:38.157577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:38.170458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:38.172139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:38.174063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:38.175180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:38.181352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:38.182166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:38.469245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:38.471198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:38.485614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:38.487107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:38.488878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:38.491675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:38.493784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:38.495244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:38.815766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:38.831622 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8f76de3-a515-4655-9654-16891e755ace tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 200 len: 1521 microversion: 2.1 time: 0.679455 Oct 25 03:07:38.835321 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 988/1802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:38 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 1521 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:38.850289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e2330d0-25d3-4f2a-b54a-326899600e36 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b803790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:38.946035 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e2330d0-25d3-4f2a-b54a-326899600e36 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.109676 Oct 25 03:07:38.948584 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 989/1803] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:38 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:38.969198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:38.973577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:38.991986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:38.992880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:39.021395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:39.024454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:39.025166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:39.026075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:39.449361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:39.465231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:39.467428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:39.472398 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73f29af0-7599-49a0-b4fe-99a00c6c261d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.007565 Oct 25 03:07:39.476250 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 815/1804] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:38 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:39.814408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:39.830096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6dbc4c74-7b90-42ad-9082-7c903409f9ea tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.875401 Oct 25 03:07:39.831537 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 990/1805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:38 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:39.873797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:39.874876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:39.893194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:39.894496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:39.895669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:39.898691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:39.900326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:39.900949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:39.964462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-31195fb9-d1e3-4ca0-93d6-1b99a1958715 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b8411f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:40.077670 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-31195fb9-d1e3-4ca0-93d6-1b99a1958715 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.117301 Oct 25 03:07:40.079036 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 991/1806] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:39 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:40.282846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0709f9e3-3cd3-411f-88e6-ef8965b5dcaa req-63f2ad41-2ecf-4dbe-8837-58529742ef5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc326aa7-64de-4b71-9ae6-29e007d2ae91", "name": "network-vif-unplugged", "status": "completed", "tag": "675a386a-407b-4b7e-adff-05d0c86c1505"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:40.314976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0709f9e3-3cd3-411f-88e6-ef8965b5dcaa req-63f2ad41-2ecf-4dbe-8837-58529742ef5c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:40.318261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0709f9e3-3cd3-411f-88e6-ef8965b5dcaa req-63f2ad41-2ecf-4dbe-8837-58529742ef5c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:40.320496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0709f9e3-3cd3-411f-88e6-ef8965b5dcaa req-63f2ad41-2ecf-4dbe-8837-58529742ef5c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:40.345171 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0709f9e3-3cd3-411f-88e6-ef8965b5dcaa req-63f2ad41-2ecf-4dbe-8837-58529742ef5c service nova] Creating event network-vif-unplugged:675a386a-407b-4b7e-adff-05d0c86c1505 for instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 on n-h2-862355-1 Oct 25 03:07:40.366979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:40.368170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0709f9e3-3cd3-411f-88e6-ef8965b5dcaa req-63f2ad41-2ecf-4dbe-8837-58529742ef5c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091921 Oct 25 03:07:40.371378 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 992/1807] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:40.384780 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87310560-734d-4b0c-8065-08cdd30503e6 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 200 len: 1521 microversion: 2.1 time: 0.526375 Oct 25 03:07:40.386882 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 816/1808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:39 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:40.501947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:40.506732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:40.531324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:40.533571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:40.538695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:40.539570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:40.541521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:40.542504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:40.855602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:40.856419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:40.877421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:40.878940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:40.879854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:40.884515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:40.885500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:40.887162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:41.289410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:41.314394 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-67dc94e7-137b-4ce7-bb9d-ca3f014a2660 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.462986 Oct 25 03:07:41.335662 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 817/1809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:40 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:41.342568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ce9df6a-adaa-4daa-9b82-8599af1e617f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33413c10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:41.391217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:41.410149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:41.413414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:41.422097 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2e871dce-05b3-4447-a8f5-8cdbb68e48ec tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.925076 Oct 25 03:07:41.423410 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 993/1810] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:40 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:41.453390 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ce9df6a-adaa-4daa-9b82-8599af1e617f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.116033 Oct 25 03:07:41.455322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:41.455969 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 818/1811] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:41 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:41.456882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:41.465152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:41.466152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:41.466775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:41.467968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:41.469742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:41.470582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:41.705811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:41.722018 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b02005ce-546d-4362-b1be-91e948afe854 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 200 len: 1479 microversion: 2.1 time: 0.297221 Oct 25 03:07:41.726294 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 994/1812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:41 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 1479 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:42.039714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d6045bde-ba46-4efe-a7eb-c0cdf4e6e144 req-ff82f2e6-118f-4ec3-b157-6a483c275e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9719fa-95dc-43be-aae9-e842a34efc22", "name": "network-vif-deleted", "tag": "f54a25b4-324c-43ce-9f8f-f695eb3588ea"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:42.076949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6045bde-ba46-4efe-a7eb-c0cdf4e6e144 req-ff82f2e6-118f-4ec3-b157-6a483c275e71 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:42.077463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6045bde-ba46-4efe-a7eb-c0cdf4e6e144 req-ff82f2e6-118f-4ec3-b157-6a483c275e71 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:42.079993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6045bde-ba46-4efe-a7eb-c0cdf4e6e144 req-ff82f2e6-118f-4ec3-b157-6a483c275e71 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:42.132882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d6045bde-ba46-4efe-a7eb-c0cdf4e6e144 req-ff82f2e6-118f-4ec3-b157-6a483c275e71 service nova] Creating event network-vif-deleted:f54a25b4-324c-43ce-9f8f-f695eb3588ea for instance 2b9719fa-95dc-43be-aae9-e842a34efc22 on n-h2-862355-1 Oct 25 03:07:42.154402 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d6045bde-ba46-4efe-a7eb-c0cdf4e6e144 req-ff82f2e6-118f-4ec3-b157-6a483c275e71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122555 Oct 25 03:07:42.156555 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 819/1813] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:42.351041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:42.352048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:42.367513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:42.368043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:42.368552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:42.371711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:42.373044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:42.373501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:42.437326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-cb63e0c9-378b-4e7e-9c0c-2f47b548e0a7 req-52eede9a-bb18-4388-8780-4d20bb159c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc326aa7-64de-4b71-9ae6-29e007d2ae91", "tag": "675a386a-407b-4b7e-adff-05d0c86c1505"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:42.475479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cb63e0c9-378b-4e7e-9c0c-2f47b548e0a7 req-52eede9a-bb18-4388-8780-4d20bb159c80 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:42.476170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cb63e0c9-378b-4e7e-9c0c-2f47b548e0a7 req-52eede9a-bb18-4388-8780-4d20bb159c80 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:42.477341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cb63e0c9-378b-4e7e-9c0c-2f47b548e0a7 req-52eede9a-bb18-4388-8780-4d20bb159c80 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:42.513888 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-cb63e0c9-378b-4e7e-9c0c-2f47b548e0a7 req-52eede9a-bb18-4388-8780-4d20bb159c80 service nova] Creating event network-changed:675a386a-407b-4b7e-adff-05d0c86c1505 for instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 on n-h2-862355-1 Oct 25 03:07:42.526467 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-cb63e0c9-378b-4e7e-9c0c-2f47b548e0a7 req-52eede9a-bb18-4388-8780-4d20bb159c80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092868 Oct 25 03:07:42.528390 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 820/1814] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 25 03:07:42.548792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:42.553006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:42.573052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:42.573593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:42.574813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:42.576619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:42.577029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:42.577469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:42.996532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:43.017257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:43.028797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:43.037551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82777ceb-9840-4b7a-a41b-f5c0aff42ed6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.504293 Oct 25 03:07:43.040972 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 821/1815] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:42 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:43.089960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c748e98-3097-4721-a0bf-108fd2b3d003 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3343c820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:43.178375 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c748e98-3097-4721-a0bf-108fd2b3d003 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.125637 Oct 25 03:07:43.179282 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 822/1816] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:43 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:43.194046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:43.195000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:43.206314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:43.207813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:43.209522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:43.212504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:43.213226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:43.213936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:43.303934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:43.306556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:43.307031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:43.308202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lazy-loading 'fault' on Instance uuid 2b9719fa-95dc-43be-aae9-e842a34efc22 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:43.389404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:43.413235 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0b68c2d-2054-4b73-8e6e-11107aa51693 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 200 len: 1313 microversion: 2.1 time: 0.221449 Oct 25 03:07:43.414415 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 823/1817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:43 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:43.474636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:43.526977 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c07236ac-e9bf-4e4d-b3fc-3507f72463fe tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 1.181496 Oct 25 03:07:43.534823 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 995/1818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:42 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:44.072281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:44.073702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:44.077313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:44.083032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.084929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.085721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.087465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.088211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.088941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.196247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ddc454a-e7f6-4dfb-80b1-8ca0ec93d9e5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b7ba0d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:44.309665 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ddc454a-e7f6-4dfb-80b1-8ca0ec93d9e5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.117308 Oct 25 03:07:44.313387 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 996/1819] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:44 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:44.440638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:44.441644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:44.457008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.461461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.465360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.466312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.470368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.472070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.529530 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] HTTP exception thrown: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 HTTP/1.1 Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:07:44.535689 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:44.537460 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2b9719fa-95dc-43be-aae9-e842a34efc22'} Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:44.538941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:44.541354 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.549258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 404 to user: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:44.550610 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80d98061-adf7-4f21-acd6-81f8e48117f5 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 404 len: 111 microversion: 2.1 time: 0.114937 Oct 25 03:07:44.551758 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 997/1820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:44 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:07:44.566316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:44.581028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:44.586718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:44.600581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.601536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.602283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.606368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.607309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.609054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.747003 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a39afc09-2a37-483a-bb97-38f2b5de1bd7 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.188561 Oct 25 03:07:44.748914 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 998/1821] 10.222.0.36 () {58 vars in 1230 bytes} [Tue Oct 25 03:07:44 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:07:44.755604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:44.756668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:44.766979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.768017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.769130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.770190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.770974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.771749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.797778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:44.815158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:44.819239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:44.828874 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-afc7cfdc-0f29-43a5-abc8-6ee23f7b323f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.762780 Oct 25 03:07:44.832054 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 824/1822] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:44 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:44.852591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-53a51e60-95fe-4e79-b3dd-c6bc1542acbf tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-53a51e60-95fe-4e79-b3dd-c6bc1542acbf tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:07:44.864556 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 25 03:07:44.867127 n-d-862355-1 devstack@n-api.service[120563]: action_args: {} Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:44.867986 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:44.869572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:44.873649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:07:44.873649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:07:44.873649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 25 03:07:44.873649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:44.876037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-53a51e60-95fe-4e79-b3dd-c6bc1542acbf tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:44.877997 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-53a51e60-95fe-4e79-b3dd-c6bc1542acbf tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.044562 Oct 25 03:07:44.879220 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 825/1823] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 25 03:07:44 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:07:44.889627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:44.897956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:44.900078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:44.909534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.911640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.913155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.914337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:44.915139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:44.915991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:44.993278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:07:45.040914 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed512e09-1920-4c64-b4f9-66cf70667373 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.154517 Oct 25 03:07:45.043028 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 826/1824] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:07:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:45.062280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.078322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:45.079827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.servers [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Removing options 'limit' from query {{(pid=120563) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 25 03:07:45.080658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:45.086693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.087433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.088025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.088923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.089605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.090282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.125293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:07:45.190867 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a30d8c6-d821-40d0-a9af-8597e0ede9a2 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.140034 Oct 25 03:07:45.196874 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 827/1825] 10.222.0.36 () {58 vars in 1144 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:45.218387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b3926b5-baa6-4693-a587-a0a981f58001 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b3926b5-baa6-4693-a587-a0a981f58001 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:07:45.231620 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 25 03:07:45.233670 n-d-862355-1 devstack@n-api.service[120563]: action_args: {} Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi '-1' Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:45.235054 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.236804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:45.238239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:45.238239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:45.238239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:07:45.238239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:07:45.238239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 25 03:07:45.238239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.238239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b3926b5-baa6-4693-a587-a0a981f58001 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:45.240339 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b3926b5-baa6-4693-a587-a0a981f58001 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.031952 Oct 25 03:07:45.243414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 828/1826] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:07:45.264250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13b0cc16-b1d7-432c-a2cf-17cae050685b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13b0cc16-b1d7-432c-a2cf-17cae050685b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:07:45.278510 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 25 03:07:45.280212 n-d-862355-1 devstack@n-api.service[120563]: action_args: {} Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'testing' Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:45.283127 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.284993 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13b0cc16-b1d7-432c-a2cf-17cae050685b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13b0cc16-b1d7-432c-a2cf-17cae050685b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.030080 Oct 25 03:07:45.287236 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 829/1827] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:07:45.304089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5acbc1b0-f1f7-4a5d-b7d1-83c8561af651 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.325356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5acbc1b0-f1f7-4a5d-b7d1-83c8561af651 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:45.326492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5acbc1b0-f1f7-4a5d-b7d1-83c8561af651 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:45.342670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.servers [None req-5acbc1b0-f1f7-4a5d-b7d1-83c8561af651 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Flavor 'non_existing_flavor' could not be found {{(pid=120563) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 25 03:07:45.344160 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5acbc1b0-f1f7-4a5d-b7d1-83c8561af651 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.049980 Oct 25 03:07:45.345290 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 830/1828] 10.222.0.36 () {58 vars in 1178 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:07:45.363436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43ffc5dc-17f8-47ce-9401-723f70d978ff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd331d6dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.446185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43ffc5dc-17f8-47ce-9401-723f70d978ff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.099503 Oct 25 03:07:45.447678 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 831/1829] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:45.459756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.469133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:45.470973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:45.481089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.481778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.482530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.483447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.484031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.484699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.599111 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41abd6e0-5771-44e2-9019-70b08c90887d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.149776 Oct 25 03:07:45.600807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 832/1830] 10.222.0.36 () {58 vars in 1174 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:07:45.614844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.620629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:45.624973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:45.636806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.637444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.638106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.641409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.642086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.642656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.708073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:45.737388 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7cdbafe-e056-4bda-b068-f61811d6c7f6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.987089 Oct 25 03:07:45.745112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 999/1831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:44 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:45.843385 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5831feee-4b89-49d2-baa2-9cf7369e1bc3 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.232489 Oct 25 03:07:45.852403 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 833/1832] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:07:45.858413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.863512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:45.867319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:45.867779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:45.868586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:45.881110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.881603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.884559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.885526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.886289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.886703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.886846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.887186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.888498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.890639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:45.893716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:45.894358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:45.976032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:07:46.066935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:46.082605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:46.085515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:46.086232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:46.657904 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5b18452-cc9b-4dd1-bc55-640416ca6a14 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.803621 Oct 25 03:07:46.658298 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1000/1833] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:46.667547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0d1e5c7-ca04-4580-8e5a-a51de7147daa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b806280>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:46.763788 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0d1e5c7-ca04-4580-8e5a-a51de7147daa tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.099966 Oct 25 03:07:46.764349 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1001/1834] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:46 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:46.778873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2cf058cc-eb12-4a7e-b79b-193ac5d3338c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:46.807864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2cf058cc-eb12-4a7e-b79b-193ac5d3338c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:46.808884 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2cf058cc-eb12-4a7e-b79b-193ac5d3338c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.043604 Oct 25 03:07:46.810530 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1002/1835] 10.222.0.36 () {58 vars in 1178 bytes} [Tue Oct 25 03:07:46 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:07:46.815545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:46.817409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:46.826520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:46.827325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:46.827943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:46.834441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:46.835266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:46.836202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:46.867045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:46.877221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:46.887862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:46.888083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec917f54-2767-48ce-acc7-75bebb6cf025 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.029149 Oct 25 03:07:46.897100 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 834/1836] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:45 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:46.897100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:46.900337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:46.902190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Searching by: {'deleted': False, 'project_id': '48e121439efa409ea63903f5e1a70eb6'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:07:46.934948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:46.941378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:46.942147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:46.948518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:46.954414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:46.959217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:47.105432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:07:47.232289 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5eb59b25-9c06-4092-b403-c209d641e51d tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.336099 Oct 25 03:07:47.242453 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 835/1837] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:07:46 2022] GET /compute/v2.1/servers => generated 683 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:47.263836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:47.264349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:47.298236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:47.298939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:47.299432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:47.304378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:47.305596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:47.308634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:47.369138 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] HTTP exception thrown: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 HTTP/1.1 Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:07:47.370800 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:47.374276 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '2b9719fa-95dc-43be-aae9-e842a34efc22'} Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:47.375427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:47.377569 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:47.379532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 404 to user: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:47.379532 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b118f90-22e4-4c94-abb5-e36f50c573be tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 404 len: 111 microversion: 2.1 time: 0.128704 Oct 25 03:07:47.389052 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 836/1838] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:07:47 2022] DELETE /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:07:47.413030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:47.416660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:47.441779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:47.448645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:47.452447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:47.454797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:47.459123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:47.464227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:47.569123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:07:47.919740 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d6b208e-654e-48c5-91ec-51e0b7b97335 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80" status: 204 len: 0 microversion: 2.1 time: 0.525308 Oct 25 03:07:47.922027 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 837/1839] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:07:47 2022] DELETE /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:07:47.942421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b6bbd93-3f28-490d-83aa-3dbef4285dcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33ace5e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:48.078519 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b6bbd93-3f28-490d-83aa-3dbef4285dcc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.155074 Oct 25 03:07:48.080228 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 838/1840] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:47 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:48.093756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:48.101077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:48.143457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:48.148589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:48.149261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:48.158017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:48.158675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:48.159707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:48.219658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:48.240248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:07:48.571378 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b34879a-1adb-470f-a304-8d05b7e70c61 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 204 len: 0 microversion: 2.1 time: 0.486282 Oct 25 03:07:48.578381 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 839/1841] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:07:48 2022] DELETE /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:07:48.609194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:48.610261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:48.636720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:48.643739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:48.644592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:48.647713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:48.648156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:48.648569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:49.020426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:49.040401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c6d2b55-f950-411e-9531-a30cbc0a625d tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 2.228518 Oct 25 03:07:49.045203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1003/1842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:46 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:49.063855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:49.065271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 2b9719fa-95dc-43be-aae9-e842a34efc22] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:49.084737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:49.085325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:49.088050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:49.088807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:49.094722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:49.095458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:49.152830 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] HTTP exception thrown: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 HTTP/1.1 Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:07:49.154441 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:49.156249 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2b9719fa-95dc-43be-aae9-e842a34efc22'} Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:49.157954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. Oct 25 03:07:49.159697 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:49.161164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 404 to user: Instance 2b9719fa-95dc-43be-aae9-e842a34efc22 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:49.161516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c528b6c-f575-404f-981a-af56c5829e4b tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22" status: 404 len: 111 microversion: 2.1 time: 0.112056 Oct 25 03:07:49.166376 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1004/1843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:49 2022] GET /compute/v2.1/servers/2b9719fa-95dc-43be-aae9-e842a34efc22 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:07:49.177843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81fda68b-e1aa-4cb7-80c2-ec4ffa872079 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b7c0a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:49.309553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:49.346560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:49.359799 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81fda68b-e1aa-4cb7-80c2-ec4ffa872079 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.194851 Oct 25 03:07:49.360385 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1005/1844] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:49 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:49.363762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:49.371999 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1410a999-56f4-4874-9d68-9edc403ef5c8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.791345 Oct 25 03:07:49.377225 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 840/1845] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:48 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:49.386094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:49.388047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:49.895124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ffc91b2b-d741-49c2-a6d3-c0763afed066 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Calling method '.version_select at 0x7efd333129d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:50.049027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:50.053626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:50.054460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:50.056961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:50.058487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:50.060507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:50.120484 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ffc91b2b-d741-49c2-a6d3-c0763afed066 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.503486 Oct 25 03:07:50.122214 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 841/1846] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:07:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:07:50.129946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:50.132247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:50.173249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:50.174327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:50.178101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:50.180979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:50.181406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:50.183882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:50.679580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:50.695012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dfd41d23-c3eb-4548-a1d2-181af8b505f1 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80" status: 200 len: 1521 microversion: 2.1 time: 1.333189 Oct 25 03:07:50.696562 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1006/1847] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:49 2022] GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80 => generated 1521 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:50.711042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee5bbd83-a36b-4141-8384-831c8e57ee3f tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Action: 'create', calling method: .version_select at 0x7efd3b7c0430>, body: {"pool": "non_exist_pool"} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:51.050410 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-ee5bbd83-a36b-4141-8384-831c8e57ee3f tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] HTTP exception thrown: Floating IP pool not found. Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee5bbd83-a36b-4141-8384-831c8e57ee3f tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Request method failure captured: Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 26 Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1MFxmhzESNaJCxLjK6dmm-Ixd2HX1bLFefWvNmaka8-jMiWkRVc99gm_bIcg15_E_wfSU6g8sUJsptCkUWVlb6mnxGbCsJdKsGx5eCtIZEd8HatXQHK2dHY5uZlHKTMeRgC6saaehszEKrzZR582vctnIyDAa4n8QYXDifh2Z07EJk Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 4877eca0f18e42c6a1804d53bfa2681a Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1228907911 Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:07:51.052025 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4877eca0f18e42c6a1804d53bfa2681a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4877eca0f18e42c6a1804d53bfa2681a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4877eca0f18e42c6a1804d53bfa2681a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4877eca0f18e42c6a1804d53bfa2681a"}]}] Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1228907911 Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 4877eca0f18e42c6a1804d53bfa2681a Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1228907911 Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsNegativeTestJSON-1228907911-project Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dbedb631b9ba46c392f66bd80e8d2dee Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1228907911-project Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: {"pool": "non_exist_pool"} Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: exception: Floating IP pool not found. Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 25 03:07:51.059586 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:51.061294 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee5bbd83-a36b-4141-8384-831c8e57ee3f tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Returning 404 to user: Floating IP pool not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:51.063187 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee5bbd83-a36b-4141-8384-831c8e57ee3f tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.355497 Oct 25 03:07:51.064719 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1007/1848] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:07:50 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:07:51.065227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ddb5622-d97b-4af9-93d5-3c82bee9ba42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b7ece50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:51.142726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ddb5622-d97b-4af9-93d5-3c82bee9ba42 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.086545 Oct 25 03:07:51.143902 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1008/1849] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:51 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:51.153670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:51.154824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:51.158750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:51.173185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:51.174170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:51.174887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:51.176294 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48f733d5-f6a1-4ce2-b816-b003f5f55667 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 1.052758 Oct 25 03:07:51.176441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:51.178957 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 842/1850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:50 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:51.179278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:51.179908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:51.198877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0b71fb3-e7c9-481f-bb26-897a010294b4 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Calling method '.version_select at 0x7efd33b8f4c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:51.372253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-b0b71fb3-e7c9-481f-bb26-897a010294b4 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9b82e425-2138-4134-8883-dbed332b5222 could not be found", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:07:51.373917 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b0b71fb3-e7c9-481f-bb26-897a010294b4 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] HTTP exception thrown: Floating IP not found for ID 9b82e425-2138-4134-8883-dbed332b5222 Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0b71fb3-e7c9-481f-bb26-897a010294b4 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Request method failure captured: Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-floating-ips/9b82e425-2138-4134-8883-dbed332b5222 HTTP/1.1 Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MFxmhzESNaJCxLjK6dmm-Ixd2HX1bLFefWvNmaka8-jMiWkRVc99gm_bIcg15_E_wfSU6g8sUJsptCkUWVlb6mnxGbCsJdKsGx5eCtIZEd8HatXQHK2dHY5uZlHKTMeRgC6saaehszEKrzZR582vctnIyDAa4n8QYXDifh2Z07EJk Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 4877eca0f18e42c6a1804d53bfa2681a Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1228907911 Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:07:51.377516 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4877eca0f18e42c6a1804d53bfa2681a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4877eca0f18e42c6a1804d53bfa2681a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4877eca0f18e42c6a1804d53bfa2681a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4877eca0f18e42c6a1804d53bfa2681a"}]}] Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1228907911 Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 4877eca0f18e42c6a1804d53bfa2681a Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1228907911 Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FloatingIPsNegativeTestJSON-1228907911-project Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dbedb631b9ba46c392f66bd80e8d2dee Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1228907911-project Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: exception: Floating IP not found for ID 9b82e425-2138-4134-8883-dbed332b5222 Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9b82e425-2138-4134-8883-dbed332b5222'} Oct 25 03:07:51.379464 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:07:51.380827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9b82e425-2138-4134-8883-dbed332b5222 could not be found Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb982b3a-94bf-4d3b-b0a2-0638aae7ecce'] Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9b82e425-2138-4134-8883-dbed332b5222. Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:51.382629 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9b82e425-2138-4134-8883-dbed332b5222 Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:51.384338 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:51.386039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9b82e425-2138-4134-8883-dbed332b5222 Oct 25 03:07:51.386039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:51.387581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0b71fb3-e7c9-481f-bb26-897a010294b4 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] Returning 404 to user: Floating IP not found for ID 9b82e425-2138-4134-8883-dbed332b5222 {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:51.388665 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0b71fb3-e7c9-481f-bb26-897a010294b4 tempest-FloatingIPsNegativeTestJSON-1228907911 tempest-FloatingIPsNegativeTestJSON-1228907911-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/9b82e425-2138-4134-8883-dbed332b5222" status: 404 len: 111 microversion: 2.1 time: 0.207759 Oct 25 03:07:51.389769 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 843/1851] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:07:51 2022] DELETE /compute/v2.1/os-floating-ips/9b82e425-2138-4134-8883-dbed332b5222 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:07:51.726071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:51.727134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:51.739096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:51.744243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:51.746290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:51.748117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:51.751863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:51.753121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:52.104171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:52.138123 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ebf9edc-5904-45b9-8c44-be14138478ca tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80" status: 200 len: 1479 microversion: 2.1 time: 0.416991 Oct 25 03:07:52.140989 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 844/1852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:51 2022] GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80 => generated 1479 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:52.151837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-902239d3-b585-40d3-a028-c8bd5f6337f4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:52.163286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-902239d3-b585-40d3-a028-c8bd5f6337f4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:52.164558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-902239d3-b585-40d3-a028-c8bd5f6337f4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:52.165341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-902239d3-b585-40d3-a028-c8bd5f6337f4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:52.353978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-902239d3-b585-40d3-a028-c8bd5f6337f4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Going to try to stop instance {{(pid=120563) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:07:52.516837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-902239d3-b585-40d3-a028-c8bd5f6337f4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action" status: 202 len: 0 microversion: 2.1 time: 0.373564 Oct 25 03:07:52.517489 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 845/1853] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:07:52 2022] POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:07:52.544954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56822f20-bd66-43e0-a34e-5ea3bf6902c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd330cf280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:52.596722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:52.630091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:52.641180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:52.648252 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56822f20-bd66-43e0-a34e-5ea3bf6902c0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.126866 Oct 25 03:07:52.649325 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 846/1854] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:52 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:52.650354 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d05009dd-9f4d-471d-ad92-9e4256d884ac tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.505007 Oct 25 03:07:52.664791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:52.666155 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1009/1855] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:51 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:52.672413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:52.696381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:52.700910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:52.701394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:52.704126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-51685542-8969-4541-afc0-6c0cd0118188 req-867e3ed1-e7eb-4077-9f1d-080f51df9fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afb7116-55e8-497c-b9c8-c12438425f80", "name": "network-vif-deleted", "tag": "d4796d15-6c42-40e4-85ea-fac60a1ade46"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:52.705447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:52.706043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:52.712562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:52.736690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-51685542-8969-4541-afc0-6c0cd0118188 req-867e3ed1-e7eb-4077-9f1d-080f51df9fb2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:52.737819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-51685542-8969-4541-afc0-6c0cd0118188 req-867e3ed1-e7eb-4077-9f1d-080f51df9fb2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:52.740242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-51685542-8969-4541-afc0-6c0cd0118188 req-867e3ed1-e7eb-4077-9f1d-080f51df9fb2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:52.793119 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-51685542-8969-4541-afc0-6c0cd0118188 req-867e3ed1-e7eb-4077-9f1d-080f51df9fb2 service nova] Creating event network-vif-deleted:d4796d15-6c42-40e4-85ea-fac60a1ade46 for instance 1afb7116-55e8-497c-b9c8-c12438425f80 on n-h1-862355-1 Oct 25 03:07:52.819892 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-51685542-8969-4541-afc0-6c0cd0118188 req-867e3ed1-e7eb-4077-9f1d-080f51df9fb2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128461 Oct 25 03:07:52.824315 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1010/1856] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:52.848619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:52.865611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:52.896149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:52.900787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:52.904668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:52.905655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:52.907981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:52.914719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:53.247280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:53.258804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb38d107-7972-4a96-ba54-56de270581ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.604903 Oct 25 03:07:53.267923 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 847/1857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:52 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:53.281916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-104a3f78-22d5-42c9-8f99-61633caaea4a req-dea3d96a-6c54-4149-8b3d-426f2ac07df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d308752-b47b-4861-99d9-30456cc3be30", "name": "network-vif-deleted", "tag": "2cdcf4c7-17fc-46f2-8c2a-f58cbe02dae7"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:07:53.301085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-104a3f78-22d5-42c9-8f99-61633caaea4a req-dea3d96a-6c54-4149-8b3d-426f2ac07df3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:53.303943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-104a3f78-22d5-42c9-8f99-61633caaea4a req-dea3d96a-6c54-4149-8b3d-426f2ac07df3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:53.307964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-104a3f78-22d5-42c9-8f99-61633caaea4a req-dea3d96a-6c54-4149-8b3d-426f2ac07df3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:53.335371 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-104a3f78-22d5-42c9-8f99-61633caaea4a req-dea3d96a-6c54-4149-8b3d-426f2ac07df3 service nova] Creating event network-vif-deleted:2cdcf4c7-17fc-46f2-8c2a-f58cbe02dae7 for instance 6d308752-b47b-4861-99d9-30456cc3be30 on n-h2-862355-1 Oct 25 03:07:53.344499 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-104a3f78-22d5-42c9-8f99-61633caaea4a req-dea3d96a-6c54-4149-8b3d-426f2ac07df3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075140 Oct 25 03:07:53.344975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 848/1858] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:07:53.362156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:53.362877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:53.377803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:53.378455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:53.378900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:53.379827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:53.380674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:53.381448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:53.486591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:53.487001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:53.489285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:53.493010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lazy-loading 'fault' on Instance uuid 1afb7116-55e8-497c-b9c8-c12438425f80 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:07:53.549127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:53.560491 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d5149409-3422-424a-a14f-642af6507878 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1677 microversion: 2.1 time: 0.731782 Oct 25 03:07:53.561919 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1011/1859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:52 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1677 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:53.638974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c327bb6e4cb48d1a949e216065aef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e121439efa409ea63903f5e1a70eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:53.652709 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-471d86a7-b746-4eb1-88c5-ea59900ca21c tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80" status: 200 len: 1313 microversion: 2.1 time: 0.306516 Oct 25 03:07:53.657856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 849/1860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:53 2022] GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:53.668398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a228666-be98-4462-9832-74f713c2b379 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b82c940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:53.688915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:53.690641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:53.714710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:53.715945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:53.718190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:53.734435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:53.734865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:53.735393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:53.771480 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3a228666-be98-4462-9832-74f713c2b379 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.106562 Oct 25 03:07:53.773028 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1012/1861] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:53 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:54.273071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:54.284806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:54.288901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:54.289832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:54.291504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:54.293011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a189375-ca09-4178-80fe-509701132dbc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.607993 Oct 25 03:07:54.294213 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 850/1862] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:53 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:07:54.300136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:54.300642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:54.301088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:54.301840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:54.302402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:54.302831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:54.661622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:54.679414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:54.721589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:54.725197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:54.729923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:54.731260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:54.731931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:54.734033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:55.097003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:55.106919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89ce488f-00c7-48e8-85f8-a3e741abbad8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.823872 Oct 25 03:07:55.122521 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1013/1863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:54 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:55.127272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:55.128196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 1afb7116-55e8-497c-b9c8-c12438425f80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:55.139345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:55.140204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:55.140730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:55.141919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:55.142395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:55.143007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:55.202126 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] HTTP exception thrown: Instance 1afb7116-55e8-497c-b9c8-c12438425f80 could not be found. Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80 HTTP/1.1 Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:07:55.204447 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 1afb7116-55e8-497c-b9c8-c12438425f80 could not be found. Oct 25 03:07:55.205987 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '1afb7116-55e8-497c-b9c8-c12438425f80'} Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afb7116-55e8-497c-b9c8-c12438425f80 could not be found. Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:55.206853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afb7116-55e8-497c-b9c8-c12438425f80 could not be found. Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afb7116-55e8-497c-b9c8-c12438425f80 could not be found. Oct 25 03:07:55.208280 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.222689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 404 to user: Instance 1afb7116-55e8-497c-b9c8-c12438425f80 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:55.223959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b5854405-80c1-4120-b384-3780b5331e89 tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80" status: 404 len: 111 microversion: 2.1 time: 0.108946 Oct 25 03:07:55.224792 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1014/1864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:55 2022] GET /compute/v2.1/servers/1afb7116-55e8-497c-b9c8-c12438425f80 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:07:55.231695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-acfced65-bd22-4f60-835d-dd6ae3165438 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b8ba310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:55.258277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:55.290566 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f269b46-95cc-44f9-a6e6-447bb95a6ee2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1677 microversion: 2.1 time: 0.703140 Oct 25 03:07:55.293474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 851/1865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:54 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1677 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:55.312415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:55.319411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] [instance: 6d308752-b47b-4861-99d9-30456cc3be30] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:55.340204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:55.341537 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-acfced65-bd22-4f60-835d-dd6ae3165438 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.114978 Oct 25 03:07:55.342160 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1015/1866] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:55 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:55.344856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:55.345712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:55.347931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:55.348900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:55.352661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:55.363240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:55.363855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:55.371198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:55.372483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:55.373097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:55.374031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:55.378181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:55.378881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:55.418968 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] HTTP exception thrown: Instance 6d308752-b47b-4861-99d9-30456cc3be30 could not be found. Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Request method failure captured: Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 HTTP/1.1 Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1LTWmnK8yRxP0eKModziPMx0W_w1H_21hTAHeB5nFaXjggqLPJK85hwZco_9ayZgPtdfO7dHOkqXK38u13CqNOixqdTQV5ybbt_HuW2BRYSm-ZxIujyAs46BulL7DioNGjTLP8-hQ_ZnzRW9ZByEBc2sbHUel4XdFvFOiBBmIIHBK0 Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:07:55.439059 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48e121439efa409ea63903f5e1a70eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48e121439efa409ea63903f5e1a70eb6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48e121439efa409ea63903f5e1a70eb6"}]}] Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 48e121439efa409ea63903f5e1a70eb6 Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-70274066 Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3c327bb6e4cb48d1a949e216065aef4c Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListServersNegativeTestJSON-70274066-project Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 6d308752-b47b-4861-99d9-30456cc3be30 could not be found. Oct 25 03:07:55.440851 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '6d308752-b47b-4861-99d9-30456cc3be30'} Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d308752-b47b-4861-99d9-30456cc3be30 could not be found. Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:55.442010 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d308752-b47b-4861-99d9-30456cc3be30 could not be found. Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d308752-b47b-4861-99d9-30456cc3be30 could not be found. Oct 25 03:07:55.444650 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:07:55.451002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] Returning 404 to user: Instance 6d308752-b47b-4861-99d9-30456cc3be30 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:55.452551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52a42b23-ceac-4eeb-8ba1-d6856d34611e tempest-ListServersNegativeTestJSON-70274066 tempest-ListServersNegativeTestJSON-70274066-project] 10.222.0.36 "GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30" status: 404 len: 111 microversion: 2.1 time: 0.156369 Oct 25 03:07:55.455782 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 852/1867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:55 2022] GET /compute/v2.1/servers/6d308752-b47b-4861-99d9-30456cc3be30 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:07:55.925851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:55.983289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:55.995584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:56.003178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:56.022877 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7fa2425f-dd5d-474f-82b0-421149c29437 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.673647 Oct 25 03:07:56.028864 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1016/1868] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:55 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:56.139110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:56.139935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:56.152661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:56.153489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:56.154299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:56.158073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:56.158890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:56.159698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:56.323866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:56.325142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:56.334026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:56.343124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:56.344372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:56.346955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:56.347750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:56.348450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:56.358660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:56.852121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:56.867123 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf13a3a2-e3c9-4fe8-af47-9750bb7f2c1e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.727871 Oct 25 03:07:56.872413 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 853/1869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:56 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:56.907633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5677bf69-123d-423f-a2e2-1f7ca7e654ea tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd330b7a60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:56.985302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:57.049747 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5677bf69-123d-423f-a2e2-1f7ca7e654ea tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.161087 Oct 25 03:07:57.050513 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 854/1870] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:56 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:57.066754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:57.076098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:57.107909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:57.117941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:57.121547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:57.124205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:57.126960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:57.128978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:57.632946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:57.664479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:57.667631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:57.674252 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35947f65-c504-48a7-9e03-077c68d20c1d tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.611252 Oct 25 03:07:57.676729 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 855/1871] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:57 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:57.848206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:57.858332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:07:57.863350 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-250c0809-5210-42b9-aa6d-b6279389ddd8 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1677 microversion: 2.1 time: 1.543621 Oct 25 03:07:57.885379 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1017/1872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:56 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1677 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:57.913670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:57.916022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:57.934656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:57.935607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:57.938176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:57.939167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:57.940127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:57.941400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:58.181298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0777fdef-4cc1-4f6c-a914-363d7f5b3dd1 tempest-FloatingIPDetailsNegativeTestJSON-1046445033 tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project] Calling method '.version_select at 0x7efd3b803940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:58.312470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-0777fdef-4cc1-4f6c-a914-363d7f5b3dd1 tempest-FloatingIPDetailsNegativeTestJSON-1046445033 tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 98271a8c-7d17-4ba0-b882-8d34647049b1 could not be found", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:07:58.313259 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0777fdef-4cc1-4f6c-a914-363d7f5b3dd1 tempest-FloatingIPDetailsNegativeTestJSON-1046445033 tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project] HTTP exception thrown: Floating IP not found for ID 98271a8c-7d17-4ba0-b882-8d34647049b1 Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0777fdef-4cc1-4f6c-a914-363d7f5b3dd1 tempest-FloatingIPDetailsNegativeTestJSON-1046445033 tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project] Request method failure captured: Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-floating-ips/98271a8c-7d17-4ba0-b882-8d34647049b1 HTTP/1.1 Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1MNmA9xyxHR-9ogV4-ruJmf2Q_8t7mbJ6ShHhJkgVGqGeJPHmBqDSbjo0G4psXXdmvhbtVroU_E0P2_LaJq6jOjzzPl38UOoU3vnfzzvk1rjYpGlfUxE02uCrckSWAOMbfo8cZyNicuDWSwihwHdmOpB6KNJsf_ri1EgOenzo0Hugk Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8adfae77c1e24a2aa6cac35945a21b96 Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1046445033 Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:07:58.316846 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8adfae77c1e24a2aa6cac35945a21b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8adfae77c1e24a2aa6cac35945a21b96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8adfae77c1e24a2aa6cac35945a21b96", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8adfae77c1e24a2aa6cac35945a21b96"}]}] Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1046445033 Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8adfae77c1e24a2aa6cac35945a21b96 Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1046445033 Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: e0ca128add1342cfb8abc82e65a9914e Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: exception: Floating IP not found for ID 98271a8c-7d17-4ba0-b882-8d34647049b1 Oct 25 03:07:58.319664 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '98271a8c-7d17-4ba0-b882-8d34647049b1'} Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:58.320667 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 98271a8c-7d17-4ba0-b882-8d34647049b1 could not be found Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0fb1687-d882-4893-9897-50455f797984'] Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 98271a8c-7d17-4ba0-b882-8d34647049b1. Oct 25 03:07:58.322182 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 98271a8c-7d17-4ba0-b882-8d34647049b1 Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:07:58.323561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:07:58.325010 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:07:58.325010 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 98271a8c-7d17-4ba0-b882-8d34647049b1 Oct 25 03:07:58.325010 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:07:58.325010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0777fdef-4cc1-4f6c-a914-363d7f5b3dd1 tempest-FloatingIPDetailsNegativeTestJSON-1046445033 tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project] Returning 404 to user: Floating IP not found for ID 98271a8c-7d17-4ba0-b882-8d34647049b1 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:07:58.325010 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0777fdef-4cc1-4f6c-a914-363d7f5b3dd1 tempest-FloatingIPDetailsNegativeTestJSON-1046445033 tempest-FloatingIPDetailsNegativeTestJSON-1046445033-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/98271a8c-7d17-4ba0-b882-8d34647049b1" status: 404 len: 111 microversion: 2.1 time: 0.319989 Oct 25 03:07:58.325010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1018/1873] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:07:57 2022] GET /compute/v2.1/os-floating-ips/98271a8c-7d17-4ba0-b882-8d34647049b1 => generated 111 bytes in 322 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:07:58.350368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d7ce01c-5590-4e60-b873-2d35747f3e88 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b803af0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:58.457298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d7ce01c-5590-4e60-b873-2d35747f3e88 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.130083 Oct 25 03:07:58.466319 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1019/1874] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:58 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:58.710239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:58.711452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:58.726510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:58.729914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:58.730697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:58.734372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:58.734885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:58.742224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:58.827082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:58.843256 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbc65f8b-6ce2-4a37-ae4d-5298ee5f0fa5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.943522 Oct 25 03:07:58.845892 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 856/1875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:57 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:58.901292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:58.902224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:58.912390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:58.915910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:58.917965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:58.919480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:58.924737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:58.925251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:59.702164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:59.718867 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9cec94f-1f52-4644-a6bc-004e8e60ee7d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1677 microversion: 2.1 time: 0.827351 Oct 25 03:07:59.720124 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 857/1876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:58 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1677 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:07:59.725664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4d9055a8-c0eb-4976-afd7-ec5c3fa760af tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3357b1f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:59.814058 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4d9055a8-c0eb-4976-afd7-ec5c3fa760af tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.092537 Oct 25 03:07:59.814914 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 858/1877] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:07:59 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:07:59.871358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:59.872823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:07:59.873512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:07:59.886478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:59.899908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:07:59.903812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:59.904391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:59.904840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:59.905608 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-42dbfbf3-963b-4f8e-b403-9ba6d6720637 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.198532 Oct 25 03:07:59.908557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1020/1878] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:07:58 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:07:59.911449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:07:59.912996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:07:59.913217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:07:59.939306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:00.749376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:00.749812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:00.760354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:00.768900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:00.769426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:00.770235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:00.770714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:00.771809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:01.222677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:01.232332 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b3e5ad5-cc0b-4730-a41d-9c171463c120 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 1.363591 Oct 25 03:08:01.236573 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 859/1879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:07:59 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:01.248926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c0fb357-5538-4476-a92f-72e886cddb5e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3313b040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:01.328597 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c0fb357-5538-4476-a92f-72e886cddb5e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.090552 Oct 25 03:08:01.335306 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 860/1880] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:08:01 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:01.351536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:01.352438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:01.367590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:01.368462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:01.374865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:01.376067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:01.376864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:01.377576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:01.766063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:01.781033 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1dc7802f-6a3b-4fa1-a76a-383f048d7923 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1677 microversion: 2.1 time: 1.034831 Oct 25 03:08:01.791236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1021/1881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:00 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1677 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:02.084445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:02.118968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:02.124965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:02.132395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed925142-8ebb-4bec-b180-40e679a48416 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.794116 Oct 25 03:08:02.133154 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 861/1882] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:01 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:02.263006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:02.264378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:02.274155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:02.275027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:02.275754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:02.276762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:02.277951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:02.278628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:02.350173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80648caa-7c23-4f06-9a97-efe5f4eae7f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3313a700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:02.428316 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-80648caa-7c23-4f06-9a97-efe5f4eae7f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.081300 Oct 25 03:08:02.429784 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 862/1883] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:08:02 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:02.811893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:02.826123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:02.844890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:02.845785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:02.846419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:02.849987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:02.850748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:02.851370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:03.095787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:03.111472 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5ac64cb3-d1f0-477a-a4bb-90979b75f753 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.852866 Oct 25 03:08:03.112153 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1022/1884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:02 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:03.165644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:03.166299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:03.181638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:03.182201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:03.184368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:03.185133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:03.185607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:03.186156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:03.251091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:03.264998 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-135c8099-a50d-4887-bee8-f78c3195bee4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1677 microversion: 2.1 time: 0.456829 Oct 25 03:08:03.271878 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 863/1885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:02 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1677 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:03.445614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5cf6a5ad-9d88-40ca-9bfa-52ddafbf703e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33312af0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:03.523303 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5cf6a5ad-9d88-40ca-9bfa-52ddafbf703e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.082393 Oct 25 03:08:03.526743 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 864/1886] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:08:03 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:03.639805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:03.674008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:03.682974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:03.688401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c75a3abf-66d5-45ef-b2c3-68681d1f06ed tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.527637 Oct 25 03:08:03.714247 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1023/1887] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:03 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:04.136957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:04.137984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:04.158495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:04.159454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:04.160571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:04.162208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:04.164876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:04.167187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:04.295718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:04.300998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:04.351047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:04.355015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:04.356578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:04.358354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:04.359337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:04.360660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:04.824548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:04.839883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe57d45d-7cf7-4a60-9abe-88fa06d65da2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1654 microversion: 2.1 time: 0.551588 Oct 25 03:08:04.842105 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1024/1888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:04 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1654 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:04.859706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-332ab0b9-b18d-41c8-b21f-77e084700b9f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3367a790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:04.981015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-332ab0b9-b18d-41c8-b21f-77e084700b9f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.133116 Oct 25 03:08:04.987613 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1025/1889] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:08:04 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:05.001616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:05.004582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:05.017409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:05.019558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:05.023988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:05.027006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:05.028009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:05.030824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:05.457931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:05.491184 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5739020e-5346-45b1-b5fa-f6a4c0cc421a tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 1.357110 Oct 25 03:08:05.496328 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 865/1890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:04 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:05.505218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad19ce03-a8e4-439c-859c-3ae714e89965 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:05.517229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad19ce03-a8e4-439c-859c-3ae714e89965 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:05.518070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad19ce03-a8e4-439c-859c-3ae714e89965 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:05.518736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad19ce03-a8e4-439c-859c-3ae714e89965 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:05.587901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:05.601602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad19ce03-a8e4-439c-859c-3ae714e89965 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Going to try to start instance {{(pid=120563) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 25 03:08:05.608484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:05.615778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:05.617290 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-147a91b4-3ff7-4156-91ea-547799b10130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.628206 Oct 25 03:08:05.618916 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1026/1891] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:04 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:05.629204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-703ab216-6694-456c-b5ef-26773ebe55ad req-e59ccf0b-0a75-4257-b9a4-a89e9165d54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ded7945-9647-4ba2-8f58-50aea584fed7", "name": "network-vif-unplugged", "status": "completed", "tag": "2025e32c-5be3-4b07-a237-39e499927e8a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:05.655882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-703ab216-6694-456c-b5ef-26773ebe55ad req-e59ccf0b-0a75-4257-b9a4-a89e9165d54d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:05.657695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-703ab216-6694-456c-b5ef-26773ebe55ad req-e59ccf0b-0a75-4257-b9a4-a89e9165d54d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:05.658315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-703ab216-6694-456c-b5ef-26773ebe55ad req-e59ccf0b-0a75-4257-b9a4-a89e9165d54d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:05.680399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad19ce03-a8e4-439c-859c-3ae714e89965 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action" status: 202 len: 0 microversion: 2.1 time: 0.182521 Oct 25 03:08:05.681022 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 866/1892] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:08:05 2022] POST /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:08:05.690075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:05.691037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:05.712522 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-703ab216-6694-456c-b5ef-26773ebe55ad req-e59ccf0b-0a75-4257-b9a4-a89e9165d54d service nova] Creating event network-vif-unplugged:2025e32c-5be3-4b07-a237-39e499927e8a for instance 5ded7945-9647-4ba2-8f58-50aea584fed7 on n-h1-862355-1 Oct 25 03:08:05.714338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:05.718387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:05.719087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:05.720000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:05.720673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:05.721298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:05.731254 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-703ab216-6694-456c-b5ef-26773ebe55ad req-e59ccf0b-0a75-4257-b9a4-a89e9165d54d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110428 Oct 25 03:08:05.737477 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1027/1893] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:06.000114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7404424-cf72-4812-9851-b02af7f52524 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd335a03a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:06.109111 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d7404424-cf72-4812-9851-b02af7f52524 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1414 microversion: 2.1 time: 0.114952 Oct 25 03:08:06.110910 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1028/1894] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:08:05 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:06.522231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:06.523011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:06.543820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:06.553709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:06.554301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:06.555086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:06.558103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:06.558719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:06.833130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:06.847346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3475582c-fbad-48aa-8a3e-978fddb60231 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1663 microversion: 2.1 time: 1.161531 Oct 25 03:08:06.863513 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 867/1895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:05 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1663 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:06.873356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:06.874000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:06.893182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:06.893773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:06.894231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:06.896873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:06.897359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:06.897930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:07.300425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:07.347236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32902822-0886-4c24-98ed-94bc57920932 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.825354 Oct 25 03:08:07.352994 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1029/1896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:06 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:07.368363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c64c7600-9785-490f-8fb4-be9e4bbbc878 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b89e670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:07.446081 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c64c7600-9785-490f-8fb4-be9e4bbbc878 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1423 microversion: 2.1 time: 0.091620 Oct 25 03:08:07.457519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1030/1897] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:08:07 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:07.475229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4fb2b4b-7f0c-4b84-abb5-640ece3fa689 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3b8723a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:07.507641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:07.516988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:07.528371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:07.539286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a87ab873-e3ea-48b1-9130-46c1fe421be6 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.670522 Oct 25 03:08:07.550075 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 868/1898] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:06 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:07.590150 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4fb2b4b-7f0c-4b84-abb5-640ece3fa689 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 200 len: 1423 microversion: 2.1 time: 0.125771 Oct 25 03:08:07.610766 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1031/1899] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:08:07 2022] GET /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:07.859163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-115046c8-b1f9-4ef0-8e19-5408b0bfda69 req-75671b98-7340-491f-a83a-e50defd0e0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ded7945-9647-4ba2-8f58-50aea584fed7", "tag": "2025e32c-5be3-4b07-a237-39e499927e8a"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:07.877576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:07.878451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:07.887803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=81 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:07.893745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-115046c8-b1f9-4ef0-8e19-5408b0bfda69 req-75671b98-7340-491f-a83a-e50defd0e0c8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:07.894078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:07.895701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-115046c8-b1f9-4ef0-8e19-5408b0bfda69 req-75671b98-7340-491f-a83a-e50defd0e0c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:07.895847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:07.897374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:07.900770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:07.901358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-115046c8-b1f9-4ef0-8e19-5408b0bfda69 req-75671b98-7340-491f-a83a-e50defd0e0c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:07.901732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:07.902373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:07.947313 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-115046c8-b1f9-4ef0-8e19-5408b0bfda69 req-75671b98-7340-491f-a83a-e50defd0e0c8 service nova] Creating event network-changed:2025e32c-5be3-4b07-a237-39e499927e8a for instance 5ded7945-9647-4ba2-8f58-50aea584fed7 on n-h1-862355-1 Oct 25 03:08:07.966576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-115046c8-b1f9-4ef0-8e19-5408b0bfda69 req-75671b98-7340-491f-a83a-e50defd0e0c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108828 Oct 25 03:08:07.967684 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 869/1900] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:08:07.983483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-368478727", "imageRef": "f605acbc-f3ba-45fe-9aa3-39890c783db3", "flavorRef": "452", "networks": [{"uuid": "385d0b29-fab5-4e63-9127-a294e08d4c17"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:08.143241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] validate_networks() for [('385d0b29-fab5-4e63-9127-a294e08d4c17', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:08:08.619444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:08.633151 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f95ae0b0-9add-4822-9d23-0987e436d56f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1663 microversion: 2.1 time: 0.760986 Oct 25 03:08:08.634543 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1032/1901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:07 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1663 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:08.641158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:08.642973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:08.654128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:08.655818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:08.657823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:08.661474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:08.663566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:08.664296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:09.078975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:09.108475 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12122c6b-14e0-4dac-ad72-737d2d848829 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1393 microversion: 2.1 time: 0.472358 Oct 25 03:08:09.110037 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1033/1902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:08 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1393 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:09.127658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:09.132603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:09.140184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:09.140896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:09.141336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:09.142338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:09.143155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:09.144946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:09.619022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:08:09.619495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:08:09.619914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:08:09.620735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:08:09.621556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:08:09.640709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:09.651170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:09.655431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:09.659604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:09.661123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:09.661302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:09.663954 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9f1fe63-3d58-4b50-9e4a-a152ab7b9e4a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.552463 Oct 25 03:08:09.665412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:09.667258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:09.670294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:09.674269 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1034/1903] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:09 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:09.690434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:09.691069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:09.708420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:09.709665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:09.709665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:09.710824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:09.711297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:09.711776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:09.777655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:08:09.802263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for user 438a56b0a79647f6bb195b7e0c42b089 and project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:08:09.836732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:08:09.839690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f605acbc-f3ba-45fe-9aa3-39890c783db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:08:09.925930 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5425f49-269a-4091-9a42-70a10578b272 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.955894 Oct 25 03:08:09.926960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 870/1904] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:08:09.938437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d942f8b1-8275-4fcb-ab37-4eff71b5a58c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:09.942774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d942f8b1-8275-4fcb-ab37-4eff71b5a58c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:10.108886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d942f8b1-8275-4fcb-ab37-4eff71b5a58c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:10.122599 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d942f8b1-8275-4fcb-ab37-4eff71b5a58c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1207 microversion: 2.1 time: 0.185424 Oct 25 03:08:10.123561 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 871/1905] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:09 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1207 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:10.137520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:10.139839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:10.149383 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8f2204bc-4877-4f04-a77d-7a682c684c5c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1667 microversion: 2.1 time: 0.473867 Oct 25 03:08:10.154227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:10.157871 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1035/1906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:09 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1667 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:10.174604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:10.179906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:10.184444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:10.185626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:10.187843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:10.189297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:10.191271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:10.564704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:10.579487 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93701d71-0998-49e9-9090-99c5a08beec9 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1383 microversion: 2.1 time: 0.444413 Oct 25 03:08:10.580347 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 872/1907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:10 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1383 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:10.604745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-205879e8-721a-47e4-9738-4a81953a46d6 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '.version_select at 0x7efd335a0280>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:10.609234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-205879e8-721a-47e4-9738-4a81953a46d6 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:10.609692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-205879e8-721a-47e4-9738-4a81953a46d6 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:10.615764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-205879e8-721a-47e4-9738-4a81953a46d6 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:10.651423 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-205879e8-721a-47e4-9738-4a81953a46d6 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 3084 microversion: 2.1 time: 0.051012 Oct 25 03:08:10.665986 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1036/1908] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:08:10 2022] GET /compute/v2.1/os-migrations => generated 3084 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:10.668361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:10.668972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:10.680836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:10.681503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:10.681980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:10.682715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:10.683184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:10.683619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:10.692228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:10.692846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:10.722711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:10.723251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:10.723709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:10.725163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:10.725632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:10.734206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:10.996793 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f768875-3ee8-450e-a53f-704bc7ebf188 tempest-LiveMigrationTest-1471256414 tempest-LiveMigrationTest-1471256414-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1534 microversion: 2.1 time: 0.332872 Oct 25 03:08:11.000085 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 873/1909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:10 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1534 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:11.049059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:11.049858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:11.059347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:11.060299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:11.061105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:11.062193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:11.062945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:11.063645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:11.117149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:11.260484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:11.301484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:11.304638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:11.307821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff32e3da-e164-44cc-ab7a-2558b9b72f9e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.618273 Oct 25 03:08:11.309708 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1037/1910] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:10 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:11.342110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:11.345038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:11.367076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:11.367881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:11.372007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:11.374935 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-10ebcb96-adac-4ef0-af1c-e29ae87e09d5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 204 len: 0 microversion: 2.1 time: 0.338589 Oct 25 03:08:11.375310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:11.376608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:11.376890 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 874/1911] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:11 2022] DELETE /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:11.378614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:11.392430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:11.393160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:11.448829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:11.449635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:11.450671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:11.451583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:11.453105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:11.453741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:11.513868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:11.528324 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-add27fbe-6522-4914-8a5b-c8025b2f8b4d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1203 microversion: 2.1 time: 0.217175 Oct 25 03:08:11.545916 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1038/1912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:11 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:11.750569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:11.808030 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9e704d7-8a24-464e-ba19-e42ccd07f6ce tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1389 microversion: 2.1 time: 0.423826 Oct 25 03:08:11.811248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 875/1913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:11 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1389 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:12.345322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:12.345981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:12.364214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:12.364723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:12.370505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:12.371314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:12.371796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:12.379182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:12.427273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1255853089", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": "none"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:12.515890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:08:12.520043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:08:12.520908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:08:12.522353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:08:12.522969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:08:12.533513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:12.534359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:12.535073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:12.536049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:12.537555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:12.538443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:12.583339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Getting quotas for project 3f2f2e3b3a3a4fd686236749a0123fb4. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:08:12.595912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Getting quotas for user 86eb801d136b4ad5968e7e125eb7ade8 and project 3f2f2e3b3a3a4fd686236749a0123fb4. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:08:12.625127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:08:12.627507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:08:12.720108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:12.733153 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef182391-9fe2-4b73-9d62-fddcbfdcf3fd tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.496383 Oct 25 03:08:12.733840 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1039/1914] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:08:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 25 03:08:12.748693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:12.750189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:12.751384 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b927b304-8f39-41bf-8237-9b63db945d3c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.413177 Oct 25 03:08:12.759930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:12.762584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:12.770722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:12.773241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:12.773956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:12.775619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:12.776409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:12.777066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:12.795284 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 876/1915] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:12 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:12.820727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa571e75-ba71-439a-9e0f-60011dc54a99 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:12.821542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa571e75-ba71-439a-9e0f-60011dc54a99 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:13.008504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:13.029778 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9683d809-0c1a-452f-9346-f03b55de9ab4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1259 microversion: 2.1 time: 0.284855 Oct 25 03:08:13.031551 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1040/1916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:12 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1259 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:13.044157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:13.044819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:13.079129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:13.079509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:13.082876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:13.088911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:13.089788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:13.089939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:13.101181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa571e75-ba71-439a-9e0f-60011dc54a99 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:13.115270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa571e75-ba71-439a-9e0f-60011dc54a99 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:13.119535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa571e75-ba71-439a-9e0f-60011dc54a99 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:13.121347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa571e75-ba71-439a-9e0f-60011dc54a99 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1281 microversion: 2.47 time: 0.321103 Oct 25 03:08:13.125228 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 877/1917] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:12 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:13.799897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:13.801044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:13.824155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:13.826647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:13.828430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:13.830696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:13.832795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:13.833716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:13.993954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.027992 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-deb3b9ae-e606-474b-a81b-f8f56a7fc9dd tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1389 microversion: 2.1 time: 0.995313 Oct 25 03:08:14.028610 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1041/1918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:13 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1389 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:14.071848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e6e96212-4eb1-4d1c-92e4-44dd13e54df3 req-8ce217f3-e85c-4987-8c16-5bc4d1275c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d634c7-bfa9-44d9-92f0-db85353b6c80", "name": "network-vif-unplugged", "status": "completed", "tag": "e0cbe30f-06e7-4571-aba4-e8d45bdbf746"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:14.105029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e6e96212-4eb1-4d1c-92e4-44dd13e54df3 req-8ce217f3-e85c-4987-8c16-5bc4d1275c52 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:14.105582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e6e96212-4eb1-4d1c-92e4-44dd13e54df3 req-8ce217f3-e85c-4987-8c16-5bc4d1275c52 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:14.111858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e6e96212-4eb1-4d1c-92e4-44dd13e54df3 req-8ce217f3-e85c-4987-8c16-5bc4d1275c52 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:14.161288 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e6e96212-4eb1-4d1c-92e4-44dd13e54df3 req-8ce217f3-e85c-4987-8c16-5bc4d1275c52 service nova] Creating event network-vif-unplugged:e0cbe30f-06e7-4571-aba4-e8d45bdbf746 for instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 on n-h1-862355-1 Oct 25 03:08:14.187507 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e6e96212-4eb1-4d1c-92e4-44dd13e54df3 req-8ce217f3-e85c-4987-8c16-5bc4d1275c52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157566 Oct 25 03:08:14.188158 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1042/1919] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:14.207573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:14.208296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:14.265721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:14.271427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:14.274879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:14.275678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:14.276169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:14.276715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:14.299183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:14.362504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.373404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.378097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.387221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eaed590f-1f45-4b37-b1a4-ecae22b27d37 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.596405 Oct 25 03:08:14.408018 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 878/1920] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:13 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:14.424746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:14.426997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:14.441743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:14.448887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:14.449774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:14.450783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:14.463007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:14.463863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:14.677592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:14.694220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.712389 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3402d7d2-5337-41f8-81ba-3720593be453 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1265 microversion: 2.1 time: 0.519243 Oct 25 03:08:14.715594 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1043/1921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:14 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1265 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:14.732388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-293f63b2-9aa8-4273-8511-b3877be36c4c req-3309be3e-e2b1-44f0-92e2-7505d00d87dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc326aa7-64de-4b71-9ae6-29e007d2ae91", "name": "network-vif-deleted", "tag": "675a386a-407b-4b7e-adff-05d0c86c1505"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:14.758140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.772618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.775540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:14.782314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-293f63b2-9aa8-4273-8511-b3877be36c4c req-3309be3e-e2b1-44f0-92e2-7505d00d87dd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:14.783119 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2feea8e-bcf8-4ba8-a0e4-87fdfb70ad85 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1277 microversion: 2.47 time: 0.373127 Oct 25 03:08:14.786467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-293f63b2-9aa8-4273-8511-b3877be36c4c req-3309be3e-e2b1-44f0-92e2-7505d00d87dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:14.787101 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 879/1922] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:14 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1277 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:14.787280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-293f63b2-9aa8-4273-8511-b3877be36c4c req-3309be3e-e2b1-44f0-92e2-7505d00d87dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:14.833276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-293f63b2-9aa8-4273-8511-b3877be36c4c req-3309be3e-e2b1-44f0-92e2-7505d00d87dd service nova] Creating event network-vif-deleted:675a386a-407b-4b7e-adff-05d0c86c1505 for instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 on n-h1-862355-1 Oct 25 03:08:14.854042 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-293f63b2-9aa8-4273-8511-b3877be36c4c req-3309be3e-e2b1-44f0-92e2-7505d00d87dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136646 Oct 25 03:08:14.860121 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1044/1923] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:15.054815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.056329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:15.067469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:15.070311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:15.074319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:15.075500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:15.076294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:15.077995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:15.214545 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef38a507-0888-4191-8798-e758ac03cec8 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] 10.222.0.36 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.425839 Oct 25 03:08:15.228331 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 880/1924] 10.222.0.36 () {58 vars in 1128 bytes} [Tue Oct 25 03:08:14 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 25 03:08:15.234426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c718e550-c413-4d5d-98da-d97bbd0cadd7 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Calling method '.version_select at 0x7efd333124c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.322853 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c718e550-c413-4d5d-98da-d97bbd0cadd7 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] HTTP exception thrown: Image not found. Oct 25 03:08:15.324244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c718e550-c413-4d5d-98da-d97bbd0cadd7 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Request method failure captured: Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MdwAELLy952wB74v7Hw10N6zJ_y95ZCqTSiRq_kd-eDa506q7LD0fLzPl6J5BzBNjuGa4-IYxgE1yXlUFiPrjWZ5ncZLucbTa5nsycyWTQ5xNMfarLcxl27oEiB2CGqSDjrBMPGbSUbGd6iI2QJXx0H6CfARX5H8ci7xt1u7WeGPM Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:15.332978 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d607a8b85dc454fb36a06603b10310f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d607a8b85dc454fb36a06603b10310f"}]}] Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 826253cb04434018baae91e2d4266576 Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '-1'} Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:15.335609 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.336714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:15.338154 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:08:15.339617 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.343647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c718e550-c413-4d5d-98da-d97bbd0cadd7 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:15.345649 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73eda143-dec7-4b84-81a5-8fea5d576d71 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.296242 Oct 25 03:08:15.346758 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c718e550-c413-4d5d-98da-d97bbd0cadd7 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] 10.222.0.36 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.116894 Oct 25 03:08:15.347334 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 881/1925] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 25 03:08:15 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:08:15.358045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50d573b8-9e14-461c-9938-95823faaa356 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Calling method '.version_select at 0x7efd331e6040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.363704 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1045/1926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:15 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:15.425782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-50d573b8-9e14-461c-9938-95823faaa356 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] HTTP exception thrown: Image not found. Oct 25 03:08:15.431017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50d573b8-9e14-461c-9938-95823faaa356 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Request method failure captured: Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/images/6ad82f93-d344-4928-97d5-34c2c98d452j HTTP/1.1 Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MdwAELLy952wB74v7Hw10N6zJ_y95ZCqTSiRq_kd-eDa506q7LD0fLzPl6J5BzBNjuGa4-IYxgE1yXlUFiPrjWZ5ncZLucbTa5nsycyWTQ5xNMfarLcxl27oEiB2CGqSDjrBMPGbSUbGd6iI2QJXx0H6CfARX5H8ci7xt1u7WeGPM Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:15.433297 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d607a8b85dc454fb36a06603b10310f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d607a8b85dc454fb36a06603b10310f"}]}] Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 826253cb04434018baae91e2d4266576 Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '6ad82f93-d344-4928-97d5-34c2c98d452j'} Oct 25 03:08:15.435425 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ad82f93-d344-4928-97d5-34c2c98d452j to delete Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.436742 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ad82f93-d344-4928-97d5-34c2c98d452j could not be found. Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:15.438446 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:08:15.440733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.445080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50d573b8-9e14-461c-9938-95823faaa356 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:15.445080 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50d573b8-9e14-461c-9938-95823faaa356 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] 10.222.0.36 "DELETE /compute/v2.1/images/6ad82f93-d344-4928-97d5-34c2c98d452j" status: 404 len: 62 microversion: 2.1 time: 0.091362 Oct 25 03:08:15.446247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:15.448342 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 882/1927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:15 2022] DELETE /compute/v2.1/images/6ad82f93-d344-4928-97d5-34c2c98d452j => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:08:15.467042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3933e37-103d-43e4-8319-03d4dbb766b0 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Calling method '.version_select at 0x7efd382a03a0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.477660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:15.478220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:15.478670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:15.479408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:15.479875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:15.480400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:15.511276 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b3933e37-103d-43e4-8319-03d4dbb766b0 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] HTTP exception thrown: Image not found. Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3933e37-103d-43e4-8319-03d4dbb766b0 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Request method failure captured: Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/images/34835891-4eac-4a32-9d98-8d3c560fa2fd1 HTTP/1.1 Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MdwAELLy952wB74v7Hw10N6zJ_y95ZCqTSiRq_kd-eDa506q7LD0fLzPl6J5BzBNjuGa4-IYxgE1yXlUFiPrjWZ5ncZLucbTa5nsycyWTQ5xNMfarLcxl27oEiB2CGqSDjrBMPGbSUbGd6iI2QJXx0H6CfARX5H8ci7xt1u7WeGPM Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:15.514718 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d607a8b85dc454fb36a06603b10310f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d607a8b85dc454fb36a06603b10310f"}]}] Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 826253cb04434018baae91e2d4266576 Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '34835891-4eac-4a32-9d98-8d3c560fa2fd1'} Oct 25 03:08:15.517583 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 34835891-4eac-4a32-9d98-8d3c560fa2fd1 to delete Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.519422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34835891-4eac-4a32-9d98-8d3c560fa2fd1 could not be found. Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:15.522137 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3933e37-103d-43e4-8319-03d4dbb766b0 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:15.525365 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3933e37-103d-43e4-8319-03d4dbb766b0 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] 10.222.0.36 "DELETE /compute/v2.1/images/34835891-4eac-4a32-9d98-8d3c560fa2fd1" status: 404 len: 62 microversion: 2.1 time: 0.065065 Oct 25 03:08:15.529613 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 883/1928] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:15 2022] DELETE /compute/v2.1/images/34835891-4eac-4a32-9d98-8d3c560fa2fd1 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:08:15.537504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0af2fa36-d317-4439-9bc6-a01dc9030157 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Calling method '.version_select at 0x7efd333d29d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.591923 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0af2fa36-d317-4439-9bc6-a01dc9030157 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] HTTP exception thrown: Image not found. Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0af2fa36-d317-4439-9bc6-a01dc9030157 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Request method failure captured: Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/images/tempest-invalid-3961194 HTTP/1.1 Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MdwAELLy952wB74v7Hw10N6zJ_y95ZCqTSiRq_kd-eDa506q7LD0fLzPl6J5BzBNjuGa4-IYxgE1yXlUFiPrjWZ5ncZLucbTa5nsycyWTQ5xNMfarLcxl27oEiB2CGqSDjrBMPGbSUbGd6iI2QJXx0H6CfARX5H8ci7xt1u7WeGPM Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:15.594016 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d607a8b85dc454fb36a06603b10310f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d607a8b85dc454fb36a06603b10310f"}]}] Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 826253cb04434018baae91e2d4266576 Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'tempest-invalid-3961194'} Oct 25 03:08:15.595656 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-3961194 to delete Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.596640 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-3961194 could not be found. Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:15.600118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0af2fa36-d317-4439-9bc6-a01dc9030157 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0af2fa36-d317-4439-9bc6-a01dc9030157 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] 10.222.0.36 "DELETE /compute/v2.1/images/tempest-invalid-3961194" status: 404 len: 62 microversion: 2.1 time: 0.065679 Oct 25 03:08:15.602304 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 884/1929] 10.222.0.36 () {58 vars in 1197 bytes} [Tue Oct 25 03:08:15 2022] DELETE /compute/v2.1/images/tempest-invalid-3961194 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:08:15.609296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7dac618f-4daa-4527-9dc1-dfa6426f7c55 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Calling method '.version_select at 0x7efd337a9820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.672194 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-7dac618f-4daa-4527-9dc1-dfa6426f7c55 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] HTTP exception thrown: Image not found. Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7dac618f-4daa-4527-9dc1-dfa6426f7c55 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Request method failure captured: Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/images/e0bb323b-d925-472d-9485-61d71f6e5e32 HTTP/1.1 Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MdwAELLy952wB74v7Hw10N6zJ_y95ZCqTSiRq_kd-eDa506q7LD0fLzPl6J5BzBNjuGa4-IYxgE1yXlUFiPrjWZ5ncZLucbTa5nsycyWTQ5xNMfarLcxl27oEiB2CGqSDjrBMPGbSUbGd6iI2QJXx0H6CfARX5H8ci7xt1u7WeGPM Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:15.674069 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4d607a8b85dc454fb36a06603b10310f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4d607a8b85dc454fb36a06603b10310f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4d607a8b85dc454fb36a06603b10310f"}]}] Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 4d607a8b85dc454fb36a06603b10310f Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091 Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 826253cb04434018baae91e2d4266576 Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1484995091-project Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e0bb323b-d925-472d-9485-61d71f6e5e32'} Oct 25 03:08:15.675674 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e0bb323b-d925-472d-9485-61d71f6e5e32 to delete Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.678527 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e0bb323b-d925-472d-9485-61d71f6e5e32 could not be found. Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:15.680424 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7dac618f-4daa-4527-9dc1-dfa6426f7c55 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:15.681984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7dac618f-4daa-4527-9dc1-dfa6426f7c55 tempest-ImagesDeleteNegativeTestJSON-1484995091 tempest-ImagesDeleteNegativeTestJSON-1484995091-project] 10.222.0.36 "DELETE /compute/v2.1/images/e0bb323b-d925-472d-9485-61d71f6e5e32" status: 404 len: 62 microversion: 2.1 time: 0.072510 Oct 25 03:08:15.686377 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 885/1930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:15 2022] DELETE /compute/v2.1/images/e0bb323b-d925-472d-9485-61d71f6e5e32 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:08:15.748111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:15.748766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:15.760981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:15.761795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:15.762423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:15.763295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:15.763896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:15.764496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:16.223589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:16.246759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:16.249106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:16.255278 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2daba11d-ead9-42aa-a07f-12e8128d024f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.834126 Oct 25 03:08:16.264851 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1046/1931] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:15 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:16.270916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:16.292354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:16.321346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:16.326744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:16.328156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:16.330448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:16.334402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:16.342450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:16.655604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:16.670301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:16.672144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:16.677175 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22beebc0-5d70-40a3-a318-6c14b3a3481a tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1339 microversion: 2.47 time: 0.410045 Oct 25 03:08:16.682457 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1047/1932] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:16 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1339 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:16.702210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:16.706480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:16.736010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:16.738749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:16.741569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:16.744963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:16.745472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:16.745955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:16.955450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:16.966804 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-750cf420-971f-4baa-9f5e-39ba533c9bc6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.281685 Oct 25 03:08:16.969339 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1048/1933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:16 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:17.084986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:17.093157 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b0c8201-01fe-4b46-9ad3-3424919b6a0b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 1.355767 Oct 25 03:08:17.109627 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 886/1934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:15 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:17.295937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:17.297456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:17.313443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:17.315396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:17.316176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:17.317627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:17.320733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:17.322679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:17.712132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:17.713118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:17.725112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:17.729444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:17.731844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:17.732868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:17.734407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:17.737563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:17.877877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:17.891864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:17.894861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:17.896263 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99c270e1-4691-4889-aaa4-133a8770c60c tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1339 microversion: 2.47 time: 0.189517 Oct 25 03:08:17.897304 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 887/1935] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:17 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:17.997464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:17.998119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:18.029488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:18.031388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:18.033565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:18.040093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:18.041121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:18.041818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:18.042450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:18.052344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:18.059782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:18.061630 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05e41d1f-ebc4-4e69-928f-6e32ba222f0c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.770712 Oct 25 03:08:18.062591 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1049/1936] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:17 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:18.117233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:18.117895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:18.129757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:18.130263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:18.131327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:18.132240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:18.136557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:18.137388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:18.274366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:18.284816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f0267137-bf02-486e-9821-db18dd0896de tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.291326 Oct 25 03:08:18.285557 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 888/1937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:17 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:18.407552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:18.417631 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c5881e53-ad46-4a7f-96db-3626b62ed718 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.304945 Oct 25 03:08:18.418941 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1050/1938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:18 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:18.511380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-9d9b676f-72f4-4396-a6bf-db63acbd109a req-4ea5331a-dde4-41d6-ad29-cacdd35dde5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f474cc1b-e0fe-4085-9216-34e00a0d228d", "tag": "07111e27-3936-4c74-93d2-aba44f9e2a79"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:18.527210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9d9b676f-72f4-4396-a6bf-db63acbd109a req-4ea5331a-dde4-41d6-ad29-cacdd35dde5a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:18.527701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9d9b676f-72f4-4396-a6bf-db63acbd109a req-4ea5331a-dde4-41d6-ad29-cacdd35dde5a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:18.528137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9d9b676f-72f4-4396-a6bf-db63acbd109a req-4ea5331a-dde4-41d6-ad29-cacdd35dde5a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:18.564268 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-9d9b676f-72f4-4396-a6bf-db63acbd109a req-4ea5331a-dde4-41d6-ad29-cacdd35dde5a service nova] Creating event network-changed:07111e27-3936-4c74-93d2-aba44f9e2a79 for instance f474cc1b-e0fe-4085-9216-34e00a0d228d on n-h2-862355-1 Oct 25 03:08:18.570408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-9d9b676f-72f4-4396-a6bf-db63acbd109a req-4ea5331a-dde4-41d6-ad29-cacdd35dde5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064221 Oct 25 03:08:18.571388 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 889/1939] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:18.924761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:18.925927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:18.950048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:18.952980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:18.959412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:18.961614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:18.962537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:18.965204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:19.100149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:19.101264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:19.124063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:19.133456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:19.134478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:19.135949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:19.136916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:19.137724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:19.148749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:19.210317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:19.219100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:19.224729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94d4bf7e-36f6-48ef-9649-0cc77497253f tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1339 microversion: 2.47 time: 0.304472 Oct 25 03:08:19.227240 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1051/1940] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:18 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1339 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:19.309597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:19.310260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:19.325306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:19.331918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:19.332517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:19.333282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:19.333867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:19.335122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:19.665841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:19.683062 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-deb301c7-16f9-4eb0-ba59-67c67df5495c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.377906 Oct 25 03:08:19.706456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:19.712540 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1052/1941] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:19 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:19.737204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:19.741553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:19.776237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:19.778770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:19.781346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:19.784566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:19.788773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:19.792923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:20.165563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:20.207344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:20.218746 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e47cea4-b507-4628-bc02-7a65207e9336 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.482161 Oct 25 03:08:20.219473 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1053/1942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:19 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:20.236964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:20.244345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:20.246204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec97b382-4798-49f7-9473-54fd41c52063 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.154685 Oct 25 03:08:20.249382 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 890/1943] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:19 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:20.255269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:20.257542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:20.274576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:20.276843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:20.278267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:20.280710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:20.281515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:20.283656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:20.537314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:20.553690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:20.559219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:20.560783 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9df74b74-c279-41f5-891d-e447415ace9b tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1339 microversion: 2.47 time: 0.310301 Oct 25 03:08:20.584861 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1054/1944] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:20 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1339 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:20.720481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:20.721346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:20.735161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:20.736088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:20.736791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:20.739545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:20.740126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:20.740566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:21.040118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:21.055397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c62b25bd-05d3-4d2a-8711-6cc48d955223 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.333270 Oct 25 03:08:21.070225 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 891/1945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:20 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:21.252312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:21.254402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:21.263082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:21.264009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:21.264761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:21.265963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:21.266730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:21.267460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:21.283053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:21.284653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:21.308923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:21.310074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:21.310544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:21.311277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:21.311739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:21.312178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:21.606160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:21.614575 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a96af80d-0c8f-4dc5-a88e-ccb4af856f19 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.369119 Oct 25 03:08:21.618408 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1055/1946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:21 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:21.631671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:21.632724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:21.645642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:21.647115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:21.650433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:21.651980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:21.652698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:21.660102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:21.784583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:21.809346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:21.810757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:21.817076 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc547aec-5f61-448f-9821-10fd67b864f7 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1339 microversion: 2.47 time: 0.197332 Oct 25 03:08:21.818865 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1056/1947] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:21 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:22.084765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:22.085930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:22.092887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:22.112921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:22.113542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:22.114453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:22.124934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:22.125371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:22.285739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:22.301063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0761258a-3007-497f-96a6-747ddb26f2a1 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.221326 Oct 25 03:08:22.301910 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1057/1948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:22 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:22.343105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:22.356184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:22.366909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:22.368148 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-497032ec-aa6a-42fd-8ee1-f7cc1f530b64 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.090537 Oct 25 03:08:22.376302 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 892/1949] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:21 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:22.664884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:22.665929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:22.676351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:22.678455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:22.680580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:22.681983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:22.682859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:22.684058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:22.684764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:22.685432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:22.849811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:22.850874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:22.867280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:22.868259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:22.870187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:22.871180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:22.872196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:22.873083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:23.110065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:23.203178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:23.228294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:23.231433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:23.248061 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f88affb7-7692-4cec-9352-7582918c77d6 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1339 microversion: 2.47 time: 0.401238 Oct 25 03:08:23.250448 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 893/1950] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:22 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1339 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:23.290261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:23.307257 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f1462d6b-6f70-49b4-ab16-edef2affa7d2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.653364 Oct 25 03:08:23.308591 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1058/1951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:22 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:23.333026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:23.334496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:23.348202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:23.349494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:23.351122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:23.352218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:23.354270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:23.354904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:23.406897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:23.407607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:23.424134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:23.425508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:23.428452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:23.429257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:23.429782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:23.430224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:23.567082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:23.587570 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9596dc64-5259-4901-bdb6-b6629ac5b8d6 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.259128 Oct 25 03:08:23.589422 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 894/1952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:23 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:24.282790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:24.283818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:24.306505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:24.308960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:24.309885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:24.312446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:24.315745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:24.316507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:24.666584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:24.669365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:24.689338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:24.691245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:24.692775 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c2f11da-fac4-4592-b5da-7f7893da2df8 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.290211 Oct 25 03:08:24.694358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1059/1953] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:23 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:24.701081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:24.718145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:24.719104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:24.732466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:24.737386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:24.742580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:24.743163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:24.744985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:24.745568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:24.745908 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aeece356-cf8c-4d69-98f4-4832df5b95ee tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1360 microversion: 2.47 time: 0.458584 Oct 25 03:08:24.748294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:24.759895 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 895/1954] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:24 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1360 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:24.795110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:24.795737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:24.831419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:24.834758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:24.835305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:24.836081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:24.836574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:24.838420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:24.840702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:25.232439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:25.272870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b005226c-7790-4acc-8105-7e7fa931d115 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1184 microversion: 2.1 time: 0.511754 Oct 25 03:08:25.273740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 896/1955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:24 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1184 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:25.297422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-128865702"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:25.309027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:25.331541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:25.332167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:25.333664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:25.335322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:25.336086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:25.336725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:25.524501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:25.538825 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-62374ac8-a76d-4c42-8cb8-02e4371010df tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.837073 Oct 25 03:08:25.546514 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1060/1956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:24 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:25.731123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:25.732417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:25.755301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:25.759294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:25.762707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:25.763518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:25.764004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:25.770592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:25.984480 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2565304-a93b-4bce-8a9f-1a26b102f1e1 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "POST /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc/action" status: 202 len: 52 microversion: 2.47 time: 0.709599 Oct 25 03:08:25.992801 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 897/1957] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:08:25 2022] POST /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc/action => generated 52 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 25 03:08:26.024111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:26.024723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:26.039719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.040229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.040684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.044698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.045223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.045721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.180737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:26.323553 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b446ac40-15d0-440c-89a7-a0491d5f2e2e tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 204 len: 0 microversion: 2.47 time: 0.330352 Oct 25 03:08:26.325063 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 898/1958] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:08:25 2022] DELETE /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:08:26.332182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:26.333159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:26.343051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.344034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.344859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.346182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.347001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.347597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.466115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.467391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.468014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.468871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lazy-loading 'fault' on Instance uuid dc326aa7-64de-4b71-9ae6-29e007d2ae91 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:26.489598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:26.720538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:26.733147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:26.734810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:26.736201 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28ac2b5c-7c5e-4bed-97e0-2b03c3f4a1f9 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 1.011537 Oct 25 03:08:26.746106 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1061/1959] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:25 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:26.753628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:26.754677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:26.756657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:26.772531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.773071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.773528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.774341 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e7209c2b-f694-44fe-a987-f7779776bc15 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 200 len: 1189 microversion: 2.1 time: 0.444629 Oct 25 03:08:26.774473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.775172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.776411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.799905 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 899/1960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:26 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 1189 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:26.817902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:26.819401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:26.862006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.862508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.862954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:26.874496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:26.875359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:26.880103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:27.250699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:27.259141 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc9175b1-7d71-4573-8a26-dcc3a483ad30 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.458036 Oct 25 03:08:27.259735 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 900/1961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:26 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:27.505380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-170346179", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "7a43a2a1-1a73-48f7-bffe-b80325e046ec"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:27.605101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] validate_networks() for [('7a43a2a1-1a73-48f7-bffe-b80325e046ec', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:08:27.634436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:27.648779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:27.655327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:27.662460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e6bf3b8-c0ed-4c88-a9bc-7e8e7ba9286d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1366 microversion: 2.47 time: 0.915059 Oct 25 03:08:27.670566 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1062/1962] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:26 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1366 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:27.767006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:27.768535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:27.784373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:27.786373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:27.786847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:27.796993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:27.799018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:27.799492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.141173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:28.156478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:28.174212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:28.175519 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-716eba1d-be80-44b2-a295-6bee3e2ce9cb tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1487 microversion: 2.25 time: 0.412926 Oct 25 03:08:28.176119 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1063/1963] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:27 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1487 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:28.188136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:28.189919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: dc326aa7-64de-4b71-9ae6-29e007d2ae91] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:28.223467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.227464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.228753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.231536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.238276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.241916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.285617 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] HTTP exception thrown: Instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 could not be found. Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Request method failure captured: Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 HTTP/1.1 Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F7-hOK8gQYZomL5Kx5Mt-SrWJxGRF6kw3besvl-6zdNRkcCNxZeV6-r7cmguK6iziEMUrd3Osg24XUTj5Qycwtc7PKW02_99utqxh2Z0PIlA-SoJfIsL79LiSsyZPoWRJfOVUqb37mPCWhgpDYi7IZgD6IPnx2LkLpPqh-muUbNr0 Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:28.292968 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9eaf27614124019998010f834321c31", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9eaf27614124019998010f834321c31"}]}] Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f7fc1bae87d741e58f4e2182796f2df3 Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 could not be found. Oct 25 03:08:28.295197 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'dc326aa7-64de-4b71-9ae6-29e007d2ae91'} Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 could not be found. Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:28.296359 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 could not be found. Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 could not be found. Oct 25 03:08:28.298529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:28.304418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Returning 404 to user: Instance dc326aa7-64de-4b71-9ae6-29e007d2ae91 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:28.307655 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8c1d915-e100-4bd5-ba2c-654c61c19a9e tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91" status: 404 len: 111 microversion: 2.1 time: 0.130106 Oct 25 03:08:28.311141 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1064/1964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:28 2022] GET /compute/v2.1/servers/dc326aa7-64de-4b71-9ae6-29e007d2ae91 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:28.350272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:28.356608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:28.380245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.381113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.382793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.388452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.389179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.393044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.460761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:08:28.461992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:08:28.463023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:08:28.463693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:08:28.464339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:08:28.479265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.480306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.481195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.482247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.482926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.484004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.531903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Getting quotas for project f201d471005d447a85df971b269e65d4. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:08:28.549513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Getting quotas for user 58ff7c33a185492ea7d0565af7cf999a and project f201d471005d447a85df971b269e65d4. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:08:28.621713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:08:28.629629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:08:28.850456 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6229da40-6edf-4903-9826-13811720e1b7 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584994 Oct 25 03:08:28.854042 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 901/1965] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:08:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:08:28.880805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:28.903823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:28.953233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.953770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.954224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:28.970503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:28.971386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:28.972057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:29.197362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:29.265775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:29.278224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:29.279041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:29.288035 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-405a2113-e278-454a-8685-74a90defa19d tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1366 microversion: 2.47 time: 0.431893 Oct 25 03:08:29.288974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 902/1966] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:28 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:29.305256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-130cda17-d72a-43f1-a63b-a4a4fa0f04b1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:29.308675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-130cda17-d72a-43f1-a63b-a4a4fa0f04b1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:29.323080 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfde7ff7-dc77-453a-80c3-fb240ac73ddd tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.990620 Oct 25 03:08:29.342733 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1065/1967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:28 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:29.382783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:29.383754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:29.422284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:29.426674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:29.431550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:29.434961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-130cda17-d72a-43f1-a63b-a4a4fa0f04b1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:29.436745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:29.440175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:29.441877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:29.443308 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-130cda17-d72a-43f1-a63b-a4a4fa0f04b1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1215 microversion: 2.1 time: 0.152941 Oct 25 03:08:29.446699 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 903/1968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:29 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:30.085380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:30.100471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:30.104147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:30.107858 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b62b429-e0ec-4d86-b9e0-70f363a3a886 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1477 microversion: 2.25 time: 0.762327 Oct 25 03:08:30.111191 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1066/1969] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:29 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1477 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:30.139911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18f1706b-8166-40f4-8c6f-f9fbc1a499ea tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '.version_select at 0x7efd32ffa1f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:30.144155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f1706b-8166-40f4-8c6f-f9fbc1a499ea tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:30.144768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f1706b-8166-40f4-8c6f-f9fbc1a499ea tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:30.145209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f1706b-8166-40f4-8c6f-f9fbc1a499ea tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:30.168131 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18f1706b-8166-40f4-8c6f-f9fbc1a499ea tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 3200 microversion: 2.25 time: 0.032232 Oct 25 03:08:30.169458 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 904/1970] 10.222.0.36 () {60 vars in 1184 bytes} [Tue Oct 25 03:08:30 2022] GET /compute/v2.1/os-migrations => generated 3200 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:30.195877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:30.196951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:30.219465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:30.220615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:30.221267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:30.222291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:30.227261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:30.229196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:30.319578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:30.320207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:30.330283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:30.331031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:30.331468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:30.332174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:30.332991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:30.333143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:30.560311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:30.576653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:30.581334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:30.582713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb1ec1be-c7c5-438b-9c8d-c7645b56cc00 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1366 microversion: 2.47 time: 0.268492 Oct 25 03:08:30.585587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 905/1971] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:30 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:30.600363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:30.601181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:30.620069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:30.620643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:30.621009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:30.621742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:30.630621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:30.631735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:30.935695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:30.981500 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50a788b4-a38f-4a0f-bd9f-5aab11b2fbd7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.394760 Oct 25 03:08:30.986748 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 906/1972] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:30 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:31.014127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:31.018907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:31.070230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.095320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.095775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.096530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.096990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.097417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.276890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] Lazy-loading 'services' on Instance uuid 5ded7945-9647-4ba2-8f58-50aea584fed7 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:31.349787 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8a971f93-1d49-49d3-92e8-0ede99b7d75b tempest-LiveAutoBlockMigrationV225Test-1201915702 tempest-LiveAutoBlockMigrationV225Test-1201915702-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1970 microversion: 2.25 time: 1.158191 Oct 25 03:08:31.378850 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1067/1973] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:30 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1970 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:31.402115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:31.403741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:31.433164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.435808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.439120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.443129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.448944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.453516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.474422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:31.484430 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-545551e9-7dce-4ff8-8f7f-e3ca1f195bda tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1267 microversion: 2.1 time: 0.496269 Oct 25 03:08:31.489461 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 907/1974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:30 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1267 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:31.553291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:31.617627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:31.618506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:31.634910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.635695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.636828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.638596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.639447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.640066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.794179 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b55ea3d6-82ff-450c-90e9-a428812d15df tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 204 len: 0 microversion: 2.25 time: 0.398393 Oct 25 03:08:31.796283 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1068/1975] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:08:31 2022] DELETE /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:08:31.825952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:31.827591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:31.857017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.863896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.864872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.867149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:31.871091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:31.872739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:31.877923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:31.898048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:31.903618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:31.905012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3253db60-c929-43b0-85b9-36db9bbc5427 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1366 microversion: 2.47 time: 0.297911 Oct 25 03:08:31.927363 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 908/1976] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:31 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:32.005649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:32.007690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:32.046162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:32.049298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:32.049814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:32.059890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:32.064344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:32.064864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:32.495554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:32.503886 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c96acd85-d21e-47ce-bed9-b47788cd5016 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.503217 Oct 25 03:08:32.504484 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 909/1977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:31 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:32.518287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:32.524744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:32.537714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:32.541107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:32.541794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:32.542745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:32.549287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:32.550037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:32.604693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:32.616298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:32.617793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:32.621797 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51c774c5-1c66-4878-a56f-a5d961de874c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1483 microversion: 2.25 time: 0.821035 Oct 25 03:08:32.624450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1069/1978] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:31 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1483 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:32.673748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:32.689903 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-312e30fa-b0c9-45ae-b436-028f740ce7d0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1273 microversion: 2.1 time: 0.176226 Oct 25 03:08:32.708610 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 910/1979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:32 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:32.935353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:32.936692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:32.948248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:32.951990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:32.952637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:32.956387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:32.958140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:32.960367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:33.198521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:33.215194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:33.222785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:33.230678 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8bae3844-440c-4fa8-af28-559de715e968 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1366 microversion: 2.47 time: 0.299323 Oct 25 03:08:33.253986 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1070/1980] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:32 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:33.528766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:33.529498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:33.547841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:33.552386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:33.553449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:33.557023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:33.563827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:33.564550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:33.656505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:33.657318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:33.668905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:33.669423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:33.670791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:33.671562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:33.672037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:33.672479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:34.067546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.087399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.089169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.093318 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1abed144-bf1d-48e3-b66a-9f497f2441d1 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1483 microversion: 2.25 time: 0.442597 Oct 25 03:08:34.094173 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1071/1981] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:33 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1483 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:34.104359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:34.108381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:34.123121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:34.124763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:34.125235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:34.128539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:34.129253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:34.133419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:34.149449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.159336 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7df8018d-29fa-4957-9061-cf8fdb3f4dff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.635086 Oct 25 03:08:34.163472 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 911/1982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:33 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:34.268435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:34.269442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:34.286393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:34.289040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:34.291747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:34.293395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:34.296537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:34.297426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:34.453487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.468655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.474435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.478857 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6f8f526-c44b-4bd3-8792-ab5566e379b3 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1366 microversion: 2.47 time: 0.214198 Oct 25 03:08:34.483484 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 912/1983] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:34 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:34.502919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:34.516212 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32219d53-7c1a-4918-b79e-ef6a70f165c4 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 0.417336 Oct 25 03:08:34.516819 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1072/1984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:34 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:35.122165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:35.129654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:35.134768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:35.153863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.156610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.157224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.160656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.161702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.165036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.190701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:35.192572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:35.197354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:35.210546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.212552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.214265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.215160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.216871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.219663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.493835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:35.508328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:35.511449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:35.514346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90fdbf3a-0ad6-4de6-a325-6890c5f8511f tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1483 microversion: 2.25 time: 0.396816 Oct 25 03:08:35.529492 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 913/1985] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:35 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1483 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:35.529492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:35.529492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:35.540376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.542283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.546402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.548029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.548813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.549497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.604673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:35.745396 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a31aa288-1308-4cbd-a951-23f6576b73b8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 204 len: 0 microversion: 2.1 time: 0.225370 Oct 25 03:08:35.749828 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 914/1986] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:35 2022] DELETE /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:35.780863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:35.785069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:35.800396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:35.821460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-080520d2-49da-4f6d-988b-7074dab489b8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.631591 Oct 25 03:08:35.825166 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1073/1987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:35 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:35.830328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:35.849204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.853619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.854083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:35.857268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.858058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.858535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.858970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.870949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.871123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.871434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.872149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.872616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.873047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.936777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:35.937695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:35.938391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:35.939372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lazy-loading 'fault' on Instance uuid 7c2013a3-13e9-41ac-a872-cad4f74dc4cc {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:36.043068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:36.056235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:36.060511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:36.065396 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8401af01-97df-4303-81d6-646fccb5f866 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1371 microversion: 2.47 time: 0.308209 Oct 25 03:08:36.067829 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 915/1988] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:35 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:36.076123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:36.077254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:36.085429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:36.086437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:36.087268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:36.088314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:36.089056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:36.090022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:36.117455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:36.232718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:36.241383 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97b148dd-2d8a-4ada-9eea-ac8b1215571a tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 0.414786 Oct 25 03:08:36.257610 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1074/1989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:35 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:36.262790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-972697a3-d222-42cb-a070-b429a1d16998 req-7d7326b6-78e5-4a27-8ef5-09da0e0da3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ff7e87-dfdd-42cf-a121-1d52b70b5402", "tag": "b0220ffc-a460-4916-a184-c71d7485a5be"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:36.273889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-972697a3-d222-42cb-a070-b429a1d16998 req-7d7326b6-78e5-4a27-8ef5-09da0e0da3e8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:36.274723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-972697a3-d222-42cb-a070-b429a1d16998 req-7d7326b6-78e5-4a27-8ef5-09da0e0da3e8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:36.275453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-972697a3-d222-42cb-a070-b429a1d16998 req-7d7326b6-78e5-4a27-8ef5-09da0e0da3e8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:36.290182 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-972697a3-d222-42cb-a070-b429a1d16998 req-7d7326b6-78e5-4a27-8ef5-09da0e0da3e8 service nova] Creating event network-changed:b0220ffc-a460-4916-a184-c71d7485a5be for instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 on n-h1-862355-1 Oct 25 03:08:36.296196 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-972697a3-d222-42cb-a070-b429a1d16998 req-7d7326b6-78e5-4a27-8ef5-09da0e0da3e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036975 Oct 25 03:08:36.296904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1075/1990] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:36.364951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-507739550", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "05ce7fca-15ae-4f11-bf0d-1d24b23b50a6"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:36.416234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:36.426165 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b2f0238-ef7f-425a-8933-e7450032edc5 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1669 microversion: 2.1 time: 0.354456 Oct 25 03:08:36.426755 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 916/1991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:36 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1669 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:36.441875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] validate_networks() for [('05ce7fca-15ae-4f11-bf0d-1d24b23b50a6', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:08:36.557332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:36.558107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:36.570822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:36.571669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:36.572332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:36.573267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:36.574120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:36.575003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:36.945880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:08:36.946307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:08:36.946781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:08:36.947191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:08:36.948071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:08:36.958734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:36.960013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:36.960814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:36.961792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:36.962460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:36.963100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:36.984783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for project f40282bec7bb43e49e8015cde76e5a19. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:08:36.990841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for user 92b6e776ceef40e5a979f3ed63f7cdfe and project f40282bec7bb43e49e8015cde76e5a19. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:08:37.007325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:08:37.010070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:08:37.081047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-84bb0a93-8018-4c1a-ae51-770f960b147a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782211 Oct 25 03:08:37.091002 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1076/1992] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:08:37.094068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:37.094795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:37.104539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.105097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.105556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.107852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.109408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.109894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.149603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:37.204397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.217594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.219911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.221426 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ae2c05c-62d4-4371-bd8f-f01446295a8e tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1483 microversion: 2.25 time: 0.678205 Oct 25 03:08:37.222600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 917/1993] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:36 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1483 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:37.229164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-befae7e6-41a3-4b79-b2ca-cebf2f25d9c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:37.230115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-befae7e6-41a3-4b79-b2ca-cebf2f25d9c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:37.292836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-befae7e6-41a3-4b79-b2ca-cebf2f25d9c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.301845 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-befae7e6-41a3-4b79-b2ca-cebf2f25d9c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1224 microversion: 2.1 time: 0.077906 Oct 25 03:08:37.320012 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 918/1994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:37 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:37.326409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:37.327239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:37.336454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.337385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.338037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.338960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.339586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.340330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.388809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.389726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.390651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.391429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lazy-loading 'fault' on Instance uuid 7c2013a3-13e9-41ac-a872-cad4f74dc4cc {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:37.454980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.465738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.467947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.469613 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8cf0ba3c-b7de-4c4e-80d4-0df7428b4bb0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1371 microversion: 2.47 time: 0.148193 Oct 25 03:08:37.470315 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 919/1995] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:37 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:37.476824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:37.478042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:37.493202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.494285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.494908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.496129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.497365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.498198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.660538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.670455 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa5e4b01-53a1-48fa-9fc7-0501ce287cc1 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 0.198776 Oct 25 03:08:37.681966 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 920/1996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:37 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:37.681966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:37.681966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:37.696490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.696985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.697418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.698292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:37.698743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:37.699168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:37.777437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.786152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e95d7af-d343-4ce1-989b-410e1e7e98c3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.698808 Oct 25 03:08:37.786802 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1077/1997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:37 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:37.875589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:37.889113 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5540b10b-00d0-4815-98a2-da87b1288c24 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1669 microversion: 2.1 time: 0.216758 Oct 25 03:08:37.889545 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 921/1998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:37 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:38.252313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:38.253242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:38.267772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.270841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.271982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.274048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.278496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.279351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.327498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:38.328325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:38.344591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.348168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.348626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.349384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.350410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.350841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.438636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:38.462608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:38.463199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:38.465273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:38.468171 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-855917ca-2503-488c-8b48-720c6522cc4c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1441 microversion: 2.25 time: 0.220589 Oct 25 03:08:38.494753 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a2f0bb38-f895-4493-9350-4b3935685e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1220 microversion: 2.1 time: 0.172172 Oct 25 03:08:38.495364 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 922/1999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:38 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:38.499032 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1078/2000] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:38 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1441 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:38.507514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-927457ea-0900-4cb6-a117-b8436d2e1333 req-315ff6c4-f635-427d-8b87-209f14503a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ded7945-9647-4ba2-8f58-50aea584fed7", "name": "network-vif-deleted", "tag": "2025e32c-5be3-4b07-a237-39e499927e8a"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:38.521322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:38.522887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:38.529602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.530243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:38.530613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.531215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.532116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.532761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.533997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.534164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-927457ea-0900-4cb6-a117-b8436d2e1333 req-315ff6c4-f635-427d-8b87-209f14503a4c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.536051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-927457ea-0900-4cb6-a117-b8436d2e1333 req-315ff6c4-f635-427d-8b87-209f14503a4c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.537626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-927457ea-0900-4cb6-a117-b8436d2e1333 req-315ff6c4-f635-427d-8b87-209f14503a4c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.602843 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-927457ea-0900-4cb6-a117-b8436d2e1333 req-315ff6c4-f635-427d-8b87-209f14503a4c service nova] Creating event network-vif-deleted:2025e32c-5be3-4b07-a237-39e499927e8a for instance 5ded7945-9647-4ba2-8f58-50aea584fed7 on n-h2-862355-1 Oct 25 03:08:38.632761 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-927457ea-0900-4cb6-a117-b8436d2e1333 req-315ff6c4-f635-427d-8b87-209f14503a4c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135597 Oct 25 03:08:38.634076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 923/2001] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:38.661877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.665724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.666429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.667099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lazy-loading 'fault' on Instance uuid 7c2013a3-13e9-41ac-a872-cad4f74dc4cc {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:38.696115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:38.696809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:38.712257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.712658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.713100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.713882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.714346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.714778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.801037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:38.810366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:38.820078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86eb801d136b4ad5968e7e125eb7ade8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2f2e3b3a3a4fd686236749a0123fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:38.821298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7876f36c-574e-4e10-9ef8-bed4c6e2dae0 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 200 len: 1371 microversion: 2.47 time: 0.319047 Oct 25 03:08:38.821890 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1079/2002] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:38 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:38.841509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:38.842762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:38.849311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.852907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.853552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:38.854570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:38.858404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:38.859085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.195571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:39.204858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d921b63f-a9eb-4f03-a5d8-c2a20b31e821 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 0.513348 Oct 25 03:08:39.222841 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 924/2003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:38 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:39.228467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:39.229577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:39.236877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.237694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.238432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.239421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.239778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:39.241056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.241838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.250895 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d0185a7d-4c79-4daa-a935-fe85ca4d01b5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.422606 Oct 25 03:08:39.296965 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1080/2004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:38 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:39.387554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:39.403346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f18ffa44-2038-4cac-98ff-79bb0d718674 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1601 microversion: 2.1 time: 0.176486 Oct 25 03:08:39.403979 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 925/2005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:39 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:39.497581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:39.498145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:39.506673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.507178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.507627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.508353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.508810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.509243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.523430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:39.524206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:39.533955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.535279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.539014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.540109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.540753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.541296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.635710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:39.648453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:39.650844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:39.660758 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a003386f-149f-4ae1-8e99-98815e171a1c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1276 microversion: 2.1 time: 0.140884 Oct 25 03:08:39.665280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:39.669613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-865d4b2b-3619-427e-b70e-01002155339a tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1266 microversion: 2.25 time: 0.174465 Oct 25 03:08:39.676955 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 926/2006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:39 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:39.690595 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1081/2007] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:39 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:39.854534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:39.858139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] [instance: 7c2013a3-13e9-41ac-a872-cad4f74dc4cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:39.874960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.875852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.876516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.877478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:39.878177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:39.878863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:39.925337 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] HTTP exception thrown: Instance 7c2013a3-13e9-41ac-a872-cad4f74dc4cc could not be found. Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Request method failure captured: Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc HTTP/1.1 Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mc1SgCSZELBW-jp0Smton2vyreJMy80wBToE16twhWOgUA1mRx8Mb1_m26OJ211ZJgAeu3nUQJ8F5bL5f2MjVDU-RfsY7cf4wcFqTsHrFj8uyd6ojSyVhd4dZXauyZ_AAlw5ShrU8WWPN5b6PreYPZZZ1hEV_8Yelgg79RMceqWRc Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.47 Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3f2f2e3b3a3a4fd686236749a0123fb4 Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersAaction247Test-1925457481 Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:39.928386 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3f2f2e3b3a3a4fd686236749a0123fb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3f2f2e3b3a3a4fd686236749a0123fb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3f2f2e3b3a3a4fd686236749a0123fb4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3f2f2e3b3a3a4fd686236749a0123fb4"}]}] Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersAaction247Test-1925457481 Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3f2f2e3b3a3a4fd686236749a0123fb4 Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersAaction247Test-1925457481 Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersAaction247Test-1925457481-project Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 86eb801d136b4ad5968e7e125eb7ade8 Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersAaction247Test-1925457481-project Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 7c2013a3-13e9-41ac-a872-cad4f74dc4cc could not be found. Oct 25 03:08:39.931114 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '7c2013a3-13e9-41ac-a872-cad4f74dc4cc'} Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2013a3-13e9-41ac-a872-cad4f74dc4cc could not be found. Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:39.932243 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2013a3-13e9-41ac-a872-cad4f74dc4cc could not be found. Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2013a3-13e9-41ac-a872-cad4f74dc4cc could not be found. Oct 25 03:08:39.934104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:39.940318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] Returning 404 to user: Instance 7c2013a3-13e9-41ac-a872-cad4f74dc4cc could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:39.943804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-22627636-1de1-46a3-9b3e-977e7c3d5084 tempest-ServersAaction247Test-1925457481 tempest-ServersAaction247Test-1925457481-project] 10.222.0.36 "GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc" status: 404 len: 111 microversion: 2.47 time: 0.094020 Oct 25 03:08:39.945063 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 927/2008] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:39 2022] GET /compute/v2.1/servers/7c2013a3-13e9-41ac-a872-cad4f74dc4cc => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:08:40.239630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:40.240354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:40.258757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.264290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.265031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.266068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.274670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:40.275301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:40.279605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.280238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.286036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.286531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.286980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.287727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.288178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.296348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.527472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:40.536259 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-df56c482-5b57-4668-8c37-af9708f4ac94 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.266131 Oct 25 03:08:40.536849 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 928/2009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:40 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:40.553849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:40.554475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:40.569285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.569843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.570286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.573441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.573975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.574408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.674730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.675228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.675663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.676112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lazy-loading 'fault' on Instance uuid 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:40.819301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:40.829790 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4120f941-8f94-4b23-885b-805b3a3f4fbc tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 200 len: 1325 microversion: 2.1 time: 0.290811 Oct 25 03:08:40.848854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 929/2010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:40 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:40.853251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:40.857637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:40.886948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.887399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.887880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:40.888732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:40.889278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:40.889625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.232444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:41.245705 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c4f0f49-baed-402a-92a3-cd801f4f3c7d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.401014 Oct 25 03:08:41.251114 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 930/2011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:40 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:41.259733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:41.262201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:41.263623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:41.272967 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab7814fe-401b-46ac-a2f1-73306dd3a0ad tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 1.047654 Oct 25 03:08:41.282852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:41.286904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:41.288519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.289017 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1082/2012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:40 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:41.295263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:41.297441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:41.298027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.307760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bc9a4491-f9bd-4a77-bbca-76903b21374e req-9099ce95-3302-46da-b12e-8a40226b27a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b07198c-8cd6-4c96-a6eb-b19cd147f6a6", "name": "network-vif-deleted", "tag": "fd266ab4-1299-454f-9ad2-48aea8b010d0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:41.344639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bc9a4491-f9bd-4a77-bbca-76903b21374e req-9099ce95-3302-46da-b12e-8a40226b27a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:41.347659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bc9a4491-f9bd-4a77-bbca-76903b21374e req-9099ce95-3302-46da-b12e-8a40226b27a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:41.348205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bc9a4491-f9bd-4a77-bbca-76903b21374e req-9099ce95-3302-46da-b12e-8a40226b27a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.395599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bc9a4491-f9bd-4a77-bbca-76903b21374e req-9099ce95-3302-46da-b12e-8a40226b27a7 service nova] Creating event network-vif-deleted:fd266ab4-1299-454f-9ad2-48aea8b010d0 for instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 on n-h2-862355-1 Oct 25 03:08:41.420252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bc9a4491-f9bd-4a77-bbca-76903b21374e req-9099ce95-3302-46da-b12e-8a40226b27a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129651 Oct 25 03:08:41.421131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1083/2013] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:41.455563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:41.468621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:41.470428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:41.471920 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-225402ae-7635-4758-aded-0a2588b4a2e7 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1266 microversion: 2.25 time: 0.219529 Oct 25 03:08:41.472905 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 931/2014] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:41 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:41.562378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:41.563205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:41.578584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:41.579281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:41.579768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.580616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:41.581459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:41.582005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.858101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:41.858697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:41.873458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:41.873970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:41.874406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.875348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:41.875988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:41.876601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:41.912779 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] HTTP exception thrown: Instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 could not be found. Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Request method failure captured: Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 HTTP/1.1 Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1F7-hOK8gQYZomL5Kx5Mt-SrWJxGRF6kw3besvl-6zdNRkcCNxZeV6-r7cmguK6iziEMUrd3Osg24XUTj5Qycwtc7PKW02_99utqxh2Z0PIlA-SoJfIsL79LiSsyZPoWRJfOVUqb37mPCWhgpDYi7IZgD6IPnx2LkLpPqh-muUbNr0 Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:41.915144 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9eaf27614124019998010f834321c31", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9eaf27614124019998010f834321c31"}]}] Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: f7fc1bae87d741e58f4e2182796f2df3 Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 could not be found. Oct 25 03:08:41.916917 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '2b07198c-8cd6-4c96-a6eb-b19cd147f6a6'} Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 could not be found. Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:41.917951 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 could not be found. Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 could not be found. Oct 25 03:08:41.919567 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:41.924200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Returning 404 to user: Instance 2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:41.925549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db1b997d-701a-46f9-9222-e7a43c0979ca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6" status: 404 len: 111 microversion: 2.1 time: 0.071601 Oct 25 03:08:41.938465 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 932/2015] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:41 2022] GET /compute/v2.1/servers/2b07198c-8cd6-4c96-a6eb-b19cd147f6a6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:08:41.947870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6edfdaf4-7031-4832-9dea-e73eaca0efa8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '.version_select at 0x7efd32fafa60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:41.953026 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6edfdaf4-7031-4832-9dea-e73eaca0efa8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [2698d7d8-7098-4280-8304-e045207ae121] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 03:08:42.385039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:42.397721 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1ff2622a-7ab2-4a4b-b4bd-45193a56efdf tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.840465 Oct 25 03:08:42.412891 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1084/2016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:41 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:42.428924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:42.429396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:42.441282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:42.443236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:42.444197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:42.445156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:42.446548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:42.453840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:42.782282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:42.799599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-445ebc97-1880-44aa-9cfc-fa76f5914a2f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.384311 Oct 25 03:08:42.801653 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1085/2017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:42 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:42.813313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:42.814121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:42.822692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:42.823823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:42.824460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:42.825346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:42.826272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:42.826871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:42.967519 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [None req-6edfdaf4-7031-4832-9dea-e73eaca0efa8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [2698d7d8-7098-4280-8304-e045207ae121] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43836. Oct 25 03:08:43.015645 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6edfdaf4-7031-4832-9dea-e73eaca0efa8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002187416" status: 202 len: 0 microversion: 2.1 time: 1.069685 Oct 25 03:08:43.019304 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 933/2018] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002187416 => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:08:43.027304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:43.030482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:43.042879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.046899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.060381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.063836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.064845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.065486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.153222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:43.161374 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f42e1037-bb4d-4138-ab55-d8114dd172f3 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 0.357436 Oct 25 03:08:43.171925 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1086/2019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:42 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:43.251818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:43.267702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:43.269166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:43.273887 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87c573f4-ffab-44f5-9f1f-ed948184b6dc tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1266 microversion: 2.25 time: 0.253398 Oct 25 03:08:43.282361 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 934/2020] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:43 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:43.427317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:43.429800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:43.442545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.443091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.446498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.447774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.451325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.451689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.517988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ae5a4e48-2059-456b-8fe3-b6d94dd53224 req-09c8ee2c-3ac5-46c3-84dd-36f1782466d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a", "tag": "5a373b70-0df6-4a41-8ba8-44a6e36fb92e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:43.546185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ae5a4e48-2059-456b-8fe3-b6d94dd53224 req-09c8ee2c-3ac5-46c3-84dd-36f1782466d1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.547837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ae5a4e48-2059-456b-8fe3-b6d94dd53224 req-09c8ee2c-3ac5-46c3-84dd-36f1782466d1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.549452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ae5a4e48-2059-456b-8fe3-b6d94dd53224 req-09c8ee2c-3ac5-46c3-84dd-36f1782466d1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.570335 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ae5a4e48-2059-456b-8fe3-b6d94dd53224 req-09c8ee2c-3ac5-46c3-84dd-36f1782466d1 service nova] Creating event network-changed:5a373b70-0df6-4a41-8ba8-44a6e36fb92e for instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a on n-h2-862355-1 Oct 25 03:08:43.592245 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ae5a4e48-2059-456b-8fe3-b6d94dd53224 req-09c8ee2c-3ac5-46c3-84dd-36f1782466d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079398 Oct 25 03:08:43.593838 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 935/2021] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:43.671333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:43.673610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:43.686278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.686771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.687256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.687896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.688350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.688766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.737567 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d07f75a-f463-4a21-b802-7c49d5603946 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071742 Oct 25 03:08:43.744996 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 936/2022] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:08:43 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:08:43.817437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:43.818110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:43.827534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.828348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.829047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.830031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.831398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.832069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.838196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:43.839838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:43.854166 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-acd496dc-772d-41c7-880b-8e2ec8ce8167 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.432359 Oct 25 03:08:43.854773 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1087/2023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:43 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:43.865610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:43.866766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:43.871219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:43.878544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.879270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.880030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:43.882331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:43.883055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:43.883814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.050844 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f5d823c-9073-41c6-bdf3-aca009245466 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 204 len: 0 microversion: 2.1 time: 0.236997 Oct 25 03:08:44.054249 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 937/2024] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:43 2022] DELETE /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:44.066136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:44.067800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:44.076298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.077000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.077882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.079601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.080438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.081387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.243922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:44.255070 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-11289098-a3aa-4b4d-afd5-3dcb7ac07e74 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.399220 Oct 25 03:08:44.276583 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1088/2025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:43 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:44.282445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:44.283413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:44.290447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.291241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.291973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.292901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.293561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.294300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.315593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:44.350018 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a5da2c6-270e-42de-aa1c-f9233f11c32f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1673 microversion: 2.1 time: 0.288773 Oct 25 03:08:44.352064 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 938/2026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:44 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1673 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:44.367873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:44.368292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:44.379961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.385637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.386332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.387045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.390629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.391352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.451122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:44.579063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:44.587567 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f443196-0032-4996-b2ca-c1140a8e3c14 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 204 len: 0 microversion: 2.1 time: 0.233034 Oct 25 03:08:44.592758 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 939/2027] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:44 2022] DELETE /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:44.595302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:44.596238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:44.600066 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a05d5efe-4cf1-4133-aac9-877dfc48b63d tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 0.321447 Oct 25 03:08:44.601293 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1089/2028] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:44 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:44.603681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.604482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.605012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.605865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.606393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.606894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.618250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:44.619233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:44.640117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.641300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.658804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.660210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.660710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.661400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.691411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:44.718563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:44.723063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:44.728640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-df2d7555-6c6f-4fd2-abdf-b099b003e611 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1266 microversion: 2.25 time: 0.137201 Oct 25 03:08:44.731231 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 940/2029] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:44 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:44.835567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1baa6f98-8e98-4fb7-9dad-67187bae9c31 req-824d6a9e-f4e3-4c6e-8886-d498427395a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f474cc1b-e0fe-4085-9216-34e00a0d228d", "name": "network-vif-plugged", "status": "completed", "tag": "07111e27-3936-4c74-93d2-aba44f9e2a79"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:44.848644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1baa6f98-8e98-4fb7-9dad-67187bae9c31 req-824d6a9e-f4e3-4c6e-8886-d498427395a8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:44.849239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1baa6f98-8e98-4fb7-9dad-67187bae9c31 req-824d6a9e-f4e3-4c6e-8886-d498427395a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:44.850251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1baa6f98-8e98-4fb7-9dad-67187bae9c31 req-824d6a9e-f4e3-4c6e-8886-d498427395a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:44.867359 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1baa6f98-8e98-4fb7-9dad-67187bae9c31 req-824d6a9e-f4e3-4c6e-8886-d498427395a8 service nova] Creating event network-vif-plugged:07111e27-3936-4c74-93d2-aba44f9e2a79 for instance f474cc1b-e0fe-4085-9216-34e00a0d228d on n-h2-862355-1 Oct 25 03:08:44.873203 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1baa6f98-8e98-4fb7-9dad-67187bae9c31 req-824d6a9e-f4e3-4c6e-8886-d498427395a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042188 Oct 25 03:08:44.874326 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 941/2030] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:44.941952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:44.957325 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4db1d738-ae0b-4f67-a100-a0edc6b544e3 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1485 microversion: 2.1 time: 0.354161 Oct 25 03:08:44.958340 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1090/2031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:44 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1485 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:45.159128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:45.159843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:45.167514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.168002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.168585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.169305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.169807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.170237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.282327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:45.283669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:45.294455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.296569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.297826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.299427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.300412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.302405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.478416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:45.491153 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec86ff46-25b5-490f-96ee-698de282c762 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.212168 Oct 25 03:08:45.492176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1091/2032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:45 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:45.497487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:45.498234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:45.501488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:45.504664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.505230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.506091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.506988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.507452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.507887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.510270 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d7f4f2d7-016f-49be-ac0f-558ff114a97f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.633609 Oct 25 03:08:45.513936 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 942/2033] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:44 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:45.627498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:45.628487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:45.649495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.650180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.650650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.651523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.652272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.652878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.665718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:45.676413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ad3a953-b730-452e-946b-f050ba5259c0 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1673 microversion: 2.1 time: 0.183108 Oct 25 03:08:45.677331 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1092/2034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:45 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:45.766771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:45.768679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:45.777424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.778325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.779105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.780050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.780787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.781447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.854277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:45.868521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:45.870007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:45.871195 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-311e8ca8-2a4b-45ac-a90f-cdc5706392ff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 200 len: 1266 microversion: 2.25 time: 0.120914 Oct 25 03:08:45.872089 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1093/2035] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:45 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:08:45.941071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:45.953605 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d42cf5f0-7be1-449a-a8ef-f761918c70c8 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 0.330066 Oct 25 03:08:45.954495 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 943/2036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:45 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:45.982141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:45.982860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:45.991779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.993083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.993978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:45.995454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:45.996161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:45.996983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:46.004777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:46.161475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:46.172176 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61f48669-fc61-48f3-8ad8-febb5a440cde tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1485 microversion: 2.1 time: 0.194003 Oct 25 03:08:46.173564 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1094/2037] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:45 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1485 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:46.519128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:46.522792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:46.535623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:46.536254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:46.541748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:46.542366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:46.544213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:46.544983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:46.545492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:46.545951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:46.551130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:46.551656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:46.552196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:46.557010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:46.557768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:46.559241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:46.976790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:46.998697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:47.165210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:47.174267 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53dfb53e-4850-4440-b4c2-25fd543063f7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.644052 Oct 25 03:08:47.175676 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1095/2038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:46 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:47.181180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:47.183136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:47.189477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.190320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.190931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.191833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.192477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.193157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.222010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:47.234877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-afb5256d-7362-4899-97b0-d1dc7c97a668 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.722596 Oct 25 03:08:47.235476 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 944/2039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:46 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:47.240164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a5d2bbc9-0880-44fb-a31a-79f9e53c4ef4 req-4845ad9c-1b61-4a7a-aa29-c45477a8b6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ff7e87-dfdd-42cf-a121-1d52b70b5402", "name": "network-vif-plugged", "status": "completed", "tag": "b0220ffc-a460-4916-a184-c71d7485a5be"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:47.274063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a5d2bbc9-0880-44fb-a31a-79f9e53c4ef4 req-4845ad9c-1b61-4a7a-aa29-c45477a8b6f4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.285904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a5d2bbc9-0880-44fb-a31a-79f9e53c4ef4 req-4845ad9c-1b61-4a7a-aa29-c45477a8b6f4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.287217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a5d2bbc9-0880-44fb-a31a-79f9e53c4ef4 req-4845ad9c-1b61-4a7a-aa29-c45477a8b6f4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.300014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:47.308108 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a5d2bbc9-0880-44fb-a31a-79f9e53c4ef4 req-4845ad9c-1b61-4a7a-aa29-c45477a8b6f4 service nova] Creating event network-vif-plugged:b0220ffc-a460-4916-a184-c71d7485a5be for instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 on n-h1-862355-1 Oct 25 03:08:47.314484 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a5d2bbc9-0880-44fb-a31a-79f9e53c4ef4 req-4845ad9c-1b61-4a7a-aa29-c45477a8b6f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077256 Oct 25 03:08:47.321150 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 945/2040] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:47.331393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:47.332669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 5ded7945-9647-4ba2-8f58-50aea584fed7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:47.369920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.371060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.371681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.372668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.373295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.373961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.397019 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] HTTP exception thrown: Instance 5ded7945-9647-4ba2-8f58-50aea584fed7 could not be found. Oct 25 03:08:47.401381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Request method failure captured: Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 HTTP/1.1 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1F42L11gec9u4DwtgqnN2nk45qlZzrzZ6NXKlm2QVDpkFiocvC6Mb1NmYdmI8e8sLdaCZAe_EjE46YxooCWSEFBjQ1YevpFQL4IloFOuu0ptIiRvy9iHMEXQaLrtlsLpy_XXxkMdq0MqO9OxkAod4MHUcjoD4A1b621xNhCC_AMDE0 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.25 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:47.402300 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5e6aa25f05c4cd9bfd8d84eefc36c68", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}] Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 54c1fabb546b47cea96d2d70b32f4c69 Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 5ded7945-9647-4ba2-8f58-50aea584fed7 could not be found. Oct 25 03:08:47.404024 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '5ded7945-9647-4ba2-8f58-50aea584fed7'} Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ded7945-9647-4ba2-8f58-50aea584fed7 could not be found. Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:47.404940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ded7945-9647-4ba2-8f58-50aea584fed7 could not be found. Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ded7945-9647-4ba2-8f58-50aea584fed7 could not be found. Oct 25 03:08:47.407612 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:47.414160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Returning 404 to user: Instance 5ded7945-9647-4ba2-8f58-50aea584fed7 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:47.415255 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9117dd36-028a-47ad-90aa-f20d89cd1b33 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7" status: 404 len: 111 microversion: 2.25 time: 0.092577 Oct 25 03:08:47.416068 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 946/2041] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:47 2022] GET /compute/v2.1/servers/5ded7945-9647-4ba2-8f58-50aea584fed7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:08:47.418719 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-62954774-5173-40fa-a324-c8dfc2783395 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1673 microversion: 2.1 time: 0.240330 Oct 25 03:08:47.422213 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1096/2042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:47 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:47.425753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:47.430359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:47.437848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:47.438572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:47.440048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.440715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.441337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.443030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.443680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.444876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.446205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.459667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.460338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.461224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:47.461882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:47.462589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:47.711750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:47.728556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f287c70c-36ea-4677-a2e9-e2ccec652477 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1485 microversion: 2.1 time: 0.300425 Oct 25 03:08:47.729380 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1097/2043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:47 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1485 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:48.206224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:48.207569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:48.221892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:48.222586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:48.222985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:48.223711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:48.224278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:48.231183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:48.433509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:48.442446 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28cf18ce-532d-42d8-9804-1422a17bbb1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1307 microversion: 2.1 time: 0.243589 Oct 25 03:08:48.444487 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1098/2044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:48 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1307 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:08:48.449220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:48.450041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:48.458242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:48.459242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:48.459925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:48.460951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:48.461590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:48.462359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:48.585962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:48.600998 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4027c43-9350-404b-b7be-d0bd50277373 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1315 microversion: 2.1 time: 1.183649 Oct 25 03:08:48.609286 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 947/2045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:47 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1315 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:48.626503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:48.627163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:48.646857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:48.647574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:48.648029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:48.648771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:48.649233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:48.649666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:48.959591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:48.986971 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a90701e-2266-4bef-89dd-12570a68f57c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.541114 Oct 25 03:08:48.990624 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1099/2046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:48 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:49.001920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:49.023814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:49.045986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.047427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.048119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.049232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.052532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.059478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.079943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:49.092391 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57eb6d4a-04e9-46c2-b05e-7ae10d390976 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1673 microversion: 2.1 time: 0.479588 Oct 25 03:08:49.115942 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 948/2047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:48 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1673 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:49.122408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:49.128552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:49.130823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Searching by: {'deleted': False, 'project_id': '3ad24b576dc24c1f8122c207f017242a'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:08:49.135813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:49.150188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.150969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.153188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.154256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.158016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.164931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.215070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:49.224047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:08:49.226332 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-06b35dc8-b96c-4b83-a582-d1346def31c8 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1443 microversion: 2.1 time: 0.232589 Oct 25 03:08:49.247064 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1100/2048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:48 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1443 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:49.307766 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6289c5d9-9771-4d7d-9e6a-3d30b12da05d tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.189733 Oct 25 03:08:49.312827 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 949/2049] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:08:49 2022] GET /compute/v2.1/servers => generated 339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:49.327583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:49.334832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:49.336074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Searching by: {'deleted': False, 'project_id': '3ad24b576dc24c1f8122c207f017242a'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:08:49.342747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.343512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.344182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.345147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.345922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.346584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.391018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:08:49.458857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:49.472675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:49.476100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:49.486479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.491246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.492056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.493021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.493378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.494455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.494909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.495592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.496289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.714721 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87fbece3-a69a-44bf-a042-8df7d56f2bd6 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.391219 Oct 25 03:08:49.716103 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1101/2050] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:08:49 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:49.722090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:49.722907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:49.733040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.733778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.734492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:49.735605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:49.736436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:49.737471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.023671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:50.062949 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a20a2ff1-f478-4242-8553-e2384f269236 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1504 microversion: 2.1 time: 0.344685 Oct 25 03:08:50.088815 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1102/2051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:49 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:50.095895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1a172c87-5c7b-4868-aa59-17c3857a8131 req-01360d0b-34e7-45b3-a42c-86fac2c416de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854f52da-f0d9-4754-8851-e49bc29f2b87", "name": "network-vif-deleted", "tag": "7c5a35c2-56c8-4882-91a0-17c0ee655ba7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:50.127944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a172c87-5c7b-4868-aa59-17c3857a8131 req-01360d0b-34e7-45b3-a42c-86fac2c416de service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.129597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a172c87-5c7b-4868-aa59-17c3857a8131 req-01360d0b-34e7-45b3-a42c-86fac2c416de service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.134512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a172c87-5c7b-4868-aa59-17c3857a8131 req-01360d0b-34e7-45b3-a42c-86fac2c416de service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.159169 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1a172c87-5c7b-4868-aa59-17c3857a8131 req-01360d0b-34e7-45b3-a42c-86fac2c416de service nova] Creating event network-vif-deleted:7c5a35c2-56c8-4882-91a0-17c0ee655ba7 for instance 854f52da-f0d9-4754-8851-e49bc29f2b87 on n-h1-862355-1 Oct 25 03:08:50.167365 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1a172c87-5c7b-4868-aa59-17c3857a8131 req-01360d0b-34e7-45b3-a42c-86fac2c416de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076951 Oct 25 03:08:50.174168 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1103/2052] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:50.182467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b2c5651-358b-47dc-9377-a8f2534e3c45 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:50.203234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b2c5651-358b-47dc-9377-a8f2534e3c45 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027509 Oct 25 03:08:50.220577 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1104/2053] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:08:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:50.227632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:50.228365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:50.259984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.260763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.261510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.262491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.263318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.263901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.307970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:50.328928 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-20eda036-2430-45b9-9611-4db936f4166f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1487 microversion: 2.1 time: 0.860847 Oct 25 03:08:50.354126 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 950/2054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:49 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1487 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:50.365537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:50.367107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:50.374175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.377195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.378016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.379073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.382317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.383095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.446640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:50.491318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:50.587601 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11b5df3f-217a-42ad-8ce9-7e2a034754d6 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "DELETE /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 204 len: 0 microversion: 2.1 time: 0.231866 Oct 25 03:08:50.588575 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 951/2055] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:50 2022] DELETE /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:50.596331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:50.602836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:50.622617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.623476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.624147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.625096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.625813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.626450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.631606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:50.641286 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f887112a-58f2-4752-bcd1-1833f0a01cb0 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.418779 Oct 25 03:08:50.658257 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1105/2056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:50 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:50.676142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:50.679839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:50.711594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.713519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.716696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.718768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.720815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.721614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.781429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:50.791476 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03be3d5e-de32-4918-8b48-b22d92531dd6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1606 microversion: 2.1 time: 0.201284 Oct 25 03:08:50.797131 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 952/2057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:50 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1606 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:50.821009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:50.824754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:50.826306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.827054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.828798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.829450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lazy-loading 'fault' on Instance uuid 854f52da-f0d9-4754-8851-e49bc29f2b87 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:50.840822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.850373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.850996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.851876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.852464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.853010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.919993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:50.934795 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6e02fea8-07ae-449a-b61e-7805c8369093 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 200 len: 1300 microversion: 2.1 time: 0.274984 Oct 25 03:08:50.938921 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1106/2058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:50 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 1300 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:50.950758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:50.951501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:50.954136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:50.968486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.969498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.970220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:50.974440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:50.975151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:50.975796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.061394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:51.134484 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-acbc66fe-c571-4c36-860e-b6d338a34bae tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 204 len: 0 microversion: 2.1 time: 0.335524 Oct 25 03:08:51.136486 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 953/2059] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:50 2022] DELETE /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:51.143764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:51.145320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:51.153549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.154548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.155237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.156222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.157756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.158370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.263950 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-923b3185-7bde-4227-92de-f659309985d9 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 204 len: 0 microversion: 2.1 time: 0.323490 Oct 25 03:08:51.265493 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1107/2060] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:50 2022] DELETE /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:51.274616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:51.279740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:51.289005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.295718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.296491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.297769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.298436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.299782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.403525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:51.419002 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-138cf884-83c6-4dd3-9a3f-7af33c9f89e0 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1510 microversion: 2.1 time: 0.280574 Oct 25 03:08:51.420706 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 954/2061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:51 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:51.426040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:51.427439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:51.434821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.435787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.436447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.437948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.438742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.439656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.708825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:51.716956 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c27b3be-55b4-475d-8019-8064d7d2f62b tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1713 microversion: 2.1 time: 0.294919 Oct 25 03:08:51.718615 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 955/2062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:51 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1713 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:51.723923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7e426b99-2997-4b3b-a204-685f7bbcd35f req-950e5fca-266e-4082-8f50-c63e2a4cf355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a", "name": "network-vif-plugged", "status": "completed", "tag": "5a373b70-0df6-4a41-8ba8-44a6e36fb92e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:51.735821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7e426b99-2997-4b3b-a204-685f7bbcd35f req-950e5fca-266e-4082-8f50-c63e2a4cf355 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.736593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7e426b99-2997-4b3b-a204-685f7bbcd35f req-950e5fca-266e-4082-8f50-c63e2a4cf355 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.737207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7e426b99-2997-4b3b-a204-685f7bbcd35f req-950e5fca-266e-4082-8f50-c63e2a4cf355 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.778893 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7e426b99-2997-4b3b-a204-685f7bbcd35f req-950e5fca-266e-4082-8f50-c63e2a4cf355 service nova] Creating event network-vif-plugged:5a373b70-0df6-4a41-8ba8-44a6e36fb92e for instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a on n-h2-862355-1 Oct 25 03:08:51.786297 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7e426b99-2997-4b3b-a204-685f7bbcd35f req-950e5fca-266e-4082-8f50-c63e2a4cf355 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065673 Oct 25 03:08:51.795991 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 956/2063] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:51.811983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:51.812708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:51.835691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.836194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.836642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.837364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.842355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:51.850069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.850855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.856924 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e62f878-265d-41ac-8664-f4bdcef894dc tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1493 microversion: 2.1 time: 0.588032 Oct 25 03:08:51.858999 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1108/2064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:51 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1493 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:51.871264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:51.874255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:51.912090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.914531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.919309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:51.921670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:51.930510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:51.931506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.078941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:52.085799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.086724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.089827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.090553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lazy-loading 'fault' on Instance uuid 6faa7633-59e1-4162-803d-193a945d6472 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:52.165648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:52.333535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:52.349920 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6e42bc8a-2ddd-4e7e-b859-e1b4660b8505 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 200 len: 1327 microversion: 2.1 time: 0.489414 Oct 25 03:08:52.354886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:52.364514 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1109/2065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:51 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 1327 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:52.366914 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-735f85f3-185c-45d2-a9ad-fe0cbad21d23 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.567197 Oct 25 03:08:52.373092 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 957/2066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:51 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:52.390052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:52.394063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-0541d5c4-f63a-4114-b3fb-ec6686743bb5 req-fe269e61-913f-4966-849b-142ff0ac2589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faa7633-59e1-4162-803d-193a945d6472", "name": "network-vif-deleted", "tag": "939590e7-8279-4561-834e-1a7792cfe022"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:52.394392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: 854f52da-f0d9-4754-8851-e49bc29f2b87] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:52.414467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.415176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.415740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.416591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.417096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0541d5c4-f63a-4114-b3fb-ec6686743bb5 req-fe269e61-913f-4966-849b-142ff0ac2589 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.417578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.417802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.418467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0541d5c4-f63a-4114-b3fb-ec6686743bb5 req-fe269e61-913f-4966-849b-142ff0ac2589 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.420275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0541d5c4-f63a-4114-b3fb-ec6686743bb5 req-fe269e61-913f-4966-849b-142ff0ac2589 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.457929 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-0541d5c4-f63a-4114-b3fb-ec6686743bb5 req-fe269e61-913f-4966-849b-142ff0ac2589 service nova] Creating event network-vif-deleted:939590e7-8279-4561-834e-1a7792cfe022 for instance 6faa7633-59e1-4162-803d-193a945d6472 on n-h1-862355-1 Oct 25 03:08:52.461122 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] HTTP exception thrown: Instance 854f52da-f0d9-4754-8851-e49bc29f2b87 could not be found. Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Request method failure captured: Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 HTTP/1.1 Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F7-hOK8gQYZomL5Kx5Mt-SrWJxGRF6kw3besvl-6zdNRkcCNxZeV6-r7cmguK6iziEMUrd3Osg24XUTj5Qycwtc7PKW02_99utqxh2Z0PIlA-SoJfIsL79LiSsyZPoWRJfOVUqb37mPCWhgpDYi7IZgD6IPnx2LkLpPqh-muUbNr0 Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:52.463044 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9eaf27614124019998010f834321c31", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9eaf27614124019998010f834321c31"}]}] Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f7fc1bae87d741e58f4e2182796f2df3 Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 854f52da-f0d9-4754-8851-e49bc29f2b87 could not be found. Oct 25 03:08:52.464847 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '854f52da-f0d9-4754-8851-e49bc29f2b87'} Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854f52da-f0d9-4754-8851-e49bc29f2b87 could not be found. Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:52.465938 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854f52da-f0d9-4754-8851-e49bc29f2b87 could not be found. Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854f52da-f0d9-4754-8851-e49bc29f2b87 could not be found. Oct 25 03:08:52.467590 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:52.470458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Returning 404 to user: Instance 854f52da-f0d9-4754-8851-e49bc29f2b87 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:52.471871 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-0541d5c4-f63a-4114-b3fb-ec6686743bb5 req-fe269e61-913f-4966-849b-142ff0ac2589 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096430 Oct 25 03:08:52.473352 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f25e3617-c618-4b4e-b219-d3cdf1d40f4c tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87" status: 404 len: 111 microversion: 2.1 time: 0.106296 Oct 25 03:08:52.477123 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 958/2067] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:52.477542 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1110/2068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:52 2022] GET /compute/v2.1/servers/854f52da-f0d9-4754-8851-e49bc29f2b87 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:52.487997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:52.489270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:52.492049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:52.492872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:52.513839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.514268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.514722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.516694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.517210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.517585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.517744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.518181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.518548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.518902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.519368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.520489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.586220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:52.810501 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f896b6b0-b94c-4d51-8c4b-2edc335de078 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 204 len: 0 microversion: 2.1 time: 0.331141 Oct 25 03:08:52.811463 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1111/2069] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:52 2022] DELETE /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:52.834847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:52.837597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:52.858857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.859748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.860412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.863047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:52.863794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:52.868115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:52.995853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:53.015081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fddfd1dc-60a2-49fa-bfe5-1f668ffa81ca tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1510 microversion: 2.1 time: 0.533379 Oct 25 03:08:53.018975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 959/2070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:52 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1510 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:53.028074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:53.031334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:53.044536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.048353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.049060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.050030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.052669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.054217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.307465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:53.319711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd48da4f-1161-46bf-afda-12bc833652da tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1500 microversion: 2.1 time: 0.298501 Oct 25 03:08:53.336973 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 960/2071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:53 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1500 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:53.336973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:53.338989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:53.359662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.360171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.360614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.369781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.370290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.370749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.659793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:53.694727 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b688f8cf-55da-47a7-91d4-47adb23055f2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1713 microversion: 2.1 time: 0.877293 Oct 25 03:08:53.695393 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1112/2072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:52 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1713 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:53.715215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:53.715860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:53.737479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.749942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.754589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.755398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.755897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.756408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.807092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] HTTP exception thrown: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Request method failure captured: Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 HTTP/1.1 Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Jb1broKUreObl3eBApe7nsIPCglEclFB9zyqbEmn9nnfzqo81PPiHFVCFYRsPHU99SxLICxKq_NRQgL7NEc7VV1Oasu-QAi_0TQXUVDMshvo2Q_Sy_ycDEMIU3MVsbbG9RYnRbPJe0-Yp-FZHcYqWgOazabF3VxHTmLCIAmEbjpm0 Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:53.808845 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_493ac819082a42af8d6e3c702c510a3b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/493ac819082a42af8d6e3c702c510a3b"}]}] Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 6a6e67c6afc74b39bb5cfac771f3e7d7 Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:08:53.810772 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6faa7633-59e1-4162-803d-193a945d6472'} Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:53.811964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:08:53.813428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:53.815704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Returning 404 to user: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:53.815704 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e34b0785-5a84-40d0-a63b-87fd6ae85118 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 404 len: 111 microversion: 2.1 time: 0.113968 Oct 25 03:08:53.820429 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1113/2073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:53 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:53.828768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:53.828768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:53.873598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.874475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.874736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.887023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:53.887538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:53.888019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:53.997355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:54.010493 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec07be0f-8a01-4e6f-871b-03cddb7b036e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1493 microversion: 2.1 time: 0.685840 Oct 25 03:08:54.014112 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 961/2074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:53 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1493 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:54.028568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c09f04c-2403-4528-97f6-bb2be29e7e69 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '.version_select at 0x7efd330bc670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:54.069227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c09f04c-2403-4528-97f6-bb2be29e7e69 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117660121" status: 202 len: 0 microversion: 2.1 time: 0.053510 Oct 25 03:08:54.073392 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 962/2075] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117660121 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:08:54.083543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:54.085059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:54.112440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.113655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.114779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.115715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.116333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.116920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.200088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.206321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.210123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.210770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lazy-loading 'fault' on Instance uuid 56ff7e87-dfdd-42cf-a121-1d52b70b5402 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:54.420228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff7c33a185492ea7d0565af7cf999a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f201d471005d447a85df971b269e65d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:54.430890 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c6e9a338-9779-4009-a012-b8298bff9f96 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 200 len: 1305 microversion: 2.1 time: 0.356010 Oct 25 03:08:54.431496 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 963/2076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:54 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 1305 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:54.461882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:54.462607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:54.476698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.477302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.477766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.478512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.479545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.479986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.542632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:08:54.628092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:54.661971 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17cb01b1-a2b7-4f2e-ba14-178e91959575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1324 microversion: 2.1 time: 0.840441 Oct 25 03:08:54.666604 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1114/2077] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:53 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1324 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:54.690715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:54.695831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:54.729073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.729984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.733636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.734690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.737709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.738724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.793448 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf607425-b465-489f-a31b-bcea950f12ae tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 204 len: 0 microversion: 2.25 time: 0.344010 Oct 25 03:08:54.794682 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 964/2078] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:08:54 2022] DELETE /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:08:54.803339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-edd33a1b-aaea-4fe5-8414-2536db7fbc8a req-8b90beb6-7e30-46e4-bfdd-e3ca4dd59c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ff7e87-dfdd-42cf-a121-1d52b70b5402", "name": "network-vif-deleted", "tag": "b0220ffc-a460-4916-a184-c71d7485a5be"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:54.845370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-edd33a1b-aaea-4fe5-8414-2536db7fbc8a req-8b90beb6-7e30-46e4-bfdd-e3ca4dd59c73 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.846249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-edd33a1b-aaea-4fe5-8414-2536db7fbc8a req-8b90beb6-7e30-46e4-bfdd-e3ca4dd59c73 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.847329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-edd33a1b-aaea-4fe5-8414-2536db7fbc8a req-8b90beb6-7e30-46e4-bfdd-e3ca4dd59c73 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.863804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-edd33a1b-aaea-4fe5-8414-2536db7fbc8a req-8b90beb6-7e30-46e4-bfdd-e3ca4dd59c73 service nova] Creating event network-vif-deleted:b0220ffc-a460-4916-a184-c71d7485a5be for instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 on n-h1-862355-1 Oct 25 03:08:54.870216 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-edd33a1b-aaea-4fe5-8414-2536db7fbc8a req-8b90beb6-7e30-46e4-bfdd-e3ca4dd59c73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072794 Oct 25 03:08:54.871463 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 965/2079] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:54.880191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:54.881862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:54.898104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.899141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.899935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.900925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:54.901641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:54.902474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:54.932465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:55.519861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:55.532128 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a19d9bbc-55c3-4e21-aadf-17b2816bafca tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1500 microversion: 2.1 time: 0.862121 Oct 25 03:08:55.533540 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1115/2080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:54 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1500 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:55.552834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:55.559818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:55.570588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:55.571316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:55.571825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:55.572610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:55.573131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:55.573624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:55.650104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:55.659777 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23025bfb-bfa9-4433-a6a9-1ee5fb903dc2 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1713 microversion: 2.1 time: 0.786739 Oct 25 03:08:55.660467 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 966/2081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:54 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1713 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:55.668790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:55.669827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:55.677130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:55.678077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:55.678589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:55.679382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:55.680000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:55.680590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:56.221665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:56.241562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:56.243068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:56.255077 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3717bcdb-8e9d-4d1b-bf74-3c71dca4986c tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1732 microversion: 2.25 time: 0.720106 Oct 25 03:08:56.255780 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1116/2082] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:55 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1732 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:56.272099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:56.273074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:56.289273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:56.290269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:56.295887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:56.297086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:56.298479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:56.299315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:56.344146 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] HTTP exception thrown: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Request method failure captured: Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 HTTP/1.1 Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1MqDVCv3UqCsoYLXhk9OlLACN_HV6qdZqa94PmNkfH8fu4syDFIGO06CGR0fJj8Ogj0pgQmoXkxxeM4fizOFdcLTawcrMwadOtjGtAPDfCL1s956qvMLlR4grq1f0aaf7JGwoSPNrFlivbOvXt0qFnuK1db9OMxd2-Qv2fn3xpoLDE Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:56.348475 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f201d471005d447a85df971b269e65d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f201d471005d447a85df971b269e65d4"}]}] Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 58ff7c33a185492ea7d0565af7cf999a Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:56.350327 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '56ff7e87-dfdd-42cf-a121-1d52b70b5402'} Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:56.351546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:56.355808 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:56.358401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Returning 404 to user: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:56.358401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b7c461a-feaf-41c6-b3cb-8fa0354d120e tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 404 len: 111 microversion: 2.1 time: 0.095807 Oct 25 03:08:56.358401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1117/2083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:56 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:56.523063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-572982425", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "a7f0e6fa-af8b-4e1b-aaba-638e1fa4f4c3"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:56.620884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] validate_networks() for [('a7f0e6fa-af8b-4e1b-aaba-638e1fa4f4c3', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:08:56.671459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:56.681984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7ab63ecd-e101-428b-a0fb-3aac9a9ab86d tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 200 len: 1493 microversion: 2.1 time: 1.019968 Oct 25 03:08:56.699146 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 967/2084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:55 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 1493 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:56.706454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:56.707384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:56.718410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:56.721259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:56.723066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:56.726168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:56.727026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:56.727712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.160658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:57.169598 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c819a8cf-b8ce-45b6-8540-e299526c49dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 0.469021 Oct 25 03:08:57.170355 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 968/2085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:56 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:57.180588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:08:57.181525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:08:57.182294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:08:57.183098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:08:57.183761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:08:57.197951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.198092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-64c20b6a-ee72-49f3-9ad7-1229cf717c14 req-c408172a-8315-41c1-ae19-bc15fb98518b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f474cc1b-e0fe-4085-9216-34e00a0d228d", "name": "network-vif-deleted", "tag": "07111e27-3936-4c74-93d2-aba44f9e2a79"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:57.199078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.199614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.201042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.202123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.203007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.217092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64c20b6a-ee72-49f3-9ad7-1229cf717c14 req-c408172a-8315-41c1-ae19-bc15fb98518b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.217801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64c20b6a-ee72-49f3-9ad7-1229cf717c14 req-c408172a-8315-41c1-ae19-bc15fb98518b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.218974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64c20b6a-ee72-49f3-9ad7-1229cf717c14 req-c408172a-8315-41c1-ae19-bc15fb98518b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.229992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Getting quotas for project d95ea41adfbe42efae37c03379cb76f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:08:57.239492 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-64c20b6a-ee72-49f3-9ad7-1229cf717c14 req-c408172a-8315-41c1-ae19-bc15fb98518b service nova] Creating event network-vif-deleted:07111e27-3936-4c74-93d2-aba44f9e2a79 for instance f474cc1b-e0fe-4085-9216-34e00a0d228d on n-h2-862355-1 Oct 25 03:08:57.242444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Getting quotas for user 638c4a1ba8fd4e1f877cfe8e60834070 and project d95ea41adfbe42efae37c03379cb76f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:08:57.245826 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-64c20b6a-ee72-49f3-9ad7-1229cf717c14 req-c408172a-8315-41c1-ae19-bc15fb98518b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051753 Oct 25 03:08:57.247069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 969/2086] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:57.254233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2082820332", "metadata": {"image_type": "test"}}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:57.257019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:57.263766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.264694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.265324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.266490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.267122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.267723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.279234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:08:57.282010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:08:57.285081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] HTTP exception thrown: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Request method failure captured: Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402/action HTTP/1.1 Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 112 Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MqDVCv3UqCsoYLXhk9OlLACN_HV6qdZqa94PmNkfH8fu4syDFIGO06CGR0fJj8Ogj0pgQmoXkxxeM4fizOFdcLTawcrMwadOtjGtAPDfCL1s956qvMLlR4grq1f0aaf7JGwoSPNrFlivbOvXt0qFnuK1db9OMxd2-Qv2fn3xpoLDE Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:57.287836 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f201d471005d447a85df971b269e65d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f201d471005d447a85df971b269e65d4"}]}] Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 58ff7c33a185492ea7d0565af7cf999a Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2082820332", "metadata": {"image_type": "test"}}} Oct 25 03:08:57.289428 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '56ff7e87-dfdd-42cf-a121-1d52b70b5402', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2082820332', 'metadata': {'image_type': 'test'}}}} Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:57.290384 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:57.291824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:57.294970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:57.294970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:57.294970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:57.294970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:57.294970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.294970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Returning 404 to user: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:57.294970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5879ca15-0a6c-4ae9-967f-08ba08c167ed tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "POST /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402/action" status: 404 len: 111 microversion: 2.1 time: 0.040930 Oct 25 03:08:57.296569 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 970/2087] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 25 03:08:57 2022] POST /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:57.303047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:57.303599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:57.310613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.311482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.312368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.314206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.315237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.316031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.368178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.369160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.369865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.370589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lazy-loading 'fault' on Instance uuid e55448dc-6c7b-4106-80ee-65b05ae56e71 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:57.383986 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2cc141be-5ba7-4363-a9f9-fa017f4eb52e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023819 Oct 25 03:08:57.384649 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1118/2088] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:08:57.394311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:57.395222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:57.402119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.403218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.404043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.405095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.406390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.408655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.494450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7fc1bae87d741e58f4e2182796f2df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eaf27614124019998010f834321c31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:57.510991 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d73e509e-bb25-43c7-9646-c01d00959380 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 200 len: 1301 microversion: 2.1 time: 0.212858 Oct 25 03:08:57.527003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5e91b8c87e42d581050ae86062276f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad24b576dc24c1f8122c207f017242a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:57.528413 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 971/2089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:57 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 1301 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:57.540112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:57.541074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:57.548288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.548590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55c4462a-ad72-4664-b386-dddfb4917dd4 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 200 len: 1646 microversion: 2.1 time: 0.160817 Oct 25 03:08:57.549294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.550008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.557851 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1119/2090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:57 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 1646 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:57.562130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.562927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.564263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.566699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:57.567863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:57.588623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.589127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.589574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.598712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:57.599225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:57.599674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:57.789606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:57.798639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:57.801415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:57.803213 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6b571ee9-4c2a-4156-8cae-7472b18cafe3 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1732 microversion: 2.25 time: 0.251135 Oct 25 03:08:57.804676 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1120/2091] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:57 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:57.810640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47105c72-5739-4439-9ff6-a3d63e74f97f tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1899617002", "metadata": {"image_type": "test"}}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:57.814890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47105c72-5739-4439-9ff6-a3d63e74f97f tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Failed to fetch instance by id tempest-invalid-1279126749 {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 25 03:08:57.816490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-47105c72-5739-4439-9ff6-a3d63e74f97f tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] HTTP exception thrown: Instance tempest-invalid-1279126749 could not be found. Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47105c72-5739-4439-9ff6-a3d63e74f97f tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Request method failure captured: Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/tempest-invalid-1279126749/action HTTP/1.1 Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 112 Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1MqDVCv3UqCsoYLXhk9OlLACN_HV6qdZqa94PmNkfH8fu4syDFIGO06CGR0fJj8Ogj0pgQmoXkxxeM4fizOFdcLTawcrMwadOtjGtAPDfCL1s956qvMLlR4grq1f0aaf7JGwoSPNrFlivbOvXt0qFnuK1db9OMxd2-Qv2fn3xpoLDE Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:57.818804 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f201d471005d447a85df971b269e65d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f201d471005d447a85df971b269e65d4"}]}] Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 58ff7c33a185492ea7d0565af7cf999a Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1899617002", "metadata": {"image_type": "test"}}} Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:57.820896 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance tempest-invalid-1279126749 could not be found. Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'tempest-invalid-1279126749', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1899617002', 'metadata': {'image_type': 'test'}}}} Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1279126749 could not be found. Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:57.822122 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1279126749 could not be found. Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1279126749 could not be found. Oct 25 03:08:57.823932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:57.827566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47105c72-5739-4439-9ff6-a3d63e74f97f tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Returning 404 to user: Instance tempest-invalid-1279126749 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:57.828947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47105c72-5739-4439-9ff6-a3d63e74f97f tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "POST /compute/v2.1/servers/tempest-invalid-1279126749/action" status: 404 len: 101 microversion: 2.1 time: 0.022721 Oct 25 03:08:57.829596 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1121/2092] 10.222.0.36 () {60 vars in 1249 bytes} [Tue Oct 25 03:08:57 2022] POST /compute/v2.1/servers/tempest-invalid-1279126749/action => generated 101 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:57.835390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63e8e37d-77c5-454d-9180-6752be740bd7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'create', calling method: .version_select at 0x7efd33dee700>, body: {"keypair": {"name": "tempest-keypair-991134758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7YqR69HACtUvlNndPDRPNTErqOLuLsV9WuYBq/LI4frRuL+e3jqK1nqOsDsCC13NdEhqTLJhzh8k6xbXv1yTdPrMnMGjdYowSRfFN2k/0IO7h4027cdiAHb/EAp/z3Cw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:57.855797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-63e8e37d-77c5-454d-9180-6752be740bd7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for project 493ac819082a42af8d6e3c702c510a3b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:08:57.863067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-63e8e37d-77c5-454d-9180-6752be740bd7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for user 6a6e67c6afc74b39bb5cfac771f3e7d7 and project 493ac819082a42af8d6e3c702c510a3b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:08:57.896966 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63e8e37d-77c5-454d-9180-6752be740bd7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065989 Oct 25 03:08:57.898720 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1122/2093] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:08:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:57.924486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17fafed5-9b24-4764-84f4-17f842fd73e3 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:57.925734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17fafed5-9b24-4764-84f4-17f842fd73e3 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:58.049222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:58.060297 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d85934d-5818-4446-8814-4853ec9047b3 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 0.530595 Oct 25 03:08:58.062364 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 972/2094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:57 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:58.068396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:58.069374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:58.087952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:58.091367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:58.094672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:58.100056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:58.100887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:58.102265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:58.118081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17fafed5-9b24-4764-84f4-17f842fd73e3 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:58.141427 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d HTTP/1.1 Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:58.143012 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:08:58.144840 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f474cc1b-e0fe-4085-9216-34e00a0d228d'} Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:58.145977 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:08:58.147602 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.150835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:58.150835 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc4245e8-14d4-42cd-91a8-024376475673 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 404 len: 111 microversion: 2.1 time: 0.080891 Oct 25 03:08:58.155245 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 973/2095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:58 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:58.167582 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17fafed5-9b24-4764-84f4-17f842fd73e3 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1224 microversion: 2.1 time: 0.255364 Oct 25 03:08:58.168504 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1123/2096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:57 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1224 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:58.169154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9612793e-3b74-4c0f-9af5-e25f10082764 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1964422927"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:58.172384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9612793e-3b74-4c0f-9af5-e25f10082764 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 25 03:08:58.172911 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9612793e-3b74-4c0f-9af5-e25f10082764 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9612793e-3b74-4c0f-9af5-e25f10082764 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Request method failure captured: Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 57 Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MqDVCv3UqCsoYLXhk9OlLACN_HV6qdZqa94PmNkfH8fu4syDFIGO06CGR0fJj8Ogj0pgQmoXkxxeM4fizOFdcLTawcrMwadOtjGtAPDfCL1s956qvMLlR4grq1f0aaf7JGwoSPNrFlivbOvXt0qFnuK1db9OMxd2-Qv2fn3xpoLDE Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:58.174484 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f201d471005d447a85df971b269e65d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f201d471005d447a85df971b269e65d4"}]}] Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 58ff7c33a185492ea7d0565af7cf999a Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: {"createImage": {"name": "tempest-test-snap-1964422927"}} Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:58.176999 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1964422927'}}} Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:58.178239 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.179932 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.183987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9612793e-3b74-4c0f-9af5-e25f10082764 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:58.184864 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9612793e-3b74-4c0f-9af5-e25f10082764 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028645 Oct 25 03:08:58.192660 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 974/2097] 10.222.0.36 () {60 vars in 1275 bytes} [Tue Oct 25 03:08:58 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:58.194061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f77e5a8d-7cd6-45d5-852e-c5b23bd1556b req-81ea27ef-3831-4081-bff6-6e0b58333ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d", "name": "network-vif-deleted", "tag": "622945fd-e5db-4600-a346-b7d74da64aa5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:58.202973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5eeac193-4388-4675-b407-583f60105497 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-256010420", "metadata": {"": ""}}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5eeac193-4388-4675-b407-583f60105497 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action HTTP/1.1 Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 106 Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:58.216189 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-256010420", "metadata": {"": ""}}} Oct 25 03:08:58.219217 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-256010420', 'metadata': {'': ''}}}} Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'': ''} Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.220285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.222662 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5eeac193-4388-4675-b407-583f60105497 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:58.226076 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5eeac193-4388-4675-b407-583f60105497 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action" status: 400 len: 170 microversion: 2.1 time: 0.031172 Oct 25 03:08:58.232615 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 975/2098] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 25 03:08:58 2022] POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action => generated 170 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:08:58.240804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f77e5a8d-7cd6-45d5-852e-c5b23bd1556b req-81ea27ef-3831-4081-bff6-6e0b58333ca0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:58.241439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f77e5a8d-7cd6-45d5-852e-c5b23bd1556b req-81ea27ef-3831-4081-bff6-6e0b58333ca0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:58.241930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f77e5a8d-7cd6-45d5-852e-c5b23bd1556b req-81ea27ef-3831-4081-bff6-6e0b58333ca0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:58.246008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be6ae291-c7c5-4cb7-baf6-eddb18028fb5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd330bc310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:58.292889 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f77e5a8d-7cd6-45d5-852e-c5b23bd1556b req-81ea27ef-3831-4081-bff6-6e0b58333ca0 service nova] Creating event network-vif-deleted:622945fd-e5db-4600-a346-b7d74da64aa5 for instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d on n-h2-862355-1 Oct 25 03:08:58.312818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f77e5a8d-7cd6-45d5-852e-c5b23bd1556b req-81ea27ef-3831-4081-bff6-6e0b58333ca0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139315 Oct 25 03:08:58.313452 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1124/2099] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:58.325261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57b26d21-f674-4e4e-b6a9-fe137d2ade87 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-430293179"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:58.332379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57b26d21-f674-4e4e-b6a9-fe137d2ade87 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 25 03:08:58.349817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-57b26d21-f674-4e4e-b6a9-fe137d2ade87 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57b26d21-f674-4e4e-b6a9-fe137d2ade87 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Request method failure captured: Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 56 Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1MqDVCv3UqCsoYLXhk9OlLACN_HV6qdZqa94PmNkfH8fu4syDFIGO06CGR0fJj8Ogj0pgQmoXkxxeM4fizOFdcLTawcrMwadOtjGtAPDfCL1s956qvMLlR4grq1f0aaf7JGwoSPNrFlivbOvXt0qFnuK1db9OMxd2-Qv2fn3xpoLDE Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:58.351454 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f201d471005d447a85df971b269e65d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f201d471005d447a85df971b269e65d4"}]}] Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 58ff7c33a185492ea7d0565af7cf999a Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: {"createImage": {"name": "tempest-test-snap-430293179"}} Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:58.353011 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-430293179'}}} Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:58.354296 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 25 03:08:58.355776 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:58.357197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57b26d21-f674-4e4e-b6a9-fe137d2ade87 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:58.357197 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57b26d21-f674-4e4e-b6a9-fe137d2ade87 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.038078 Oct 25 03:08:58.359975 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1125/2100] 10.222.0.36 () {60 vars in 1281 bytes} [Tue Oct 25 03:08:58 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:58.390403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:58.391157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:58.411401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:58.418696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:58.421399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:58.422218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:58.427188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:58.428844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.041915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:59.050658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec08fe20-d4e9-4e55-ad59-f5f72891475c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 0.689609 Oct 25 03:08:59.072222 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1126/2101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:58 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:59.080051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.082859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:59.090084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.090736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.091763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.092167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.092892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.093589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.116693 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] HTTP exception thrown: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Request method failure captured: Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 HTTP/1.1 Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1MqDVCv3UqCsoYLXhk9OlLACN_HV6qdZqa94PmNkfH8fu4syDFIGO06CGR0fJj8Ogj0pgQmoXkxxeM4fizOFdcLTawcrMwadOtjGtAPDfCL1s956qvMLlR4grq1f0aaf7JGwoSPNrFlivbOvXt0qFnuK1db9OMxd2-Qv2fn3xpoLDE Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:59.119300 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f201d471005d447a85df971b269e65d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f201d471005d447a85df971b269e65d4"}]}] Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 58ff7c33a185492ea7d0565af7cf999a Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.120880 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '56ff7e87-dfdd-42cf-a121-1d52b70b5402'} Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:59.121926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.123534 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.126470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Returning 404 to user: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:59.129373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1cc95a9-a417-444a-8a31-363b06782c25 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "DELETE /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 404 len: 111 microversion: 2.1 time: 0.052741 Oct 25 03:08:59.145134 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1127/2102] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:08:59 2022] DELETE /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:59.152175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.154303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] [instance: e55448dc-6c7b-4106-80ee-65b05ae56e71] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:59.163369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.164132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.164574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.165325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.169930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.169930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.175623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:08:59.216956 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] HTTP exception thrown: Instance e55448dc-6c7b-4106-80ee-65b05ae56e71 could not be found. Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Request method failure captured: Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 HTTP/1.1 Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F7-hOK8gQYZomL5Kx5Mt-SrWJxGRF6kw3besvl-6zdNRkcCNxZeV6-r7cmguK6iziEMUrd3Osg24XUTj5Qycwtc7PKW02_99utqxh2Z0PIlA-SoJfIsL79LiSsyZPoWRJfOVUqb37mPCWhgpDYi7IZgD6IPnx2LkLpPqh-muUbNr0 Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:59.218558 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9eaf27614124019998010f834321c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9eaf27614124019998010f834321c31", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9eaf27614124019998010f834321c31"}]}] Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a9eaf27614124019998010f834321c31 Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-LiveMigrationTest-1994426623 Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f7fc1bae87d741e58f4e2182796f2df3 Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-LiveMigrationTest-1994426623-project Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e55448dc-6c7b-4106-80ee-65b05ae56e71 could not be found. Oct 25 03:08:59.220208 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e55448dc-6c7b-4106-80ee-65b05ae56e71'} Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55448dc-6c7b-4106-80ee-65b05ae56e71 could not be found. Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:59.221670 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55448dc-6c7b-4106-80ee-65b05ae56e71 could not be found. Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55448dc-6c7b-4106-80ee-65b05ae56e71 could not be found. Oct 25 03:08:59.225126 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.228215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] Returning 404 to user: Instance e55448dc-6c7b-4106-80ee-65b05ae56e71 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:59.229914 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e15fd42-f402-4c54-b54c-64c99c112e27 tempest-LiveMigrationTest-1994426623 tempest-LiveMigrationTest-1994426623-project] 10.222.0.36 "GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71" status: 404 len: 111 microversion: 2.1 time: 0.076780 Oct 25 03:08:59.230656 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1128/2103] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:59 2022] GET /compute/v2.1/servers/e55448dc-6c7b-4106-80ee-65b05ae56e71 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:59.238510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.239349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] [instance: 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:59.246003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.247912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.248541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.249707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.250413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.265199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.291519 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] HTTP exception thrown: Instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d could not be found. Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Request method failure captured: Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d HTTP/1.1 Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1LODHh4eiq_vE4A3Uv-zncH4QG81vKH0PlSggNhVTI7_j6rYVCMPqe0xuVfkr5aDeb16yAuV93kL74fKI-wYS-mBRXwFnbxLwKPpNEb3BqMdu5Cz0E3fwSwbsajHGnM_-2f0KoV9_k3-6LscV3whriqZBfj2zIbc9xy12uFvOVUoOo Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3ad24b576dc24c1f8122c207f017242a Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestManualDisk-1332907432 Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:08:59.295141 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ad24b576dc24c1f8122c207f017242a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ad24b576dc24c1f8122c207f017242a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3ad24b576dc24c1f8122c207f017242a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3ad24b576dc24c1f8122c207f017242a"}]}] Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestManualDisk-1332907432 Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3ad24b576dc24c1f8122c207f017242a Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestManualDisk-1332907432 Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestManualDisk-1332907432-project Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: bd5e91b8c87e42d581050ae86062276f Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestManualDisk-1332907432-project Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d could not be found. Oct 25 03:08:59.296691 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d'} Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d could not be found. Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:59.298326 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d could not be found. Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d could not be found. Oct 25 03:08:59.305098 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.308004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Returning 404 to user: Instance 0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:59.308004 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-15bd5ff9-f95c-4046-9a2f-551e6193a882 tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d" status: 404 len: 111 microversion: 2.1 time: 0.064369 Oct 25 03:08:59.308004 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1129/2104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:59 2022] GET /compute/v2.1/servers/0fda8908-7a4b-4f9c-a61a-4c8aa9aaf96d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:59.308710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.309773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:59.355593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.356095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.356539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.357264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.360801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.363165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.468593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.469500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.470202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.471011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lazy-loading 'fault' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:08:59.549494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:59.561372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:59.563214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:59.564650 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfff7e51-3f64-4fda-ba8f-a2032c758193 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1376 microversion: 2.25 time: 0.261264 Oct 25 03:08:59.579136 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1130/2105] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:08:59 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1376 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:08:59.591904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.592865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:59.600578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.601406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.602123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.603123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.603800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.604460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.687638 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-be6ae291-c7c5-4cb7-baf6-eddb18028fb5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 204 len: 0 microversion: 2.1 time: 1.452564 Oct 25 03:08:59.688138 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 976/2106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:58 2022] DELETE /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 0 bytes in 1454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:08:59.694672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.695561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] [instance: 56ff7e87-dfdd-42cf-a121-1d52b70b5402] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:59.703526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.704490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.705118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.706666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.707448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.708081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.733549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] HTTP exception thrown: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Request method failure captured: Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 HTTP/1.1 Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1MqDVCv3UqCsoYLXhk9OlLACN_HV6qdZqa94PmNkfH8fu4syDFIGO06CGR0fJj8Ogj0pgQmoXkxxeM4fizOFdcLTawcrMwadOtjGtAPDfCL1s956qvMLlR4grq1f0aaf7JGwoSPNrFlivbOvXt0qFnuK1db9OMxd2-Qv2fn3xpoLDE Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:08:59.735633 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f201d471005d447a85df971b269e65d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f201d471005d447a85df971b269e65d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f201d471005d447a85df971b269e65d4"}]}] Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f201d471005d447a85df971b269e65d4 Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-92635310 Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 58ff7c33a185492ea7d0565af7cf999a Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesNegativeTestJSON-92635310-project Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.737867 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '56ff7e87-dfdd-42cf-a121-1d52b70b5402'} Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:08:59.738888 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. Oct 25 03:08:59.740570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:08:59.743323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] Returning 404 to user: Instance 56ff7e87-dfdd-42cf-a121-1d52b70b5402 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:08:59.744490 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9fff06cf-c08d-4dfc-a357-ea5164a47121 tempest-ImagesNegativeTestJSON-92635310 tempest-ImagesNegativeTestJSON-92635310-project] 10.222.0.36 "GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402" status: 404 len: 111 microversion: 2.1 time: 0.054983 Oct 25 03:08:59.751604 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 977/2107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:59 2022] GET /compute/v2.1/servers/56ff7e87-dfdd-42cf-a121-1d52b70b5402 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:08:59.757435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.782512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:08:59.811202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.814107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.816898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.822911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.824816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.827514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.884346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:08:59.896512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f1dfd60-9eca-44cc-8ee1-29dda39c0912 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 0.316062 Oct 25 03:08:59.898243 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1131/2108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:59 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:08:59.904020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f50a1866-c502-4bcb-81cf-effa8508897d req-c15444de-0942-434a-b1f3-b34e91b32558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55448dc-6c7b-4106-80ee-65b05ae56e71", "name": "network-vif-deleted", "tag": "4e4aba84-66fb-484c-b7b8-0863d6075f02"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:08:59.918038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f50a1866-c502-4bcb-81cf-effa8508897d req-c15444de-0942-434a-b1f3-b34e91b32558 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:08:59.918701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f50a1866-c502-4bcb-81cf-effa8508897d req-c15444de-0942-434a-b1f3-b34e91b32558 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:08:59.920694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f50a1866-c502-4bcb-81cf-effa8508897d req-c15444de-0942-434a-b1f3-b34e91b32558 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:08:59.936074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f50a1866-c502-4bcb-81cf-effa8508897d req-c15444de-0942-434a-b1f3-b34e91b32558 service nova] Creating event network-vif-deleted:4e4aba84-66fb-484c-b7b8-0863d6075f02 for instance e55448dc-6c7b-4106-80ee-65b05ae56e71 on n-h2-862355-1 Oct 25 03:08:59.942784 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f50a1866-c502-4bcb-81cf-effa8508897d req-c15444de-0942-434a-b1f3-b34e91b32558 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042239 Oct 25 03:08:59.948641 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1132/2109] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:08:59.957130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5604870f-d7b3-46d2-beb0-210b753396bf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] Calling method '.version_select at 0x7efd382039d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:08:59.998656 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5604870f-d7b3-46d2-beb0-210b753396bf tempest-ServersTestManualDisk-1332907432 tempest-ServersTestManualDisk-1332907432-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365954930" status: 202 len: 0 microversion: 2.1 time: 0.046747 Oct 25 03:09:00.012418 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1133/2110] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365954930 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:09:00.019519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:00.020516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:00.029654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:00.030648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:00.031282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:00.032413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:00.033384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:00.034305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:00.077299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:00.102445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:00.143175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:00.158100 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97fbff82-6654-4704-9e65-0cf2458f9a88 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1276 microversion: 2.1 time: 0.404324 Oct 25 03:09:00.161040 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 978/2111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:08:59 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1276 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:00.167634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46f18245-b4c0-43a0-ac07-2b8274d2c2a1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1075478847", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46f18245-b4c0-43a0-ac07-2b8274d2c2a1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action HTTP/1.1 Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 619 Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:00.173631 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:00.176235 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:09:00.177258 n-d-862355-1 devstack@n-api.service[120563]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1075478847", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 25 03:09:00.177258 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:09:00.177258 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1075478847', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 25 03:09:00.177506 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:00.180931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:00.184392 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:00.187784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:00.187784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:00.187784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:09:00.187784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:09:00.187784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:09:00.187784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:00.192336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46f18245-b4c0-43a0-ac07-2b8274d2c2a1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:00.196620 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46f18245-b4c0-43a0-ac07-2b8274d2c2a1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action" status: 400 len: 938 microversion: 2.1 time: 0.032979 Oct 25 03:09:00.205031 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 979/2112] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 25 03:09:00 2022] POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action => generated 938 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:09:00.224394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:00.224394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:00.259902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:00.264214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:00.264869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:00.266336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:00.267140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:00.267691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:00.356265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-83333f0f-98da-4e69-a88e-de6bf281177f tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 204 len: 0 microversion: 2.1 time: 0.341717 Oct 25 03:09:00.357970 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1134/2113] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:00 2022] DELETE /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:00.445206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b817a830-14e6-4855-a160-1753037e915e req-fb4f756e-6165-4a04-98e3-c30fa496c861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6dbd798-ea90-476c-91fc-c466e0b7bd7a", "name": "network-vif-deleted", "tag": "65ec2208-6a10-4f7c-be38-2e1cb525e222"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:00.481216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b817a830-14e6-4855-a160-1753037e915e req-fb4f756e-6165-4a04-98e3-c30fa496c861 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:00.481938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b817a830-14e6-4855-a160-1753037e915e req-fb4f756e-6165-4a04-98e3-c30fa496c861 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:00.482395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b817a830-14e6-4855-a160-1753037e915e req-fb4f756e-6165-4a04-98e3-c30fa496c861 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:00.510997 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b817a830-14e6-4855-a160-1753037e915e req-fb4f756e-6165-4a04-98e3-c30fa496c861 service nova] Creating event network-vif-deleted:65ec2208-6a10-4f7c-be38-2e1cb525e222 for instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a on n-h1-862355-1 Oct 25 03:09:00.528265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b817a830-14e6-4855-a160-1753037e915e req-fb4f756e-6165-4a04-98e3-c30fa496c861 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086079 Oct 25 03:09:00.530959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1135/2114] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:09:00.549210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-801101198", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "385d0b29-fab5-4e63-9127-a294e08d4c17"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:00.655468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] validate_networks() for [('385d0b29-fab5-4e63-9127-a294e08d4c17', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:09:01.276084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:01.294628 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0583fe4e-3fb6-4b9b-826a-10593224fc43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 1.087452 Oct 25 03:09:01.295787 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 980/2115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:00 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:01.301002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:01.301883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:01.317124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.317941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.318562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.319459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.321298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.322188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.389472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.390282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.391068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.391707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lazy-loading 'fault' on Instance uuid b6dbd798-ea90-476c-91fc-c466e0b7bd7a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:09:01.545726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:09:01.546283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:09:01.546847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:09:01.547378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:09:01.547908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:09:01.566360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.566979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.567544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.568550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.569277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.574464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.612752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:01.628169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Getting quotas for user 438a56b0a79647f6bb195b7e0c42b089 and project 51199e37f0e945079e5d400ebd6d3a5d. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:01.630251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:01.663760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:09:01.673338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:09:01.757821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc73e7fb-8e80-4b1b-8eca-e6a2ac9d0e83 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219680 Oct 25 03:09:01.759117 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1136/2116] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:09:01.764281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:01.765669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:01.773829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.774598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.775034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.775773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.776220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.776678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.840306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:01.860493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:01.866943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:01.870720 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7673aba-ee30-461b-92c0-b281f02610f5 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 200 len: 1376 microversion: 2.25 time: 0.572368 Oct 25 03:09:01.886886 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 981/2117] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:01 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 1376 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:09:01.898950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:01.899301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:01.900146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:01.908902 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-003623f0-1506-456f-ba0c-d07eac89c560 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1282 microversion: 2.1 time: 0.147763 Oct 25 03:09:01.909888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.910587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.911287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.912178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:01.912792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:01.913376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:01.914278 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1137/2118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:01 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:01.927641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d56801f8-c2a9-4ae3-896c-17b508f07475 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:01.928268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d56801f8-c2a9-4ae3-896c-17b508f07475 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:02.066139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d56801f8-c2a9-4ae3-896c-17b508f07475 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:02.075177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d56801f8-c2a9-4ae3-896c-17b508f07475 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1207 microversion: 2.1 time: 0.159762 Oct 25 03:09:02.077213 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1138/2119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:01 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1207 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:02.712211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:02.722475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0dc6eb8-9d71-4775-91c4-930c539b1069 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 0.834285 Oct 25 03:09:02.723968 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 982/2120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:01 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:02.747583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d9bc84c0-9369-4669-a3b6-e673974f4eed tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d9bc84c0-9369-4669-a3b6-e673974f4eed tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action HTTP/1.1 Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 285 Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:02.753715 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:09:02.755389 n-d-862355-1 devstack@n-api.service[120562]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:09:02.759205 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:09:02.759967 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:09:02.761376 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:09:02.762396 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:09:02.762396 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.762396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d9bc84c0-9369-4669-a3b6-e673974f4eed tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:02.762396 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d9bc84c0-9369-4669-a3b6-e673974f4eed tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action" status: 400 len: 619 microversion: 2.1 time: 0.012105 Oct 25 03:09:02.762761 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1139/2121] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Oct 25 03:09:02 2022] POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:09:02.764450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:02.765310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:02.771583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:02.772592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:02.773921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:02.774670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:02.775129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:02.775748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:02.910038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:02.910696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: b6dbd798-ea90-476c-91fc-c466e0b7bd7a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:02.924412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:02.925134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:02.925801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:02.926725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:02.927558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:02.929079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:02.947862 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] HTTP exception thrown: Instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a could not be found. Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Request method failure captured: Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a HTTP/1.1 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F42L11gec9u4DwtgqnN2nk45qlZzrzZ6NXKlm2QVDpkFiocvC6Mb1NmYdmI8e8sLdaCZAe_EjE46YxooCWSEFBjQ1YevpFQL4IloFOuu0ptIiRvy9iHMEXQaLrtlsLpy_XXxkMdq0MqO9OxkAod4MHUcjoD4A1b621xNhCC_AMDE0 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.25 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:02.950005 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5e6aa25f05c4cd9bfd8d84eefc36c68", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}] Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 54c1fabb546b47cea96d2d70b32f4c69 Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a could not be found. Oct 25 03:09:02.951682 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'b6dbd798-ea90-476c-91fc-c466e0b7bd7a'} Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a could not be found. Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:02.952829 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a could not be found. Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a could not be found. Oct 25 03:09:02.954490 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:02.957859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Returning 404 to user: Instance b6dbd798-ea90-476c-91fc-c466e0b7bd7a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:02.958986 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a7686e2-7cf7-4d40-9bd9-49b1cc1c04ce tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a" status: 404 len: 111 microversion: 2.25 time: 0.060839 Oct 25 03:09:02.961248 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1140/2122] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:02 2022] GET /compute/v2.1/servers/b6dbd798-ea90-476c-91fc-c466e0b7bd7a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:09:02.968345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:02.968979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:02.976922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:02.981060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:02.983155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:02.986878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:02.989758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:02.992233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:03.088013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:03.100218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb93c925-1fa6-4781-96be-78e257d3108f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1282 microversion: 2.1 time: 0.137503 Oct 25 03:09:03.115307 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1141/2123] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:02 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:03.126322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5397109d-dfc1-4c1c-ba11-2a88dee42834 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '.version_select at 0x7efd38203f70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:03.167516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5397109d-dfc1-4c1c-ba11-2a88dee42834 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887778576" status: 204 len: 0 microversion: 2.25 time: 0.050215 Oct 25 03:09:03.170355 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1142/2124] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:09:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887778576 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:09:03.185355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:03.187164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:03.196715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:03.197462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:03.198169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:03.199124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:03.199835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:03.200516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:03.327043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:03.341698 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-227908a2-835d-4c20-a7bb-b6342da8d5e6 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1267 microversion: 2.1 time: 0.169146 Oct 25 03:09:03.367496 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1143/2125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:03 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:03.621211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:03.633936 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ac881f3-f674-45ac-835a-3587a5ac3130 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 0.873447 Oct 25 03:09:03.653285 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 983/2126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:02 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:03.663193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:03.663917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:03.677109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:03.678092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:03.678753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:03.680630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:03.681326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:03.683579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.136139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:04.137361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:04.146691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.147595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.148700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.149854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.150549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.151228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.255038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:04.265502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c7d18f8-a797-474e-9e72-04291aeb7ec6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 0.606306 Oct 25 03:09:04.266914 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1144/2127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:03 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:04.292564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-532383670"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:04.297558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:04.323310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.326700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.331314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.332354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.333041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.334304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.680510 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bae512df-d37a-43eb-8fa8-25ec90e95faa tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action" status: 202 len: 0 microversion: 2.1 time: 0.394253 Oct 25 03:09:04.684584 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1145/2128] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:09:04 2022] POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 25 03:09:04.698976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:04.700025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:04.709703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.710671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.711325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.712358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.713028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.713727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.744881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:04.761863 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8056766f-0949-4a2b-b269-e73c66d08804 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1282 microversion: 2.1 time: 0.628884 Oct 25 03:09:04.763027 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 984/2129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:04 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1282 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:04.777857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1020215780"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:04.780603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:04.793176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.793737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.794511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.795436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:04.798584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:04.799452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:04.854154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:04.863942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ddb235f-3c27-4700-9974-9e7c3108a7a8 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1265 microversion: 2.1 time: 0.175481 Oct 25 03:09:04.874628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1146/2130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:04 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:04.898739 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Cannot 'createImage' instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a while it is in task_state image_snapshot_pending Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action HTTP/1.1 Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 85 Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:04.900427 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1020215780"}} Oct 25 03:09:04.902211 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: exception: Cannot 'createImage' instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a while it is in task_state image_snapshot_pending Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1020215780'}}} Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:04.903084 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a while it is in task_state image_snapshot_pending Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a while it is in task_state image_snapshot_pending Oct 25 03:09:04.904769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:04.907740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 409 to user: Cannot 'createImage' instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a while it is in task_state image_snapshot_pending {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:04.909259 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3bcbc6a6-5297-4030-a036-96c4c324ccec tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action" status: 409 len: 167 microversion: 2.1 time: 0.144300 Oct 25 03:09:04.910708 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 985/2131] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:09:04 2022] POST /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a/action => generated 167 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:04.918856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ce8b3086-9e5f-4ef6-90d4-85124c5a4e9a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '.version_select at 0x7efd33eb3a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:05.117424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ce8b3086-9e5f-4ef6-90d4-85124c5a4e9a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/images/26430b1e-bf14-477e-ae08-831b3d123b9c" status: 204 len: 0 microversion: 2.1 time: 0.202593 Oct 25 03:09:05.118258 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1147/2132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:04 2022] DELETE /compute/v2.1/images/26430b1e-bf14-477e-ae08-831b3d123b9c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:05.127883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:05.128504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:05.134492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.135192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.136129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.137023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.138232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.139351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.181923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:05.182543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:05.193666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.194277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.194793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.195578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.205793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.206503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.246618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:05.379858 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12cf6336-d2e0-413f-ba38-5f935647f130 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "DELETE /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 204 len: 0 microversion: 2.25 time: 0.201743 Oct 25 03:09:05.380522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1148/2133] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:09:05 2022] DELETE /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:09:05.389039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:05.390050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:05.400325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.401196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.402029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.402933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.403712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.404293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.709448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:05.722356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:05.726686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:05.729512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7840b53c-831d-4ce3-a272-4c161450bc57 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1549 microversion: 2.25 time: 0.344405 Oct 25 03:09:05.736131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1149/2134] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:05 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1549 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:09:05.746605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1a3e9545-e106-47bf-b18a-f09081f03184 req-78cfe89b-666c-4289-81ec-a5ab4b6410f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d634c7-bfa9-44d9-92f0-db85353b6c80", "name": "network-vif-deleted", "tag": "e0cbe30f-06e7-4571-aba4-e8d45bdbf746"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:05.774722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a3e9545-e106-47bf-b18a-f09081f03184 req-78cfe89b-666c-4289-81ec-a5ab4b6410f6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.776848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a3e9545-e106-47bf-b18a-f09081f03184 req-78cfe89b-666c-4289-81ec-a5ab4b6410f6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.777657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1a3e9545-e106-47bf-b18a-f09081f03184 req-78cfe89b-666c-4289-81ec-a5ab4b6410f6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.814831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1a3e9545-e106-47bf-b18a-f09081f03184 req-78cfe89b-666c-4289-81ec-a5ab4b6410f6 service nova] Creating event network-vif-deleted:e0cbe30f-06e7-4571-aba4-e8d45bdbf746 for instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 on n-h1-862355-1 Oct 25 03:09:05.827509 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1a3e9545-e106-47bf-b18a-f09081f03184 req-78cfe89b-666c-4289-81ec-a5ab4b6410f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089134 Oct 25 03:09:05.831085 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1150/2135] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:05.852441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:05.865282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:05.871219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:05.880870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.881559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.882117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.882449 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f4fbb2fb-b659-4b54-bd0e-d71eada0c41e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1534 microversion: 2.1 time: 0.758788 Oct 25 03:09:05.883060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.883744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.884273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.885740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 986/2136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:05 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1534 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:05.927066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:05.928742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:05.941366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.943614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.944307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:05.945888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:05.946548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:05.946976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:06.246710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:06.258486 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e55c13c-216c-4498-ad2b-8d03cb0506e4 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.424110 Oct 25 03:09:06.268361 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1151/2137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:05 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:06.292240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:06.311682 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8f8e26c8-8cf7-4ae3-aa08-dfb0fd523c11 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1265 microversion: 2.1 time: 0.414991 Oct 25 03:09:06.319001 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 987/2138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:05 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1265 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:06.397079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-764647743", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de479dae-f122-4afa-92d4-4fbfe6f8f2ce"}], "security_groups": [{"name": "tempest-securitygroup--928901569"}], "key_name": "tempest-keypair-991134758", "user_data": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:06.620988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] validate_networks() for [('de479dae-f122-4afa-92d4-4fbfe6f8f2ce', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:09:06.760507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:06.761086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:06.779765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:06.780552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:06.781184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:06.782286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:06.782924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:06.783583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:07.474762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:09:07.475354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:09:07.475661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:09:07.476077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:09:07.476501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:09:07.489562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:07.493253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:07.493785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:07.499112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:07.499824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:07.500454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:07.549467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for project 493ac819082a42af8d6e3c702c510a3b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:07.563325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Getting quotas for user 6a6e67c6afc74b39bb5cfac771f3e7d7 and project 493ac819082a42af8d6e3c702c510a3b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:07.590575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:09:07.596049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:09:07.684801 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-905c92ba-0683-4a13-9a19-87a06535f7c3 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.292147 Oct 25 03:09:07.685764 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1152/2139] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:09:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:09:07.695248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:07.696440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:07.706635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:07.707740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:07.708360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:07.709388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:07.710033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:07.710725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:08.289903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:08.303764 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec25afe9-b598-4a75-9dbe-a9e728e6d405 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1540 microversion: 2.1 time: 0.613390 Oct 25 03:09:08.304655 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1153/2140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:07 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1540 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:08.318658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:08.322506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:08.351566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:08.356608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:08.357198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:08.358040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:08.358522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:08.358954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:08.440244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:08.545376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:08.560775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:08.562904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:08.566108 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2070727c-fcc2-4fc6-a071-3b30a10f6df0 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1549 microversion: 2.25 time: 1.809565 Oct 25 03:09:08.567057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 988/2141] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:06 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1549 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:09:08.577219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:08.579715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:08.595435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:08.596482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:08.597457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:08.598441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:08.599259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:08.600278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:08.625167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:08.994976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:09.010977 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c744f46-239e-4fac-bd37-5d44d08d01b9 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.703844 Oct 25 03:09:09.011688 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1154/2142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:08 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:09.023883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:09.026341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:09.050564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:09.051088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:09.051507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:09.052223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:09.052682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:09.053288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:09.190917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:09.205305 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8487d816-5a83-4ffe-95b0-ee7745399a25 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1288 microversion: 2.1 time: 0.189548 Oct 25 03:09:09.218251 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1155/2143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:09 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:09.333868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:09.334470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:09.341886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:09.342652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:09.343459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:09.345029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:09.345659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:09.346270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:09.576302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:09.585915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e450972-7e46-459f-8a19-01e7e7bc43a3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 1.017314 Oct 25 03:09:09.587205 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 989/2144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:08 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:09.595990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:09.596886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:09.603316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:09.605050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:09.605791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:09.608187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:09.609301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:09.610899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:09.611546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:09.831034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:09.861989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:09.867195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:09.868441 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82ea1cd4-e1fb-4bb8-b837-ded367b62cff tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 200 len: 1507 microversion: 2.25 time: 0.276328 Oct 25 03:09:09.873005 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 990/2145] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:09 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:09:09.888921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d97b1393-6907-4ca6-ab33-00f924edb704 req-dbf9a145-41c9-4ca0-b395-228ee35722b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18469533-ab8d-41ee-b31a-ed6af250dca2", "name": "network-vif-deleted", "tag": "aab9bd8d-50b0-491f-98df-0eb600f06623"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:09.919235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d97b1393-6907-4ca6-ab33-00f924edb704 req-dbf9a145-41c9-4ca0-b395-228ee35722b4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:09.934403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d97b1393-6907-4ca6-ab33-00f924edb704 req-dbf9a145-41c9-4ca0-b395-228ee35722b4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:09.940645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d97b1393-6907-4ca6-ab33-00f924edb704 req-dbf9a145-41c9-4ca0-b395-228ee35722b4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:09.981247 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d97b1393-6907-4ca6-ab33-00f924edb704 req-dbf9a145-41c9-4ca0-b395-228ee35722b4 service nova] Creating event network-vif-deleted:aab9bd8d-50b0-491f-98df-0eb600f06623 for instance 18469533-ab8d-41ee-b31a-ed6af250dca2 on n-h1-862355-1 Oct 25 03:09:09.989343 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d97b1393-6907-4ca6-ab33-00f924edb704 req-dbf9a145-41c9-4ca0-b395-228ee35722b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114889 Oct 25 03:09:09.990854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 991/2146] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:10.054784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:10.055785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:10.066652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.067873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.068572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.069584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.070428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.071095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.536395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:10.551756 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8f3154b-e6d6-4075-8008-acee4a91c68b tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1540 microversion: 2.1 time: 1.221581 Oct 25 03:09:10.554111 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1156/2147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:09 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1540 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:10.560221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:10.561553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:10.585067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.585918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.587234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:10.587759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.599221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58e6ab9a-8cb1-40fc-809d-fd46393b691f tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.567355 Oct 25 03:09:10.604621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.605692 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 992/2148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:10 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:10.610348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.613563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.623293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:10.626754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:10.641926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.658575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.659306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.660234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.661027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.661665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.772897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:10.787947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f35e2e08-0e02-4d7d-a59d-fd9303f00317 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1294 microversion: 2.1 time: 0.230919 Oct 25 03:09:10.790157 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1157/2149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:10 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1294 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:10.894673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:10.895309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 18469533-ab8d-41ee-b31a-ed6af250dca2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:10.903551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.904052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.908545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.909603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:10.910295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:10.918559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:10.940510 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] HTTP exception thrown: Instance 18469533-ab8d-41ee-b31a-ed6af250dca2 could not be found. Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Request method failure captured: Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 HTTP/1.1 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1F42L11gec9u4DwtgqnN2nk45qlZzrzZ6NXKlm2QVDpkFiocvC6Mb1NmYdmI8e8sLdaCZAe_EjE46YxooCWSEFBjQ1YevpFQL4IloFOuu0ptIiRvy9iHMEXQaLrtlsLpy_XXxkMdq0MqO9OxkAod4MHUcjoD4A1b621xNhCC_AMDE0 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.25 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:10.942673 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5e6aa25f05c4cd9bfd8d84eefc36c68", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}] Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 54c1fabb546b47cea96d2d70b32f4c69 Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 18469533-ab8d-41ee-b31a-ed6af250dca2 could not be found. Oct 25 03:09:10.944292 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '18469533-ab8d-41ee-b31a-ed6af250dca2'} Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18469533-ab8d-41ee-b31a-ed6af250dca2 could not be found. Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:10.945169 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18469533-ab8d-41ee-b31a-ed6af250dca2 could not be found. Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18469533-ab8d-41ee-b31a-ed6af250dca2 could not be found. Oct 25 03:09:10.946666 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:10.949797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Returning 404 to user: Instance 18469533-ab8d-41ee-b31a-ed6af250dca2 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:10.951217 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d6a54c5d-6899-4369-9c9e-3df837f46a26 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2" status: 404 len: 111 microversion: 2.25 time: 0.060350 Oct 25 03:09:10.952446 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1158/2150] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:10 2022] GET /compute/v2.1/servers/18469533-ab8d-41ee-b31a-ed6af250dca2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:09:10.963914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:10.964803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:11.006572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.007478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.008510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:11.009389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.009913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.010345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:11.086746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:11.131661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:11.147429 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b20f223-9b4d-4644-ad48-ffd1b558973e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.536114 Oct 25 03:09:11.148583 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 993/2151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:10 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:11.269422 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c37d5faa-b24a-4340-8190-95a131ffb6c4 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "DELETE /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 204 len: 0 microversion: 2.25 time: 0.309273 Oct 25 03:09:11.270094 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1159/2152] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:09:10 2022] DELETE /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:09:11.278262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:11.278881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:11.291094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.291603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.295909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:11.297391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.302317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.303064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:11.578578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:11.580038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:11.594762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.597463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.598893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:11.600172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.602167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.604546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:11.869053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:11.885238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:11.885779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:11.887913 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-958c6ea5-9757-4ebc-8c17-7c1bcb262476 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1564 microversion: 2.25 time: 0.613570 Oct 25 03:09:11.903422 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 994/2153] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:11 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1564 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:09:11.913948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:11.916259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:11.929545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.930181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.931312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:11.933311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:11.935185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:11.936207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.210899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:12.219764 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe9d215e-b408-4ec3-9b93-eecc5fbad40e tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1540 microversion: 2.1 time: 0.646977 Oct 25 03:09:12.239130 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1160/2154] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:11 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1540 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:12.244308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a1949076-5014-40fb-924e-2bd8fa7088e7 req-51769de4-a9a0-4246-ab4a-a03132dd52bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a", "name": "network-vif-plugged", "status": "completed", "tag": "5a373b70-0df6-4a41-8ba8-44a6e36fb92e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:12.254880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a1949076-5014-40fb-924e-2bd8fa7088e7 req-51769de4-a9a0-4246-ab4a-a03132dd52bb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.255636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a1949076-5014-40fb-924e-2bd8fa7088e7 req-51769de4-a9a0-4246-ab4a-a03132dd52bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.256301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a1949076-5014-40fb-924e-2bd8fa7088e7 req-51769de4-a9a0-4246-ab4a-a03132dd52bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.269464 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a1949076-5014-40fb-924e-2bd8fa7088e7 req-51769de4-a9a0-4246-ab4a-a03132dd52bb service nova] Creating event network-vif-plugged:5a373b70-0df6-4a41-8ba8-44a6e36fb92e for instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a on n-h2-862355-1 Oct 25 03:09:12.274656 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a1949076-5014-40fb-924e-2bd8fa7088e7 req-51769de4-a9a0-4246-ab4a-a03132dd52bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034004 Oct 25 03:09:12.275844 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1161/2155] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:12.282880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:12.284045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:12.290946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.291675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.292298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.293189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.293901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.294500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.390362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:12.403142 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d0f7498-ae41-4167-a3f0-1de3a251bb24 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.498126 Oct 25 03:09:12.415719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 995/2156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:11 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:12.438459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-57a6b1aa-c08d-4998-92ff-a563861917b6 req-36bbda62-1ecc-448b-ab5b-f063bb829cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951e4506-aede-4537-a913-152c40f3c429", "tag": "711d4ef3-bd8d-450d-972b-0aaf619bc902"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:12.455566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-57a6b1aa-c08d-4998-92ff-a563861917b6 req-36bbda62-1ecc-448b-ab5b-f063bb829cb1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.456417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-57a6b1aa-c08d-4998-92ff-a563861917b6 req-36bbda62-1ecc-448b-ab5b-f063bb829cb1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.457038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-57a6b1aa-c08d-4998-92ff-a563861917b6 req-36bbda62-1ecc-448b-ab5b-f063bb829cb1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.488362 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-57a6b1aa-c08d-4998-92ff-a563861917b6 req-36bbda62-1ecc-448b-ab5b-f063bb829cb1 service nova] Creating event network-changed:711d4ef3-bd8d-450d-972b-0aaf619bc902 for instance 951e4506-aede-4537-a913-152c40f3c429 on n-h1-862355-1 Oct 25 03:09:12.507652 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-57a6b1aa-c08d-4998-92ff-a563861917b6 req-36bbda62-1ecc-448b-ab5b-f063bb829cb1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079839 Oct 25 03:09:12.510157 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 996/2157] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:12.520989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:12.521522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:12.532898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.545376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.548128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.549243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.549961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.550669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.667760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:12.682741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ffda018-7ff2-4aaa-a792-000e82a4cd4d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1294 microversion: 2.1 time: 0.403113 Oct 25 03:09:12.683740 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1162/2158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:12 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1294 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:12.805915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d81b018f-d8fc-4b29-ba12-82a722f18230 req-99820cf0-282b-4674-a347-1fdca7cbd45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c0d5f2-d314-4e8d-af27-cc6ef9cb3118", "name": "network-vif-deleted", "tag": "d0a4f158-13c2-4754-9042-8eb43f5c1347"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:12.830283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d81b018f-d8fc-4b29-ba12-82a722f18230 req-99820cf0-282b-4674-a347-1fdca7cbd45c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.831069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d81b018f-d8fc-4b29-ba12-82a722f18230 req-99820cf0-282b-4674-a347-1fdca7cbd45c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.832564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d81b018f-d8fc-4b29-ba12-82a722f18230 req-99820cf0-282b-4674-a347-1fdca7cbd45c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.876625 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d81b018f-d8fc-4b29-ba12-82a722f18230 req-99820cf0-282b-4674-a347-1fdca7cbd45c service nova] Creating event network-vif-deleted:d0a4f158-13c2-4754-9042-8eb43f5c1347 for instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 on n-h1-862355-1 Oct 25 03:09:12.885920 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d81b018f-d8fc-4b29-ba12-82a722f18230 req-99820cf0-282b-4674-a347-1fdca7cbd45c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095595 Oct 25 03:09:12.888643 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1163/2159] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:09:12.918420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:12.919525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:12.932208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.933317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.934561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:12.936726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:12.937766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:12.938504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:13.081657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:13.082189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:13.084975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:13.085558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lazy-loading 'fault' on Instance uuid 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:09:13.111944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:13.141538 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-956614e0-d9d7-44b9-bb9b-2e871ca28708 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.620131 Oct 25 03:09:13.145716 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 997/2160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:12 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:13.251944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:13.252942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:13.264388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:13.270216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:13.271582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:13.272280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:13.273220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:13.274108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:13.277170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:13.277958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:13.279218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54c1fabb546b47cea96d2d70b32f4c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e6aa25f05c4cd9bfd8d84eefc36c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:13.280813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-504fd01a-a8b6-492d-bfad-9c16d39a9b69 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 200 len: 1352 microversion: 2.25 time: 0.367229 Oct 25 03:09:13.308380 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1164/2161] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:12 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 1352 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:09:13.436583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:13.439187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:13.464138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:13.465202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:13.469576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:13.472629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:13.475182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:13.478297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:13.890102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:13.899063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-863dba8d-e331-4771-a7bd-ad79fcbcd459 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.469250 Oct 25 03:09:13.900104 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1165/2162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:13 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:13.923018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:13.925283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:13.952788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:13.953422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:13.954181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:13.955002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:13.955520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:13.959031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.365623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:14.378514 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97b85585-8431-41e7-9234-87b841f04528 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.476911 Oct 25 03:09:14.390172 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1166/2163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:13 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:14.390172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:14.390172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:14.402297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.402797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.403246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.403961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.404423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.404858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.481972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:14.493614 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-edb510da-283f-4b93-87bb-488ae30adcb8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1522 microversion: 2.1 time: 1.247419 Oct 25 03:09:14.512133 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 998/2164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:13 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1522 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:14.512133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:14.512133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] [instance: 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:14.512133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.512505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.512505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.512505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.512505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.512779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.546794 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] HTTP exception thrown: Instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 could not be found. Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Request method failure captured: Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 HTTP/1.1 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1F42L11gec9u4DwtgqnN2nk45qlZzrzZ6NXKlm2QVDpkFiocvC6Mb1NmYdmI8e8sLdaCZAe_EjE46YxooCWSEFBjQ1YevpFQL4IloFOuu0ptIiRvy9iHMEXQaLrtlsLpy_XXxkMdq0MqO9OxkAod4MHUcjoD4A1b621xNhCC_AMDE0 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.25 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:14.548517 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5e6aa25f05c4cd9bfd8d84eefc36c68", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5e6aa25f05c4cd9bfd8d84eefc36c68"}]}] Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e5e6aa25f05c4cd9bfd8d84eefc36c68 Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-274057452 Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 54c1fabb546b47cea96d2d70b32f4c69 Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-274057452-project Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 could not be found. Oct 25 03:09:14.549773 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '61c0d5f2-d314-4e8d-af27-cc6ef9cb3118'} Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 could not be found. Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:14.550481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 could not be found. Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 could not be found. Oct 25 03:09:14.551572 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:14.552481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] Returning 404 to user: Instance 61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:14.558571 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca1e412e-c034-4c66-8397-8bca88db3672 tempest-LiveAutoBlockMigrationV225Test-274057452 tempest-LiveAutoBlockMigrationV225Test-274057452-project] 10.222.0.36 "GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118" status: 404 len: 111 microversion: 2.25 time: 0.053801 Oct 25 03:09:14.559658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 999/2165] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:09:14 2022] GET /compute/v2.1/servers/61c0d5f2-d314-4e8d-af27-cc6ef9cb3118 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:09:14.567862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:14.568599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:14.576721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.579199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.579856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.580762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.581402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.582055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.688363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:14.782493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:14.797449 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3159cb83-5f55-46c1-9327-5a5076b81389 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.415647 Oct 25 03:09:14.799609 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1167/2166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:14 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:14.813469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-539969b3-77ff-4ded-8444-d11308bd847b req-f5ae331d-8c99-4281-a450-0a9c15ba37bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2bfa70f-0821-4542-aa42-9e304450fedd", "tag": "b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:14.833453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:14.857803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-539969b3-77ff-4ded-8444-d11308bd847b req-f5ae331d-8c99-4281-a450-0a9c15ba37bb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.859961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-539969b3-77ff-4ded-8444-d11308bd847b req-f5ae331d-8c99-4281-a450-0a9c15ba37bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.861117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-539969b3-77ff-4ded-8444-d11308bd847b req-f5ae331d-8c99-4281-a450-0a9c15ba37bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.862344 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad9fba71-e3fd-4f05-a1f2-54dd569382ca tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 204 len: 0 microversion: 2.1 time: 0.300412 Oct 25 03:09:14.863429 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1000/2167] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:14 2022] DELETE /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:14.880264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:14.880788 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-539969b3-77ff-4ded-8444-d11308bd847b req-f5ae331d-8c99-4281-a450-0a9c15ba37bb service nova] Creating event network-changed:b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9 for instance d2bfa70f-0821-4542-aa42-9e304450fedd on n-h2-862355-1 Oct 25 03:09:14.881032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:14.893512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.899207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.899850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.900951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.901557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.909069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.914254 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-539969b3-77ff-4ded-8444-d11308bd847b req-f5ae331d-8c99-4281-a450-0a9c15ba37bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112767 Oct 25 03:09:14.914936 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1168/2168] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:14.932001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:14.932713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:14.942663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.943417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.944058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:14.944961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:14.945641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:14.946009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:15.246759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:15.260256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6bb5e573-6fdf-4abf-b1fa-0690064c6315 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.334508 Oct 25 03:09:15.261083 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1169/2169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:14 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:15.270437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:15.278404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6111d0b1-1a99-4bae-afbb-4cb5aa42f569 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1528 microversion: 2.1 time: 0.406938 Oct 25 03:09:15.279219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1001/2170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:14 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:15.410818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:15.412350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:15.426025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:15.427041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:15.427704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:15.428939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:15.429597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:15.430999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:15.768259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:15.787864 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8842adf5-d44f-4328-a9ce-93e73f0c7b65 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.383865 Oct 25 03:09:15.801888 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1170/2171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:15 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:15.825430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:15.828614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:15.838400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:15.839370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:15.839913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:15.840932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:15.844167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:15.845122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:16.291714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:16.292976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:16.324369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:16.325330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:16.325881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:16.327321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:16.327862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:16.329257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:16.766388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:16.770096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:16.777799 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3061a74-0aad-4248-a1e6-8564a9320a6e tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.497187 Oct 25 03:09:16.788147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1171/2172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:16 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:16.810834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:16.812319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:16.822714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:16.823528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:16.824918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:16.826333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:16.827779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:16.828429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:16.847058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:16.861063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef4fcdbd-82a2-4342-884b-1a7c605c29e2 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 1.041702 Oct 25 03:09:16.874058 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1002/2173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:15 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:16.894338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c2e8e831-a23c-4bea-b59d-cd5eb492df85 req-f304e6ae-5806-4aca-a8bd-3738599c91b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a", "name": "network-vif-unplugged", "status": "completed", "tag": "5a373b70-0df6-4a41-8ba8-44a6e36fb92e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:16.906488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c2e8e831-a23c-4bea-b59d-cd5eb492df85 req-f304e6ae-5806-4aca-a8bd-3738599c91b2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:16.907506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c2e8e831-a23c-4bea-b59d-cd5eb492df85 req-f304e6ae-5806-4aca-a8bd-3738599c91b2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:16.908155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c2e8e831-a23c-4bea-b59d-cd5eb492df85 req-f304e6ae-5806-4aca-a8bd-3738599c91b2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:16.924567 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c2e8e831-a23c-4bea-b59d-cd5eb492df85 req-f304e6ae-5806-4aca-a8bd-3738599c91b2 service nova] Creating event network-vif-unplugged:5a373b70-0df6-4a41-8ba8-44a6e36fb92e for instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a on n-h2-862355-1 Oct 25 03:09:16.937926 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c2e8e831-a23c-4bea-b59d-cd5eb492df85 req-f304e6ae-5806-4aca-a8bd-3738599c91b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061488 Oct 25 03:09:16.940016 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1003/2174] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:16.947412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:16.948497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:16.957742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:16.963097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:16.963948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:16.965027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:16.965783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:16.966485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:17.355520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:17.364905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1f4a8ce-9d09-43c1-88d8-52806998542f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1528 microversion: 2.1 time: 0.585426 Oct 25 03:09:17.365504 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1172/2175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:16 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1528 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:17.802254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:17.802879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:17.804808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:17.805477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=28 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:17.828351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:17.829929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:17.830895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:17.834123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:17.839288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:17.841725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:17.912293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:17.926561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cbce860a-b975-45a3-8943-548043703387 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.982857 Oct 25 03:09:17.943508 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1004/2176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:16 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:17.956066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:17.959057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:17.970335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:17.970830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:17.971263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:17.972512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:17.972512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:17.977314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:18.639235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:18.661387 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17138d2d-28cd-47a1-bb6e-ced49f2f7ba2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.862732 Oct 25 03:09:18.677222 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1173/2177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:17 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:18.682594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:18.686158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:18.699004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:18.699779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:18.700212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:18.701816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:18.701924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:18.702364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:18.790567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:18.814324 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb2c5be2-799a-4861-8f3c-0a2a3dbd8f89 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 200 len: 1486 microversion: 2.1 time: 0.134911 Oct 25 03:09:18.816462 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1174/2178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:18 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 1486 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:18.843843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-61d8801f-004e-4994-a402-52219918647f req-60813e6a-8610-41ed-bea0-7e5cb4399f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a", "name": "network-vif-deleted", "tag": "5a373b70-0df6-4a41-8ba8-44a6e36fb92e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:18.864409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:18.877806 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3829b4b6-d8d0-4047-b945-46702a1be9c9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.933057 Oct 25 03:09:18.878627 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1005/2179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:17 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:18.907919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-61d8801f-004e-4994-a402-52219918647f req-60813e6a-8610-41ed-bea0-7e5cb4399f7d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:18.908573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-61d8801f-004e-4994-a402-52219918647f req-60813e6a-8610-41ed-bea0-7e5cb4399f7d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:18.909143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-61d8801f-004e-4994-a402-52219918647f req-60813e6a-8610-41ed-bea0-7e5cb4399f7d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:18.926286 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-61d8801f-004e-4994-a402-52219918647f req-60813e6a-8610-41ed-bea0-7e5cb4399f7d service nova] Creating event network-vif-deleted:5a373b70-0df6-4a41-8ba8-44a6e36fb92e for instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a on n-h2-862355-1 Oct 25 03:09:18.932368 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-61d8801f-004e-4994-a402-52219918647f req-60813e6a-8610-41ed-bea0-7e5cb4399f7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114476 Oct 25 03:09:18.933643 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1175/2180] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:18.956385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:18.956992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:18.971934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:18.972997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:18.973801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:18.974685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:18.975349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:18.976439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:19.296050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-acbe5a7c-d2d0-4eda-b88a-8def4d042bcd req-993d7ce2-da9d-41d3-ac10-9718732e384e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951e4506-aede-4537-a913-152c40f3c429", "name": "network-vif-plugged", "status": "completed", "tag": "711d4ef3-bd8d-450d-972b-0aaf619bc902"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:19.316283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-acbe5a7c-d2d0-4eda-b88a-8def4d042bcd req-993d7ce2-da9d-41d3-ac10-9718732e384e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:19.316782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-acbe5a7c-d2d0-4eda-b88a-8def4d042bcd req-993d7ce2-da9d-41d3-ac10-9718732e384e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:19.317222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-acbe5a7c-d2d0-4eda-b88a-8def4d042bcd req-993d7ce2-da9d-41d3-ac10-9718732e384e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:19.345473 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-acbe5a7c-d2d0-4eda-b88a-8def4d042bcd req-993d7ce2-da9d-41d3-ac10-9718732e384e service nova] Creating event network-vif-plugged:711d4ef3-bd8d-450d-972b-0aaf619bc902 for instance 951e4506-aede-4537-a913-152c40f3c429 on n-h1-862355-1 Oct 25 03:09:19.355672 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-acbe5a7c-d2d0-4eda-b88a-8def4d042bcd req-993d7ce2-da9d-41d3-ac10-9718732e384e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063610 Oct 25 03:09:19.356865 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1176/2181] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:09:19.654224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:19.661707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:19.690647 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5cb5ba96-f0e8-4c35-9046-38652424844b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.737109 Oct 25 03:09:19.691716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:19.692509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:19.693350 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1006/2182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:18 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:19.704620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:19.705126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:19.709883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:19.711040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:19.711736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:19.716551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:19.844453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:19.845186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:19.865066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:19.868495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:19.868959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:19.872017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:19.872509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:19.878084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:19.896518 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a HTTP/1.1 Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:19.899101 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:09:19.900139 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a'} Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:19.900719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:09:19.901656 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:19.906977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:19.908139 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84e885c4-54d5-460b-b791-3f4edbfc08c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 404 len: 111 microversion: 2.1 time: 0.071511 Oct 25 03:09:19.909826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1007/2183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:19 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:09:19.920536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:19.922263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:19.939919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:19.940761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:19.941556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:19.942513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:19.943440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:19.944071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:20.366196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:20.379936 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ec05343-5b58-4057-a56b-bf7227d6f33e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.467745 Oct 25 03:09:20.398428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1008/2184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:19 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:20.417523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-712c3a82-3626-4742-8db7-f21f82226193 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'create', calling method: .version_select at 0x7efd32f09670>, body: {"keypair": {"name": "tempest-keypair-227833742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLShBiNiuVQTqML1ngylvejiuMCwJ+nlQQ3uk1LC40Dc5LMiQFNTwMfubgFts0asumqnnunm1UbiygyUoLQ7vXLYDEaKY2SWtuCTi28V1h7iNWQ/zVBEUYmjLVEMT9qHw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:20.449228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:20.465434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-712c3a82-3626-4742-8db7-f21f82226193 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for project f40282bec7bb43e49e8015cde76e5a19. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:20.468101 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32c8c901-5021-48eb-9327-0d3711c6b47a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1324 microversion: 2.1 time: 0.781887 Oct 25 03:09:20.469419 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1177/2185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:19 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1324 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:20.472015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-712c3a82-3626-4742-8db7-f21f82226193 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for user 92b6e776ceef40e5a979f3ed63f7cdfe and project f40282bec7bb43e49e8015cde76e5a19. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:20.491617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7d90d2e4-c28c-4625-8467-468ccd169f89 req-46a4fdcb-76cc-4203-8ae9-fcad41d2af6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b", "tag": "7dc69e0e-d64b-4150-a446-65d3737a6071"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:20.504683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7d90d2e4-c28c-4625-8467-468ccd169f89 req-46a4fdcb-76cc-4203-8ae9-fcad41d2af6e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:20.505830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7d90d2e4-c28c-4625-8467-468ccd169f89 req-46a4fdcb-76cc-4203-8ae9-fcad41d2af6e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:20.506466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7d90d2e4-c28c-4625-8467-468ccd169f89 req-46a4fdcb-76cc-4203-8ae9-fcad41d2af6e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:20.511795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-712c3a82-3626-4742-8db7-f21f82226193 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108898 Oct 25 03:09:20.512432 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1009/2186] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:09:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:20.540100 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7d90d2e4-c28c-4625-8467-468ccd169f89 req-46a4fdcb-76cc-4203-8ae9-fcad41d2af6e service nova] Creating event network-changed:7dc69e0e-d64b-4150-a446-65d3737a6071 for instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b on n-h1-862355-1 Oct 25 03:09:20.548389 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7d90d2e4-c28c-4625-8467-468ccd169f89 req-46a4fdcb-76cc-4203-8ae9-fcad41d2af6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076676 Oct 25 03:09:20.549776 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1178/2187] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:20.721743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:20.722719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:20.730702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:20.731540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:20.732886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:20.734364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:20.735088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:20.735872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:21.435143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:21.436309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:21.446640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:21.447288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:21.448022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:21.449298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:21.449950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:21.451189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:21.759366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:21.770727 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37076be2-ec2d-4234-9853-45db2a30ebff tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.355085 Oct 25 03:09:21.771746 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1179/2188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:21 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:21.776771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:21.780064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:21.788502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:21.789462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:21.791107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:21.792009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:21.792671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:21.793252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.112846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:22.131404 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27e504de-56f6-4e01-8538-79de381ea81a tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1521 microversion: 2.1 time: 0.357816 Oct 25 03:09:22.135700 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1180/2189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:21 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:22.159114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:22.159804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:22.183380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.191698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.192759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.193695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.194305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.195488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.242291 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] HTTP exception thrown: Instance is not a member of specified network Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Request method failure captured: Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429/ips/invalid HTTP/1.1 Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NHRjPh-mVIbIfcMYXb4p8XPwptkshsuFJmFxqEbnUu5mOFOSURNryftbtXn_D0v-dbIvgsFDuaUvYApPqYIicT_UC4e5mrG5inpkdArjQDrfwDYWPFNsWubRxAgzv9pCpCkid8lwVYqhM9nHqmj9wX6onca4io75HhWxvxtqY0mUI Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: d95ea41adfbe42efae37c03379cb76f3 Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:22.246381 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d95ea41adfbe42efae37c03379cb76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d95ea41adfbe42efae37c03379cb76f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d95ea41adfbe42efae37c03379cb76f3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d95ea41adfbe42efae37c03379cb76f3"}]}] Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: d95ea41adfbe42efae37c03379cb76f3 Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerAddressesNegativeTestJSON-677264183-project Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 638c4a1ba8fd4e1f877cfe8e60834070 Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-677264183-project Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance is not a member of specified network Oct 25 03:09:22.247502 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '951e4506-aede-4537-a913-152c40f3c429', 'id': 'invalid'} Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 25 03:09:22.248268 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.251028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:22.252126 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-902b79d2-017c-4bc6-b954-6f5b8fc38d7d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.098456 Oct 25 03:09:22.253310 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1181/2190] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:09:22 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429/ips/invalid => generated 91 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:22.269909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc5954e7-d302-4ae7-a2cc-9d370a4d9dd2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:22.271307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc5954e7-d302-4ae7-a2cc-9d370a4d9dd2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Failed to fetch instance by id 999 {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 25 03:09:22.272052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-dc5954e7-d302-4ae7-a2cc-9d370a4d9dd2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] HTTP exception thrown: Instance 999 could not be found. Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc5954e7-d302-4ae7-a2cc-9d370a4d9dd2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Request method failure captured: Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NHRjPh-mVIbIfcMYXb4p8XPwptkshsuFJmFxqEbnUu5mOFOSURNryftbtXn_D0v-dbIvgsFDuaUvYApPqYIicT_UC4e5mrG5inpkdArjQDrfwDYWPFNsWubRxAgzv9pCpCkid8lwVYqhM9nHqmj9wX6onca4io75HhWxvxtqY0mUI Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: d95ea41adfbe42efae37c03379cb76f3 Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:22.273961 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d95ea41adfbe42efae37c03379cb76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d95ea41adfbe42efae37c03379cb76f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d95ea41adfbe42efae37c03379cb76f3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d95ea41adfbe42efae37c03379cb76f3"}]}] Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: d95ea41adfbe42efae37c03379cb76f3 Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerAddressesNegativeTestJSON-677264183-project Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 638c4a1ba8fd4e1f877cfe8e60834070 Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-677264183-project Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 999 could not be found. Oct 25 03:09:22.275136 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '999'} Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 25 03:09:22.275707 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 25 03:09:22.276679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:22.279822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc5954e7-d302-4ae7-a2cc-9d370a4d9dd2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:22.284397 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc5954e7-d302-4ae7-a2cc-9d370a4d9dd2 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.019629 Oct 25 03:09:22.285596 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1182/2191] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:09:22 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:22.295963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:22.297019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:22.308587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.309865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.310652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.311696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.312365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.313000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.337370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:22.346879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:22.347982 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-132cffb1-a5b8-47ae-b9aa-33e66d077c19 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 1.631800 Oct 25 03:09:22.365566 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1010/2192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:20 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:22.511644 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc9166a7-715d-4838-b6f4-566f629762e1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "DELETE /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 204 len: 0 microversion: 2.1 time: 0.220503 Oct 25 03:09:22.514434 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1183/2193] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:22 2022] DELETE /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:22.524240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:22.525975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:22.541671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.555696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.557704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.561278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.563154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.565343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.798214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:22.799091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:22.833572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.834365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.835001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:22.836094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:22.839563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:22.852158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:23.084323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:23.099490 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-af81a4d9-b385-41a4-8fc5-aec0078cee5d tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1527 microversion: 2.1 time: 0.580900 Oct 25 03:09:23.102846 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1011/2194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:22 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1527 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:23.124146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c0698da4-79d4-4e31-aafb-6e53d618e79c req-7627f800-0ce8-4880-ab37-4d5387166784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bfa70f-0821-4542-aa42-9e304450fedd", "name": "network-vif-plugged", "status": "completed", "tag": "b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:23.149373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c0698da4-79d4-4e31-aafb-6e53d618e79c req-7627f800-0ce8-4880-ab37-4d5387166784 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:23.150399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c0698da4-79d4-4e31-aafb-6e53d618e79c req-7627f800-0ce8-4880-ab37-4d5387166784 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:23.151606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c0698da4-79d4-4e31-aafb-6e53d618e79c req-7627f800-0ce8-4880-ab37-4d5387166784 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:23.171713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c0698da4-79d4-4e31-aafb-6e53d618e79c req-7627f800-0ce8-4880-ab37-4d5387166784 service nova] Creating event network-vif-plugged:b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9 for instance d2bfa70f-0821-4542-aa42-9e304450fedd on n-h2-862355-1 Oct 25 03:09:23.182549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c0698da4-79d4-4e31-aafb-6e53d618e79c req-7627f800-0ce8-4880-ab37-4d5387166784 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077938 Oct 25 03:09:23.184430 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1012/2195] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:23.234345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:23.244943 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20c80407-3b27-4945-a7e3-6e6b18f6fc28 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.452624 Oct 25 03:09:23.246236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1184/2196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:22 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:23.375267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:23.376795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:23.389887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:23.392592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:23.395361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:23.399434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:23.405506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:23.407178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:23.698121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:23.715041 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ab71b59-0b25-4b42-aba5-96ee6175b895 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.346179 Oct 25 03:09:23.730821 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1013/2197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:23 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:24.129233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:24.130376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:24.150449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:24.150952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:24.151395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:24.152108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:24.162060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:24.162952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:24.270838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:24.272398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:24.297366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:24.299602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:24.301358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:24.303407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:24.308242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:24.310405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:24.870848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:24.880047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5975dec5-3ac5-41de-9132-ad48c0753af5 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1527 microversion: 2.1 time: 0.758292 Oct 25 03:09:24.883114 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1185/2198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:24 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1527 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:24.896473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:24.897395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:24.913337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:24.914200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:24.914876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:24.915800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:24.916460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:24.917109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:24.994248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:25.011074 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c274faf9-ca0b-4d83-bfb0-8a6e6a4787d1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1307 microversion: 2.1 time: 0.746292 Oct 25 03:09:25.018424 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1014/2199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:24 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1307 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:25.431012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:25.474512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9714b826-058f-4b60-b61f-207b8480d692 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.586818 Oct 25 03:09:25.474512 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1186/2200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:24 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:25.907587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:25.908532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:25.915055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:25.915893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:25.916547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:25.917488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:25.918107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:25.919046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:26.047830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:26.048462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:26.061249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:26.062114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:26.062793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:26.078514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:26.082623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:26.084895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:26.510229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:26.522846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:26.530876 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73ec3916-b4d4-428b-957b-e3a00a3a15e4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1487 microversion: 2.1 time: 0.486165 Oct 25 03:09:26.531608 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1187/2201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:26 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1487 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:26.548926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:26.551163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:26.556641 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-920735b7-7cd5-417e-bd7c-3b83be67d4b1 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1527 microversion: 2.1 time: 0.654198 Oct 25 03:09:26.573107 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1015/2202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:25 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1527 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:26.573734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:26.581308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:26.582314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:26.584397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:26.587636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1073754388"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:26.588023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:26.590250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:26.590875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:26.597759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:26.598607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:26.599271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:26.600225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:26.600895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:26.601557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:27.022588 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb26c274-f332-4eca-a88f-518ef9b71f1c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "POST /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd/action" status: 202 len: 0 microversion: 2.1 time: 0.441585 Oct 25 03:09:27.023726 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1016/2203] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:09:26 2022] POST /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:09:27.035673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a83a4522-e2f7-4ba0-acd1-c75be9f5d398 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33042f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:27.057780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:27.067649 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87d843c3-a675-4928-b5c7-4fa834f56b35 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.532756 Oct 25 03:09:27.079225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1188/2204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:26 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:27.132772 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a83a4522-e2f7-4ba0-acd1-c75be9f5d398 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570" status: 200 len: 1414 microversion: 2.1 time: 0.101273 Oct 25 03:09:27.134280 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1017/2205] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:09:27 2022] GET /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:27.152050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ce7cff9-9f75-4710-ac26-f962fb17baea tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3386f700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:27.225653 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ce7cff9-9f75-4710-ac26-f962fb17baea tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570" status: 200 len: 1414 microversion: 2.1 time: 0.077425 Oct 25 03:09:27.237302 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1189/2206] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:09:27 2022] GET /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:27.240458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d29ecb88-7c41-42c4-8e43-f0f3a4e9a2a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd331e64c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:27.269340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1345978929", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:27.411715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] validate_networks() for [('05ce7fca-15ae-4f11-bf0d-1d24b23b50a6', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:09:27.526288 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d29ecb88-7c41-42c4-8e43-f0f3a4e9a2a5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570" status: 204 len: 0 microversion: 2.1 time: 0.289742 Oct 25 03:09:27.526879 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1018/2207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:27 2022] DELETE /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:27.536809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-673d1184-9a65-4377-8c9a-11dbf863caa7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd330b7ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:27.575395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-673d1184-9a65-4377-8c9a-11dbf863caa7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Image not found. Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-673d1184-9a65-4377-8c9a-11dbf863caa7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570 HTTP/1.1 Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:27.579148 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '5fc08d54-3a61-4b6c-b448-55435a0c3570'} Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:27.580422 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5fc08d54-3a61-4b6c-b448-55435a0c3570 Oct 25 03:09:27.581145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:27.582032 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5fc08d54-3a61-4b6c-b448-55435a0c3570 could not be found. Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:09:27.583058 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-673d1184-9a65-4377-8c9a-11dbf863caa7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:27.584330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-673d1184-9a65-4377-8c9a-11dbf863caa7 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570" status: 404 len: 62 microversion: 2.1 time: 0.048504 Oct 25 03:09:27.588623 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1019/2208] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:09:27 2022] GET /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:09:27.598333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:27.601042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:27.616370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:27.619224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:27.619738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:27.620589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:27.622211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:27.622808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:28.580500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:28.588770 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39cc7f3a-6b65-4217-8b67-2bf4bd2c9b44 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1499 microversion: 2.1 time: 0.998995 Oct 25 03:09:28.590402 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1020/2209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:27 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1499 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:28.622333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:28.623142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:28.630119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:28.630623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:28.631067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:28.631782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:28.632244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:28.632672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:28.690683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:28.691409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:28.692469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:28.693251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lazy-loading 'fault' on Instance uuid 951e4506-aede-4537-a913-152c40f3c429 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:09:28.809298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638c4a1ba8fd4e1f877cfe8e60834070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95ea41adfbe42efae37c03379cb76f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:28.849837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-edccfe85-7bb2-432d-b25c-7a339e66c652 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 200 len: 1314 microversion: 2.1 time: 0.245594 Oct 25 03:09:28.852434 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1021/2210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:28 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:28.859038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:28.860089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:28.869158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:28.872150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:28.873142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:28.874369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:28.876792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:28.878012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:29.191431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:09:29.191431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:09:29.191875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:09:29.191941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:09:29.192528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:09:29.216632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:29.217285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:29.217847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:29.218723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:29.219271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:29.220417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:29.274774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for project f40282bec7bb43e49e8015cde76e5a19. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:29.287877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for user 92b6e776ceef40e5a979f3ed63f7cdfe and project f40282bec7bb43e49e8015cde76e5a19. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:29.328057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:09:29.330611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:09:29.428254 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-751d9dc3-f75d-4413-a961-acf369710575 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.177397 Oct 25 03:09:29.447441 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1190/2211] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:09:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:09:29.453499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-738fe47f-1490-4691-85b1-0ec9ea673d5f req-ddaeabf0-87f3-4ee6-af96-d1dacbe6047a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951e4506-aede-4537-a913-152c40f3c429", "name": "network-vif-deleted", "tag": "711d4ef3-bd8d-450d-972b-0aaf619bc902"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:29.469108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-738fe47f-1490-4691-85b1-0ec9ea673d5f req-ddaeabf0-87f3-4ee6-af96-d1dacbe6047a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:29.469892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-738fe47f-1490-4691-85b1-0ec9ea673d5f req-ddaeabf0-87f3-4ee6-af96-d1dacbe6047a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:29.470526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-738fe47f-1490-4691-85b1-0ec9ea673d5f req-ddaeabf0-87f3-4ee6-af96-d1dacbe6047a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:29.494503 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-738fe47f-1490-4691-85b1-0ec9ea673d5f req-ddaeabf0-87f3-4ee6-af96-d1dacbe6047a service nova] Creating event network-vif-deleted:711d4ef3-bd8d-450d-972b-0aaf619bc902 for instance 951e4506-aede-4537-a913-152c40f3c429 on n-h1-862355-1 Oct 25 03:09:29.507153 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-738fe47f-1490-4691-85b1-0ec9ea673d5f req-ddaeabf0-87f3-4ee6-af96-d1dacbe6047a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058049 Oct 25 03:09:29.508113 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1191/2212] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:29.732924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-154301927", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:29.782014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:29.803891 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e351fed-ce41-4cba-8e9b-c32494762caa tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.950123 Oct 25 03:09:29.807192 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1022/2213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:28 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:29.816357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:09:29.829323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3b1a90c3-d4d6-4deb-857e-a6e97d492d27 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:29.832451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3b1a90c3-d4d6-4deb-857e-a6e97d492d27 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:29.941204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3b1a90c3-d4d6-4deb-857e-a6e97d492d27 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:29.953726 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3b1a90c3-d4d6-4deb-857e-a6e97d492d27 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1225 microversion: 2.1 time: 0.143940 Oct 25 03:09:29.955807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1023/2214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:29 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:29.963221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:29.964131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:29.974504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:29.981773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:29.982695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:29.983839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:29.984500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:29.985334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.287974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:09:30.288640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:09:30.289394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:09:30.289919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:09:30.290667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:09:30.308676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.309484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.310150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.312125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.312843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.313430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.341947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:30.347931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for user a205c6ef239c44e8b2768df15ea8d943 and project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:30.366253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:09:30.368927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:09:30.434814 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c2f6415c-df3f-41fa-ad42-945f83d79948 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924384 Oct 25 03:09:30.436090 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1192/2215] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:09:30.442598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:30.443241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] [instance: 951e4506-aede-4537-a913-152c40f3c429] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:30.454550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.468474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.469977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.473095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.474151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.476132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.512540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:30.545756 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] HTTP exception thrown: Instance 951e4506-aede-4537-a913-152c40f3c429 could not be found. Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Request method failure captured: Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 HTTP/1.1 Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NHRjPh-mVIbIfcMYXb4p8XPwptkshsuFJmFxqEbnUu5mOFOSURNryftbtXn_D0v-dbIvgsFDuaUvYApPqYIicT_UC4e5mrG5inpkdArjQDrfwDYWPFNsWubRxAgzv9pCpCkid8lwVYqhM9nHqmj9wX6onca4io75HhWxvxtqY0mUI Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: d95ea41adfbe42efae37c03379cb76f3 Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:30.552894 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d95ea41adfbe42efae37c03379cb76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d95ea41adfbe42efae37c03379cb76f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d95ea41adfbe42efae37c03379cb76f3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d95ea41adfbe42efae37c03379cb76f3"}]}] Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: d95ea41adfbe42efae37c03379cb76f3 Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-677264183 Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerAddressesNegativeTestJSON-677264183-project Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 638c4a1ba8fd4e1f877cfe8e60834070 Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-677264183-project Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 951e4506-aede-4537-a913-152c40f3c429 could not be found. Oct 25 03:09:30.554122 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '951e4506-aede-4537-a913-152c40f3c429'} Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951e4506-aede-4537-a913-152c40f3c429 could not be found. Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:30.554705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951e4506-aede-4537-a913-152c40f3c429 could not be found. Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951e4506-aede-4537-a913-152c40f3c429 could not be found. Oct 25 03:09:30.555641 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:30.561045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] Returning 404 to user: Instance 951e4506-aede-4537-a913-152c40f3c429 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:30.561045 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f98ab584-2c8c-4eb1-ac73-27ede8fe4b94 tempest-ServerAddressesNegativeTestJSON-677264183 tempest-ServerAddressesNegativeTestJSON-677264183-project] 10.222.0.36 "GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429" status: 404 len: 111 microversion: 2.1 time: 0.118070 Oct 25 03:09:30.561045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1193/2216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:30 2022] GET /compute/v2.1/servers/951e4506-aede-4537-a913-152c40f3c429 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:30.574528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a9a6e96-6cd6-430f-b525-1a4c8ae7465c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:30.575210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a9a6e96-6cd6-430f-b525-1a4c8ae7465c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:30.725059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a9a6e96-6cd6-430f-b525-1a4c8ae7465c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:30.734763 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a9a6e96-6cd6-430f-b525-1a4c8ae7465c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1212 microversion: 2.1 time: 0.177858 Oct 25 03:09:30.750987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1194/2217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:30 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1212 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:30.773771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:30.787062 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aefd9cbf-e142-49f0-b866-d4729f5ee998 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1505 microversion: 2.1 time: 0.829609 Oct 25 03:09:30.788024 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1024/2218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:29 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:30.831397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:30.832524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:30.842293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.845665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.846169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.846927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.849016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.849156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.981922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:30.982749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:30.990577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.991297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.991975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:30.992958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:30.994545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:30.995245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:31.376830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:31.388576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d3f44076-7009-4ace-abb4-215a51985214 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1277 microversion: 2.1 time: 0.411694 Oct 25 03:09:31.394507 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1025/2219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:30 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1277 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:31.639145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:31.649055 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-468438a2-14df-40d8-9050-2a58c4aba682 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.822521 Oct 25 03:09:31.652451 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1195/2220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:30 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:31.762268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:31.763186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:31.772890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:31.773408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:31.777138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:31.778027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:31.781719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:31.784776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:31.819418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:31.820215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:31.837338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:31.838035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:31.838583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:31.839463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:31.840167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:31.840793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:31.933530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:31.953292 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97dac25f-36bc-47a6-8c61-6ac800b459f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1208 microversion: 2.1 time: 0.195287 Oct 25 03:09:31.955994 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1026/2221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:31 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:31.997779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1bb6799f-97b7-4815-90ea-90c2894bc080 req-883a9238-3e3a-4f38-b25f-eccb7c1e6d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b", "name": "network-vif-plugged", "status": "completed", "tag": "7dc69e0e-d64b-4150-a446-65d3737a6071"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:32.015747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1bb6799f-97b7-4815-90ea-90c2894bc080 req-883a9238-3e3a-4f38-b25f-eccb7c1e6d1e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:32.016244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1bb6799f-97b7-4815-90ea-90c2894bc080 req-883a9238-3e3a-4f38-b25f-eccb7c1e6d1e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:32.022542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1bb6799f-97b7-4815-90ea-90c2894bc080 req-883a9238-3e3a-4f38-b25f-eccb7c1e6d1e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:32.055204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1bb6799f-97b7-4815-90ea-90c2894bc080 req-883a9238-3e3a-4f38-b25f-eccb7c1e6d1e service nova] Creating event network-vif-plugged:7dc69e0e-d64b-4150-a446-65d3737a6071 for instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b on n-h1-862355-1 Oct 25 03:09:32.073211 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1bb6799f-97b7-4815-90ea-90c2894bc080 req-883a9238-3e3a-4f38-b25f-eccb7c1e6d1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084383 Oct 25 03:09:32.076440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1027/2222] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:32.427614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:32.428332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:32.439471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:32.443001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:32.443711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:32.445619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:32.449154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:32.450062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:32.648685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:32.690319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:32.695841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:32.697446 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c1048fc4-c63d-49d6-8235-869cffbee782 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1505 microversion: 2.1 time: 0.878626 Oct 25 03:09:32.698930 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1196/2223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:31 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1505 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:32.710757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:32.710845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:32.730478 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5c1672a1-a275-4300-a180-edfe70ac4985 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1283 microversion: 2.1 time: 0.308697 Oct 25 03:09:32.731480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:32.731991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:32.732451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:32.733238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:32.733727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:32.734170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:32.750063 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1028/2224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:32 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1283 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:32.981724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:32.982407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:32.991784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:32.995784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:32.999112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:33.000105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:33.000786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:33.001492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:33.117909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:33.133733 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6689a8fb-9f4b-4e75-b2a4-399eae619b20 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1270 microversion: 2.1 time: 0.156923 Oct 25 03:09:33.134928 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1029/2225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:32 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:33.278680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-69673382-8183-4308-803e-134be19ad9f0 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Action: 'create', calling method: .version_select at 0x7efd3313a820>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-635038874", "policies": ["affinity"]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:33.300232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-69673382-8183-4308-803e-134be19ad9f0 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:33.306518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:33.309098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-69673382-8183-4308-803e-134be19ad9f0 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:33.330632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:33.343034 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab38d498-7ce8-4120-a114-d9c7593a1bf9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1361 microversion: 2.1 time: 0.637709 Oct 25 03:09:33.348993 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1197/2226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:32 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1361 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:33.416326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-69673382-8183-4308-803e-134be19ad9f0 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:33.424632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-69673382-8183-4308-803e-134be19ad9f0 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:33.442718 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-69673382-8183-4308-803e-134be19ad9f0 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.305406 Oct 25 03:09:33.444134 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1030/2227] 10.222.0.36 () {60 vars in 1174 bytes} [Tue Oct 25 03:09:33 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:33.455874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-430d14c0-3789-481f-a302-c06702a0e2af tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Action: 'create', calling method: .version_select at 0x7efd382f7f70>, body: {"server_group": {"name": "tempest-server-group-2081385018", "policies": ["affinity"]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:33.514571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-430d14c0-3789-481f-a302-c06702a0e2af tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:33.531083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-430d14c0-3789-481f-a302-c06702a0e2af tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:33.540293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:33.685309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-430d14c0-3789-481f-a302-c06702a0e2af tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:33.702661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-430d14c0-3789-481f-a302-c06702a0e2af tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:33.724708 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-430d14c0-3789-481f-a302-c06702a0e2af tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.272786 Oct 25 03:09:33.725317 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1198/2228] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 25 03:09:33 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:33.736680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e686ecb-cc8a-4585-893e-cea67e0a6754 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Action: 'create', calling method: .version_select at 0x7efd33de1790>, body: {"server_group": {"name": "tempest-server-group-2081385018", "policies": ["affinity"]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:33.737772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:33.738604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:33.747354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:33.748100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:33.748682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:33.749615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:33.750924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:33.754782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:33.782130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7e686ecb-cc8a-4585-893e-cea67e0a6754 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:33.791250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7e686ecb-cc8a-4585-893e-cea67e0a6754 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:33.909792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7e686ecb-cc8a-4585-893e-cea67e0a6754 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:33.936727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7e686ecb-cc8a-4585-893e-cea67e0a6754 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:33.978828 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e686ecb-cc8a-4585-893e-cea67e0a6754 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.245264 Oct 25 03:09:33.986287 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1199/2229] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 25 03:09:33 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:09:34.003173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:34.007005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:34.034274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:34.034867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:34.035291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:34.036077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:34.036536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:34.036955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:34.363712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:34.378462 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-94d66ec8-38be-4049-8bdb-1803723123e3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1500 microversion: 2.1 time: 0.654951 Oct 25 03:09:34.383870 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1031/2230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:33 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1500 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:34.396874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fdcf6905-d307-4d19-b857-795fc19967a2 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:34.530374 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fdcf6905-d307-4d19-b857-795fc19967a2 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/7bea11bf-9f0a-480e-9183-855baedef1e6" status: 204 len: 0 microversion: 2.1 time: 0.145073 Oct 25 03:09:34.530994 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1032/2231] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:09:34 2022] DELETE /compute/v2.1/os-server-groups/7bea11bf-9f0a-480e-9183-855baedef1e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:34.536296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2845be8b-62b4-4da4-a0de-03d036d14930 req-70f5444d-8c91-4bb3-a6ad-4c8927625bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bfa70f-0821-4542-aa42-9e304450fedd", "name": "network-vif-plugged", "status": "completed", "tag": "b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:34.558261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2845be8b-62b4-4da4-a0de-03d036d14930 req-70f5444d-8c91-4bb3-a6ad-4c8927625bbe service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:34.558749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2845be8b-62b4-4da4-a0de-03d036d14930 req-70f5444d-8c91-4bb3-a6ad-4c8927625bbe service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:34.559202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2845be8b-62b4-4da4-a0de-03d036d14930 req-70f5444d-8c91-4bb3-a6ad-4c8927625bbe service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:34.604716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2845be8b-62b4-4da4-a0de-03d036d14930 req-70f5444d-8c91-4bb3-a6ad-4c8927625bbe service nova] Creating event network-vif-plugged:b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9 for instance d2bfa70f-0821-4542-aa42-9e304450fedd on n-h2-862355-1 Oct 25 03:09:34.614189 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2845be8b-62b4-4da4-a0de-03d036d14930 req-70f5444d-8c91-4bb3-a6ad-4c8927625bbe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081493 Oct 25 03:09:34.614871 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1033/2232] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:34.627501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:34.631671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:34.642062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:34.642562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:34.648249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:34.649095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:34.649582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:34.650074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:34.778645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:34.793026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c43f9205-5594-41bf-9625-30ff735db865 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 0.808372 Oct 25 03:09:34.798211 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1200/2233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:33 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:34.814566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:34.815562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:34.817553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:34.828262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:34.831231 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f8668658-78ce-4c38-865d-04d0cb7be117 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1270 microversion: 2.1 time: 0.209495 Oct 25 03:09:34.833945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:34.834765 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1034/2234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:34 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:34.835400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:34.837363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:34.847377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cde5845-e031-4ffc-9f9f-f68bfab8025c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:34.850471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:34.851058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:34.896096 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cde5845-e031-4ffc-9f9f-f68bfab8025c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.057674 Oct 25 03:09:34.905801 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1035/2235] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:09:34 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:34.913560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6e0d388-87cc-43fb-9362-3340b0b1b553 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:34.985953 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6e0d388-87cc-43fb-9362-3340b0b1b553 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/0cee802e-c329-43fa-a31e-ca90aa9e9efa" status: 204 len: 0 microversion: 2.1 time: 0.077912 Oct 25 03:09:34.990498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1036/2236] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:09:34 2022] DELETE /compute/v2.1/os-server-groups/0cee802e-c329-43fa-a31e-ca90aa9e9efa => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:34.996569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27428701-9fa4-41d0-bf32-f1076816a85e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:35.033199 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-27428701-9fa4-41d0-bf32-f1076816a85e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.041224 Oct 25 03:09:35.033843 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1037/2237] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:09:34 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:35.053588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03523b11-d3e4-4404-8a76-d605a14db56e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Action: 'create', calling method: .version_select at 0x7efd331e6e50>, body: {"server_group": {"name": "tempest-server-group-1491751098", "policies": ["affinity"]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:35.100588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03523b11-d3e4-4404-8a76-d605a14db56e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:35.115116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03523b11-d3e4-4404-8a76-d605a14db56e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:35.203746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03523b11-d3e4-4404-8a76-d605a14db56e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:35.226191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03523b11-d3e4-4404-8a76-d605a14db56e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:35.265047 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03523b11-d3e4-4404-8a76-d605a14db56e tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.218903 Oct 25 03:09:35.273138 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1038/2238] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 25 03:09:35 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:35.291343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1762112b-f4a7-4d29-8f44-1303807b0a1c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:35.365421 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1762112b-f4a7-4d29-8f44-1303807b0a1c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/13440363-f039-4c9c-9f3c-93afb8c04186" status: 204 len: 0 microversion: 2.1 time: 0.090835 Oct 25 03:09:35.370730 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1039/2239] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:09:35 2022] DELETE /compute/v2.1/os-server-groups/13440363-f039-4c9c-9f3c-93afb8c04186 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:35.375989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-693c0984-2363-4f95-91bc-cd830afeb1d2 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:35.402111 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-693c0984-2363-4f95-91bc-cd830afeb1d2 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.030034 Oct 25 03:09:35.419887 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1040/2240] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:09:35 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:35.425307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:35.426208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:35.460578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:35.461359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:35.461989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:35.462886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:35.469346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:35.470397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:35.952210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:35.963370 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f68ec1d-5bed-491d-8b73-602fbba2cb18 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1487 microversion: 2.1 time: 0.541951 Oct 25 03:09:35.986106 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1041/2241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:35 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1487 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:36.001132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a917d53-2ed3-4fdf-82c5-d9270ec5cb22 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Action: 'create', calling method: .version_select at 0x7efd32f14280>, body: {"server_group": {"name": "tempest-server-group-1491830788", "policies": ["anti-affinity"]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:36.064523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2a917d53-2ed3-4fdf-82c5-d9270ec5cb22 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:36.078903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2a917d53-2ed3-4fdf-82c5-d9270ec5cb22 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:36.159271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:36.214198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2a917d53-2ed3-4fdf-82c5-d9270ec5cb22 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:36.224702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2a917d53-2ed3-4fdf-82c5-d9270ec5cb22 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_groups'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:36.263738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a917d53-2ed3-4fdf-82c5-d9270ec5cb22 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.276356 Oct 25 03:09:36.266349 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1042/2242] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 25 03:09:35 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:36.280732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:36.281369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:36.310300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:36.310966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:36.311428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:36.312198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:36.314730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:36.315174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:36.628385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:36.647454 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b7fd7c6-9e0c-4bd4-be0d-698046dacb86 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1546 microversion: 2.1 time: 1.835754 Oct 25 03:09:36.648653 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1201/2243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:34 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1546 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:36.658909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:36.659855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:36.667669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:36.668412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:36.670221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:36.671230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:36.674053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:36.674723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:37.326107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:37.338594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e1a8548b-8574-4ce0-9b13-a543d0535ca1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 1.071182 Oct 25 03:09:37.354071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:37.354926 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1043/2244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:36 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:37.361566 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d2552ed-3b6a-483d-a012-a6359691b98a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1312 microversion: 2.1 time: 0.708894 Oct 25 03:09:37.361566 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1202/2245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:36 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1312 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:37.370955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:37.375358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:37.387236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:37.387958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:37.388672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:37.389407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8721d3e-3b7d-4c2c-a428-7abb3e45fa26 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:37.395314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:37.396062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:37.396660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:37.456238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:37.528390 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8721d3e-3b7d-4c2c-a428-7abb3e45fa26 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/a1a0bba7-9666-4469-a328-468a6017f51e" status: 204 len: 0 microversion: 2.1 time: 0.162534 Oct 25 03:09:37.530902 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1203/2246] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:09:37 2022] DELETE /compute/v2.1/os-server-groups/a1a0bba7-9666-4469-a328-468a6017f51e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:37.537651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:37.538269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:37.549594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:37.550129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:37.550575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:37.551291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:37.551751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:37.554796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:37.621233 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cfe6da1-01d2-4a16-b0ff-48dddf1e36b1 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 204 len: 0 microversion: 2.1 time: 0.264710 Oct 25 03:09:37.622086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1044/2247] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:37 2022] DELETE /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:37.627854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-62a36669-645c-4da2-9455-441527d0ae78 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:37.655697 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-62a36669-645c-4da2-9455-441527d0ae78 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032024 Oct 25 03:09:37.657171 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1045/2248] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:09:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:37.665703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81376e9f-5001-4cfe-b811-a54420b5645c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3313b160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:37.704451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-81376e9f-5001-4cfe-b811-a54420b5645c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Image not found. Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81376e9f-5001-4cfe-b811-a54420b5645c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570 HTTP/1.1 Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:37.706778 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '5fc08d54-3a61-4b6c-b448-55435a0c3570'} Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:37.708064 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5fc08d54-3a61-4b6c-b448-55435a0c3570 to delete Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:37.708805 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5fc08d54-3a61-4b6c-b448-55435a0c3570 could not be found. Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:37.709808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81376e9f-5001-4cfe-b811-a54420b5645c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:37.714427 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81376e9f-5001-4cfe-b811-a54420b5645c tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570" status: 404 len: 62 microversion: 2.1 time: 0.051171 Oct 25 03:09:37.717776 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1046/2249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:37 2022] DELETE /compute/v2.1/images/5fc08d54-3a61-4b6c-b448-55435a0c3570 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:37.724452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:37.726970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:37.740108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:37.742944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:37.745755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:37.748155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:37.748972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:37.750977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:37.801063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:37.912839 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Instance is already in deleting state, ignoring this request Oct 25 03:09:37.914301 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95a13d4c-a688-4c14-9621-a27a5f3e27fb tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 204 len: 0 microversion: 2.1 time: 0.196674 Oct 25 03:09:37.924815 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1047/2250] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:37 2022] DELETE /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:37.935075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-473750388", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8edba9b6-7bdb-4498-8e69-f46e936e6914"}]}, "os:scheduler_hints": {"group": "bcf51d1c-706b-44a0-9111-484f850e9b44"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:38.002717 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb6b53a8-3d3d-4604-a30a-6ec4d3cdc7de tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.469701 Oct 25 03:09:38.003313 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1204/2251] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:09:37 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-interface => generated 284 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:38.018220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:38.019088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:38.032089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] validate_networks() for [('8edba9b6-7bdb-4498-8e69-f46e936e6914', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:09:38.036314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:38.037086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:38.037731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:38.038627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:38.039664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:38.041939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:39.031376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:39.044462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c00f776f-abb9-46a8-9da9-6565f1f3df4b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1493 microversion: 2.1 time: 1.030462 Oct 25 03:09:39.053229 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1205/2252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:38 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1493 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:39.060823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:39.066724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:39.092707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:39.100927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:39.103876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:39.105736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:39.107552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:39.108299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:39.349652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:09:39.352028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:09:39.352687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:09:39.354005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:09:39.354589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:09:39.386436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:39.386944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:39.387394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:39.388154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:39.388625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:39.389071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:39.439689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:39.451736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:39.475613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:09:39.478857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:09:39.539822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120563) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 25 03:09:39.599583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_group_members'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:39.606330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_group_members'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:39.673663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_group_members'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:39.683348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Getting quotas for user 83299b0ebf0140cfa8448bb0733f004e and project 33bbb82803c64f04af271175dc2ea611. Resources: {'server_group_members'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:39.731506 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19f8fa4f-086a-4e9a-be56-cf7027b32817 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805439 Oct 25 03:09:39.738390 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1048/2253] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:09:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:09:39.745274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:39.746239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:39.759914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:39.760705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:39.761347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:39.762992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:39.763644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:39.764277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:40.315084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:40.323980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9e5d0db-359c-403c-bc77-eb8a8fc3335e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1312 microversion: 2.1 time: 0.589309 Oct 25 03:09:40.329514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:40.344579 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1049/2254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:39 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1312 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:40.361797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-27a89f33-4f3f-4360-b681-8e3a3fa1f1c1 req-da7c4c68-0302-4958-9858-f957b05aedc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bfa70f-0821-4542-aa42-9e304450fedd", "name": "network-vif-unplugged", "status": "completed", "tag": "b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:40.376229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-27a89f33-4f3f-4360-b681-8e3a3fa1f1c1 req-da7c4c68-0302-4958-9858-f957b05aedc4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:40.376699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-27a89f33-4f3f-4360-b681-8e3a3fa1f1c1 req-da7c4c68-0302-4958-9858-f957b05aedc4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:40.377139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-27a89f33-4f3f-4360-b681-8e3a3fa1f1c1 req-da7c4c68-0302-4958-9858-f957b05aedc4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:40.398706 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-27a89f33-4f3f-4360-b681-8e3a3fa1f1c1 req-da7c4c68-0302-4958-9858-f957b05aedc4 service nova] Creating event network-vif-unplugged:b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9 for instance d2bfa70f-0821-4542-aa42-9e304450fedd on n-h2-862355-1 Oct 25 03:09:40.405729 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-27a89f33-4f3f-4360-b681-8e3a3fa1f1c1 req-da7c4c68-0302-4958-9858-f957b05aedc4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059734 Oct 25 03:09:40.406967 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1050/2255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:40.412339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-06c80307-a7d1-4d74-ae10-203acaad651f req-4053a1bc-5c83-4909-a01c-5018988ef432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb018e4-b858-42fa-9832-79fbfe052184", "tag": "69d5e780-5c64-43de-bb3f-d32a4862274d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:40.424273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06c80307-a7d1-4d74-ae10-203acaad651f req-4053a1bc-5c83-4909-a01c-5018988ef432 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:40.427083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06c80307-a7d1-4d74-ae10-203acaad651f req-4053a1bc-5c83-4909-a01c-5018988ef432 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:40.427760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06c80307-a7d1-4d74-ae10-203acaad651f req-4053a1bc-5c83-4909-a01c-5018988ef432 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:40.443716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-06c80307-a7d1-4d74-ae10-203acaad651f req-4053a1bc-5c83-4909-a01c-5018988ef432 service nova] Creating event network-changed:69d5e780-5c64-43de-bb3f-d32a4862274d for instance 2eb018e4-b858-42fa-9832-79fbfe052184 on n-h1-862355-1 Oct 25 03:09:40.451854 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-06c80307-a7d1-4d74-ae10-203acaad651f req-4053a1bc-5c83-4909-a01c-5018988ef432 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042924 Oct 25 03:09:40.452877 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1051/2256] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:40.463331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-256ae3c2-9706-4490-a775-48ddd5ccaebf tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:40.466516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-256ae3c2-9706-4490-a775-48ddd5ccaebf tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:40.535572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:40.566258 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5fa30867-a0d9-4ca1-b9fb-9d703335c227 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 1.505368 Oct 25 03:09:40.567090 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1206/2257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:39 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:40.579553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:40.583888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:40.604596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:40.606381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:40.607165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:40.610533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:40.611426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:40.612019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:40.679218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-256ae3c2-9706-4490-a775-48ddd5ccaebf tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:40.687851 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-256ae3c2-9706-4490-a775-48ddd5ccaebf tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1212 microversion: 2.1 time: 0.233103 Oct 25 03:09:40.688480 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1052/2258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:40 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1212 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:41.357003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:41.358088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:41.387847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:41.392198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:41.392866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:41.393845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:41.394506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:41.395132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:42.117941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '438a56b0a79647f6bb195b7e0c42b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51199e37f0e945079e5d400ebd6d3a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:42.131551 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6fbed4d5-5cfd-420a-adaf-ada939b5bd4e tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 200 len: 1493 microversion: 2.1 time: 1.563347 Oct 25 03:09:42.132554 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1207/2259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:40 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 1493 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:42.151486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4a15585f-7368-4f0e-bfac-a027fac5390a req-55322c4e-317f-4622-9c1b-9a291c62610a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e615f5-3bb8-4978-ac78-86989bd3f2fb", "tag": "e45f9c98-03b9-481a-965e-40f271ac641a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:42.186359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a15585f-7368-4f0e-bfac-a027fac5390a req-55322c4e-317f-4622-9c1b-9a291c62610a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:42.186859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a15585f-7368-4f0e-bfac-a027fac5390a req-55322c4e-317f-4622-9c1b-9a291c62610a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:42.187387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a15585f-7368-4f0e-bfac-a027fac5390a req-55322c4e-317f-4622-9c1b-9a291c62610a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:42.223726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4a15585f-7368-4f0e-bfac-a027fac5390a req-55322c4e-317f-4622-9c1b-9a291c62610a service nova] Creating event network-changed:e45f9c98-03b9-481a-965e-40f271ac641a for instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb on n-h2-862355-1 Oct 25 03:09:42.239460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4a15585f-7368-4f0e-bfac-a027fac5390a req-55322c4e-317f-4622-9c1b-9a291c62610a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093128 Oct 25 03:09:42.240698 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1208/2260] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:42.252010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:42.253618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:42.272684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:42.273586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:42.274431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:42.275509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:42.276148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:42.276745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:42.559167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:42.576347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd9586c4-72a5-4252-bfff-6a7d541572ec tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1312 microversion: 2.1 time: 1.221634 Oct 25 03:09:42.579087 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1053/2261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:41 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1312 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:42.590391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:42.594439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:42.617346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:42.620124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:42.624402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:42.633649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:42.642930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:42.643543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:42.851004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:42.867527 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6a0ecb9-7c3e-4037-a1d8-cf52fd38dc24 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1270 microversion: 2.1 time: 0.287161 Oct 25 03:09:42.870329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1054/2262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:42 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:42.884268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2c8d2cb6-14d8-4701-a72b-65028d8c4b79 req-545f130d-337d-4a4c-a8f8-fe95f3cd1530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2bfa70f-0821-4542-aa42-9e304450fedd", "name": "network-vif-deleted", "tag": "b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:42.907904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2c8d2cb6-14d8-4701-a72b-65028d8c4b79 req-545f130d-337d-4a4c-a8f8-fe95f3cd1530 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:42.908527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2c8d2cb6-14d8-4701-a72b-65028d8c4b79 req-545f130d-337d-4a4c-a8f8-fe95f3cd1530 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:42.912158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2c8d2cb6-14d8-4701-a72b-65028d8c4b79 req-545f130d-337d-4a4c-a8f8-fe95f3cd1530 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:42.939641 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2c8d2cb6-14d8-4701-a72b-65028d8c4b79 req-545f130d-337d-4a4c-a8f8-fe95f3cd1530 service nova] Creating event network-vif-deleted:b6a69d4b-5bb9-4947-ab19-5c941d4ef2d9 for instance d2bfa70f-0821-4542-aa42-9e304450fedd on n-h2-862355-1 Oct 25 03:09:42.954520 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2c8d2cb6-14d8-4701-a72b-65028d8c4b79 req-545f130d-337d-4a4c-a8f8-fe95f3cd1530 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079295 Oct 25 03:09:42.957780 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1055/2263] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:42.979688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:42.989586 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f15890a6-d329-4c5c-afe8-a342fe5376dd tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 0.747464 Oct 25 03:09:43.011797 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1209/2264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:42 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:43.157992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.159497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: d2bfa70f-0821-4542-aa42-9e304450fedd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.172739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.173459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.174382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.175242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.175827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.176446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.233102 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance d2bfa70f-0821-4542-aa42-9e304450fedd could not be found. Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd HTTP/1.1 Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:43.236044 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance d2bfa70f-0821-4542-aa42-9e304450fedd could not be found. Oct 25 03:09:43.237454 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'd2bfa70f-0821-4542-aa42-9e304450fedd'} Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2bfa70f-0821-4542-aa42-9e304450fedd could not be found. Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.238524 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2bfa70f-0821-4542-aa42-9e304450fedd could not be found. Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2bfa70f-0821-4542-aa42-9e304450fedd could not be found. Oct 25 03:09:43.239808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.242568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance d2bfa70f-0821-4542-aa42-9e304450fedd could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.255195 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b163fc7-5496-4cdb-b8c3-8d6c3eceebc5 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd" status: 404 len: 111 microversion: 2.1 time: 0.100987 Oct 25 03:09:43.265357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.266423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.267009 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1056/2265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] GET /compute/v2.1/servers/d2bfa70f-0821-4542-aa42-9e304450fedd => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:43.280591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.281177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.292325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.293301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.293991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.294568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.338394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d HTTP/1.1 Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:43.340981 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.342240 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f474cc1b-e0fe-4085-9216-34e00a0d228d'} Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.343023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.344054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.346342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.348926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6989788c-2203-4570-a0e2-6df8adbb01f3 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 404 len: 111 microversion: 2.1 time: 0.086101 Oct 25 03:09:43.358616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.359509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f474cc1b-e0fe-4085-9216-34e00a0d228d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.365295 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1210/2266] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:43 2022] DELETE /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:43.367299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.368824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.369472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.370597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.371238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.371869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.404333 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d HTTP/1.1 Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:43.412221 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.413533 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f474cc1b-e0fe-4085-9216-34e00a0d228d'} Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.414517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. Oct 25 03:09:43.416437 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.418887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance f474cc1b-e0fe-4085-9216-34e00a0d228d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.420401 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b805d888-8bff-48dc-8320-85325da2d992 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d" status: 404 len: 111 microversion: 2.1 time: 0.065655 Oct 25 03:09:43.423782 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1057/2267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] GET /compute/v2.1/servers/f474cc1b-e0fe-4085-9216-34e00a0d228d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:43.432571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa896978-ea7c-43cf-a911-db9c899a8e61 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd339e9ca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.481423 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-fa896978-ea7c-43cf-a911-db9c899a8e61 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Image not found. Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa896978-ea7c-43cf-a911-db9c899a8e61 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 HTTP/1.1 Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:43.483714 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f605acbc-f3ba-45fe-9aa3-39890c783db3'} Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.485085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f605acbc-f3ba-45fe-9aa3-39890c783db3 to delete Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.486008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f605acbc-f3ba-45fe-9aa3-39890c783db3 could not be found. Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.487269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:09:43.488519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.489223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa896978-ea7c-43cf-a911-db9c899a8e61 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.490223 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa896978-ea7c-43cf-a911-db9c899a8e61 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3" status: 404 len: 62 microversion: 2.1 time: 0.062269 Oct 25 03:09:43.491279 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1211/2268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] DELETE /compute/v2.1/images/f605acbc-f3ba-45fe-9aa3-39890c783db3 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:09:43.499849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.500590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.511103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.511762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.516155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.517139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.517760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.518303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.552245 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 HTTP/1.1 Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:43.559742 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.561378 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e4d634c7-bfa9-44d9-92f0-db85353b6c80'} Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.562025 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.563059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.567411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.568518 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e3af2d5-9f38-4c2a-8c07-4f855b00158b tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 404 len: 111 microversion: 2.1 time: 0.072679 Oct 25 03:09:43.573821 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1058/2269] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:43 2022] DELETE /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:43.582695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.583478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e4d634c7-bfa9-44d9-92f0-db85353b6c80] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.597466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.598265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.599402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.601421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.602408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.612728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.617303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.618023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.618351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.619213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.620083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.620327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.621598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.622095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.663309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 HTTP/1.1 Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:43.669110 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.670557 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e4d634c7-bfa9-44d9-92f0-db85353b6c80'} Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.671289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. Oct 25 03:09:43.672491 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.674542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance e4d634c7-bfa9-44d9-92f0-db85353b6c80 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.675812 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2f05e0b-3be3-4351-8999-e4c30ded5f07 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80" status: 404 len: 111 microversion: 2.1 time: 0.098023 Oct 25 03:09:43.676900 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1212/2270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] GET /compute/v2.1/servers/e4d634c7-bfa9-44d9-92f0-db85353b6c80 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:43.700097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b8c0f49-48cb-462f-a5a1-534523423bb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33dee8b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.738329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-9b8c0f49-48cb-462f-a5a1-534523423bb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Image not found. Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b8c0f49-48cb-462f-a5a1-534523423bb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 HTTP/1.1 Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:43.741339 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '01b762c5-f3b9-41a6-961c-b71af0bd9ea4'} Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.742535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 01b762c5-f3b9-41a6-961c-b71af0bd9ea4 to delete Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.743955 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 01b762c5-f3b9-41a6-961c-b71af0bd9ea4 could not be found. Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.745266 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:09:43.746467 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.749135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b8c0f49-48cb-462f-a5a1-534523423bb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.752930 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b8c0f49-48cb-462f-a5a1-534523423bb0 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4" status: 404 len: 62 microversion: 2.1 time: 0.057249 Oct 25 03:09:43.755137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1213/2271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] DELETE /compute/v2.1/images/01b762c5-f3b9-41a6-961c-b71af0bd9ea4 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:43.767080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.768316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.779469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.780220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.780880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.781861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.782548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.783647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.803015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 HTTP/1.1 Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:43.805042 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.806570 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '337c82ae-8606-4611-bfdf-90396ac6f490'} Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.807304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.808540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.811091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.812191 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0bfc189-f1d2-4b17-a8b5-1f597a529b77 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 404 len: 111 microversion: 2.1 time: 0.052501 Oct 25 03:09:43.813407 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1214/2272] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:43 2022] DELETE /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:43.825474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.826722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: 337c82ae-8606-4611-bfdf-90396ac6f490] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.835159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.836388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.837576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.838850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.839521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.840101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:43.866853 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 HTTP/1.1 Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:43.872712 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.874065 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '337c82ae-8606-4611-bfdf-90396ac6f490'} Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.874767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. Oct 25 03:09:43.876305 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.877441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance 337c82ae-8606-4611-bfdf-90396ac6f490 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.877441 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a95eb742-b4b2-415a-89cf-04a9aab7f1c4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490" status: 404 len: 111 microversion: 2.1 time: 0.056594 Oct 25 03:09:43.877441 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1215/2273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] GET /compute/v2.1/servers/337c82ae-8606-4611-bfdf-90396ac6f490 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:43.902433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f74113da-c69e-4c3d-a3e7-b1f14e8f0269 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd33808670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.933046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f74113da-c69e-4c3d-a3e7-b1f14e8f0269 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Image not found. Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f74113da-c69e-4c3d-a3e7-b1f14e8f0269 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 HTTP/1.1 Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:43.936223 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e760bc67-3643-444b-b1c4-da6fab5ce307'} Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:43.938872 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e760bc67-3643-444b-b1c4-da6fab5ce307 to delete Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.939656 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e760bc67-3643-444b-b1c4-da6fab5ce307 could not be found. Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:43.940723 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:43.941715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f74113da-c69e-4c3d-a3e7-b1f14e8f0269 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:43.958667 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f74113da-c69e-4c3d-a3e7-b1f14e8f0269 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307" status: 404 len: 62 microversion: 2.1 time: 0.044031 Oct 25 03:09:43.959902 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1216/2274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] DELETE /compute/v2.1/images/e760bc67-3643-444b-b1c4-da6fab5ce307 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:43.972800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:43.973710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:43.982735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=30 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:43.989918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:43.991287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:43.991926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.004554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.005505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.026742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.268482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:44.289037 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fb7346fc-7c24-4bc5-9b6f-19bcb40a2727 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1270 microversion: 2.1 time: 0.324537 Oct 25 03:09:44.308742 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1217/2275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1270 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:44.351143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:44.351887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:44.355322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:44.358480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:44.373871 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-daaee2f4-f64e-4aaf-ab4c-edee01e6380b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1312 microversion: 2.1 time: 0.775889 Oct 25 03:09:44.375773 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1059/2276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:43 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1312 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:44.393044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:44.395595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:44.400627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.406460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.409139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.410114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.414974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.415874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.424763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.425447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.427110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.429319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.431913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.447345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.478679 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 HTTP/1.1 Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:44.484545 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.485954 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f5638e8a-6990-4068-bc45-bd2bbe313310'} Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:44.486745 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.487974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.491088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:44.492159 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1fd2126d-d9b2-4c35-9435-eb6f7f7a58b4 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 404 len: 111 microversion: 2.1 time: 0.181807 Oct 25 03:09:44.496986 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1218/2277] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:44 2022] DELETE /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:44.511182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d4dec7b8-d104-4e8a-a0fa-d77af2799461 req-510c896c-eaa7-4704-9afd-56d34ee3683e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b", "tag": "7dc69e0e-d64b-4150-a446-65d3737a6071"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:44.544816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d4dec7b8-d104-4e8a-a0fa-d77af2799461 req-510c896c-eaa7-4704-9afd-56d34ee3683e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.545314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d4dec7b8-d104-4e8a-a0fa-d77af2799461 req-510c896c-eaa7-4704-9afd-56d34ee3683e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.558810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d4dec7b8-d104-4e8a-a0fa-d77af2799461 req-510c896c-eaa7-4704-9afd-56d34ee3683e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.604533 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d4dec7b8-d104-4e8a-a0fa-d77af2799461 req-510c896c-eaa7-4704-9afd-56d34ee3683e service nova] Creating event network-changed:7dc69e0e-d64b-4150-a446-65d3737a6071 for instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b on n-h1-862355-1 Oct 25 03:09:44.615587 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d4dec7b8-d104-4e8a-a0fa-d77af2799461 req-510c896c-eaa7-4704-9afd-56d34ee3683e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114466 Oct 25 03:09:44.638319 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1219/2278] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:44.650915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:44.654427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: f5638e8a-6990-4068-bc45-bd2bbe313310] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:44.673720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.676060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.678177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.680084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.683588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.684329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.718255 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 HTTP/1.1 Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:44.721870 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.723196 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f5638e8a-6990-4068-bc45-bd2bbe313310'} Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:44.723865 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. Oct 25 03:09:44.724851 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.736103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance f5638e8a-6990-4068-bc45-bd2bbe313310 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:44.742001 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9787e60-1048-4d3d-beca-f563e569a236 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310" status: 404 len: 111 microversion: 2.1 time: 0.098879 Oct 25 03:09:44.746070 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1220/2279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:44 2022] GET /compute/v2.1/servers/f5638e8a-6990-4068-bc45-bd2bbe313310 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:44.756776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2fcc5f6-a432-4ee2-8cb8-7b34a784b9b9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '.version_select at 0x7efd3382c700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:44.796938 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a2fcc5f6-a432-4ee2-8cb8-7b34a784b9b9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Image not found. Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2fcc5f6-a432-4ee2-8cb8-7b34a784b9b9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 HTTP/1.1 Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:44.798959 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0b326a26-4690-4cb4-87d1-b3c051b88676'} Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:44.800395 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0b326a26-4690-4cb4-87d1-b3c051b88676 to delete Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.801111 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0b326a26-4690-4cb4-87d1-b3c051b88676 could not be found. Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:44.802951 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2fcc5f6-a432-4ee2-8cb8-7b34a784b9b9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:44.804204 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a2fcc5f6-a432-4ee2-8cb8-7b34a784b9b9 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676" status: 404 len: 62 microversion: 2.1 time: 0.047692 Oct 25 03:09:44.807809 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1221/2280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:44 2022] DELETE /compute/v2.1/images/0b326a26-4690-4cb4-87d1-b3c051b88676 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:44.823876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:44.824525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:44.853536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.859594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.860395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.863116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.863823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.867010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.909955 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d HTTP/1.1 Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:44.919840 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:44.921095 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e73a5304-6eac-4d37-9205-152d9fb4a87d'} Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:44.921799 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:44.922850 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:44.923830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:44.923923 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e93cda81-82ee-4220-9703-6c05f5031ace tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 404 len: 111 microversion: 2.1 time: 0.111064 Oct 25 03:09:44.928218 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1222/2281] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:44 2022] DELETE /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:09:44.938116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:44.948309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] [instance: e73a5304-6eac-4d37-9205-152d9fb4a87d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:44.959852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.960845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.961507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:44.962743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:44.964349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:44.964951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:45.018679 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] HTTP exception thrown: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Request method failure captured: Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d HTTP/1.1 Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1IPv5-0TclSrRpePx_T2FbTWGZ_ooSjKSIUslWzGtXvwfn_b6UIwZJLfWlLQW99fUjMdBAu6BCk8q2A8SSCx-rikeOlxsO2mcTfM1SinREOurCKVqaw8jzBnLdoa9rhBDkdJXAbRIQYvZL-8OHdFX4033ByOfx87iMgk0Ga318kqr0 Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:09:45.020289 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/51199e37f0e945079e5d400ebd6d3a5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_51199e37f0e945079e5d400ebd6d3a5d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/51199e37f0e945079e5d400ebd6d3a5d"}]}] Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 51199e37f0e945079e5d400ebd6d3a5d Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesTestJSON-1594892090 Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 438a56b0a79647f6bb195b7e0c42b089 Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesTestJSON-1594892090-project Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:45.021611 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e73a5304-6eac-4d37-9205-152d9fb4a87d'} Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:45.022393 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. Oct 25 03:09:45.023687 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:09:45.024945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] Returning 404 to user: Instance e73a5304-6eac-4d37-9205-152d9fb4a87d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:45.026549 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4d12ba23-70aa-422a-97c9-a32650d11520 tempest-ImagesTestJSON-1594892090 tempest-ImagesTestJSON-1594892090-project] 10.222.0.36 "GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d" status: 404 len: 111 microversion: 2.1 time: 0.089063 Oct 25 03:09:45.027184 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1223/2282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:44 2022] GET /compute/v2.1/servers/e73a5304-6eac-4d37-9205-152d9fb4a87d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:09:45.059406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:45.068611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4bc17f27-683f-44f9-8d50-5d0e91692695 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 0.690992 Oct 25 03:09:45.076933 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1060/2283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:44 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:45.321291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:45.321708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:45.329385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:45.329915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:45.330367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:45.335413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:45.336054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:45.336998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:45.399770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:45.400783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:45.410060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:45.414880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:45.415697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:45.416746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:45.417452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:45.418158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:45.992308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:46.030377 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35c18cfb-06f0-4c61-8cd5-34775de4d927 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1312 microversion: 2.1 time: 0.634761 Oct 25 03:09:46.031354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1061/2284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:45 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1312 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:46.101493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:46.103343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:46.107183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:46.122194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:46.123606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:46.124400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:46.126106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:46.127628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:46.128070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:46.150077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:46.159315 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b853f3af-33d1-4f62-816d-0fc73b23c738 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1312 microversion: 2.1 time: 0.844114 Oct 25 03:09:46.166402 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1224/2285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:45 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1312 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:46.682492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-524589154", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "e3ad6997-7833-4129-a1a5-d74a976de721"}, {"uuid": "bdc8066b-279f-42c2-9311-b38eb47bdf8b"}, {"uuid": "e3ad6997-7833-4129-a1a5-d74a976de721"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:46.792875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] validate_networks() for [('e3ad6997-7833-4129-a1a5-d74a976de721', None, None, None, None, None), ('bdc8066b-279f-42c2-9311-b38eb47bdf8b', None, None, None, None, None), ('e3ad6997-7833-4129-a1a5-d74a976de721', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:09:47.258278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:47.267671 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97c32730-3d57-467b-b7e6-1f83bcec4942 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 1.172734 Oct 25 03:09:47.274654 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1062/2286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:46 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:47.282627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:47.285809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:47.305352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:47.305952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:47.306572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:47.318491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:47.318993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:47.319690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.045721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:48.092292 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6220f987-8b50-4db6-9e81-1f6d19410037 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1312 microversion: 2.1 time: 0.816205 Oct 25 03:09:48.094541 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1063/2287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:47 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1312 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:48.102280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:48.103491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:48.133745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:48.136900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:48.137519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.138599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:48.139218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:48.139943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.271162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:09:48.273055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:09:48.273768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:09:48.274306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:09:48.274841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:09:48.289632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:48.291354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:48.292332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.293613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:48.294319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:48.296074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.316694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Getting quotas for project 5ee4fd42dd0b405f9549e74a07fe340b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:09:48.323721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:48.326803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Getting quotas for user ab41f1b82ab9460e8127e95241317f05 and project 5ee4fd42dd0b405f9549e74a07fe340b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:09:48.352681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:09:48.357013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:09:48.420149 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c82b5df3-47bd-4001-8871-9512603bc810 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741673 Oct 25 03:09:48.426613 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1225/2288] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:09:48.435316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e78a52ec-d721-4a14-87ae-3881d16af0f6 req-3995d6b4-c93d-4bf5-b16e-750281313d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb018e4-b858-42fa-9832-79fbfe052184", "name": "network-vif-plugged", "status": "completed", "tag": "69d5e780-5c64-43de-bb3f-d32a4862274d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:48.450326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e78a52ec-d721-4a14-87ae-3881d16af0f6 req-3995d6b4-c93d-4bf5-b16e-750281313d5a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:48.468014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e78a52ec-d721-4a14-87ae-3881d16af0f6 req-3995d6b4-c93d-4bf5-b16e-750281313d5a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:48.472488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e78a52ec-d721-4a14-87ae-3881d16af0f6 req-3995d6b4-c93d-4bf5-b16e-750281313d5a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.499915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:48.551222 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e78a52ec-d721-4a14-87ae-3881d16af0f6 req-3995d6b4-c93d-4bf5-b16e-750281313d5a service nova] Creating event network-vif-plugged:69d5e780-5c64-43de-bb3f-d32a4862274d for instance 2eb018e4-b858-42fa-9832-79fbfe052184 on n-h1-862355-1 Oct 25 03:09:48.558043 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e78a52ec-d721-4a14-87ae-3881d16af0f6 req-3995d6b4-c93d-4bf5-b16e-750281313d5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130045 Oct 25 03:09:48.559045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1226/2289] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:48.564188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:48.565274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:48.572920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:48.573926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:48.574800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.576934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:48.577980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:48.578621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:48.692829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:48.713340 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58f6e53b-ff44-4449-98bc-77d2c1d57839 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1312 microversion: 2.1 time: 0.617352 Oct 25 03:09:48.714318 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1064/2290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:48 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:48.731669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c667e3bc-6aba-4781-9784-517f4a33b4ae tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:48.734592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c667e3bc-6aba-4781-9784-517f4a33b4ae tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:48.871226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:48.897380 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b65db746-4133-4363-93ef-dcc71bb4732c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 0.336924 Oct 25 03:09:48.902651 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1227/2291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:48 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:48.932291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c667e3bc-6aba-4781-9784-517f4a33b4ae tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:48.942029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=47 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:48.948615 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c667e3bc-6aba-4781-9784-517f4a33b4ae tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1212 microversion: 2.1 time: 0.232282 Oct 25 03:09:48.949440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1065/2292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:48 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1212 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:49.124350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:49.124972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:49.147259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:49.147770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:49.148767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:49.152189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:49.152702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:49.153217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:49.426454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:49.748643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:49.760414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8862aa9-83b1-4180-b2de-8f6702bab4f6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1312 microversion: 2.1 time: 0.639749 Oct 25 03:09:49.763091 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1228/2293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:49 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1312 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:49.776460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c028cb60-9939-4da2-9362-5bfff9b05924 req-c3523cee-c5c9-4aaa-920f-bb9d70485e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b09bcf1-6b1e-4c0f-8e54-90843ad4f605", "tag": "29e33307-5763-4a90-9b66-f90e3de4a251"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:49.815848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c028cb60-9939-4da2-9362-5bfff9b05924 req-c3523cee-c5c9-4aaa-920f-bb9d70485e7a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:49.816995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c028cb60-9939-4da2-9362-5bfff9b05924 req-c3523cee-c5c9-4aaa-920f-bb9d70485e7a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:49.819037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c028cb60-9939-4da2-9362-5bfff9b05924 req-c3523cee-c5c9-4aaa-920f-bb9d70485e7a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:49.855279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c028cb60-9939-4da2-9362-5bfff9b05924 req-c3523cee-c5c9-4aaa-920f-bb9d70485e7a service nova] Creating event network-changed:29e33307-5763-4a90-9b66-f90e3de4a251 for instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 on n-h2-862355-1 Oct 25 03:09:49.860371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15cde51b-951e-4d85-ac78-88e41751c57e tempest-NetworksTest-1635489150 tempest-NetworksTest-1635489150-project-admin] Calling method '.version_select at 0x7efd33042280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:49.861385 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c028cb60-9939-4da2-9362-5bfff9b05924 req-c3523cee-c5c9-4aaa-920f-bb9d70485e7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094913 Oct 25 03:09:49.862527 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1229/2294] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:49.870913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:49.871944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:49.894640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:49.896696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:49.917594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:49.919999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:49.927957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:49.929506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:50.167830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:50.176413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c5155a9-e150-4b17-9b2b-b9ea1a8c072c tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1312 microversion: 2.1 time: 0.311803 Oct 25 03:09:50.177017 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1230/2295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:49 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:50.183465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:50.184423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:50.196967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:50.197922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:50.198553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:50.199762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:50.200953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:50.201545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:50.275241 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15cde51b-951e-4d85-ac78-88e41751c57e tempest-NetworksTest-1635489150 tempest-NetworksTest-1635489150-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 6692 microversion: 2.1 time: 0.967635 Oct 25 03:09:50.276018 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1066/2296] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:09:49 2022] GET /compute/v2.1/os-networks => generated 6692 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:50.283007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:50.283621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:50.297891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:50.298390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:50.298830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:50.299546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:50.300002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:50.300427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:50.431406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:50.440349 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cdc17976-4070-42b0-9905-6a36d8a5e3bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 0.262102 Oct 25 03:09:50.454254 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1231/2297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:50 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:50.463684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-550d13ad-8bf4-48bf-8950-06984db93a90 tempest-NetworksTest-1635489150 tempest-NetworksTest-1635489150-project-admin] Calling method '.version_select at 0x7efd338cfca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:50.466247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:50.494458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9329db1b-27c0-42b6-8726-8117399d64c6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1208 microversion: 2.1 time: 0.206948 Oct 25 03:09:50.495052 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1067/2298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:50 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1208 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:50.580622 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-550d13ad-8bf4-48bf-8950-06984db93a90 tempest-NetworksTest-1635489150 tempest-NetworksTest-1635489150-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks/d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1" status: 200 len: 652 microversion: 2.1 time: 0.125170 Oct 25 03:09:50.581987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1232/2299] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:09:50 2022] GET /compute/v2.1/os-networks/d8f41e7b-9ffc-4642-b11b-abfd2b5d57f1 => generated 652 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:50.591592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebb5fa4b-7ca6-4bf8-b882-05232caccb76 tempest-NetworksTest-1635489150 tempest-NetworksTest-1635489150-project-admin] Calling method '.version_select at 0x7efd33f32310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:50.788420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:50.789653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:50.801055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:50.816276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:50.817119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:50.822674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:50.823514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:50.825239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:51.031275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:51.045331 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dcd4e1c2-7785-4c14-bd21-8d0de79e6ac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1462 microversion: 2.1 time: 0.261734 Oct 25 03:09:51.045967 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1233/2300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:50 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1462 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:51.120174 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ebb5fa4b-7ca6-4bf8-b882-05232caccb76 tempest-NetworksTest-1635489150 tempest-NetworksTest-1635489150-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 6692 microversion: 2.1 time: 0.532381 Oct 25 03:09:51.121299 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1068/2301] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:09:50 2022] GET /compute/v2.1/os-networks => generated 6692 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:51.129131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-99ebce6a-6737-4ce7-9aaf-9cf1aa2d6981 req-82f3cf10-97cc-45a0-a3e0-0544689aafab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e615f5-3bb8-4978-ac78-86989bd3f2fb", "name": "network-vif-plugged", "status": "completed", "tag": "e45f9c98-03b9-481a-965e-40f271ac641a"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:51.156409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-99ebce6a-6737-4ce7-9aaf-9cf1aa2d6981 req-82f3cf10-97cc-45a0-a3e0-0544689aafab service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:51.158378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-99ebce6a-6737-4ce7-9aaf-9cf1aa2d6981 req-82f3cf10-97cc-45a0-a3e0-0544689aafab service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:51.159976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-99ebce6a-6737-4ce7-9aaf-9cf1aa2d6981 req-82f3cf10-97cc-45a0-a3e0-0544689aafab service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:51.193132 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-99ebce6a-6737-4ce7-9aaf-9cf1aa2d6981 req-82f3cf10-97cc-45a0-a3e0-0544689aafab service nova] Creating event network-vif-plugged:e45f9c98-03b9-481a-965e-40f271ac641a for instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb on n-h2-862355-1 Oct 25 03:09:51.199907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-99ebce6a-6737-4ce7-9aaf-9cf1aa2d6981 req-82f3cf10-97cc-45a0-a3e0-0544689aafab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076896 Oct 25 03:09:51.205782 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1069/2302] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:51.222319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:51.223112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:51.234870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:51.235370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:51.235817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:51.236541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:51.236999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:51.237431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:51.433055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:51.433900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:51.450007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:51.450654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:51.451347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:51.453420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:51.454507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:51.456570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:51.927496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6bc90ed5-3261-4062-8684-432feac34b4a tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1613 microversion: 2.1 time: 0.859833 Oct 25 03:09:51.943935 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1234/2303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:51 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1613 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:51.953076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:51.953957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:51.961029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:51.961747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:51.962385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:51.963251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:51.963863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:51.964443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:52.051647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:52.062554 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-807e99ab-af6a-417b-814f-dc5cb1925ce8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1312 microversion: 2.1 time: 0.855446 Oct 25 03:09:52.065395 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1070/2304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:51 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1312 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:52.073120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:52.074135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:52.088467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:52.089069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:52.089640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:52.090631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:52.091163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:52.091666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:52.196655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:52.221240 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4ff917af-b876-4c0a-8676-d88f9758d23c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1270 microversion: 2.1 time: 0.154413 Oct 25 03:09:52.221875 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1071/2305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:52 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:52.234140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:52.235284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:52.244821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:52.245582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:52.246260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:52.247247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:52.247954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:52.248964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:52.271323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:52.285508 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee07e6ad-31b1-4d5d-b6ed-a29d8d28e876 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 0.337969 Oct 25 03:09:52.286704 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1235/2306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:51 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:52.361229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd48828366c8e48c08984ae6f8074554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d3cf652470468580d897b652684f8f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:52.361854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] flavor_id is None. Assuming migration. {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 25 03:09:52.366006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:09:52.933782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea31274f-1265-4a62-b45c-a1347938f85d tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184/action" status: 202 len: 0 microversion: 2.1 time: 0.705972 Oct 25 03:09:52.935095 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1072/2307] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:09:52 2022] POST /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:09:52.943013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:52.945127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:52.955326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:52.956204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:52.957031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:52.958132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:52.959008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:52.960556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:53.089062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:53.090095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:53.102028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:53.105706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:53.106399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:53.107366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:53.109362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:53.110090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:53.480274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:53.498089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4faa0574-6dc4-443a-a321-1da9b129b761 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1471 microversion: 2.1 time: 0.558191 Oct 25 03:09:53.500038 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1236/2308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:52 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1471 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:53.514379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:53.514588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:53.532549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:53.533059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:53.533942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:53.536194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:53.540076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:53.540935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:53.872648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:53.885924 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca10b255-414f-495d-917d-598a8adfd333 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1312 microversion: 2.1 time: 0.382182 Oct 25 03:09:53.904046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1237/2309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:53 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:53.909767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:53.910656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:53.922852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:53.926673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:53.930757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:53.931838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:53.932515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:53.933931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:54.254289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:54.266131 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c52a4354-4236-478b-8e41-b13e5d58a626 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1325 microversion: 2.1 time: 0.360383 Oct 25 03:09:54.270321 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1238/2310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:53 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1325 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:54.439965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:54.464088 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-160ce1b3-6e98-4d56-a83a-54eb63b022a8 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1312 microversion: 2.1 time: 1.379247 Oct 25 03:09:54.478073 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1073/2311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:53 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1312 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:09:54.527164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:54.528249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:54.544326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:54.545268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:54.545980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:54.547400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:54.548298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:54.549007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:54.748893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:54.765329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4d56bd57-3420-4970-b3a4-29693cb54498 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1471 microversion: 2.1 time: 0.243181 Oct 25 03:09:54.767217 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1239/2312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:54 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:54.912009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:54.913224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:54.920415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:54.921337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:54.922093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:54.923008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:54.923705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:54.924470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:55.298559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:55.299582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:55.314343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:55.314716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:55.325104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:55.327593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:55.328675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:55.329705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:55.570316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:55.603008 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18736e39-a6f1-4657-a77b-a24c97d79a3a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1312 microversion: 2.1 time: 0.695014 Oct 25 03:09:55.605823 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1074/2313] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:54 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1312 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:55.669047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:55.669886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:55.683353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:55.687799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:55.688344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:55.689169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:55.689744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:55.690277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:55.795359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:55.830511 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6bd555a-78d5-4f83-9416-4c384175c253 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1522 microversion: 2.1 time: 0.538471 Oct 25 03:09:55.832184 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1240/2314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:55 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:55.841508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:55.842359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:55.849660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:55.851554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:55.852279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:55.853247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:55.853990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:55.854561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:56.033523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:56.046230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4709ab73-ddf7-4b4d-9e21-428cbc9964b8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1471 microversion: 2.1 time: 0.210984 Oct 25 03:09:56.050830 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1241/2315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:55 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:56.064222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:56.065955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:56.088858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:56.089885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:56.092596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:56.094393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:56.095052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:56.096840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:56.303116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:56.315172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc369cc6-e07f-4f97-9118-17566f442666 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1522 microversion: 2.1 time: 0.262594 Oct 25 03:09:56.321852 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1242/2316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:56 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:56.341069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1763306851"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:56.343555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:56.351297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:56.351795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:56.352411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:56.353295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:56.353979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:56.354551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:56.637028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:56.654063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df33e997-1e57-4be1-b160-cac6bd663cde tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb/action" status: 202 len: 0 microversion: 2.1 time: 0.316628 Oct 25 03:09:56.655484 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1243/2317] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:09:56 2022] POST /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:09:56.665225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:56.666220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:56.675292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:56.675775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:56.676213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:56.676923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:56.677380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:56.678671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:57.019060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:57.041286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbb2212e-9b2e-4364-befb-e100736b1819 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1312 microversion: 2.1 time: 1.418660 Oct 25 03:09:57.044826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1075/2318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:55 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1312 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:57.058791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89220604-e58b-4b52-b16b-91985b797095 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '.version_select at 0x7efd33ace820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:57.093064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:57.128358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87652d75-7f14-4c3a-aa29-bfc196beb005 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1312 microversion: 2.1 time: 0.471435 Oct 25 03:09:57.130560 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1244/2319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:56 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:57.143897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-48c20de0-d94e-4cf0-8cf3-3047036df67d req-621345f8-40d8-4422-9b45-2f92ba45ed50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b09bcf1-6b1e-4c0f-8e54-90843ad4f605", "name": "network-vif-plugged", "status": "completed", "tag": "29e33307-5763-4a90-9b66-f90e3de4a251"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:57.165090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48c20de0-d94e-4cf0-8cf3-3047036df67d req-621345f8-40d8-4422-9b45-2f92ba45ed50 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:57.165829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48c20de0-d94e-4cf0-8cf3-3047036df67d req-621345f8-40d8-4422-9b45-2f92ba45ed50 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:57.166524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48c20de0-d94e-4cf0-8cf3-3047036df67d req-621345f8-40d8-4422-9b45-2f92ba45ed50 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:57.186863 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-48c20de0-d94e-4cf0-8cf3-3047036df67d req-621345f8-40d8-4422-9b45-2f92ba45ed50 service nova] Creating event network-vif-plugged:29e33307-5763-4a90-9b66-f90e3de4a251 for instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 on n-h2-862355-1 Oct 25 03:09:57.208018 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-48c20de0-d94e-4cf0-8cf3-3047036df67d req-621345f8-40d8-4422-9b45-2f92ba45ed50 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073855 Oct 25 03:09:57.218987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1245/2320] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:09:57.255741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:57.256493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:57.284774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:57.285280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:57.300009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:57.300980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:57.301648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:57.304398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:57.378660 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89220604-e58b-4b52-b16b-91985b797095 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f" status: 204 len: 0 microversion: 2.1 time: 0.331818 Oct 25 03:09:57.380169 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1076/2321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:57 2022] DELETE /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:57.399191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f0e6404a-b27b-4305-86e6-33d8be53d37c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '.version_select at 0x7efd3330d280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:57.448841 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-f0e6404a-b27b-4305-86e6-33d8be53d37c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Image not found. Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f0e6404a-b27b-4305-86e6-33d8be53d37c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f HTTP/1.1 Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:09:57.451614 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f'} Oct 25 03:09:57.452840 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:57.453556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:09:57.454556 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f could not be found. Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:09:57.456266 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:09:57.457862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f0e6404a-b27b-4305-86e6-33d8be53d37c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:09:57.460507 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f0e6404a-b27b-4305-86e6-33d8be53d37c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f" status: 404 len: 62 microversion: 2.1 time: 0.062890 Oct 25 03:09:57.460507 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1077/2322] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:09:57 2022] GET /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:09:57.487543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:57.488193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:57.504807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:57.505327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:57.505928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:57.506653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:57.509381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:57.509916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:57.620566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:57.629896 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee2e94aa-a68e-40fd-adc7-68a26d02bc76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1471 microversion: 2.1 time: 0.408883 Oct 25 03:09:57.647149 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1246/2323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:57 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1471 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:58.077511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:58.078223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:58.093227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.093749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.094392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.095260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.096254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.096852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.173153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:58.187882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f01e5bb4-3ffc-4e54-baf4-5fe483ca9ed1 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1534 microversion: 2.1 time: 0.724591 Oct 25 03:09:58.189356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1078/2324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:57 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1534 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:58.197937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:58.199034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:58.217848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.219303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.219942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.221762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.222432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.223080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.310756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:58.313914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:58.323015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f619db0c-1bfc-4ea7-9878-c525cd85e7d6 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1312 microversion: 2.1 time: 0.249297 Oct 25 03:09:58.324027 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1247/2325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:58 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:58.342929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:58.484596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Action: 'update', calling method: .version_select at 0x7efd33deee50>, body: {"quota_set": {"ram": "5120"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:58.605790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.606372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.607057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.607973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.608667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.609300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.691734 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18825398-4e8e-421b-8dbe-51df99d449c9 tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad" status: 200 len: 240 microversion: 2.36 time: 0.366004 Oct 25 03:09:58.692964 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1248/2326] 10.222.0.36 () {62 vars in 1303 bytes} [Tue Oct 25 03:09:58 2022] PUT /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad => generated 240 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:09:58.699989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:58.701088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:58.713517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.715073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.716901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.717934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.718577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.719250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.783963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:58.804953 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7d4f0f1-c29d-4e3c-992d-36a600f5fe5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1333 microversion: 2.1 time: 0.614124 Oct 25 03:09:58.806453 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1079/2327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:58 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1333 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:58.811821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Calling method '.version_select at 0x7efd396e2af0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:58.932536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.935796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.937781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.941990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:58.942988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:58.944308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:58.948807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:58.960572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0cb579bb-9e2a-4833-87a8-024bf7b585d3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1471 microversion: 2.1 time: 0.264061 Oct 25 03:09:58.975173 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1249/2328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:58 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:58.989259 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58bc0c5b-e20e-4d86-8996-5d3bf03a6dcb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad/detail" status: 200 len: 672 microversion: 2.36 time: 0.181352 Oct 25 03:09:58.990419 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1080/2329] 10.222.0.36 () {60 vars in 1304 bytes} [Tue Oct 25 03:09:58 2022] GET /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad/detail => generated 672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:09:59.137593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Action: 'update', calling method: .version_select at 0x7efd3386fe50>, body: {"quota_set": {"ram": "2048"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:09:59.209588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.210544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.211210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.212054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.212635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.213166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.213274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:59.213865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:59.235011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.235524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.235908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.238706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.239477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.240108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.245482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:59.253347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.254000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.254516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.256639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.257184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.257708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.330050 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-276247ef-5464-4db5-82c2-f4d16e1ff6af tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad?user_id=469cfa38526349f3af021ca958fc18ea" status: 200 len: 240 microversion: 2.36 time: 0.196152 Oct 25 03:09:59.338673 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1250/2330] 10.222.0.36 () {62 vars in 1384 bytes} [Tue Oct 25 03:09:59 2022] PUT /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad?user_id=469cfa38526349f3af021ca958fc18ea => generated 240 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:09:59.346021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab3c2470-2aa1-42d7-9309-ce3ebc941bdb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] Calling method '.version_select at 0x7efd381ccaf0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:59.436251 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab3c2470-2aa1-42d7-9309-ce3ebc941bdb tempest-QuotasAdminTestV236-565063242 tempest-QuotasAdminTestV236-565063242-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad?user_id=469cfa38526349f3af021ca958fc18ea" status: 200 len: 282 microversion: 2.36 time: 0.095432 Oct 25 03:09:59.436946 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1251/2331] 10.222.0.36 () {60 vars in 1364 bytes} [Tue Oct 25 03:09:59 2022] GET /compute/v2.1/os-quota-sets/be734242ebf24b3ba326eefe532186ad?user_id=469cfa38526349f3af021ca958fc18ea => generated 282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:09:59.441727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:59.442823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:59.449749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.450243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.450680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.451374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.451823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.452245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.608368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:59.614763 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e762f71d-b368-4b0c-84ab-cdfffaf53dcb tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1497 microversion: 2.1 time: 0.176558 Oct 25 03:09:59.615351 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1252/2332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:59 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:59.637393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc95c283-af6a-4b0e-8906-847ab3974c4f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:59.654326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:09:59.672217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_groups [None req-bc95c283-af6a-4b0e-8906-847ab3974c4f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Querying cell 10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) for 1 instances {{(pid=120562) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 25 03:09:59.675145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc95c283-af6a-4b0e-8906-847ab3974c4f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.675649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc95c283-af6a-4b0e-8906-847ab3974c4f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.676549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc95c283-af6a-4b0e-8906-847ab3974c4f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.721617 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc95c283-af6a-4b0e-8906-847ab3974c4f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/bcf51d1c-706b-44a0-9111-484f850e9b44" status: 200 len: 221 microversion: 2.1 time: 0.088314 Oct 25 03:09:59.726490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1253/2333] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:09:59 2022] GET /compute/v2.1/os-server-groups/bcf51d1c-706b-44a0-9111-484f850e9b44 => generated 221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:09:59.738217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:59.739483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:59.748537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.749448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.750267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.751132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.751757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.752543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.775613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:09:59.793358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-32eec725-3bd5-4b81-86d9-312696def9ae tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1540 microversion: 2.1 time: 0.584796 Oct 25 03:09:59.798342 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1081/2334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:59 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1540 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:09:59.813547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:09:59.832773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:59.835331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:09:59.847806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.848305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.851057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.851809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:09:59.854288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:09:59.855095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:09:59.972405 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3959a37a-8333-44fc-b4bf-88212d1df93f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 204 len: 0 microversion: 2.1 time: 0.242633 Oct 25 03:09:59.978100 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1254/2335] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:09:59 2022] DELETE /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:09:59.986892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:09:59.987608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:00.002091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:00.002608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:00.003054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:00.003767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:00.004283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:00.004762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:00.184225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:00.192985 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df21937a-2cf2-437a-95e4-c2c3b47343dc tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1503 microversion: 2.1 time: 0.212315 Oct 25 03:10:00.197731 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1255/2336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:59 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:00.198446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:00.199056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:00.205770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:00.206360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:00.206799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:00.208263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:00.210020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:00.210020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:00.403181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:00.417117 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0447516d-485c-4721-86c8-497b6112766e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.220847 Oct 25 03:10:00.417743 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1256/2337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:00 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:00.566770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:00.576023 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39c9e535-3294-485f-9996-9207afb8e57c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1333 microversion: 2.1 time: 0.748153 Oct 25 03:10:00.578074 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1082/2338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:09:59 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1333 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:00.832434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:00.842129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:00.854200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:00.856039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:00.856644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:00.857970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:00.858599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:00.859173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:01.080390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:01.093293 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a878b00d-2929-411c-8323-0c10fda17e5a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1540 microversion: 2.1 time: 0.267940 Oct 25 03:10:01.094950 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1257/2339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:00 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1540 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:01.216779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:01.217940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:01.234411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:01.235427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:01.237975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:01.238965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:01.241893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:01.243728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:01.448813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:01.449505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:01.461822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:01.462242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:01.462692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:01.463406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:01.463866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:01.473407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:01.605806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:01.621980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf5706aa-f1e1-42de-8ca1-b10c29e5b643 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1503 microversion: 2.1 time: 0.406571 Oct 25 03:10:01.622621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1083/2340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:01 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:01.635406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:01.636044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:01.653318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:01.654771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:01.655412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:01.657663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:01.658421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:01.659317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:01.872674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:01.884614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1206402-9e50-41b1-8a63-c870fba13ee5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.444915 Oct 25 03:10:01.898751 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1258/2341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:01 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:02.102376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:02.110549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48e09f20-65ba-4abb-b38a-105f45002b4c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.486832 Oct 25 03:10:02.118649 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1084/2342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:01 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:02.134369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:02.135460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:02.143992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:02.144759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:02.145412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:02.147034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:02.147763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:02.149301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:02.600776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:02.609770 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f35692fc-bb8b-4f4a-9b18-82aabcba62e8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1540 microversion: 2.1 time: 0.480768 Oct 25 03:10:02.613825 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1259/2343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:02 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1540 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:02.645240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc184347-99ed-4099-83cb-d520f29d196c tempest-ListImagesTestJSON-2062510332 tempest-ListImagesTestJSON-2062510332-project] Calling method '.version_select at 0x7efd33886a60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:02.649167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:02.656214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:02.667175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:02.667899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:02.668581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:02.671977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:02.672707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:02.673358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:02.700754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc184347-99ed-4099-83cb-d520f29d196c tempest-ListImagesTestJSON-2062510332 tempest-ListImagesTestJSON-2062510332-project] 10.222.0.36 "GET /compute/v2.1/images/aaf4b9eb-e26e-4d56-8bee-d6f868921bec" status: 200 len: 784 microversion: 2.1 time: 0.245088 Oct 25 03:10:02.701353 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1085/2344] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:10:02 2022] GET /compute/v2.1/images/aaf4b9eb-e26e-4d56-8bee-d6f868921bec => generated 784 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:10:02.718002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-00ff36f3-bf35-43c8-a97b-ca3ce74347de tempest-ListImagesTestJSON-2062510332 tempest-ListImagesTestJSON-2062510332-project] Calling method '.version_select at 0x7efd330b7d30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:02.823933 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-00ff36f3-bf35-43c8-a97b-ca3ce74347de tempest-ListImagesTestJSON-2062510332 tempest-ListImagesTestJSON-2062510332-project] 10.222.0.36 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.109747 Oct 25 03:10:02.824903 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1086/2345] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Oct 25 03:10:02 2022] GET /compute/v2.1/images => generated 445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:10:02.840408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b5bfdf8-e44f-4c43-b30d-d777462e5ddd tempest-ListImagesTestJSON-2062510332 tempest-ListImagesTestJSON-2062510332-project] Calling method '.version_select at 0x7efd330b7ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:02.910709 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b5bfdf8-e44f-4c43-b30d-d777462e5ddd tempest-ListImagesTestJSON-2062510332 tempest-ListImagesTestJSON-2062510332-project] 10.222.0.36 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.076365 Oct 25 03:10:02.911723 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1087/2346] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:10:02 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:02.927175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:02.928191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:02.943411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:02.949597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:02.950427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:02.951438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:02.952370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:02.953045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:03.317418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:03.331456 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0dab7707-f782-485d-b555-4963b4037cde tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1503 microversion: 2.1 time: 0.683542 Oct 25 03:10:03.333305 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1260/2347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:02 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1503 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:03.341028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a3aa7fa9-d302-48df-bc95-5bbf99bc110e req-ded190cd-b526-4e35-ab02-dbbc191cf2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "tag": "3d4edfcd-b145-4c14-8c8e-f420fb660fb8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:03.372405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a3aa7fa9-d302-48df-bc95-5bbf99bc110e req-ded190cd-b526-4e35-ab02-dbbc191cf2ea service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:03.372405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a3aa7fa9-d302-48df-bc95-5bbf99bc110e req-ded190cd-b526-4e35-ab02-dbbc191cf2ea service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:03.372405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a3aa7fa9-d302-48df-bc95-5bbf99bc110e req-ded190cd-b526-4e35-ab02-dbbc191cf2ea service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:03.399308 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a3aa7fa9-d302-48df-bc95-5bbf99bc110e req-ded190cd-b526-4e35-ab02-dbbc191cf2ea service nova] Creating event network-changed:3d4edfcd-b145-4c14-8c8e-f420fb660fb8 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:03.406506 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a3aa7fa9-d302-48df-bc95-5bbf99bc110e req-ded190cd-b526-4e35-ab02-dbbc191cf2ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069155 Oct 25 03:10:03.407696 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1261/2348] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:03.424506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:03.425463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:03.435185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:03.435915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:03.436510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:03.437454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:03.439022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:03.439610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:03.484225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:03.520171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:03.530659 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2288deaf-850e-46be-a248-e78fa7a1cf48 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.617699 Oct 25 03:10:03.531539 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1088/2349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:02 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:03.641570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:03.642387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:03.657504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:03.660912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:03.664091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:03.665090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:03.670003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:03.672861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:04.075364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:04.086448 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51b326e4-94c8-40a4-9418-a3487b089549 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.677389 Oct 25 03:10:04.090502 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1262/2350] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:03 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:04.097099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-948c79d0-09d2-4226-9b86-a124043038ab req-06dded28-9bae-4147-b5d8-36044dae14e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e615f5-3bb8-4978-ac78-86989bd3f2fb", "name": "network-vif-plugged", "status": "completed", "tag": "e45f9c98-03b9-481a-965e-40f271ac641a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:04.137800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-948c79d0-09d2-4226-9b86-a124043038ab req-06dded28-9bae-4147-b5d8-36044dae14e0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:04.139012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-948c79d0-09d2-4226-9b86-a124043038ab req-06dded28-9bae-4147-b5d8-36044dae14e0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:04.144411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-948c79d0-09d2-4226-9b86-a124043038ab req-06dded28-9bae-4147-b5d8-36044dae14e0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:04.186724 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-948c79d0-09d2-4226-9b86-a124043038ab req-06dded28-9bae-4147-b5d8-36044dae14e0 service nova] Creating event network-vif-plugged:e45f9c98-03b9-481a-965e-40f271ac641a for instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb on n-h2-862355-1 Oct 25 03:10:04.203234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-948c79d0-09d2-4226-9b86-a124043038ab req-06dded28-9bae-4147-b5d8-36044dae14e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111281 Oct 25 03:10:04.207838 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1263/2351] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:04.366571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:04.368337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:04.387156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:04.387649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:04.388091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:04.388797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:04.389255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:04.389701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:04.495246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:04.496563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:04.497168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:04.497819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lazy-loading 'fault' on Instance uuid 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:10:04.571915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83299b0ebf0140cfa8448bb0733f004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bbb82803c64f04af271175dc2ea611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:04.586401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6ff429a-1522-4282-a73e-ee0d2a4fbe79 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 200 len: 1302 microversion: 2.1 time: 0.229340 Oct 25 03:10:04.588206 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1264/2352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:04 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 1302 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:04.596120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:04.602171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:04.604014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:04.617715 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6be92cff-e349-4423-8e8b-73490133453f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1535 microversion: 2.1 time: 0.974797 Oct 25 03:10:04.619091 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1089/2353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:03 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1535 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:04.623017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:04.625020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:04.627122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:04.627920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:04.628574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:04.633360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:04.990321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:05.022064 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63756004-f13b-499b-9a09-81356a6e4a0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.430959 Oct 25 03:10:05.024063 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1265/2354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:04 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:05.113175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:05.115780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:05.127100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.130328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.130831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.133142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.133647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.135965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.501903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a1a1ee73-9d0c-4416-b460-5f6e4c4b5d2e req-9c8c65b5-86fc-4eb7-ab1d-1d1e9b7d8d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b09bcf1-6b1e-4c0f-8e54-90843ad4f605", "name": "network-vif-deleted", "tag": "29e33307-5763-4a90-9b66-f90e3de4a251"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:05.529305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:05.534429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a1a1ee73-9d0c-4416-b460-5f6e4c4b5d2e req-9c8c65b5-86fc-4eb7-ab1d-1d1e9b7d8d0e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.535882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a1a1ee73-9d0c-4416-b460-5f6e4c4b5d2e req-9c8c65b5-86fc-4eb7-ab1d-1d1e9b7d8d0e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.537984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0249fb3a-e1e2-4d8c-9301-63bb169cd16d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.430247 Oct 25 03:10:05.539676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a1a1ee73-9d0c-4416-b460-5f6e4c4b5d2e req-9c8c65b5-86fc-4eb7-ab1d-1d1e9b7d8d0e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.544389 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1090/2355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:05 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:05.571916 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a1a1ee73-9d0c-4416-b460-5f6e4c4b5d2e req-9c8c65b5-86fc-4eb7-ab1d-1d1e9b7d8d0e service nova] Creating event network-vif-deleted:29e33307-5763-4a90-9b66-f90e3de4a251 for instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 on n-h2-862355-1 Oct 25 03:10:05.577881 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a1a1ee73-9d0c-4416-b460-5f6e4c4b5d2e req-9c8c65b5-86fc-4eb7-ab1d-1d1e9b7d8d0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083788 Oct 25 03:10:05.579149 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1266/2356] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:10:05.614440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:05.615208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:05.634372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.634877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.635321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.640974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.643360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.646028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.692821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] HTTP exception thrown: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Request method failure captured: Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 HTTP/1.1 Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NsUaAF4ptL7Q5gKe62D2I3YiIaOdV4gZGk0BHCAeyYOqX8LyFXJbPHBd1y3c9aZtTNaChN0varhOTQVFYwJzTqmMDcUN--MMk3MaLrWiQKCp8fR9nRr5kC45HWsIJyWYymQvGXqhhRjwAFyqxq74u9rCXMALX_lsz4LO0iTLrZJX4 Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:05.699683 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33bbb82803c64f04af271175dc2ea611", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33bbb82803c64f04af271175dc2ea611"}]}] Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 83299b0ebf0140cfa8448bb0733f004e Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:05.701176 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '4b09bcf1-6b1e-4c0f-8e54-90843ad4f605'} Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:05.702038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:05.703301 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:05.704304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Returning 404 to user: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:05.704686 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f6df7c1-506f-41eb-bed6-63053faeef18 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 404 len: 111 microversion: 2.1 time: 0.093961 Oct 25 03:10:05.706906 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1267/2357] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:05 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:05.720550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:05.721569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:05.731142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.732170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.735238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.736421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.737046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.737638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.931108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:05.943572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba635d21-e4ee-409c-8c8c-143c1c13e58d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1522 microversion: 2.1 time: 0.226203 Oct 25 03:10:05.944636 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1268/2358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:05 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:05.949807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cb9dda0-60e1-4dc5-a99e-5a3b65132c10 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:05.972519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_groups [None req-4cb9dda0-60e1-4dc5-a99e-5a3b65132c10 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Querying cell 10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) for 1 instances {{(pid=120562) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 25 03:10:05.974378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cb9dda0-60e1-4dc5-a99e-5a3b65132c10 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:05.975079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cb9dda0-60e1-4dc5-a99e-5a3b65132c10 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:05.975756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cb9dda0-60e1-4dc5-a99e-5a3b65132c10 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:05.990610 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cb9dda0-60e1-4dc5-a99e-5a3b65132c10 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.044406 Oct 25 03:10:05.992296 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1269/2359] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:10:05 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:06.021307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:06.022358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:06.032499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.036322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.037274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.039636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.041148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.042504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.112914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-007dfc0e-3593-4a29-b249-15e2f0123d64 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Calling method '.version_select at 0x7efd33c54c10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:06.123322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:10:06.283048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18805f7f-b02e-4dae-a573-8db44078c4a8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 204 len: 0 microversion: 2.1 time: 0.264969 Oct 25 03:10:06.289194 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1270/2360] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:06 2022] DELETE /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:10:06.298524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20b0de5f-1922-4c39-89f1-0b67f9fa0474 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:06.328053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_groups [None req-20b0de5f-1922-4c39-89f1-0b67f9fa0474 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Querying cell 10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) for 1 instances {{(pid=120562) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 25 03:10:06.329076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20b0de5f-1922-4c39-89f1-0b67f9fa0474 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.329768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20b0de5f-1922-4c39-89f1-0b67f9fa0474 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.330345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20b0de5f-1922-4c39-89f1-0b67f9fa0474 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.352297 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20b0de5f-1922-4c39-89f1-0b67f9fa0474 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/bcf51d1c-706b-44a0-9111-484f850e9b44" status: 200 len: 183 microversion: 2.1 time: 0.060103 Oct 25 03:10:06.353146 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1271/2361] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:10:06 2022] GET /compute/v2.1/os-server-groups/bcf51d1c-706b-44a0-9111-484f850e9b44 => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:06.364477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:06.366622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:06.378744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.379579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.381622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.382563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.383359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.383977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.640803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:06.649857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54698f88-e65a-404f-9e2a-7fe4f84decfa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.295241 Oct 25 03:10:06.654013 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1272/2362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:06 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:06.667264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:06.668454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:06.687341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.687832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.688528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.689466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.690104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.690674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.699960 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-007dfc0e-3593-4a29-b249-15e2f0123d64 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 371 microversion: 2.1 time: 1.152795 Oct 25 03:10:06.702237 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1091/2363] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:10:05 2022] GET /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 371 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:06.718934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:06.720950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:06.744291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.746214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.748229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.749153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.753021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.755451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.795921 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] HTTP exception thrown: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Request method failure captured: Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 HTTP/1.1 Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NsUaAF4ptL7Q5gKe62D2I3YiIaOdV4gZGk0BHCAeyYOqX8LyFXJbPHBd1y3c9aZtTNaChN0varhOTQVFYwJzTqmMDcUN--MMk3MaLrWiQKCp8fR9nRr5kC45HWsIJyWYymQvGXqhhRjwAFyqxq74u9rCXMALX_lsz4LO0iTLrZJX4 Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:06.799886 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33bbb82803c64f04af271175dc2ea611", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33bbb82803c64f04af271175dc2ea611"}]}] Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 83299b0ebf0140cfa8448bb0733f004e Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:06.801721 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '4b09bcf1-6b1e-4c0f-8e54-90843ad4f605'} Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:06.802390 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:06.804379 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:06.807005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Returning 404 to user: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:06.807005 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a8e51bcc-b0ab-4529-b92d-367034b0cfa9 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 404 len: 111 microversion: 2.1 time: 0.098794 Oct 25 03:10:06.807005 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1092/2364] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:06 2022] DELETE /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:06.811226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:06.811985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:06.822060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.822596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.823028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.824213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:06.824878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:06.825560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:06.940221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:06.952215 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0faa3303-c745-48d5-99ec-062902234300 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1528 microversion: 2.1 time: 0.296352 Oct 25 03:10:06.965822 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1273/2365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:06 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1528 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:06.969437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Action: 'update', calling method: .version_select at 0x7efd33610040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:07.509826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.510192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.510631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.511372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.511827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.512305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.583958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5341b837-a002-41a3-8b8f-53d77772345d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 328 microversion: 2.1 time: 0.624103 Oct 25 03:10:07.584721 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1274/2366] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:10:06 2022] PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 328 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:07.606250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:07.607174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] [instance: 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:07.627412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.628249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.629713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.631063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.631883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.632924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.655461 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] HTTP exception thrown: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Request method failure captured: Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 HTTP/1.1 Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NsUaAF4ptL7Q5gKe62D2I3YiIaOdV4gZGk0BHCAeyYOqX8LyFXJbPHBd1y3c9aZtTNaChN0varhOTQVFYwJzTqmMDcUN--MMk3MaLrWiQKCp8fR9nRr5kC45HWsIJyWYymQvGXqhhRjwAFyqxq74u9rCXMALX_lsz4LO0iTLrZJX4 Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:07.658944 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33bbb82803c64f04af271175dc2ea611", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33bbb82803c64f04af271175dc2ea611"}]}] Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 83299b0ebf0140cfa8448bb0733f004e Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:07.661138 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '4b09bcf1-6b1e-4c0f-8e54-90843ad4f605'} Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:07.661859 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. Oct 25 03:10:07.662932 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.667361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Returning 404 to user: Instance 4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:07.668796 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c8d8829-8cfa-4dac-a4b0-a7d7926247ad tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605" status: 404 len: 111 microversion: 2.1 time: 0.082286 Oct 25 03:10:07.673393 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1275/2367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:07 2022] GET /compute/v2.1/servers/4b09bcf1-6b1e-4c0f-8e54-90843ad4f605 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:07.690642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:07.700063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9651704a-7b80-40e5-be7b-426103e92eb7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.893221 Oct 25 03:10:07.700643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1093/2368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:06 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:07.716988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7eeb4234-5b0b-4fa3-80c5-3fdf003c7586 req-ef8ff191-79f3-40f1-9525-e2c1e7c1ab4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "tag": "0836fd50-b884-4c2d-9c9c-b51445f7bd10"}, {"name": "network-changed", "server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "tag": "0232ca20-0d23-4464-8c4d-545c39ddcd80"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:07.741122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7eeb4234-5b0b-4fa3-80c5-3fdf003c7586 req-ef8ff191-79f3-40f1-9525-e2c1e7c1ab4c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.749465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7eeb4234-5b0b-4fa3-80c5-3fdf003c7586 req-ef8ff191-79f3-40f1-9525-e2c1e7c1ab4c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.750094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7eeb4234-5b0b-4fa3-80c5-3fdf003c7586 req-ef8ff191-79f3-40f1-9525-e2c1e7c1ab4c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.782021 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7eeb4234-5b0b-4fa3-80c5-3fdf003c7586 req-ef8ff191-79f3-40f1-9525-e2c1e7c1ab4c service nova] Creating event network-changed:0836fd50-b884-4c2d-9c9c-b51445f7bd10 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:07.784514 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7eeb4234-5b0b-4fa3-80c5-3fdf003c7586 req-ef8ff191-79f3-40f1-9525-e2c1e7c1ab4c service nova] Creating event network-changed:0232ca20-0d23-4464-8c4d-545c39ddcd80 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:07.794923 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7eeb4234-5b0b-4fa3-80c5-3fdf003c7586 req-ef8ff191-79f3-40f1-9525-e2c1e7c1ab4c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089825 Oct 25 03:10:07.798441 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1094/2369] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:07.805426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:07.814769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:07.836738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.837250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.840342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.850767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.854173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.854662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.893863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:07.897532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.899634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.900286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.901301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:07.902135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:07.902753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:07.937563 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43da574a-a651-4c6b-9349-cc78935ec9da tempest-AZV2TestJSON-1918379379 tempest-AZV2TestJSON-1918379379-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.261955 Oct 25 03:10:07.938494 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1276/2370] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 25 03:10:07 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:10:07.954194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a3def24-1d2c-42b2-964b-ea42be849280 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:07.962148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3a3def24-1d2c-42b2-964b-ea42be849280 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] HTTP exception thrown: Instance group a1a0bba7-9666-4469-a328-468a6017f51e could not be found. Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a3def24-1d2c-42b2-964b-ea42be849280 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Request method failure captured: Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-server-groups/a1a0bba7-9666-4469-a328-468a6017f51e HTTP/1.1 Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NsUaAF4ptL7Q5gKe62D2I3YiIaOdV4gZGk0BHCAeyYOqX8LyFXJbPHBd1y3c9aZtTNaChN0varhOTQVFYwJzTqmMDcUN--MMk3MaLrWiQKCp8fR9nRr5kC45HWsIJyWYymQvGXqhhRjwAFyqxq74u9rCXMALX_lsz4LO0iTLrZJX4 Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:07.972965 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33bbb82803c64f04af271175dc2ea611", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33bbb82803c64f04af271175dc2ea611"}]}] Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 83299b0ebf0140cfa8448bb0733f004e Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance group a1a0bba7-9666-4469-a328-468a6017f51e could not be found. Oct 25 03:10:07.974279 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a1a0bba7-9666-4469-a328-468a6017f51e'} Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a1a0bba7-9666-4469-a328-468a6017f51e could not be found. Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:07.974961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a1a0bba7-9666-4469-a328-468a6017f51e could not be found. Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a1a0bba7-9666-4469-a328-468a6017f51e could not be found. Oct 25 03:10:07.976054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:07.978864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a3def24-1d2c-42b2-964b-ea42be849280 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Returning 404 to user: Instance group a1a0bba7-9666-4469-a328-468a6017f51e could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:07.980753 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3a3def24-1d2c-42b2-964b-ea42be849280 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/a1a0bba7-9666-4469-a328-468a6017f51e" status: 404 len: 117 microversion: 2.1 time: 0.031127 Oct 25 03:10:07.982050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1277/2371] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:10:07 2022] DELETE /compute/v2.1/os-server-groups/a1a0bba7-9666-4469-a328-468a6017f51e => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:08.106042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1985648276", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:08.213048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:08.708814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:08.721338 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5612d77-2786-4795-9b83-8593a5dbf86d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.920851 Oct 25 03:10:08.733753 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1095/2372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:07 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:08.733753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:08.733753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:08.752999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:08.753465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:08.754147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:08.755077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:08.755699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:08.756298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:08.804314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:08.804805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:08.805866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:08.805866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:08.806089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:08.828581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:08.829108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:08.829544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:08.830319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:08.831081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:08.832926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:08.887070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Getting quotas for project c2489105e3cf4fb5b982ae12e1e1d09a. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:08.898319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Getting quotas for user 5c353386fe874ba3a8a0399a5020d443 and project c2489105e3cf4fb5b982ae12e1e1d09a. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:08.930306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.utils [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] cores quota exceeded for c2489105e3cf4fb5b982ae12e1e1d09a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120562) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 25 03:10:08.933028 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Request method failure captured: Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 145 Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OMkFRiHHM4ZdaSVNWgULLw4pLkmiYru3ytxDANhN0a16AI8GUMrWU5SDlLJmuiAGX0rI6eh1rp0ICwbwPOhWbIhGOKvRWOs-YVu3XLTFzNMZipySeVMx3XvfsWZjORynKBevfUhtgdFsVV_8B0Q-0UygAd7rr5AvyuT849HUUZQJg Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:08.960194 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2489105e3cf4fb5b982ae12e1e1d09a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2489105e3cf4fb5b982ae12e1e1d09a"}]}] Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5c353386fe874ba3a8a0399a5020d443 Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1985648276", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} Oct 25 03:10:08.961511 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1985648276', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452'}}} Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 25 03:10:08.962291 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:08.963231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.966679 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4180bf5d-8063-4a6c-adea-9991933aed92 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.978650 Oct 25 03:10:08.969162 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1278/2373] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:07 2022] POST /compute/v2.1/servers => generated 111 bytes in 980 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:08.971242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:08.971562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f5d062e-a24b-4917-a59b-e95b284c6507 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:08.984854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3f5d062e-a24b-4917-a59b-e95b284c6507 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] HTTP exception thrown: Instance group 13440363-f039-4c9c-9f3c-93afb8c04186 could not be found. Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f5d062e-a24b-4917-a59b-e95b284c6507 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Request method failure captured: Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-server-groups/13440363-f039-4c9c-9f3c-93afb8c04186 HTTP/1.1 Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NsUaAF4ptL7Q5gKe62D2I3YiIaOdV4gZGk0BHCAeyYOqX8LyFXJbPHBd1y3c9aZtTNaChN0varhOTQVFYwJzTqmMDcUN--MMk3MaLrWiQKCp8fR9nRr5kC45HWsIJyWYymQvGXqhhRjwAFyqxq74u9rCXMALX_lsz4LO0iTLrZJX4 Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:08.989831 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33bbb82803c64f04af271175dc2ea611", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33bbb82803c64f04af271175dc2ea611"}]}] Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 83299b0ebf0140cfa8448bb0733f004e Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance group 13440363-f039-4c9c-9f3c-93afb8c04186 could not be found. Oct 25 03:10:08.991304 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '13440363-f039-4c9c-9f3c-93afb8c04186'} Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 13440363-f039-4c9c-9f3c-93afb8c04186 could not be found. Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:08.992086 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 13440363-f039-4c9c-9f3c-93afb8c04186 could not be found. Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 13440363-f039-4c9c-9f3c-93afb8c04186 could not be found. Oct 25 03:10:08.993302 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:08.995364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f5d062e-a24b-4917-a59b-e95b284c6507 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Returning 404 to user: Instance group 13440363-f039-4c9c-9f3c-93afb8c04186 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:08.997506 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f5d062e-a24b-4917-a59b-e95b284c6507 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/13440363-f039-4c9c-9f3c-93afb8c04186" status: 404 len: 117 microversion: 2.1 time: 0.033942 Oct 25 03:10:09.000017 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1279/2374] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:10:08 2022] DELETE /compute/v2.1/os-server-groups/13440363-f039-4c9c-9f3c-93afb8c04186 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:09.010676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:09.015756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:09.032009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:09.036541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:09.037252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:09.040450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:09.041822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:09.042281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:09.065088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:09.082382 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e15cedee-aac5-458e-a2f5-4bf485409cbf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1528 microversion: 2.1 time: 0.347120 Oct 25 03:10:09.083095 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1096/2375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:08 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1528 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:09.087890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Action: 'update', calling method: .version_select at 0x7efd3383a940>, body: {"quota_set": {"cores": 20}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:09.543578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:09.545782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:09.547293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:09.555783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:09.556228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:09.556668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:09.679566 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-32e63fc8-be10-4e43-b3ed-02b54b841c9b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 329 microversion: 2.1 time: 0.595095 Oct 25 03:10:09.680712 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1097/2376] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:10:09 2022] PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 329 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:09.685724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-638ba976-1d90-4eb5-955b-bd285ae566b4 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:09.695723 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-638ba976-1d90-4eb5-955b-bd285ae566b4 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] HTTP exception thrown: Instance group 0cee802e-c329-43fa-a31e-ca90aa9e9efa could not be found. Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-638ba976-1d90-4eb5-955b-bd285ae566b4 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Request method failure captured: Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-server-groups/0cee802e-c329-43fa-a31e-ca90aa9e9efa HTTP/1.1 Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NsUaAF4ptL7Q5gKe62D2I3YiIaOdV4gZGk0BHCAeyYOqX8LyFXJbPHBd1y3c9aZtTNaChN0varhOTQVFYwJzTqmMDcUN--MMk3MaLrWiQKCp8fR9nRr5kC45HWsIJyWYymQvGXqhhRjwAFyqxq74u9rCXMALX_lsz4LO0iTLrZJX4 Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:09.698552 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33bbb82803c64f04af271175dc2ea611", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33bbb82803c64f04af271175dc2ea611"}]}] Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 83299b0ebf0140cfa8448bb0733f004e Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance group 0cee802e-c329-43fa-a31e-ca90aa9e9efa could not be found. Oct 25 03:10:09.699718 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0cee802e-c329-43fa-a31e-ca90aa9e9efa'} Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0cee802e-c329-43fa-a31e-ca90aa9e9efa could not be found. Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:09.700366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0cee802e-c329-43fa-a31e-ca90aa9e9efa could not be found. Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0cee802e-c329-43fa-a31e-ca90aa9e9efa could not be found. Oct 25 03:10:09.701343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:09.703613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-638ba976-1d90-4eb5-955b-bd285ae566b4 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Returning 404 to user: Instance group 0cee802e-c329-43fa-a31e-ca90aa9e9efa could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:09.705147 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-638ba976-1d90-4eb5-955b-bd285ae566b4 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/0cee802e-c329-43fa-a31e-ca90aa9e9efa" status: 404 len: 117 microversion: 2.1 time: 0.023229 Oct 25 03:10:09.706772 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1098/2377] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:10:09 2022] DELETE /compute/v2.1/os-server-groups/0cee802e-c329-43fa-a31e-ca90aa9e9efa => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:09.830444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:09.846524 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-522bb205-cb8c-4122-bc48-259acd5dc817 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.844863 Oct 25 03:10:09.848036 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1280/2378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:09 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:09.859484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3bda97d9-f3b1-4734-a3b5-c97afa7f8295 req-57c4464b-0741-4471-8351-238735df4e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e615f5-3bb8-4978-ac78-86989bd3f2fb", "name": "network-vif-unplugged", "status": "completed", "tag": "e45f9c98-03b9-481a-965e-40f271ac641a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:09.878303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:09.894373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3bda97d9-f3b1-4734-a3b5-c97afa7f8295 req-57c4464b-0741-4471-8351-238735df4e78 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:09.897794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3bda97d9-f3b1-4734-a3b5-c97afa7f8295 req-57c4464b-0741-4471-8351-238735df4e78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:09.898328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3bda97d9-f3b1-4734-a3b5-c97afa7f8295 req-57c4464b-0741-4471-8351-238735df4e78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:09.929130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:09.929640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:09.929783 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3bda97d9-f3b1-4734-a3b5-c97afa7f8295 req-57c4464b-0741-4471-8351-238735df4e78 service nova] Creating event network-vif-unplugged:e45f9c98-03b9-481a-965e-40f271ac641a for instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb on n-h2-862355-1 Oct 25 03:10:09.939739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:09.940964 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3bda97d9-f3b1-4734-a3b5-c97afa7f8295 req-57c4464b-0741-4471-8351-238735df4e78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090030 Oct 25 03:10:09.942165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:09.942853 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1281/2379] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:09.943558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:09.946006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:09.948941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:09.949421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:09.949962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e59fbda5-ec70-44ef-a99e-548cd525da0f tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Calling method '.version_select at 0x7efd337bfca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:10.029640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18f57b80-10eb-47a6-b42b-6828252bb228 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/ips" status: 200 len: 145 microversion: 2.1 time: 0.319770 Oct 25 03:10:10.033939 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1099/2380] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:10:09 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/ips => generated 145 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:10.057201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e38f9d27-0dce-4ab0-b0e3-a4fb4aa2df09 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:10.075189 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e38f9d27-0dce-4ab0-b0e3-a4fb4aa2df09 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] HTTP exception thrown: Instance group 7bea11bf-9f0a-480e-9183-855baedef1e6 could not be found. Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e38f9d27-0dce-4ab0-b0e3-a4fb4aa2df09 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Request method failure captured: Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-server-groups/7bea11bf-9f0a-480e-9183-855baedef1e6 HTTP/1.1 Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NsUaAF4ptL7Q5gKe62D2I3YiIaOdV4gZGk0BHCAeyYOqX8LyFXJbPHBd1y3c9aZtTNaChN0varhOTQVFYwJzTqmMDcUN--MMk3MaLrWiQKCp8fR9nRr5kC45HWsIJyWYymQvGXqhhRjwAFyqxq74u9rCXMALX_lsz4LO0iTLrZJX4 Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:10.076740 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33bbb82803c64f04af271175dc2ea611"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33bbb82803c64f04af271175dc2ea611", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33bbb82803c64f04af271175dc2ea611"}]}] Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 33bbb82803c64f04af271175dc2ea611 Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerGroupTestJSON-1495561446 Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 83299b0ebf0140cfa8448bb0733f004e Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerGroupTestJSON-1495561446-project Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance group 7bea11bf-9f0a-480e-9183-855baedef1e6 could not be found. Oct 25 03:10:10.077972 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '7bea11bf-9f0a-480e-9183-855baedef1e6'} Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7bea11bf-9f0a-480e-9183-855baedef1e6 could not be found. Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:10.078729 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7bea11bf-9f0a-480e-9183-855baedef1e6 could not be found. Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7bea11bf-9f0a-480e-9183-855baedef1e6 could not be found. Oct 25 03:10:10.079744 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:10.082358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e38f9d27-0dce-4ab0-b0e3-a4fb4aa2df09 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Returning 404 to user: Instance group 7bea11bf-9f0a-480e-9183-855baedef1e6 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:10.084099 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e38f9d27-0dce-4ab0-b0e3-a4fb4aa2df09 tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/7bea11bf-9f0a-480e-9183-855baedef1e6" status: 404 len: 117 microversion: 2.1 time: 0.047138 Oct 25 03:10:10.087686 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1100/2381] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:10:10 2022] DELETE /compute/v2.1/os-server-groups/7bea11bf-9f0a-480e-9183-855baedef1e6 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:10.093226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:10.093998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:10.103065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.103669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.104209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:10.105366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.106074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.110030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:10.121922 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e59fbda5-ec70-44ef-a99e-548cd525da0f tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 371 microversion: 2.1 time: 0.177281 Oct 25 03:10:10.125807 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1282/2382] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:10:09 2022] GET /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:10.143674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0570f6d1-f7d4-498b-a999-b96cbd24264f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:10.214604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0570f6d1-f7d4-498b-a999-b96cbd24264f tempest-ServerGroupTestJSON-1495561446 tempest-ServerGroupTestJSON-1495561446-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/bcf51d1c-706b-44a0-9111-484f850e9b44" status: 204 len: 0 microversion: 2.1 time: 0.087509 Oct 25 03:10:10.219621 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1283/2383] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:10:10 2022] DELETE /compute/v2.1/os-server-groups/bcf51d1c-706b-44a0-9111-484f850e9b44 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:10:10.231981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:10.238458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:10.249405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.258366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.261070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:10.275474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.276193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.276854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:10.514342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:10.534858 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37ed15be-433e-4d34-9c72-0f238271dab6 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 200 len: 1486 microversion: 2.1 time: 0.311193 Oct 25 03:10:10.535538 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1284/2384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:10 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 1486 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:10.547029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Action: 'update', calling method: .version_select at 0x7efd33686310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:10.736956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.737307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.742299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:10.745418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.746103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.746562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:10.884358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8f371e54-067c-4f9f-af85-bc910c72e141 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 328 microversion: 2.1 time: 0.344860 Oct 25 03:10:10.886238 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1285/2385] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:10:10 2022] PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 328 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:10.892158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:10.893099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:10.909444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.910821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.911765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:10.912869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:10.913585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:10.914513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:11.076961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:11.096318 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34bf50d9-c7b6-4ac6-bd15-bab100668b77 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 1.006849 Oct 25 03:10:11.114206 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1101/2386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:10 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:11.171080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-418612134", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:11.301892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:12.047745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:12.048180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:12.048743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:12.049162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:12.049625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:12.067575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.069129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.070311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.073877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.075311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.076520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.139046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Getting quotas for project c2489105e3cf4fb5b982ae12e1e1d09a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:12.153495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Getting quotas for user 5c353386fe874ba3a8a0399a5020d443 and project c2489105e3cf4fb5b982ae12e1e1d09a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:12.170380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:12.173528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.utils [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] instances quota exceeded for c2489105e3cf4fb5b982ae12e1e1d09a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120563) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 25 03:10:12.174825 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Request method failure captured: Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 144 Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OMkFRiHHM4ZdaSVNWgULLw4pLkmiYru3ytxDANhN0a16AI8GUMrWU5SDlLJmuiAGX0rI6eh1rp0ICwbwPOhWbIhGOKvRWOs-YVu3XLTFzNMZipySeVMx3XvfsWZjORynKBevfUhtgdFsVV_8B0Q-0UygAd7rr5AvyuT849HUUZQJg Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:12.180724 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2489105e3cf4fb5b982ae12e1e1d09a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2489105e3cf4fb5b982ae12e1e1d09a"}]}] Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5c353386fe874ba3a8a0399a5020d443 Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-418612134", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} Oct 25 03:10:12.182307 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-418612134', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452'}}} Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 25 03:10:12.182991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:12.183961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.186223 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:12.187583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:12.187583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:12.187583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:12.187583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:12.187583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 25 03:10:12.187583 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.194142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:12.195290 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c946761d-b59e-4a24-a84e-dc023f3b766b tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.029130 Oct 25 03:10:12.196357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1102/2387] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:11 2022] POST /compute/v2.1/servers => generated 119 bytes in 1031 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:10:12.211616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-903e37f4-9e25-44cc-8084-bacf4410aad2 req-b727bfca-0f58-46cb-b57b-cd872ed1780c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e615f5-3bb8-4978-ac78-86989bd3f2fb", "name": "network-vif-deleted", "tag": "e45f9c98-03b9-481a-965e-40f271ac641a"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:12.224655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-903e37f4-9e25-44cc-8084-bacf4410aad2 req-b727bfca-0f58-46cb-b57b-cd872ed1780c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.225618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-903e37f4-9e25-44cc-8084-bacf4410aad2 req-b727bfca-0f58-46cb-b57b-cd872ed1780c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.226570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-903e37f4-9e25-44cc-8084-bacf4410aad2 req-b727bfca-0f58-46cb-b57b-cd872ed1780c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.243008 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-903e37f4-9e25-44cc-8084-bacf4410aad2 req-b727bfca-0f58-46cb-b57b-cd872ed1780c service nova] Creating event network-vif-deleted:e45f9c98-03b9-481a-965e-40f271ac641a for instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb on n-h2-862355-1 Oct 25 03:10:12.256010 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-903e37f4-9e25-44cc-8084-bacf4410aad2 req-b727bfca-0f58-46cb-b57b-cd872ed1780c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058186 Oct 25 03:10:12.263072 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1103/2388] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:12.270274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:12.271296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:12.286214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.290188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.290874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.294961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.298855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.299376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.328766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:12.332478 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb HTTP/1.1 Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:12.341638 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:12.342904 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '91e615f5-3bb8-4978-ac78-86989bd3f2fb'} Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:12.343577 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:12.344785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:12.345784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:12.345784 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b88f32c3-673f-4db3-88aa-d35c4cd56c43 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 404 len: 111 microversion: 2.1 time: 0.078728 Oct 25 03:10:12.348623 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1104/2389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:12 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:12.350739 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da4dbd8f-94f8-4f3c-bab9-bf651169e78b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 1.461398 Oct 25 03:10:12.353776 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1286/2390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:10 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:12.363802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:12.364706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:12.365184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Action: 'update', calling method: .version_select at 0x7efd33602af0>, body: {"quota_set": {"instances": 10}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:12.397932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.399223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.399690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.402584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.403232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.403676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.757751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:12.771907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1aac21a-be35-4536-873f-0926b661a8ee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.421951 Oct 25 03:10:12.773651 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1105/2391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:12 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:12.790481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-539562716", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:12.812770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.813939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.814304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.816114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:12.817158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:12.818067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:12.892838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] validate_networks() for [('05ce7fca-15ae-4f11-bf0d-1d24b23b50a6', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:12.898006 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d3e417c-7caa-4a8b-aedb-6713f3e14c0b tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 329 microversion: 2.1 time: 0.542722 Oct 25 03:10:12.899288 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1287/2392] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:10:12 2022] PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 329 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:12.912909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a2b7aa1-6d95-4647-98c0-04dcee567eb7 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Calling method '.version_select at 0x7efd336b5b80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:13.059134 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a2b7aa1-6d95-4647-98c0-04dcee567eb7 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 371 microversion: 2.1 time: 0.150628 Oct 25 03:10:13.060300 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1288/2393] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:10:12 2022] GET /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:13.075447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Action: 'update', calling method: .version_select at 0x7efd334afd30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:13.149332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:13.150024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:13.150488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:13.152043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:13.152524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:13.152964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:13.217471 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6f895c4-3ac9-416f-beb7-9a38fd48f59d tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 325 microversion: 2.1 time: 0.145947 Oct 25 03:10:13.221989 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1289/2394] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:10:13 2022] PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 325 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:10:13.236783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d74daf02-ed6e-4449-b299-1d2f1ab78054"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:13.243352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:13.253987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:13.255193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:13.255643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:13.257305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:13.258892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:13.259342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:13.364524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:13.587220 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9296b728-8c77-4d8b-a63e-023ccfe649dc tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363026 Oct 25 03:10:13.595377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1290/2395] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:10:13 2022] POST /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:13.602271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2042607855", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:13.722335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:14.015466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:14.015884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:14.016461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:14.016968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:14.017645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:14.037242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:14.040453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:14.041259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:14.043938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:14.044580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:14.046074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:14.094252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for project f40282bec7bb43e49e8015cde76e5a19. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:14.110484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Getting quotas for user 92b6e776ceef40e5a979f3ed63f7cdfe and project f40282bec7bb43e49e8015cde76e5a19. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:14.136781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:10:14.139789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:10:14.205317 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b9653f7b-2c90-4142-9b13-22219345f89c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.429523 Oct 25 03:10:14.207734 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1106/2396] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:10:14.213073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:14.216814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:14.227184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:14.228102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:14.228745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:14.229757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:14.231130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:14.231818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:14.870656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:14.883282 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-572e1b12-b976-408b-8702-ddd9baacd05b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.674176 Oct 25 03:10:14.884108 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1107/2397] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:14 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:14.890518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:14.906953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:14.923935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:14.928151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:14.930891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:14.931992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:14.939233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:14.941307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:14.968607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:14.970368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:14.971009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:14.972178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:14.972859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:14.997468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:14.998314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:14.998959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:15.005951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:15.008432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:15.009089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:15.071458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Getting quotas for project c2489105e3cf4fb5b982ae12e1e1d09a. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:15.090392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Getting quotas for user 5c353386fe874ba3a8a0399a5020d443 and project c2489105e3cf4fb5b982ae12e1e1d09a. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:15.123727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.utils [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] ram quota exceeded for c2489105e3cf4fb5b982ae12e1e1d09a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120562) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 25 03:10:15.124656 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Request method failure captured: Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 145 Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OMkFRiHHM4ZdaSVNWgULLw4pLkmiYru3ytxDANhN0a16AI8GUMrWU5SDlLJmuiAGX0rI6eh1rp0ICwbwPOhWbIhGOKvRWOs-YVu3XLTFzNMZipySeVMx3XvfsWZjORynKBevfUhtgdFsVV_8B0Q-0UygAd7rr5AvyuT849HUUZQJg Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:15.127054 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2489105e3cf4fb5b982ae12e1e1d09a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2489105e3cf4fb5b982ae12e1e1d09a"}]}] Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5c353386fe874ba3a8a0399a5020d443 Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2042607855", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} Oct 25 03:10:15.129115 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2042607855', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452'}}} Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 25 03:10:15.130350 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:15.131340 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.132496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:15.135038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:15.135038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:15.135038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:15.135038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:15.135038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 25 03:10:15.135038 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.146870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:15.148141 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe0e793a-4664-44b3-bd58-3623c96df845 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.550664 Oct 25 03:10:15.148966 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1291/2398] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 1553 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:15.156293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:15.157384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:15.172714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:15.177143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:15.177948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:15.178887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:15.179564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:15.180196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:15.253974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:15.257971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:15.288927 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ccc71c67-9a57-4f68-badb-69ac0481f9c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.401910 Oct 25 03:10:15.291421 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1108/2399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:14 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:15.310017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Action: 'update', calling method: .version_select at 0x7efd33413a60>, body: {"quota_set": {"ram": 51200}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:15.463487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:15.464232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:15.467767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:15.468889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:15.469515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:15.470154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:15.601051 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5e934b6-d1c9-49fb-ba9b-8bb8f422fb10 tempest-QuotasAdminNegativeTest-1314034743 tempest-QuotasAdminNegativeTest-1314034743-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 200 len: 329 microversion: 2.1 time: 0.307203 Oct 25 03:10:15.604050 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1109/2400] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:10:15 2022] PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 329 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:15.618733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf3515f5-f4f3-401c-8ae4-664cb1b44773 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Action: 'update', calling method: .version_select at 0x7efd335a9b80>, body: {"quota_set": {"ram": 0}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:15.624718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cf3515f5-f4f3-401c-8ae4-664cb1b44773 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '5c353386fe874ba3a8a0399a5020d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2489105e3cf4fb5b982ae12e1e1d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf3515f5-f4f3-401c-8ae4-664cb1b44773 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Request method failure captured: Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a HTTP/1.1 Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 25 Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OMkFRiHHM4ZdaSVNWgULLw4pLkmiYru3ytxDANhN0a16AI8GUMrWU5SDlLJmuiAGX0rI6eh1rp0ICwbwPOhWbIhGOKvRWOs-YVu3XLTFzNMZipySeVMx3XvfsWZjORynKBevfUhtgdFsVV_8B0Q-0UygAd7rr5AvyuT849HUUZQJg Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:15.632602 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2489105e3cf4fb5b982ae12e1e1d09a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2489105e3cf4fb5b982ae12e1e1d09a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2489105e3cf4fb5b982ae12e1e1d09a"}]}] Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: c2489105e3cf4fb5b982ae12e1e1d09a Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1379871386 Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5c353386fe874ba3a8a0399a5020d443 Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-QuotasAdminNegativeTest-1379871386-project Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: {"quota_set": {"ram": 0}} Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 25 03:10:15.634166 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c2489105e3cf4fb5b982ae12e1e1d09a', 'body': {'quota_set': {'ram': 0}}} Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:15.635130 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.636360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:15.637660 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:15.637660 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:15.637660 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 25 03:10:15.637660 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 25 03:10:15.637660 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 25 03:10:15.637660 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:15.638761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf3515f5-f4f3-401c-8ae4-664cb1b44773 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:15.639926 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf3515f5-f4f3-401c-8ae4-664cb1b44773 tempest-QuotasAdminNegativeTest-1379871386 tempest-QuotasAdminNegativeTest-1379871386-project] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a" status: 403 len: 116 microversion: 2.1 time: 0.026230 Oct 25 03:10:15.640521 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1110/2401] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Oct 25 03:10:15 2022] PUT /compute/v2.1/os-quota-sets/c2489105e3cf4fb5b982ae12e1e1d09a => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:15.859081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:15.873429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9189da42-f509-4b11-95ed-6aac12e376bc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1228 microversion: 2.1 time: 0.720994 Oct 25 03:10:15.886250 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1292/2402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:15 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1228 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:15.921608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:15.926631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:15.938073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:15.941569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:15.942224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:15.943328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:15.945526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:15.946193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:16.316036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:16.319420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:16.335928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:16.341308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:16.342270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:16.343480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:16.345804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:16.346622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:16.778655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:16.791563 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-59e2cd4c-19bf-4c87-818d-5a6b0bb09803 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.480372 Oct 25 03:10:16.793105 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1293/2403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:16 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:16.905418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:16.906685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:16.914824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:16.915670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:16.916378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:16.917823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:16.918527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:16.919171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:17.098531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:17.110954 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c668a0d-2ed4-4df4-b2e2-75f7536c9834 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1282 microversion: 2.1 time: 0.211150 Oct 25 03:10:17.113215 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1294/2404] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:16 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:17.182394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:17.199125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c61e387-32d0-4e71-b6d3-c91e1ac082f6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 1.290721 Oct 25 03:10:17.201897 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1111/2405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:15 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:17.820234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:17.820906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:17.864388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:17.864912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:17.865327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:17.871599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:17.872169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:17.872624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:18.151480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:18.153006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:18.166106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:18.167546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:18.169189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:18.171445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:18.173493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:18.175820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:18.731103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:18.748359 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8adcc2e7-0473-43fe-aa8d-1b4ee4b3ac5f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 0.935470 Oct 25 03:10:18.766947 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1295/2406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:17 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:18.766947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:18.766947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:18.824953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:18.825600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:18.825948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:18.826799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:18.828447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:18.828905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:19.312345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:19.330912 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf446163-3837-4e56-ab1c-e0ca472a9cba tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.572293 Oct 25 03:10:19.331959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1296/2407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:18 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:19.780241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:19.780868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:19.794702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:19.799538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:19.802707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:19.804153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:19.804859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:19.807851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:19.833716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:19.851451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56f7ecdb-3932-4bea-a8f1-f90f65151a6a tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 1.712215 Oct 25 03:10:19.862741 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1112/2408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:18 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:20.353803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:20.354428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:20.371407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:20.376491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:20.378823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:20.381364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:20.383209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:20.385251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:21.072600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:21.083691 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32294db3-e324-4fac-ba7a-a4dbbb0008c1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1476 microversion: 2.1 time: 1.307075 Oct 25 03:10:21.087775 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1297/2409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:19 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1476 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:21.103445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:21.104087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:21.146610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:21.150549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:21.151937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:21.154971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:21.159922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:21.160967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:21.417348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:21.429848 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dfa3ce47-ee7c-4f02-82d4-3a8613c199e3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 1.078911 Oct 25 03:10:21.431809 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1113/2410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:20 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:21.755063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:21.774935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1824334a-cc3f-4c51-ae40-4ca7f16c66c7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 0.685494 Oct 25 03:10:21.798137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1298/2411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:21 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:21.921348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a8523693-e974-4b8e-88a2-50cbdf768a36 req-11770761-a66a-4c40-b563-0df9d1a4c5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "name": "network-vif-plugged", "status": "completed", "tag": "0232ca20-0d23-4464-8c4d-545c39ddcd80"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:21.943579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a8523693-e974-4b8e-88a2-50cbdf768a36 req-11770761-a66a-4c40-b563-0df9d1a4c5a1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:21.944067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a8523693-e974-4b8e-88a2-50cbdf768a36 req-11770761-a66a-4c40-b563-0df9d1a4c5a1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:21.944504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a8523693-e974-4b8e-88a2-50cbdf768a36 req-11770761-a66a-4c40-b563-0df9d1a4c5a1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:21.973991 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a8523693-e974-4b8e-88a2-50cbdf768a36 req-11770761-a66a-4c40-b563-0df9d1a4c5a1 service nova] Creating event network-vif-plugged:0232ca20-0d23-4464-8c4d-545c39ddcd80 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:21.984389 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a8523693-e974-4b8e-88a2-50cbdf768a36 req-11770761-a66a-4c40-b563-0df9d1a4c5a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066838 Oct 25 03:10:21.988822 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1114/2412] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:10:22.115669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:22.117110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:22.131250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:22.132132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:22.132807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:22.133788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:22.136658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:22.137402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:22.457113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:22.457848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:22.491407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:22.491890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:22.492341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:22.493084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:22.494048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:22.494048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:22.935830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:22.967797 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f274606b-e5c0-4463-896d-208094ba0c40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1475 microversion: 2.1 time: 0.841358 Oct 25 03:10:22.969287 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1299/2413] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:22 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1475 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:22.986775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:22.990836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:23.025950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:23.026440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:23.029928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:23.030912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:23.035639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:23.036751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:23.679088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:23.697361 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f57def5f-1480-436a-8160-44dac1e65101 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 1.245790 Oct 25 03:10:23.705115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1115/2414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:22 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:23.908353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:23.924649 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8c4d716-d19f-4f83-bb96-35b2a969b47c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 0.949793 Oct 25 03:10:23.946707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1300/2415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:22 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:23.952883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-cb4dcb90-c39e-4ee0-9751-58ef781cc978 req-e1c57850-39eb-4d6d-afcb-4e95b7de83b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb018e4-b858-42fa-9832-79fbfe052184", "name": "network-vif-unplugged", "status": "completed", "tag": "69d5e780-5c64-43de-bb3f-d32a4862274d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:23.968552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cb4dcb90-c39e-4ee0-9751-58ef781cc978 req-e1c57850-39eb-4d6d-afcb-4e95b7de83b8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:23.969627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cb4dcb90-c39e-4ee0-9751-58ef781cc978 req-e1c57850-39eb-4d6d-afcb-4e95b7de83b8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:23.971334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cb4dcb90-c39e-4ee0-9751-58ef781cc978 req-e1c57850-39eb-4d6d-afcb-4e95b7de83b8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:23.994088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-cb4dcb90-c39e-4ee0-9751-58ef781cc978 req-e1c57850-39eb-4d6d-afcb-4e95b7de83b8 service nova] Creating event network-vif-unplugged:69d5e780-5c64-43de-bb3f-d32a4862274d for instance 2eb018e4-b858-42fa-9832-79fbfe052184 on n-h2-862355-1 Oct 25 03:10:24.030236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1153293865", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "6e19c4c3-818f-4141-bc54-45b8d35d2d18"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:24.036017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-cb4dcb90-c39e-4ee0-9751-58ef781cc978 req-e1c57850-39eb-4d6d-afcb-4e95b7de83b8 service nova] Instance 2eb018e4-b858-42fa-9832-79fbfe052184 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:10:24.078216 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-cb4dcb90-c39e-4ee0-9751-58ef781cc978 req-e1c57850-39eb-4d6d-afcb-4e95b7de83b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127575 Oct 25 03:10:24.084187 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1301/2416] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:24.102241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a252e37f-088c-4504-9f41-66a775b442c7 req-da9920bc-3b20-4994-8f2d-6c47eccaa4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2467e455-696c-4a06-958f-b9b46c902f8a", "tag": "434346e1-ea1d-46f9-8cd4-72ee523a3300"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:24.116957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:24.119796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a252e37f-088c-4504-9f41-66a775b442c7 req-da9920bc-3b20-4994-8f2d-6c47eccaa4c8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:24.120993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a252e37f-088c-4504-9f41-66a775b442c7 req-da9920bc-3b20-4994-8f2d-6c47eccaa4c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:24.121492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a252e37f-088c-4504-9f41-66a775b442c7 req-da9920bc-3b20-4994-8f2d-6c47eccaa4c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:24.143124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a252e37f-088c-4504-9f41-66a775b442c7 req-da9920bc-3b20-4994-8f2d-6c47eccaa4c8 service nova] Creating event network-changed:434346e1-ea1d-46f9-8cd4-72ee523a3300 for instance 2467e455-696c-4a06-958f-b9b46c902f8a on n-h2-862355-1 Oct 25 03:10:24.152279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a252e37f-088c-4504-9f41-66a775b442c7 req-da9920bc-3b20-4994-8f2d-6c47eccaa4c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065001 Oct 25 03:10:24.153718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1302/2417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:24.167977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:24.168698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:24.177449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:24.178472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:24.179242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:24.180190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:24.180797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:24.181839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:24.183842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] validate_networks() for [('6e19c4c3-818f-4141-bc54-45b8d35d2d18', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:24.711817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:24.726412 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d9c0428-8d28-4f66-80e0-3bec8c95b5a8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1475 microversion: 2.1 time: 0.570516 Oct 25 03:10:24.740164 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1303/2418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:24 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1475 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:24.754202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f3910e28-1f98-4c7a-b929-52570872e0a4 req-477bc3cb-974d-4e39-afaa-3f3db27725c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "name": "network-vif-plugged", "status": "completed", "tag": "3d4edfcd-b145-4c14-8c8e-f420fb660fb8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:24.783855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f3910e28-1f98-4c7a-b929-52570872e0a4 req-477bc3cb-974d-4e39-afaa-3f3db27725c3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:24.785671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f3910e28-1f98-4c7a-b929-52570872e0a4 req-477bc3cb-974d-4e39-afaa-3f3db27725c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:24.786365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f3910e28-1f98-4c7a-b929-52570872e0a4 req-477bc3cb-974d-4e39-afaa-3f3db27725c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:24.819154 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f3910e28-1f98-4c7a-b929-52570872e0a4 req-477bc3cb-974d-4e39-afaa-3f3db27725c3 service nova] Creating event network-vif-plugged:3d4edfcd-b145-4c14-8c8e-f420fb660fb8 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:24.836943 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f3910e28-1f98-4c7a-b929-52570872e0a4 req-477bc3cb-974d-4e39-afaa-3f3db27725c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087064 Oct 25 03:10:24.840668 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1304/2419] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:24.856795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:24.857979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:24.874918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:24.878199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:24.878840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:24.882134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:24.883417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:24.884166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:25.050820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=21 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:25.108703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=72 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:25.260320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:25.261329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:25.262080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:25.262693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:25.263351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:25.277871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=34 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:25.289010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:25.289723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:25.290404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:25.292173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:25.292647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:25.293083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:25.340765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Getting quotas for project 5b80ae1558b3435dbf3fef71c83507f0. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:25.351284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Getting quotas for user 2db23e5d4d024977951c5268e830be92 and project 5b80ae1558b3435dbf3fef71c83507f0. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:25.387336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:10:25.389892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:10:25.493798 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c681c59-9671-4c53-ae3c-6cecd5628821 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.785612 Oct 25 03:10:25.495440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1116/2420] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:10:25.506274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:25.508921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:25.519827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:25.528011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:25.528820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:25.529608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:25.530115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:25.530583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:25.842837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:25.858065 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec576d3a-90ec-486c-a4d3-946e3c4bffcf tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 0.361267 Oct 25 03:10:25.862100 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1117/2421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:25 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:26.037149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:26.052299 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-095e2349-82a1-4aaf-8c9e-885bd8286eed tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 1.210175 Oct 25 03:10:26.063004 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1305/2422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:24 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:26.081325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fada10f1-d426-49ed-a7da-51ce19608ed3 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:26.082431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fada10f1-d426-49ed-a7da-51ce19608ed3 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:26.303537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e2513612-adbb-44fe-b8ee-bb8764ce534b tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] Action: 'create', calling method: .version_select at 0x7efd3357bee0>, body: {"security_group": {"name": "tempest-securitygroup-2050482383", "description": "tempest-description-59355120"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:26.412191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fada10f1-d426-49ed-a7da-51ce19608ed3 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:26.420027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fada10f1-d426-49ed-a7da-51ce19608ed3 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1228 microversion: 2.1 time: 0.355186 Oct 25 03:10:26.426880 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1306/2423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:26 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1228 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:26.432515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:26.437584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:26.453402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:26.454961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:26.455687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:26.466520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:26.467441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:26.468051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:26.715824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e2513612-adbb-44fe-b8ee-bb8764ce534b tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.851669 Oct 25 03:10:26.717258 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1118/2424] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:10:25 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:26.722817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-fecfe90e-39cd-482e-9db5-f3ec25e8794e req-dc4b469f-cabe-46a8-9659-68b44b1e0dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb018e4-b858-42fa-9832-79fbfe052184", "tag": "69d5e780-5c64-43de-bb3f-d32a4862274d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:26.744019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fecfe90e-39cd-482e-9db5-f3ec25e8794e req-dc4b469f-cabe-46a8-9659-68b44b1e0dd0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:26.745278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fecfe90e-39cd-482e-9db5-f3ec25e8794e req-dc4b469f-cabe-46a8-9659-68b44b1e0dd0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:26.746946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fecfe90e-39cd-482e-9db5-f3ec25e8794e req-dc4b469f-cabe-46a8-9659-68b44b1e0dd0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:26.760724 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-fecfe90e-39cd-482e-9db5-f3ec25e8794e req-dc4b469f-cabe-46a8-9659-68b44b1e0dd0 service nova] Creating event network-changed:69d5e780-5c64-43de-bb3f-d32a4862274d for instance 2eb018e4-b858-42fa-9832-79fbfe052184 on n-h2-862355-1 Oct 25 03:10:26.776579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-fecfe90e-39cd-482e-9db5-f3ec25e8794e req-dc4b469f-cabe-46a8-9659-68b44b1e0dd0 service nova] Instance 2eb018e4-b858-42fa-9832-79fbfe052184 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:10:26.822037 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-fecfe90e-39cd-482e-9db5-f3ec25e8794e req-dc4b469f-cabe-46a8-9659-68b44b1e0dd0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103166 Oct 25 03:10:26.823542 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1119/2425] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:26.832632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23d233f0-e2f7-4ddd-9364-1860416954be tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] Action: 'create', calling method: .version_select at 0x7efd335553a0>, body: {"security_group": {"name": "tempest-securitygroup-1555577931", "description": "tempest-description-1645202202"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:27.393722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:27.412758 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6839f3a-fb3a-4e8d-a855-edb1b441860e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1475 microversion: 2.1 time: 0.984305 Oct 25 03:10:27.423409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1307/2426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:26 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1475 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:27.451947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-88fcf680-70a6-46b3-8840-d973e207c706 req-774839ae-d853-4586-b2c3-78e781c731df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "name": "network-vif-plugged", "status": "completed", "tag": "0836fd50-b884-4c2d-9c9c-b51445f7bd10"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:27.496363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-88fcf680-70a6-46b3-8840-d973e207c706 req-774839ae-d853-4586-b2c3-78e781c731df service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:27.497319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-88fcf680-70a6-46b3-8840-d973e207c706 req-774839ae-d853-4586-b2c3-78e781c731df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:27.497934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-88fcf680-70a6-46b3-8840-d973e207c706 req-774839ae-d853-4586-b2c3-78e781c731df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:27.536330 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-88fcf680-70a6-46b3-8840-d973e207c706 req-774839ae-d853-4586-b2c3-78e781c731df service nova] Creating event network-vif-plugged:0836fd50-b884-4c2d-9c9c-b51445f7bd10 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:27.555392 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-88fcf680-70a6-46b3-8840-d973e207c706 req-774839ae-d853-4586-b2c3-78e781c731df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130057 Oct 25 03:10:27.555718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1308/2427] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:27.569655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:27.577422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:27.587773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:27.588493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:27.589156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:27.590186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:27.590921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:27.591593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:27.696052 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23d233f0-e2f7-4ddd-9364-1860416954be tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.871081 Oct 25 03:10:27.696854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1120/2428] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:10:26 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:27.701935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:27.703167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:27.727017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:27.727530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:27.727983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:27.736864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:27.737457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:27.738068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:28.305164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:28.322204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-391b1e21-49da-4049-a8f7-8adc6eeb8cec tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.624016 Oct 25 03:10:28.364370 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1121/2429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:27 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:28.382681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:28.383643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:28.401780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:28.403198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:28.405274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:28.411373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:28.413162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:28.414488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:28.560169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:28.571074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-74156cf4-1628-4342-93f2-43ab572311a9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 1.004248 Oct 25 03:10:28.571679 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1309/2430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:27 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:28.842850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:28.866313 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-232cce57-f945-4ff0-a659-f86142711376 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1288 microversion: 2.1 time: 0.491544 Oct 25 03:10:28.867623 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1122/2431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:28 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1288 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:28.902191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:28.907525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:28.939419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:28.941898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:28.942601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:28.944310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:28.951276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:28.951951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:29.163897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3aac55e5-2ce6-4bfb-8e93-d6cc8cfccf36 tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Action: 'create', calling method: .version_select at 0x7efd334c8e50>, body: {"security_group": {"name": "tempest-securitygroup-1939055056", "description": "tempest-description-1044292392"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:29.292562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:29.304969 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66b0ed98-b616-4872-a3ec-40f70c8083f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1475 microversion: 2.1 time: 0.432648 Oct 25 03:10:29.306239 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1123/2432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:28 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1475 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:29.352388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:29.353311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:29.366419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:29.370181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:29.370653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:29.371428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:29.371912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:29.372350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.095382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:30.104879 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6467fd57-7e74-4ff9-a8aa-e65c073515b3 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1354 microversion: 2.1 time: 0.756321 Oct 25 03:10:30.105475 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1124/2433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:29 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1354 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:30.118154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:30.128298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:30.151107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.151633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.152081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.156344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.156889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.163066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.505098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:30.513860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f9685ea7-b2fd-46b9-ab09-a09d4d5e06bb tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 0.400527 Oct 25 03:10:30.518270 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1125/2434] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:30 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:30.525367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:30.536572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:30.549175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.551898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.553389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.554200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.554674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.555117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.638859 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-827d8446-4910-420e-b39e-8ac5c33a6ff7 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122855 Oct 25 03:10:30.639453 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1126/2435] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:10:30 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:30.644359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:30.645161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:30.661485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.661915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.662768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.663715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.664582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.665166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.866786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3aac55e5-2ce6-4bfb-8e93-d6cc8cfccf36 tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.284518 Oct 25 03:10:30.867454 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1310/2436] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:10:28 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:30.879342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:30.879962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:30.890249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.891393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.891833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.892723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.893182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.893607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.916758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:30.933280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:30.941753 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-65a83550-c8f7-4089-8a09-87868ed3effa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 0.300889 Oct 25 03:10:30.944788 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1127/2437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:30 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:30.962072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:30.962835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:30.977186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.977914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.978508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:30.979398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:30.982730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:30.983389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:31.070898 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-80264316-5bb6-4870-9454-e3a0f0c11b5d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/d74daf02-ed6e-4449-b299-1d2f1ab78054" status: 200 len: 194 microversion: 2.1 time: 0.122651 Oct 25 03:10:31.072009 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1128/2438] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Oct 25 03:10:30 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/d74daf02-ed6e-4449-b299-1d2f1ab78054 => generated 194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:31.077104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f93798ac-e0c1-4c74-bc26-8235a019827b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Action: 'create', calling method: .version_select at 0x7efd3351cdc0>, body: {"security_group": {"name": "tempest-securitygroup-32357260", "description": "tempest-description-996877666"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:31.342713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:31.374081 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-83c0f3d6-d831-4f90-9fe8-a891a6c7c124 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1475 microversion: 2.1 time: 0.505592 Oct 25 03:10:31.376515 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1311/2439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:30 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1475 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:31.385447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:31.385447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:31.396855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:31.397392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:31.398093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:31.399594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:31.402120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:31.402846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:31.759060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:31.768889 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b98bea73-cbf4-42ea-ada0-29a6fb2c8af2 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1805 microversion: 2.1 time: 0.391019 Oct 25 03:10:31.770098 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1312/2440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:31 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1805 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:31.775026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-95d6b917-6e1b-4fbc-b6b6-c7f355054105 req-92b0c252-fab6-45bb-9f1f-6df348860e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2467e455-696c-4a06-958f-b9b46c902f8a", "name": "network-vif-plugged", "status": "completed", "tag": "434346e1-ea1d-46f9-8cd4-72ee523a3300"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:31.787802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-95d6b917-6e1b-4fbc-b6b6-c7f355054105 req-92b0c252-fab6-45bb-9f1f-6df348860e4e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:31.788559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-95d6b917-6e1b-4fbc-b6b6-c7f355054105 req-92b0c252-fab6-45bb-9f1f-6df348860e4e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:31.789330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-95d6b917-6e1b-4fbc-b6b6-c7f355054105 req-92b0c252-fab6-45bb-9f1f-6df348860e4e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:31.804590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-95d6b917-6e1b-4fbc-b6b6-c7f355054105 req-92b0c252-fab6-45bb-9f1f-6df348860e4e service nova] Creating event network-vif-plugged:434346e1-ea1d-46f9-8cd4-72ee523a3300 for instance 2467e455-696c-4a06-958f-b9b46c902f8a on n-h2-862355-1 Oct 25 03:10:31.811382 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-95d6b917-6e1b-4fbc-b6b6-c7f355054105 req-92b0c252-fab6-45bb-9f1f-6df348860e4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039899 Oct 25 03:10:31.814196 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1313/2441] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:31.822675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:31.824120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:31.837452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:31.838282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:31.839313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:31.840779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:31.841467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:31.842305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:31.933804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f93798ac-e0c1-4c74-bc26-8235a019827b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.860431 Oct 25 03:10:31.934430 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1129/2442] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:10:31 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:31.942525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:31.945826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:31.960956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:31.963977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:31.964850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:31.966678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:31.968395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:31.969952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:32.035984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a186e87-545a-442f-a180-17978d3c4114 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b/ips" status: 200 len: 219 microversion: 2.1 time: 0.098795 Oct 25 03:10:32.036910 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1130/2443] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:10:31 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b/ips => generated 219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:32.050654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Calling method '.version_select at 0x7efd3363e430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:32.401577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:32.428781 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16c0aaf9-eeda-444d-a233-0a30924c2d22 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 0.611811 Oct 25 03:10:32.431381 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1314/2444] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:31 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:32.465469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:32.466146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:32.496676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:32.497353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:32.497846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:32.500692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:32.501171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:32.502672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:32.779352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:32.790356 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28e6d75a-9927-4473-8048-24f211972d8a tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 0.336924 Oct 25 03:10:32.791203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1315/2445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:32 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:32.797254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:32.798077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:32.811416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:32.812475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:32.813078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:32.814003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:32.815049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:32.815471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:32.850211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:10:32.958029 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9be636a-51d0-45ad-8d53-00410643cc8e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 204 len: 0 microversion: 2.1 time: 0.165024 Oct 25 03:10:32.961309 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1316/2446] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:32 2022] DELETE /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:10:32.967746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:32.970059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:32.977899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:32.979065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:32.979831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:32.981006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:32.981846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:32.982549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:33.191539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:33.201325 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c567b304-f703-4267-8a0f-612ce43a5ee3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1473 microversion: 2.1 time: 0.238366 Oct 25 03:10:33.214149 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1317/2447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:32 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1473 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:33.533965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1506255349", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "399e4372-9a26-4378-9554-8714a7affe92"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:33.639143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] validate_networks() for [('399e4372-9a26-4378-9554-8714a7affe92', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:34.163904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:34.165098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:34.165591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:34.166032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:34.166459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:34.178046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:34.179565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:34.182271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:34.183509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:34.184200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:34.184857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:34.208110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:34.215486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for user 256827a36f464fe1b535d91f95e48681 and project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:34.231994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:10:34.235226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:10:34.288543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d81bc78f-b877-4a1b-8c54-c6e3decccb48 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:10:34.289144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Neutron security group d81bc78f-b877-4a1b-8c54-c6e3decccb48 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:10:34.289635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.security_groups [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Security Group ID d81bc78f-b877-4a1b-8c54-c6e3decccb48 does not exist {{(pid=120563) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 25 03:10:34.301807 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e0bdb69-7821-4b17-88e6-0b406a546b51 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085162 Oct 25 03:10:34.302922 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1318/2448] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:10:34.309095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4a8c6f2c-9e73-4f41-82fc-4bf2cb408b0c req-244a2f2d-4cf3-422d-8221-d28bdf3fee75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac7e145-193f-49d5-9ed2-4d2e9dfe872d", "tag": "269541ed-ab70-4ba6-8732-faef12e01330"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:34.324600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a8c6f2c-9e73-4f41-82fc-4bf2cb408b0c req-244a2f2d-4cf3-422d-8221-d28bdf3fee75 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:34.325540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a8c6f2c-9e73-4f41-82fc-4bf2cb408b0c req-244a2f2d-4cf3-422d-8221-d28bdf3fee75 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:34.325668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d81bc78f-b877-4a1b-8c54-c6e3decccb48 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:10:34.326335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Neutron security group d81bc78f-b877-4a1b-8c54-c6e3decccb48 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:10:34.326785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.security_groups [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Security Group ID d81bc78f-b877-4a1b-8c54-c6e3decccb48 does not exist {{(pid=120563) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 25 03:10:34.327064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a8c6f2c-9e73-4f41-82fc-4bf2cb408b0c req-244a2f2d-4cf3-422d-8221-d28bdf3fee75 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:34.341071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4a8c6f2c-9e73-4f41-82fc-4bf2cb408b0c req-244a2f2d-4cf3-422d-8221-d28bdf3fee75 service nova] Creating event network-changed:269541ed-ab70-4ba6-8732-faef12e01330 for instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d on n-h2-862355-1 Oct 25 03:10:34.347786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4a8c6f2c-9e73-4f41-82fc-4bf2cb408b0c req-244a2f2d-4cf3-422d-8221-d28bdf3fee75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043360 Oct 25 03:10:34.348913 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1319/2449] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:34.355429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:34.364737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:34.371225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:34.371885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:34.372497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:34.373362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:34.373922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:34.375050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:35.341045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:35.352483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:35.364176 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d58af77-b679-4e4e-be5e-367a326aafe6 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1811 microversion: 2.1 time: 1.013858 Oct 25 03:10:35.365295 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1320/2450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:34 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1811 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:35.370368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:35.371167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:35.374322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=5 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:35.378370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:35.379334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:35.385636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:35.387104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:35.387863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:35.388589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:35.652215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:35.663990 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1209d87c-d40b-44e5-bbbc-d8c973e996b9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1324 microversion: 2.1 time: 0.297057 Oct 25 03:10:35.665035 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1321/2451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:35 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:35.674922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f5bade-5953-4344-bd72-f3f4bc39fb4c"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:35.685615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:35.704699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:35.708240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:35.708902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:35.710663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:35.713275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:35.714634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.235333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa4cd97a-7b98-4969-b36e-ed40e3562da6 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "POST /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568413 Oct 25 03:10:36.239103 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1322/2452] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:10:35 2022] POST /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments => generated 194 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:36.252219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:36.253000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:36.273434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.273993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.274434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.275458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.277392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.279306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.604961 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1979f85c-82ff-4b0a-bc67-eba7f093ff4b tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11158 microversion: 2.1 time: 4.566649 Oct 25 03:10:36.618949 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1131/2453] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 25 03:10:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11158 bytes in 4581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:10:36.633725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:36.634622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:36.652771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.653510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.654188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.655652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.656495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.657172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.723402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:36.734551 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f903055-977d-47ce-9e17-e406ee39f503 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 0.493917 Oct 25 03:10:36.736101 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1323/2454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:36 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:36.741913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:36.742562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:36.762926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.764565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.766931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.769344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.772560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.773336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.889756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:36.900881 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bda05417-54ec-4779-9c23-532fb8c17dc4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1275 microversion: 2.1 time: 0.163530 Oct 25 03:10:36.923132 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1324/2455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:36 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:36.935862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:36.937608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:36.949195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.951800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.955500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:36.956402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:36.957765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:36.958730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:37.281563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:37.290052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-97ea940f-0f73-42bc-985d-cb02883bc93b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1790 microversion: 2.1 time: 0.365351 Oct 25 03:10:37.290645 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1325/2456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:36 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1790 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:37.301356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-edc830e6-ef61-4ca2-a6eb-2065be10a11b req-9bd692c8-9dcf-4431-8881-2b6aaaca0bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "name": "network-vif-deleted", "tag": "0836fd50-b884-4c2d-9c9c-b51445f7bd10"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:37.316054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-edc830e6-ef61-4ca2-a6eb-2065be10a11b req-9bd692c8-9dcf-4431-8881-2b6aaaca0bb7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:37.316781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-edc830e6-ef61-4ca2-a6eb-2065be10a11b req-9bd692c8-9dcf-4431-8881-2b6aaaca0bb7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:37.317463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-edc830e6-ef61-4ca2-a6eb-2065be10a11b req-9bd692c8-9dcf-4431-8881-2b6aaaca0bb7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:37.332881 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-edc830e6-ef61-4ca2-a6eb-2065be10a11b req-9bd692c8-9dcf-4431-8881-2b6aaaca0bb7 service nova] Creating event network-vif-deleted:0836fd50-b884-4c2d-9c9c-b51445f7bd10 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:37.340478 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-edc830e6-ef61-4ca2-a6eb-2065be10a11b req-9bd692c8-9dcf-4431-8881-2b6aaaca0bb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047350 Oct 25 03:10:37.341770 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1326/2457] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:37.349539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7386a366-d0ff-4bbd-9387-e91485a851c8 tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] Calling method '.version_select at 0x7efd338cfd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:37.679422 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7386a366-d0ff-4bbd-9387-e91485a851c8 tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.335428 Oct 25 03:10:37.680026 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1327/2458] 10.222.0.36 () {58 vars in 1191 bytes} [Tue Oct 25 03:10:37 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:37.687718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:37.688296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:37.708501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:37.709124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:37.709585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:37.710397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:37.710798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:37.711263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:37.738684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:37.887160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:37.897825 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91f91c7e-8c32-46ff-bd90-e1acecdd74b8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1521 microversion: 2.1 time: 0.216678 Oct 25 03:10:37.900626 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1328/2459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:37 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:37.924977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cfc65921-6185-4e5c-990f-ba534fe9e5be tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Calling method '.version_select at 0x7efd3b881700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:37.939291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:37.957334 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e69b0dff-ccf5-4660-923d-038017a60a30 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1470 microversion: 2.1 time: 1.336364 Oct 25 03:10:37.958609 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1132/2460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:36 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1470 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:37.975126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:37.976682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:38.016377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.016879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.017313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.021476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.021978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.022573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.027173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:38.182627 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cfc65921-6185-4e5c-990f-ba534fe9e5be tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/29ae22b0-ab20-4166-9291-ce48ba79a778" status: 202 len: 0 microversion: 2.1 time: 0.280395 Oct 25 03:10:38.183602 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1329/2461] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:10:37 2022] DELETE /compute/v2.1/os-security-groups/29ae22b0-ab20-4166-9291-ce48ba79a778 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:10:38.191021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:38.191928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:38.214957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.216548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.217203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.219620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.221435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.222506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.372816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:38.387203 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-089f5cee-fb9e-4afd-b334-8dfed23b136a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1273 microversion: 2.1 time: 0.202343 Oct 25 03:10:38.388332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1330/2462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:38 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:38.394638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:38.395134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:38.402194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.402894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.403486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.404368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.407016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.408207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.459798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:10:38.466725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:38.482356 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e18f8324-61d7-4288-ba3c-911ff5d93ecb tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 0.522005 Oct 25 03:10:38.483614 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1133/2463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:37 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:38.495371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-be61cd52-c8d2-4fa6-9e28-066deaf54783 req-8434ce26-9568-46a7-ad32-f5941cc743c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb018e4-b858-42fa-9832-79fbfe052184", "name": "network-vif-plugged", "status": "completed", "tag": "69d5e780-5c64-43de-bb3f-d32a4862274d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:38.522781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be61cd52-c8d2-4fa6-9e28-066deaf54783 req-8434ce26-9568-46a7-ad32-f5941cc743c5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.523322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be61cd52-c8d2-4fa6-9e28-066deaf54783 req-8434ce26-9568-46a7-ad32-f5941cc743c5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.523676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be61cd52-c8d2-4fa6-9e28-066deaf54783 req-8434ce26-9568-46a7-ad32-f5941cc743c5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.561974 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-be61cd52-c8d2-4fa6-9e28-066deaf54783 req-8434ce26-9568-46a7-ad32-f5941cc743c5 service nova] Creating event network-vif-plugged:69d5e780-5c64-43de-bb3f-d32a4862274d for instance 2eb018e4-b858-42fa-9832-79fbfe052184 on n-h2-862355-1 Oct 25 03:10:38.573482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-be61cd52-c8d2-4fa6-9e28-066deaf54783 req-8434ce26-9568-46a7-ad32-f5941cc743c5 service nova] Instance 2eb018e4-b858-42fa-9832-79fbfe052184 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:10:38.609719 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-be61cd52-c8d2-4fa6-9e28-066deaf54783 req-8434ce26-9568-46a7-ad32-f5941cc743c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122025 Oct 25 03:10:38.610570 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1134/2464] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:38.619294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:38.621999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:38.627276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3aa2fc8a-6849-4017-a6b3-9159de81c3e9 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 204 len: 0 microversion: 2.1 time: 0.237414 Oct 25 03:10:38.628495 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1331/2465] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:38 2022] DELETE /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:10:38.633659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5decfedd-4091-4ce4-9d58-db73f4eaa57a tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] Calling method '.version_select at 0x7efd33602430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:38.635820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.636736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.637577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.638772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.640208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.640951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.726804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5d4b3c6-ede4-4ef9-83d5-0033ec175096 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184/action" status: 204 len: 0 microversion: 2.1 time: 0.112825 Oct 25 03:10:38.727302 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1135/2466] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:10:38 2022] POST /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184/action => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:10:38.749054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:38.754551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:38.779525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:38.783142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.784370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.785178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:38.786176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:38.788769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:38.789410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:39.067563 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5decfedd-4091-4ce4-9d58-db73f4eaa57a tempest-SecurityGroupsTestAdminJSON-1426556021 tempest-SecurityGroupsTestAdminJSON-1426556021-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/a6e6eb49-cbe0-44bd-8a3b-62091203a9d5" status: 202 len: 0 microversion: 2.1 time: 0.437650 Oct 25 03:10:39.071549 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1332/2467] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:10:38 2022] DELETE /compute/v2.1/os-security-groups/a6e6eb49-cbe0-44bd-8a3b-62091203a9d5 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:10:39.077549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:39.078518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:39.093292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:39.094357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:39.095588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:39.097175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:39.099669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:39.100305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:39.311563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:39.332492 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3123988b-44c5-4dd9-b287-58a6407b7b4f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1611 microversion: 2.1 time: 0.593129 Oct 25 03:10:39.334644 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1136/2468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:38 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1611 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:39.359815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:39.362638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:39.379060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:39.381826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:39.394718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:39.395696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:39.397216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:39.398907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:39.403533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:39.420324 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c19d51c-5dd2-43bf-a02c-ffc645e731ee tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1527 microversion: 2.1 time: 0.341182 Oct 25 03:10:39.422402 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1333/2469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:39 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1527 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:39.438798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f773378-b13b-4b81-8c80-8192d4d4415e tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] Calling method '.version_select at 0x7efd336100d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:40.089632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:40.117980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f7cff38c-ef5d-4a6a-99e4-65080cde0e7b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1470 microversion: 2.1 time: 0.771502 Oct 25 03:10:40.122995 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1137/2470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:39 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1470 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:40.140696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-22d7383a-e668-4e8a-b74a-13e3eeae57b2 req-fa0f8e15-34b5-4c84-8a25-46c4dcb87a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "name": "network-vif-deleted", "tag": "0232ca20-0d23-4464-8c4d-545c39ddcd80"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:40.154192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-22d7383a-e668-4e8a-b74a-13e3eeae57b2 req-fa0f8e15-34b5-4c84-8a25-46c4dcb87a9b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.155746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-22d7383a-e668-4e8a-b74a-13e3eeae57b2 req-fa0f8e15-34b5-4c84-8a25-46c4dcb87a9b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.156542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-22d7383a-e668-4e8a-b74a-13e3eeae57b2 req-fa0f8e15-34b5-4c84-8a25-46c4dcb87a9b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.171990 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-22d7383a-e668-4e8a-b74a-13e3eeae57b2 req-fa0f8e15-34b5-4c84-8a25-46c4dcb87a9b service nova] Creating event network-vif-deleted:0232ca20-0d23-4464-8c4d-545c39ddcd80 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:40.191624 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-22d7383a-e668-4e8a-b74a-13e3eeae57b2 req-fa0f8e15-34b5-4c84-8a25-46c4dcb87a9b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065214 Oct 25 03:10:40.194045 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1138/2471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:40.202794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:40.204016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:40.223182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.224225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.224918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.225896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.227319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.227989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.446045 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f773378-b13b-4b81-8c80-8192d4d4415e tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/3538db5e-131f-419e-a0c0-df4527f8479c" status: 202 len: 0 microversion: 2.1 time: 1.019288 Oct 25 03:10:40.446856 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1334/2472] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:10:39 2022] DELETE /compute/v2.1/os-security-groups/3538db5e-131f-419e-a0c0-df4527f8479c => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:10:40.453308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:40.454054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:40.463182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.464269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.485484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:40.489873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.494718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.495405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.496008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.499367 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82e057df-b3bb-41c7-ba2e-dba4b37ed48b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.303804 Oct 25 03:10:40.501976 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1139/2473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:40 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:40.516013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:40.521827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:40.534700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.537252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.537788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.539180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.539845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.540456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.583272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.583979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.584567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.585171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lazy-loading 'fault' on Instance uuid ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:10:40.699441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:40.713619 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f91e04b3-502c-4471-9e0a-357439593097 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 200 len: 1302 microversion: 2.1 time: 0.209306 Oct 25 03:10:40.714853 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1140/2474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:40 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 1302 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:40.734511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:40.736211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:40.744885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.745488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.746593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.747731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:40.748854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:40.749486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:40.871870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:40.883191 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-303a861c-c3e6-4767-bbd5-3fbdf4fca9a5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 0.435484 Oct 25 03:10:40.884511 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1335/2475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:40 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:40.891975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12e49a54-e1a1-4664-8eee-9e929752fd73 tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] Calling method '.version_select at 0x7efd3b881160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:41.070523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:41.089083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce6c885d-25e9-4032-aacf-4186c3e5f532 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1527 microversion: 2.1 time: 0.371799 Oct 25 03:10:41.089670 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1141/2476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:40 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1527 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:41.151324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:41.152345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:41.163712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.164221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.166082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.166850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.178581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.179048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.222214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12e49a54-e1a1-4664-8eee-9e929752fd73 tempest-SecurityGroupsTestAdminJSON-164702752 tempest-SecurityGroupsTestAdminJSON-164702752-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/0162e417-2272-4187-a15b-eb9cae2dbda8" status: 202 len: 0 microversion: 2.1 time: 0.336026 Oct 25 03:10:41.223181 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1336/2477] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:10:40 2022] DELETE /compute/v2.1/os-security-groups/0162e417-2272-4187-a15b-eb9cae2dbda8 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:10:41.525367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:41.526403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:41.541261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.544003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.544729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.548751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.549936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.550918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.687349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:41.700878 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87260f00-38e0-4bc4-a68e-5cc60f8a3325 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1470 microversion: 2.1 time: 0.555071 Oct 25 03:10:41.706781 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1142/2478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:41 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1470 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:41.739381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:41.740010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:41.747184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.750319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.750967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.752190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.754195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.755467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.788316 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] HTTP exception thrown: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Request method failure captured: Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b HTTP/1.1 Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NxE29fE6PrxVpTA3HZGEG3XDX2OcdgGdkoV2IW7Ae3m31NJX9vpRYmanM9bEPkn8Y7751vVuPC-Lr1kalGNj5E3-qMiwyTwUwi-O4enAXu9xxU0SZVRCT22P8jAfTGWOfVyme6fsU3ppLkeYLUjPa3sQFbud9KNvNX8AnWMlHFvCg Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:41.801446 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ee4fd42dd0b405f9549e74a07fe340b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ee4fd42dd0b405f9549e74a07fe340b"}]}] Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestMultiNic-795862197 Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestMultiNic-795862197-project Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ab41f1b82ab9460e8127e95241317f05 Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestMultiNic-795862197-project Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:10:41.803230 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b'} Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:41.804160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:10:41.805570 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:41.806925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Returning 404 to user: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:41.806925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aceeb7ed-edf0-4cb1-9af3-21cd136833f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 404 len: 111 microversion: 2.1 time: 0.067599 Oct 25 03:10:41.810045 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1143/2479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:41 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:10:41.910339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:41.910996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:41.927583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.928278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.928886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.929982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:41.930589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:41.931353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:41.942300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:41.961976 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d50ed0a3-7182-42c9-b058-5d3ae64a0727 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.440963 Oct 25 03:10:41.962703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1337/2480] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:41 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:42.117383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:42.118145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:42.127496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:42.128221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:42.129027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:42.130031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:42.130715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:42.131369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:42.299547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:42.308627 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c3a01c68-c94a-4690-93a8-458022de278c tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1527 microversion: 2.1 time: 0.195284 Oct 25 03:10:42.310083 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1338/2481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:42 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1527 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:42.380894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3ac04529-4fc1-4636-813a-dbb4997b9f58 req-ce115880-bf6c-4cd9-b770-e9c5838d620f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b", "name": "network-vif-deleted", "tag": "3d4edfcd-b145-4c14-8c8e-f420fb660fb8"}, {"name": "network-changed", "server_uuid": "ff95e7f4-4239-4203-ae0b-70a238e45398", "tag": "68b7272b-d333-46ca-84b2-7051e1a0ea06"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:42.398398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3ac04529-4fc1-4636-813a-dbb4997b9f58 req-ce115880-bf6c-4cd9-b770-e9c5838d620f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:42.398930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3ac04529-4fc1-4636-813a-dbb4997b9f58 req-ce115880-bf6c-4cd9-b770-e9c5838d620f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:42.399297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3ac04529-4fc1-4636-813a-dbb4997b9f58 req-ce115880-bf6c-4cd9-b770-e9c5838d620f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:42.429556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3ac04529-4fc1-4636-813a-dbb4997b9f58 req-ce115880-bf6c-4cd9-b770-e9c5838d620f service nova] Creating event network-vif-deleted:3d4edfcd-b145-4c14-8c8e-f420fb660fb8 for instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b on n-h1-862355-1 Oct 25 03:10:42.430107 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3ac04529-4fc1-4636-813a-dbb4997b9f58 req-ce115880-bf6c-4cd9-b770-e9c5838d620f service nova] Creating event network-changed:68b7272b-d333-46ca-84b2-7051e1a0ea06 for instance ff95e7f4-4239-4203-ae0b-70a238e45398 on n-h1-862355-1 Oct 25 03:10:42.446787 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3ac04529-4fc1-4636-813a-dbb4997b9f58 req-ce115880-bf6c-4cd9-b770-e9c5838d620f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070309 Oct 25 03:10:42.447517 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1339/2482] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:42.734582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:42.736268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:42.746936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:42.748918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:42.750452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:42.751759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:42.752524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:42.753162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:42.929349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:42.941500 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a31e70af-2004-4e1e-959f-1be82857bfec tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 1.035338 Oct 25 03:10:42.942347 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1144/2483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:41 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:42.992956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:42.993617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:43.009302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:43.009957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:43.010414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:43.011126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:43.011750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:43.012315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:43.022392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:43.033489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6e5e3ed-2aec-4aea-8ae8-eacaf9324869 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1462 microversion: 2.1 time: 0.304727 Oct 25 03:10:43.035307 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1340/2484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:42 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1462 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:43.059507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:43.061516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:43.069548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:43.070435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:43.072330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:43.073633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:43.074253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:43.074844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:43.331236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9d968925-71f9-48e7-9b7d-f787c57e5af7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1613 microversion: 2.1 time: 0.276837 Oct 25 03:10:43.345727 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1341/2485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:43 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1613 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:43.359933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:43.360641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:43.378252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:43.383266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:43.386654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:43.387544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:43.391898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:43.393287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:43.524052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:43.532977 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f575f91-a047-4ab2-bb72-6a037a8a40eb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.544260 Oct 25 03:10:43.542261 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1145/2486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:42 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:43.548328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-751edf21-1d5c-4428-80a4-613fb323a3ff tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '.version_select at 0x7efd33413f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:43.551899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751edf21-1d5c-4428-80a4-613fb323a3ff tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:43.552384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751edf21-1d5c-4428-80a4-613fb323a3ff tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:43.552858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751edf21-1d5c-4428-80a4-613fb323a3ff tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:43.573216 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-751edf21-1d5c-4428-80a4-613fb323a3ff tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.029414 Oct 25 03:10:43.576927 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1146/2487] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:10:43 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:43.727797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:43.741396 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b733e544-81cb-4e8b-bf49-db7be4608613 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1527 microversion: 2.1 time: 0.405408 Oct 25 03:10:43.743545 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1342/2488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:43 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1527 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:43.823853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1460401551", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:43.916622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:43.971042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:43.971968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:43.999172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.001279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.004954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.007726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.010639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.012649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.197983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:44.225015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:44.557791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:44.558885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:44.559565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:44.560827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:44.561400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:44.580024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.580521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.596623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.598716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:44.614247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.614667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.616537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.618701 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3a542926-5846-4f02-bcd6-dcb359f81eca tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 0.653672 Oct 25 03:10:44.627986 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1343/2489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:43 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:44.642417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-322fc005-a90e-478f-acc4-d7d6cae8a7a3 req-973982f6-f4eb-4aa3-a60b-5d1e7da7f6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac7e145-193f-49d5-9ed2-4d2e9dfe872d", "name": "network-vif-plugged", "status": "completed", "tag": "269541ed-ab70-4ba6-8732-faef12e01330"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:44.676547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:44.679776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-322fc005-a90e-478f-acc4-d7d6cae8a7a3 req-973982f6-f4eb-4aa3-a60b-5d1e7da7f6e6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.684207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-322fc005-a90e-478f-acc4-d7d6cae8a7a3 req-973982f6-f4eb-4aa3-a60b-5d1e7da7f6e6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.684907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-322fc005-a90e-478f-acc4-d7d6cae8a7a3 req-973982f6-f4eb-4aa3-a60b-5d1e7da7f6e6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.691943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:44.720154 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-322fc005-a90e-478f-acc4-d7d6cae8a7a3 req-973982f6-f4eb-4aa3-a60b-5d1e7da7f6e6 service nova] Creating event network-vif-plugged:269541ed-ab70-4ba6-8732-faef12e01330 for instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d on n-h2-862355-1 Oct 25 03:10:44.728166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for user a205c6ef239c44e8b2768df15ea8d943 and project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:44.740414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-322fc005-a90e-478f-acc4-d7d6cae8a7a3 req-973982f6-f4eb-4aa3-a60b-5d1e7da7f6e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108179 Oct 25 03:10:44.742799 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1344/2490] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:44.757541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-223cd5eb-d6bb-4f8e-b7e8-bb1ffd92d511 req-fd900cf1-0030-44bc-bb2e-f2a4e2e7c649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2467e455-696c-4a06-958f-b9b46c902f8a", "name": "network-vif-deleted", "tag": "434346e1-ea1d-46f9-8cd4-72ee523a3300"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:44.776949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-223cd5eb-d6bb-4f8e-b7e8-bb1ffd92d511 req-fd900cf1-0030-44bc-bb2e-f2a4e2e7c649 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.777626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-223cd5eb-d6bb-4f8e-b7e8-bb1ffd92d511 req-fd900cf1-0030-44bc-bb2e-f2a4e2e7c649 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.778256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-223cd5eb-d6bb-4f8e-b7e8-bb1ffd92d511 req-fd900cf1-0030-44bc-bb2e-f2a4e2e7c649 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.783296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:10:44.785759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:10:44.796094 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-223cd5eb-d6bb-4f8e-b7e8-bb1ffd92d511 req-fd900cf1-0030-44bc-bb2e-f2a4e2e7c649 service nova] Creating event network-vif-deleted:434346e1-ea1d-46f9-8cd4-72ee523a3300 for instance 2467e455-696c-4a06-958f-b9b46c902f8a on n-h2-862355-1 Oct 25 03:10:44.802536 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-223cd5eb-d6bb-4f8e-b7e8-bb1ffd92d511 req-fd900cf1-0030-44bc-bb2e-f2a4e2e7c649 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054907 Oct 25 03:10:44.803345 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1345/2491] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:44.830955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:44.830955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:44.839901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.840839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.842688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.843711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.844559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.845226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.910603 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f4c15fa5-f8e8-4fd0-a5d7-f855b0fa1709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.090593 Oct 25 03:10:44.911267 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1147/2492] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:10:44.922372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:44.926576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:44.933798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.934733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.935961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:44.937158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:44.937833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:44.938425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:45.157162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:45.164700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:45.166458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:45.166915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:45.167384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lazy-loading 'fault' on Instance uuid 2467e455-696c-4a06-958f-b9b46c902f8a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:10:45.184224 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f29c400a-1dee-46ea-b96d-6be8b1b02061 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.375030 Oct 25 03:10:45.185855 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1346/2493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:44 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:45.202103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ba34c69-ff78-4e00-9c83-ec96da751ae6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:45.203019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ba34c69-ff78-4e00-9c83-ec96da751ae6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:45.366899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b6e776ceef40e5a979f3ed63f7cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40282bec7bb43e49e8015cde76e5a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:45.384099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4ba34c69-ff78-4e00-9c83-ec96da751ae6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:45.394217 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba509012-da25-4a2b-81ca-ebb6bcb75e05 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 200 len: 1314 microversion: 2.1 time: 0.470081 Oct 25 03:10:45.396718 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1148/2494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:44 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:45.422469 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ba34c69-ff78-4e00-9c83-ec96da751ae6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1213 microversion: 2.1 time: 0.235110 Oct 25 03:10:45.443226 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1347/2495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:45 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1213 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:45.652855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:45.653397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:45.660734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:45.670207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:45.671021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:45.671772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:45.672261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:45.672703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:45.963845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:45.978795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8092aea6-ab72-478b-a6b1-229813bca534 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1328 microversion: 2.1 time: 0.330353 Oct 25 03:10:45.993503 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1149/2496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:45 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:46.214953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:46.218871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:46.234078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.236457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.238193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.241232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.241960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.242602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.423126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:46.424115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 2467e455-696c-4a06-958f-b9b46c902f8a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:46.440758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.445251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.446041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.447943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.451144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.454485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.458381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:46.475134 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-15045912-562f-4a65-b676-20ecef3f80fd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.266450 Oct 25 03:10:46.476368 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1348/2497] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:46 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:46.497971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:46.501228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:46.514417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.514916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.515352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.515637 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Instance 2467e455-696c-4a06-958f-b9b46c902f8a could not be found. Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a HTTP/1.1 Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:46.517453 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 2467e455-696c-4a06-958f-b9b46c902f8a could not be found. Oct 25 03:10:46.518673 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '2467e455-696c-4a06-958f-b9b46c902f8a'} Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2467e455-696c-4a06-958f-b9b46c902f8a could not be found. Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:46.519366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2467e455-696c-4a06-958f-b9b46c902f8a could not be found. Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2467e455-696c-4a06-958f-b9b46c902f8a could not be found. Oct 25 03:10:46.520433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.522785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.522785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.522785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.525130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Instance 2467e455-696c-4a06-958f-b9b46c902f8a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:46.527876 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3843b06a-66a2-447a-a6bb-e16ef32f8c0f tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a" status: 404 len: 111 microversion: 2.1 time: 0.109030 Oct 25 03:10:46.534561 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1150/2498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:46 2022] GET /compute/v2.1/servers/2467e455-696c-4a06-958f-b9b46c902f8a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:10:46.539543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41bbda10-c2b5-464b-82de-7b47fb601cb7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '.version_select at 0x7efd33f64820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:46.593836 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-41bbda10-c2b5-464b-82de-7b47fb601cb7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Image not found. Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41bbda10-c2b5-464b-82de-7b47fb601cb7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f HTTP/1.1 Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:46.595578 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f'} Oct 25 03:10:46.596796 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f to delete Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.597653 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f could not be found. Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:46.598801 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41bbda10-c2b5-464b-82de-7b47fb601cb7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:46.599919 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41bbda10-c2b5-464b-82de-7b47fb601cb7 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f" status: 404 len: 62 microversion: 2.1 time: 0.061224 Oct 25 03:10:46.601207 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1151/2499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:46 2022] DELETE /compute/v2.1/images/a3a7476f-6cd4-42ae-91ce-c55e6ff47a2f => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:10:46.606537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:46.607916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:46.616297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.617063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.617854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.618736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.619337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.619911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.659116 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb HTTP/1.1 Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:46.662293 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.663581 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '91e615f5-3bb8-4978-ac78-86989bd3f2fb'} Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:46.664275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.665430 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.668637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:46.670367 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9568f5f-49bd-4c05-8e21-c6238c83fa3d tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 404 len: 111 microversion: 2.1 time: 0.067618 Oct 25 03:10:46.671224 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1152/2500] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:46 2022] DELETE /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:46.681306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:46.683289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:46.685640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: 91e615f5-3bb8-4978-ac78-86989bd3f2fb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:46.698766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03b9f60a-9d6d-452d-8401-13e33373461e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1209 microversion: 2.1 time: 0.219323 Oct 25 03:10:46.699430 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1349/2501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:46 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1209 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:46.709569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.710211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.710759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.711538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:46.712060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:46.712598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:46.738490 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb HTTP/1.1 Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:46.740418 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.742003 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '91e615f5-3bb8-4978-ac78-86989bd3f2fb'} Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:46.742827 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. Oct 25 03:10:46.744256 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:46.745462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Instance 91e615f5-3bb8-4978-ac78-86989bd3f2fb could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:46.745462 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b50ebf7c-e71a-49b7-abf9-e7a1269368ac tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb" status: 404 len: 111 microversion: 2.1 time: 0.065844 Oct 25 03:10:46.746173 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1153/2502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:46 2022] GET /compute/v2.1/servers/91e615f5-3bb8-4978-ac78-86989bd3f2fb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:46.754704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fbc2032-155a-4c68-84ff-75488fce73fc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '.version_select at 0x7efd33736ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:46.803439 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fbc2032-155a-4c68-84ff-75488fce73fc tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227833742" status: 202 len: 0 microversion: 2.1 time: 0.052269 Oct 25 03:10:46.804454 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1350/2503] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227833742 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:10:47.004554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:47.005171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:47.011248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.012051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.013426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:47.014720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.015468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.016163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:47.019610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:47.423852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:47.442935 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57299a06-b3a2-4df3-8d82-84e439baa36e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1529 microversion: 2.1 time: 0.439943 Oct 25 03:10:47.444378 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1154/2504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:46 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1529 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:47.474014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:47.475644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:47.492003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.493470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.501245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:47.502389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:47.507701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:47.509532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.511964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.512563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:47.513864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.519125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.519810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:47.525978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.526788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.527582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:47.552966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:47.902182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:47.918757 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3accee5f-2454-4a89-8ba1-6dfdbd7d2f0e tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1529 microversion: 2.1 time: 0.450882 Oct 25 03:10:47.920202 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1351/2505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:47 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1529 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:47.936785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:47.937735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:47.948948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.949774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.951683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:47.952668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:47.953779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:47.954380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:48.074238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:48.092550 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-832722ce-a8b5-4a91-a32d-02f28a66ef8e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1271 microversion: 2.1 time: 0.168030 Oct 25 03:10:48.094897 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1352/2506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:47 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:48.360696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:48.378642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6be4bc4b-b26e-4c56-84fe-54e3d31e54f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.879566 Oct 25 03:10:48.379535 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1155/2507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:47 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:48.526481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:48.528196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:48.540116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:48.540960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:48.541630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:48.542628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:48.543419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:48.544940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:48.572052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] HTTP exception thrown: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Request method failure captured: Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d HTTP/1.1 Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OeHbTUv2qe32ai23SWIAGnG2NNUnRWv3qxvSCMMes2eXp3dCVBXh50zJ2IFTPOzBlEYr4YtHL689VxScfltF9c8cWgJlf2eTdEpgEEmkjoFy-TNO6rLaH-s9vkGRUCKgs45BCQ6rfPApQCThMMuLGcr_WlfjJHk37DgKvYvEqs-JY Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 7a86b69b6636432794c410e98560ebab Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-51565224 Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:48.574933 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a86b69b6636432794c410e98560ebab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a86b69b6636432794c410e98560ebab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a86b69b6636432794c410e98560ebab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a86b69b6636432794c410e98560ebab"}]}] Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-51565224 Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 7a86b69b6636432794c410e98560ebab Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-51565224 Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestMultiTenantJSON-51565224-project Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 103a57f7099442ddbf93ec026a756e31 Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-51565224-project Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:48.577002 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8ac7e145-193f-49d5-9ed2-4d2e9dfe872d'} Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:48.577909 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:48.579402 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:48.582871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Returning 404 to user: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:48.585901 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a30ceeb6-af4d-49e0-9393-67db33532c1c tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 404 len: 111 microversion: 2.1 time: 0.487658 Oct 25 03:10:48.587098 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1353/2508] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:48 2022] DELETE /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 111 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:48.597048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:48.597746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:48.606002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:48.606497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:48.606932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:48.608274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:48.609296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:48.609948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.026100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:49.047593 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7690cd0a-ad3b-4c19-8ca7-9a8533754efa tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1529 microversion: 2.1 time: 0.454567 Oct 25 03:10:49.048206 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1156/2509] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:48 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1529 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:49.070813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Action: 'update', calling method: >, body: {"server": {"name": "8ac7e145-193f-49d5-9ed2-4d2e9dfe872d_new"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:49.073418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:49.080694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.081450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.082105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.082975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.083580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.084159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.100608 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] HTTP exception thrown: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Request method failure captured: Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d HTTP/1.1 Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 64 Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OeHbTUv2qe32ai23SWIAGnG2NNUnRWv3qxvSCMMes2eXp3dCVBXh50zJ2IFTPOzBlEYr4YtHL689VxScfltF9c8cWgJlf2eTdEpgEEmkjoFy-TNO6rLaH-s9vkGRUCKgs45BCQ6rfPApQCThMMuLGcr_WlfjJHk37DgKvYvEqs-JY Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 7a86b69b6636432794c410e98560ebab Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-51565224 Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:49.102485 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a86b69b6636432794c410e98560ebab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7a86b69b6636432794c410e98560ebab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7a86b69b6636432794c410e98560ebab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7a86b69b6636432794c410e98560ebab"}]}] Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-51565224 Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 7a86b69b6636432794c410e98560ebab Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-51565224 Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestMultiTenantJSON-51565224-project Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 103a57f7099442ddbf93ec026a756e31 Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-51565224-project Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "8ac7e145-193f-49d5-9ed2-4d2e9dfe872d_new"}} Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:49.103913 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8ac7e145-193f-49d5-9ed2-4d2e9dfe872d', 'body': {'server': {'name': '8ac7e145-193f-49d5-9ed2-4d2e9dfe872d_new'}}} Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:49.104832 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:49.106368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:49.107700 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:49.107700 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:49.107700 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:49.107700 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:49.107700 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:49.107700 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:49.108952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] Returning 404 to user: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:49.110052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22d23987-2e32-46c3-b61f-e25a38ed0942 tempest-ServersNegativeTestMultiTenantJSON-51565224 tempest-ServersNegativeTestMultiTenantJSON-51565224-project] 10.222.0.36 "PUT /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 404 len: 111 microversion: 2.1 time: 0.043241 Oct 25 03:10:49.111115 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1354/2510] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:10:49 2022] PUT /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:49.116460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:49.117282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:49.127296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.127797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.131136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.132028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.132624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.133060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.133813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:49.134563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:49.145322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.146950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.147669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.153096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.154302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.155159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.210741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:10:49.311446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:49.320567 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5ac1f70-8607-4ad6-8e65-e1ec7f18d7f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1271 microversion: 2.1 time: 0.207810 Oct 25 03:10:49.338962 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1157/2511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:49 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:49.352986 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-711e8eb1-9952-415f-b4a4-853fe0fdf02d tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 204 len: 0 microversion: 2.1 time: 0.231484 Oct 25 03:10:49.353905 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1355/2512] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:49 2022] DELETE /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:10:49.363963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:49.365302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:49.373996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.375210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.375896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.377340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.378030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.378654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.408895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:49.409653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:49.421631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.422161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.426145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.427052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:49.428568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:49.430808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:49.816538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:49.851249 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70602caf-d7c7-4e38-b062-9fe2ba1df92e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.447926 Oct 25 03:10:49.872873 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1356/2513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:49 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:49.953502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:49.966774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e5d6df3-e63f-4532-b2c5-0838018105c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '.version_select at 0x7efd3b890940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:50.012320 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34600091-bae3-4d44-a14e-7bf36f5486f9 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1535 microversion: 2.1 time: 0.636944 Oct 25 03:10:50.015766 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1158/2514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:49 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1535 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:50.029823 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5e5d6df3-e63f-4532-b2c5-0838018105c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Image not found. Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e5d6df3-e63f-4532-b2c5-0838018105c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/images/26430b1e-bf14-477e-ae08-831b3d123b9c HTTP/1.1 Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:50.033360 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '26430b1e-bf14-477e-ae08-831b3d123b9c'} Oct 25 03:10:50.035153 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 26430b1e-bf14-477e-ae08-831b3d123b9c to delete Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:50.035911 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26430b1e-bf14-477e-ae08-831b3d123b9c could not be found. Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:50.036983 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:10:50.038157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.041836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e5d6df3-e63f-4532-b2c5-0838018105c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:50.044915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e5d6df3-e63f-4532-b2c5-0838018105c8 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/images/26430b1e-bf14-477e-ae08-831b3d123b9c" status: 404 len: 62 microversion: 2.1 time: 0.084149 Oct 25 03:10:50.045713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1357/2515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:49 2022] DELETE /compute/v2.1/images/26430b1e-bf14-477e-ae08-831b3d123b9c => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:10:50.056280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:50.057105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:50.074584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.075124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.075576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.076307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.076780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.077211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.099460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a HTTP/1.1 Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:50.116613 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.118860 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a'} Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:50.119528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.120642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.123685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:50.128052 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-76080d21-ef0b-41a8-8178-ed7ef214b9f2 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 404 len: 111 microversion: 2.1 time: 0.075912 Oct 25 03:10:50.130782 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1159/2516] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:50 2022] DELETE /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:50.138836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:50.139560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] [instance: e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:50.166389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.167634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.173193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.174921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.175680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.176361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.198979 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] HTTP exception thrown: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Request method failure captured: Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a HTTP/1.1 Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Mzd5VwMHGjM7mFiISl6lvzC5x0Ym706leCtJphAff8QW0XcZj3zxrfydd-USFoylyb2IJU0jhrRTBOWYe2_v3eJMzYnidoU8SLOySbLUDRvgdTx9MJePkRrNA83zFUGf4WLd8NKKaiXoFyE1sVptxkTJJYn7kDDYRN7YFzR51DW5M Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:50.201540 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f40282bec7bb43e49e8015cde76e5a19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f40282bec7bb43e49e8015cde76e5a19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f40282bec7bb43e49e8015cde76e5a19"}]}] Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f40282bec7bb43e49e8015cde76e5a19 Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652 Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 92b6e776ceef40e5a979f3ed63f7cdfe Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2109611652-project Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.202782 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a'} Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:50.203458 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. Oct 25 03:10:50.204561 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:50.207154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] Returning 404 to user: Instance e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:50.208280 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a47298d-2ecd-4eb6-869c-a85d84cbcf60 tempest-ImagesOneServerNegativeTestJSON-2109611652 tempest-ImagesOneServerNegativeTestJSON-2109611652-project] 10.222.0.36 "GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a" status: 404 len: 111 microversion: 2.1 time: 0.074662 Oct 25 03:10:50.210243 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1358/2517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:50 2022] GET /compute/v2.1/servers/e9fe9df9-1eec-4100-8dd0-bbfcbbd2674a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:10:50.351367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:50.351863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:50.380431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ff15e2ea-ad1c-475a-8791-88b81ab37aff req-5841a034-14f3-4f41-8dd0-529cf01bba6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff95e7f4-4239-4203-ae0b-70a238e45398", "name": "network-vif-plugged", "status": "completed", "tag": "68b7272b-d333-46ca-84b2-7051e1a0ea06"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:50.387256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.388756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.415479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.416996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.417698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.418401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.451229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ff15e2ea-ad1c-475a-8791-88b81ab37aff req-5841a034-14f3-4f41-8dd0-529cf01bba6b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.454178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ff15e2ea-ad1c-475a-8791-88b81ab37aff req-5841a034-14f3-4f41-8dd0-529cf01bba6b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.455713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ff15e2ea-ad1c-475a-8791-88b81ab37aff req-5841a034-14f3-4f41-8dd0-529cf01bba6b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.488126 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ff15e2ea-ad1c-475a-8791-88b81ab37aff req-5841a034-14f3-4f41-8dd0-529cf01bba6b service nova] Creating event network-vif-plugged:68b7272b-d333-46ca-84b2-7051e1a0ea06 for instance ff95e7f4-4239-4203-ae0b-70a238e45398 on n-h1-862355-1 Oct 25 03:10:50.496684 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ff15e2ea-ad1c-475a-8791-88b81ab37aff req-5841a034-14f3-4f41-8dd0-529cf01bba6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119451 Oct 25 03:10:50.510288 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1359/2518] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:10:50.902101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:50.902898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:50.924249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.930778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.935239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:50.938312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:50.939065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:50.939728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.158103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:51.170384 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96980b2d-75b5-455e-b1eb-831d09c876a5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 0.826711 Oct 25 03:10:51.171290 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1160/2519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:50 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:51.187468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:51.188183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:51.199139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.199791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.210315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.211098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.211589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.212027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.442762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:51.453494 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-756d1881-76ac-40a5-b48e-ad9d85cb0a30 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1315 microversion: 2.1 time: 0.556290 Oct 25 03:10:51.454344 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1360/2520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:50 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:51.474202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:51.476567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:51.489959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.491991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.493660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.494846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.495329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.497537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.598136 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-98cdfea2-819e-4873-91ce-5910ef2444ce tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.142845 Oct 25 03:10:51.600878 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1361/2521] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:10:51 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:51.754040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:51.754876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:51.762826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.767671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.768398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.769311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.769964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.770583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.790586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:51.803298 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c65198b-a0f4-4459-a7a3-0472aaff7a30 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1535 microversion: 2.1 time: 0.630931 Oct 25 03:10:51.805184 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1161/2522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:51 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1535 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:51.874262 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2e3e3e6-a53c-45f7-933c-e5113bb56897 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/d74daf02-ed6e-4449-b299-1d2f1ab78054" status: 200 len: 194 microversion: 2.1 time: 0.124728 Oct 25 03:10:51.875179 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1362/2523] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Oct 25 03:10:51 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/d74daf02-ed6e-4449-b299-1d2f1ab78054 => generated 194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:51.888237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:51.888730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:51.900230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.900736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.905203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:51.908585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:51.909164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:51.909623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:52.149113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lazy-loading 'services' on Instance uuid 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:10:52.204461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:52.205091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:52.213849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:52.217775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:52.218615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:52.219378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:52.219856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:52.220294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:52.303175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb1bb0a9-94ff-40e6-a33c-7614414aa94b tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/d74daf02-ed6e-4449-b299-1d2f1ab78054" status: 202 len: 0 microversion: 2.1 time: 0.420210 Oct 25 03:10:52.303951 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1162/2524] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:10:51 2022] DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/d74daf02-ed6e-4449-b299-1d2f1ab78054 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:10:52.485186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:52.487510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:52.504467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:52.505800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:52.507767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:52.511373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:52.512989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:52.514574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:52.808975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:52.823258 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53ddd05b-9755-49ad-b438-cd5878d39aa9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 0.625157 Oct 25 03:10:52.834769 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1363/2525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:52 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:52.849863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:52.850851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:52.860644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:52.861550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:52.862253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:52.864059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:52.864859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:52.865518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:53.103956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:53.122685 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe646a1d-a4f0-4414-9090-db3f66e60530 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1502 microversion: 2.1 time: 0.644638 Oct 25 03:10:53.123384 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1163/2526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:52 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1502 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:53.145965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:53.146389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:53.158396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:53.159206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:53.160488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:53.161620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:53.162409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:53.163009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:53.267416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:10:53.595984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d6db13c-8de5-42c4-8f7e-8423a6f03a4d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 204 len: 0 microversion: 2.1 time: 0.453682 Oct 25 03:10:53.599909 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1164/2527] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:10:53 2022] DELETE /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:10:53.609912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db23e5d4d024977951c5268e830be92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b80ae1558b3435dbf3fef71c83507f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:53.619560 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2dff1f5b-d40a-4ff5-a309-af0ba1a39ed5 tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 200 len: 1493 microversion: 2.1 time: 0.783223 Oct 25 03:10:53.620147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1364/2528] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:52 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 1493 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:53.632466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3b0c7c1c-3c1a-45a1-a06c-fb1ab205edf8 req-0e9a5d84-bba0-4552-8c8b-6a94d24ba5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56dad91-2314-4ab2-8f7b-b39e9fb7b718", "tag": "a58f5c84-d26c-4f37-af47-222a12750747"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:53.655152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f918033d-ebd4-465a-85c7-5026bed1c1ef req-d0897d5e-ae31-47cb-ba34-5576efed5780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac7e145-193f-49d5-9ed2-4d2e9dfe872d", "name": "network-vif-deleted", "tag": "269541ed-ab70-4ba6-8732-faef12e01330"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:53.677521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b0c7c1c-3c1a-45a1-a06c-fb1ab205edf8 req-0e9a5d84-bba0-4552-8c8b-6a94d24ba5f2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:53.678031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b0c7c1c-3c1a-45a1-a06c-fb1ab205edf8 req-0e9a5d84-bba0-4552-8c8b-6a94d24ba5f2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:53.680417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b0c7c1c-3c1a-45a1-a06c-fb1ab205edf8 req-0e9a5d84-bba0-4552-8c8b-6a94d24ba5f2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:53.696181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f918033d-ebd4-465a-85c7-5026bed1c1ef req-d0897d5e-ae31-47cb-ba34-5576efed5780 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:53.696688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f918033d-ebd4-465a-85c7-5026bed1c1ef req-d0897d5e-ae31-47cb-ba34-5576efed5780 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:53.697131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f918033d-ebd4-465a-85c7-5026bed1c1ef req-d0897d5e-ae31-47cb-ba34-5576efed5780 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:53.707162 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3b0c7c1c-3c1a-45a1-a06c-fb1ab205edf8 req-0e9a5d84-bba0-4552-8c8b-6a94d24ba5f2 service nova] Creating event network-changed:a58f5c84-d26c-4f37-af47-222a12750747 for instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 on n-h2-862355-1 Oct 25 03:10:53.724168 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3b0c7c1c-3c1a-45a1-a06c-fb1ab205edf8 req-0e9a5d84-bba0-4552-8c8b-6a94d24ba5f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101487 Oct 25 03:10:53.728574 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1165/2529] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:53.741395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:53.744333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f918033d-ebd4-465a-85c7-5026bed1c1ef req-d0897d5e-ae31-47cb-ba34-5576efed5780 service nova] Creating event network-vif-deleted:269541ed-ab70-4ba6-8732-faef12e01330 for instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d on n-h2-862355-1 Oct 25 03:10:53.748618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:53.781594 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f918033d-ebd4-465a-85c7-5026bed1c1ef req-d0897d5e-ae31-47cb-ba34-5576efed5780 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138521 Oct 25 03:10:53.782444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:53.783299 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1365/2530] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:53.784145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:53.786274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:53.787620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:53.789904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:53.791501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:53.810914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-917926247", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "0570281e-670e-4ff3-96c6-c84adbc7eaf7"}, {"uuid": "675b4e2c-ace8-4dd8-b87c-d0d7b5e7ba48"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:53.980012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] validate_networks() for [('0570281e-670e-4ff3-96c6-c84adbc7eaf7', None, None, None, None, None), ('675b4e2c-ace8-4dd8-b87c-d0d7b5e7ba48', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:10:54.271686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:54.300773 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-26a267cd-9a2e-40e3-825e-fb84a7b290ac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1508 microversion: 2.1 time: 0.555084 Oct 25 03:10:54.303757 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1166/2531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:53 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1508 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:54.312541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:54.316298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:54.350303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:54.354400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:54.371937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:54.374324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:54.374833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:54.378660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:54.658725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:54.752944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:55.390979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:56.018029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:56.032861 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4030bb82-07b4-401e-9e0b-48bff65e3cc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 1.720382 Oct 25 03:10:56.055088 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1167/2532] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:54 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:56.060955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:56.061791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] [instance: 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:56.069642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:56.070385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:56.071017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:56.071896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:56.072925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:56.073517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:56.093031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] HTTP exception thrown: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Request method failure captured: Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d HTTP/1.1 Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1ONqkCIHd2QNsNpYyRVWoP5bDYbzH8SKLoP2MVgjQ_d6rpd6Sm45EbilpFxOsxRNHetW8gBA1np7GpWbL9E9hkXUBvQBGTknHG-300sdgVDmp-20amnWNRM10CbkMQzP5pBXb41zGOfwdsV4wNfAUEF58KstC2UGlpSqJJpzE5M0OA Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 5b80ae1558b3435dbf3fef71c83507f0 Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-816649363 Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:10:56.096654 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5b80ae1558b3435dbf3fef71c83507f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5b80ae1558b3435dbf3fef71c83507f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5b80ae1558b3435dbf3fef71c83507f0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5b80ae1558b3435dbf3fef71c83507f0"}]}] Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-816649363 Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 5b80ae1558b3435dbf3fef71c83507f0 Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-816649363 Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestMultiTenantJSON-816649363-project Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2db23e5d4d024977951c5268e830be92 Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-816649363-project Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:56.098184 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '8ac7e145-193f-49d5-9ed2-4d2e9dfe872d'} Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:56.099039 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. Oct 25 03:10:56.100342 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:10:56.103090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] Returning 404 to user: Instance 8ac7e145-193f-49d5-9ed2-4d2e9dfe872d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:56.104561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0bd77a5-0f8d-4668-85ae-b9d96c65d3ed tempest-ServersNegativeTestMultiTenantJSON-816649363 tempest-ServersNegativeTestMultiTenantJSON-816649363-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d" status: 404 len: 111 microversion: 2.1 time: 0.047743 Oct 25 03:10:56.106386 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1168/2533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:56 2022] GET /compute/v2.1/servers/8ac7e145-193f-49d5-9ed2-4d2e9dfe872d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:56.119078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:56.119950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:56.128590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:56.129301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:56.129919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:56.130816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:56.131416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:56.131979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:56.669918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:56.689480 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf2d7dcf-9657-4c9d-8c5e-51814b354678 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1508 microversion: 2.1 time: 0.575936 Oct 25 03:10:56.690323 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1169/2534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:56 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:57.061609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:57.062950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:57.073975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:57.076082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:57.077863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:57.078809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:57.084111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:57.084866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:57.112775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:10:57.380392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:10:57.380933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:10:57.381357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:10:57.382054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:10:57.382685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:10:57.406259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:57.410349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:57.411146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:57.412086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:57.412732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:57.415030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:57.467233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Getting quotas for project 5ee4fd42dd0b405f9549e74a07fe340b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:10:57.480776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Getting quotas for user ab41f1b82ab9460e8127e95241317f05 and project 5ee4fd42dd0b405f9549e74a07fe340b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:10:57.519114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:10:57.522777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:10:57.633569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3026ba5-f902-42c3-80a5-7d263af24016 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.848000 Oct 25 03:10:57.640253 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1366/2535] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:10:57.652576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a714a2d-aec0-4fc2-abf1-32e651c30b5f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:57.653504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a714a2d-aec0-4fc2-abf1-32e651c30b5f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:57.655550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:57.725594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7ae2d991-8ccf-4c17-bc1d-7642eafc924e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 0.667145 Oct 25 03:10:57.726507 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1170/2536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:57 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:57.742846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:57.744637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:57.787432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:57.789475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:57.790242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:57.793432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:57.795024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:57.797425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:58.089215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a714a2d-aec0-4fc2-abf1-32e651c30b5f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:58.098515 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a714a2d-aec0-4fc2-abf1-32e651c30b5f tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1212 microversion: 2.1 time: 0.450358 Oct 25 03:10:58.104611 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1367/2537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:57 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1212 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:58.109583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7f9ec25b-db68-4a96-a158-befe0431b163 req-2a26907b-84c4-46d4-88ec-7ec43f6f7e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff95e7f4-4239-4203-ae0b-70a238e45398", "name": "network-vif-deleted", "tag": "68b7272b-d333-46ca-84b2-7051e1a0ea06"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:58.134047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:58.137869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f9ec25b-db68-4a96-a158-befe0431b163 req-2a26907b-84c4-46d4-88ec-7ec43f6f7e04 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:58.146055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f9ec25b-db68-4a96-a158-befe0431b163 req-2a26907b-84c4-46d4-88ec-7ec43f6f7e04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:58.146577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f9ec25b-db68-4a96-a158-befe0431b163 req-2a26907b-84c4-46d4-88ec-7ec43f6f7e04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:58.159285 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb02ced8-195f-41d7-9ad3-5eccaa9f9ae7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 200 len: 1466 microversion: 2.1 time: 0.419586 Oct 25 03:10:58.159993 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1171/2538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:57 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 1466 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:58.176740 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7f9ec25b-db68-4a96-a158-befe0431b163 req-2a26907b-84c4-46d4-88ec-7ec43f6f7e04 service nova] Creating event network-vif-deleted:68b7272b-d333-46ca-84b2-7051e1a0ea06 for instance ff95e7f4-4239-4203-ae0b-70a238e45398 on n-h1-862355-1 Oct 25 03:10:58.195361 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7f9ec25b-db68-4a96-a158-befe0431b163 req-2a26907b-84c4-46d4-88ec-7ec43f6f7e04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089228 Oct 25 03:10:58.196707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1368/2539] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:10:58.756623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:58.757547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:58.783748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:58.786060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:58.791622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:58.793480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:58.794497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:58.798072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:59.132793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:59.134303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:59.156084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:59.162469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:59.166380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:59.169216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:59.170328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:59.172919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:59.440882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:59.451108 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eecee6f3-0b15-469e-ad69-3ad6050d98f4 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1216 microversion: 2.1 time: 0.323519 Oct 25 03:10:59.458185 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1369/2540] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:59 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1216 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:10:59.463274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:10:59.468690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:10:59.488468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:59.488990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:59.489440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:59.507663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:10:59.508642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:10:59.510106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:10:59.534637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 HTTP/1.1 Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:10:59.537189 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:10:59.538685 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'ff95e7f4-4239-4203-ae0b-70a238e45398'} Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:10:59.539519 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:10:59.540860 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:10:59.542908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:10:59.543996 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf76d5ed-ba03-4070-a12b-b78c1e008023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 404 len: 111 microversion: 2.1 time: 0.084478 Oct 25 03:10:59.545184 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1370/2541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:59 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:10:59.556566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:10:59.567036 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d19bbae0-9d23-41fc-ab5b-4430cad0f610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 0.815888 Oct 25 03:10:59.575498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1172/2542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:10:58 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:10:59.710364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1620923927", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "399e4372-9a26-4378-9554-8714a7affe92"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:10:59.799813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] validate_networks() for [('399e4372-9a26-4378-9554-8714a7affe92', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:11:00.487677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:00.488354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:00.499276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:00.499792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:00.501213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:00.505925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:00.506636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:00.507745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:00.711102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:00.725730 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-daaa7d83-6290-480e-89cf-f8e5bd7d98d8 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1282 microversion: 2.1 time: 0.243488 Oct 25 03:11:00.726564 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1173/2543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:00 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:00.736897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:00.737937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:00.749185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:00.757014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:00.757630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:00.758941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:00.761690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:00.762486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:01.135856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:01.149546 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-752b43f9-5706-4b0b-9e04-c9158e2aadf3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 0.421723 Oct 25 03:11:01.170580 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1174/2544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:00 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:01.749610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:01.750290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:01.765994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:01.766493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:01.767005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:01.767650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:01.780256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:01.783135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:02.059242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:02.071902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-72a71cd5-1c48-47f3-9d70-09502444fe1c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1270 microversion: 2.1 time: 0.327152 Oct 25 03:11:02.094549 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1175/2545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:01 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1270 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:02.179191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:02.179868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:02.198165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:02.202186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:02.202941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:02.204916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:02.208484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:02.209716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:02.210354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:02.950790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:02.968098 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4150301f-5ac4-4852-a99d-e418dab7933e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 0.793154 Oct 25 03:11:02.978030 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1176/2546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:02 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:03.111159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:03.112088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:03.127948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.128447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.128880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.129595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.130071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.130494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.340426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:03.358286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-462c79a3-32cb-4cec-a8b6-07b7bd533380 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1270 microversion: 2.1 time: 0.253770 Oct 25 03:11:03.378193 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1177/2547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:03 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:03.710348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:11:03.710956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:11:03.712139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:11:03.713601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:11:03.714872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:11:03.741089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.743251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.748745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.751096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.753707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.754417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.779675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:03.781185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:03.788722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.789496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.790607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.791612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.792558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.793600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.826889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:03.864177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for user 256827a36f464fe1b535d91f95e48681 and project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:03.864818 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6b7e087-8854-4bb7-b95e-0f9b95010025 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/55f5bade-5953-4344-bd72-f3f4bc39fb4c" status: 200 len: 194 microversion: 2.1 time: 0.089722 Oct 25 03:11:03.874083 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1178/2548] 10.222.0.36 () {58 vars in 1413 bytes} [Tue Oct 25 03:11:03 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/55f5bade-5953-4344-bd72-f3f4bc39fb4c => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:03.880664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:03.881176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:03.900414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.901460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.901936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.902655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:03.903107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:03.904642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:03.905035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:11:03.907415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:11:03.992671 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-42ded7de-ee8e-449e-bd53-8ca44273a5b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.286976 Oct 25 03:11:04.001718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1371/2549] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:11:04.008332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:04.009580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:04.020579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:04.021259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:04.021946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:04.022753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:04.024016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:04.026526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:04.227020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lazy-loading 'services' on Instance uuid 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:11:04.457087 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d90e4437-fdb2-4e37-99d2-a54544759a7c tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/55f5bade-5953-4344-bd72-f3f4bc39fb4c" status: 202 len: 0 microversion: 2.1 time: 0.581664 Oct 25 03:11:04.462725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1179/2550] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:11:03 2022] DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments/55f5bade-5953-4344-bd72-f3f4bc39fb4c => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:11:04.498850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-859eb606-6529-4d4b-84e1-d73025aea537 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:04.503306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-859eb606-6529-4d4b-84e1-d73025aea537 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:04.883351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-859eb606-6529-4d4b-84e1-d73025aea537 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:04.895629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-859eb606-6529-4d4b-84e1-d73025aea537 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1215 microversion: 2.1 time: 0.428694 Oct 25 03:11:04.896264 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1180/2551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:04 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:04.920638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:04.926400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:04.946435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:04.946892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:04.947339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:04.949098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:04.949626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:04.950105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:05.438065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:05.446236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0157ba1b-c2f0-40ab-9c91-c0c2d946f030 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 1.442944 Oct 25 03:11:05.465900 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1372/2552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:04 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:05.928720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:05.930814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:05.944697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:05.951085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:05.951962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:05.952953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:05.954738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:05.958557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:06.176509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:06.198365 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0811bda2-6533-4e48-8247-7ec65999a9cf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1219 microversion: 2.1 time: 0.274905 Oct 25 03:11:06.199012 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1373/2553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:05 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1219 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:06.473200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:06.474653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:06.496963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:06.497541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:06.498034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:06.504780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:06.512764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:06.513339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:06.604484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:07.137296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:07.160015 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-83c08d40-72d0-4828-b6d6-f8806d7309f7 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1312 microversion: 2.1 time: 2.240351 Oct 25 03:11:07.163621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1181/2554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:04 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1312 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:07.224292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:07.225069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:07.247592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:07.248842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:07.249465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:07.250600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:07.251219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:07.251834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:07.359205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:07.372842 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b30ddd5a-2558-4472-a98a-7f36b22360e4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 0.903394 Oct 25 03:11:07.373488 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1374/2555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:06 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:07.429785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:07.442289 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-600e0bb9-a8c5-481c-b4a6-027b999937e4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1285 microversion: 2.1 time: 0.221673 Oct 25 03:11:07.446556 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1182/2556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:07 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:08.197235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:08.198355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:08.206120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:08.226411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:08.229286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:08.232766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:08.234993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:08.235487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:08.238997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:08.397123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:08.398330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:08.415557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:08.422753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:08.428063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:08.429052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:08.429711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:08.433485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:08.865753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:08.876420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-982ab7ea-d20a-4a7b-ba45-cb1f63f70a2c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.685462 Oct 25 03:11:08.901410 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1375/2557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:08 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:08.911724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:08.911824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:08.941038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:08.942212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:08.942666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:08.943394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:08.943868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:08.944274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:09.193361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:09.205929 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bcdcacd0-43f3-45bb-b679-7d626a842e87 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1273 microversion: 2.1 time: 0.300807 Oct 25 03:11:09.206552 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1376/2558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:08 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:09.231619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0b7e603a-505f-4e66-8db3-8e4aae02f770 req-b3d99d1d-cc11-4b42-b5d0-7dc8369c239c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56dad91-2314-4ab2-8f7b-b39e9fb7b718", "name": "network-vif-plugged", "status": "completed", "tag": "a58f5c84-d26c-4f37-af47-222a12750747"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:09.279184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0b7e603a-505f-4e66-8db3-8e4aae02f770 req-b3d99d1d-cc11-4b42-b5d0-7dc8369c239c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:09.281591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0b7e603a-505f-4e66-8db3-8e4aae02f770 req-b3d99d1d-cc11-4b42-b5d0-7dc8369c239c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:09.282779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0b7e603a-505f-4e66-8db3-8e4aae02f770 req-b3d99d1d-cc11-4b42-b5d0-7dc8369c239c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:09.304412 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0b7e603a-505f-4e66-8db3-8e4aae02f770 req-b3d99d1d-cc11-4b42-b5d0-7dc8369c239c service nova] Creating event network-vif-plugged:a58f5c84-d26c-4f37-af47-222a12750747 for instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 on n-h2-862355-1 Oct 25 03:11:09.311124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0b7e603a-505f-4e66-8db3-8e4aae02f770 req-b3d99d1d-cc11-4b42-b5d0-7dc8369c239c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103214 Oct 25 03:11:09.313778 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1377/2559] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:09.674985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:09.710278 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e14a7cf9-ae36-4766-b6a2-a9634cf20505 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 1.310002 Oct 25 03:11:09.713742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1183/2560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:08 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:09.873183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5b337c47-51ee-4e04-96f1-d7565b700d3d req-3103ee8f-05b1-4d2c-a6ad-ee193f7888a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fdb320-4cd3-48e9-b40e-6b82a74c73c0", "tag": "12a1bd3a-1f15-4dc5-a880-2fea8d305ef9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:09.896172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b337c47-51ee-4e04-96f1-d7565b700d3d req-3103ee8f-05b1-4d2c-a6ad-ee193f7888a1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:09.900961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b337c47-51ee-4e04-96f1-d7565b700d3d req-3103ee8f-05b1-4d2c-a6ad-ee193f7888a1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:09.903520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b337c47-51ee-4e04-96f1-d7565b700d3d req-3103ee8f-05b1-4d2c-a6ad-ee193f7888a1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:09.905592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:09.906323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:09.916319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:09.922796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:09.924005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:09.936639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:09.937398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:09.937876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:09.939928 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5b337c47-51ee-4e04-96f1-d7565b700d3d req-3103ee8f-05b1-4d2c-a6ad-ee193f7888a1 service nova] Creating event network-changed:12a1bd3a-1f15-4dc5-a880-2fea8d305ef9 for instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 on n-h2-862355-1 Oct 25 03:11:09.950958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5b337c47-51ee-4e04-96f1-d7565b700d3d req-3103ee8f-05b1-4d2c-a6ad-ee193f7888a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082931 Oct 25 03:11:09.960641 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1378/2561] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:10.232921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:10.233821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:10.256391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:10.258085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:10.258605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:10.259598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:10.261803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:10.262466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:10.373013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:10.383618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7528709-673b-4669-b9ff-5740b53b4d2d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.482156 Oct 25 03:11:10.386189 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1184/2562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:09 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:10.736442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:10.737664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:10.752542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:10.755881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:10.756378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:10.757124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:10.769502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:10.770735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:11.278867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:11.304673 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-11a6d49c-db0a-4d7c-97b4-c80705019c0a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 1.076716 Oct 25 03:11:11.309407 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1379/2563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:10 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:12.121045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43871088-9450-4f33-bbc2-fb49df35b84f tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd3b881430>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvxMFluhYDr1H+5i9EbMv9bfSzpCUdL2m4xeuD3boJtf9DlWTPkZEsbXSC44YEHEhi0IphYZC3AhTm+ITnHTSN/q/n2O6gnKoiMqS+4c2pe0kx26b2cG8bGwdfATj+T7A=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43871088-9450-4f33-bbc2-fb49df35b84f tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 257 Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:12.137382 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:11:12.139002 n-d-862355-1 devstack@n-api.service[120562]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvxMFluhYDr1H+5i9EbMv9bfSzpCUdL2m4xeuD3boJtf9DlWTPkZEsbXSC44YEHEhi0IphYZC3AhTm+ITnHTSN/q/n2O6gnKoiMqS+4c2pe0kx26b2cG8bGwdfATj+T7A=="}} Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvxMFluhYDr1H+5i9EbMv9bfSzpCUdL2m4xeuD3boJtf9DlWTPkZEsbXSC44YEHEhi0IphYZC3AhTm+ITnHTSN/q/n2O6gnKoiMqS+4c2pe0kx26b2cG8bGwdfATj+T7A=='}}} Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.139823 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:12.141028 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:11:12.142594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:11:12.143908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 25 03:11:12.143908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.143908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43871088-9450-4f33-bbc2-fb49df35b84f tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:12.143908 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43871088-9450-4f33-bbc2-fb49df35b84f tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.824423 Oct 25 03:11:12.145905 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1380/2564] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:11:11 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 836 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:11:12.151465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:12.152087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:12.169634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:12.178188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:12.187225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:12.188086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:12.190829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:12.191507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:12.198504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:12.201925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-04843da7-579a-4dbe-8140-a8a9233c6a1e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1313 microversion: 2.1 time: 1.469169 Oct 25 03:11:12.205005 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1185/2565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:10 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1313 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:12.211390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7636a86a-36ad-4295-b272-4d572f40b868 req-007d20f3-4635-4b8b-af18-f5f6ef1a9418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fdb320-4cd3-48e9-b40e-6b82a74c73c0", "tag": "097cb95e-409f-44ca-bc61-b74a15139585"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:12.247561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7636a86a-36ad-4295-b272-4d572f40b868 req-007d20f3-4635-4b8b-af18-f5f6ef1a9418 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:12.249535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7636a86a-36ad-4295-b272-4d572f40b868 req-007d20f3-4635-4b8b-af18-f5f6ef1a9418 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:12.250197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7636a86a-36ad-4295-b272-4d572f40b868 req-007d20f3-4635-4b8b-af18-f5f6ef1a9418 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:12.273057 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7636a86a-36ad-4295-b272-4d572f40b868 req-007d20f3-4635-4b8b-af18-f5f6ef1a9418 service nova] Creating event network-changed:097cb95e-409f-44ca-bc61-b74a15139585 for instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 on n-h2-862355-1 Oct 25 03:11:12.286196 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7636a86a-36ad-4295-b272-4d572f40b868 req-007d20f3-4635-4b8b-af18-f5f6ef1a9418 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079872 Oct 25 03:11:12.294238 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1186/2566] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:12.341290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-54b5bf04-d2ce-42b6-9015-5c8cb1547bae tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd3339f040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1207961773", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:12.401352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-54b5bf04-d2ce-42b6-9015-5c8cb1547bae tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:12.427299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-54b5bf04-d2ce-42b6-9015-5c8cb1547bae tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for user 8211200c082f4d3dae748d32b355a16d and project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:12.456060 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-54b5bf04-d2ce-42b6-9015-5c8cb1547bae tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-54b5bf04-d2ce-42b6-9015-5c8cb1547bae tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 2167 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1207961773", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:11:12.488795 n-d-862355-1 devstack@n-api.service[120563]: exception: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1207961773', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:12.491704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-54b5bf04-d2ce-42b6-9015-5c8cb1547bae tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-54b5bf04-d2ce-42b6-9015-5c8cb1547bae tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.189985 Oct 25 03:11:12.496886 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1187/2567] 10.222.0.36 () {60 vars in 1160 bytes} [Tue Oct 25 03:11:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:11:12.499443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:12.499765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:12.522834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:12.523335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:12.523780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:12.527875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:12.528548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:12.529153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:12.648001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:12.660320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e048d4e8-27bd-4d71-98e7-9b997ce0391c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.513270 Oct 25 03:11:12.661732 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1381/2568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:12 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:12.674627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d1d3520-b104-4b7c-9873-c41fdc97dd45 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd3b80d8b0>, body: {"keypair": {"name": "tempest-keypair-954551146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD48uc+lto4xBaV6cNv+HF8JppQdmMVBD+TgB58F2yRz0C1kV8Dh7eSSJj50EZr+sTtuFglztGqKMYOF9fX1Z72+8eaN9BmKs5rm0HzDZvsxXOkoev/kxyoJBGdglbPsRw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:12.725314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-1d1d3520-b104-4b7c-9873-c41fdc97dd45 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:12.739314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-1d1d3520-b104-4b7c-9873-c41fdc97dd45 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for user 8211200c082f4d3dae748d32b355a16d and project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:12.823005 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d1d3520-b104-4b7c-9873-c41fdc97dd45 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158631 Oct 25 03:11:12.825284 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1382/2569] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:11:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:12.839171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4034139-edd5-4d7c-9a6d-1a78b1595a2c tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd32d47d30>, body: {"keypair": {"name": "tempest-keypair-954551146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx29NCyioMNioV55n/cZSQ4oTcsc26yvbbzMfDKW2PU1f2z8pX+SrI1hrHuxC7IoAkKMkX7FyppTEzJR08So28GxhJGkiy1ANS9DIwWrZgpFXvuqZMQoVPENd458vTrNA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:12.902520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a4034139-edd5-4d7c-9a6d-1a78b1595a2c tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:12.921271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a4034139-edd5-4d7c-9a6d-1a78b1595a2c tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for user 8211200c082f4d3dae748d32b355a16d and project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:12.954089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a4034139-edd5-4d7c-9a6d-1a78b1595a2c tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] HTTP exception thrown: Key pair 'tempest-keypair-954551146' already exists. Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4034139-edd5-4d7c-9a6d-1a78b1595a2c tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 272 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: {"keypair": {"name": "tempest-keypair-954551146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx29NCyioMNioV55n/cZSQ4oTcsc26yvbbzMfDKW2PU1f2z8pX+SrI1hrHuxC7IoAkKMkX7FyppTEzJR08So28GxhJGkiy1ANS9DIwWrZgpFXvuqZMQoVPENd458vTrNA=="}} Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: exception: Key pair 'tempest-keypair-954551146' already exists. Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-954551146', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx29NCyioMNioV55n/cZSQ4oTcsc26yvbbzMfDKW2PU1f2z8pX+SrI1hrHuxC7IoAkKMkX7FyppTEzJR08So28GxhJGkiy1ANS9DIwWrZgpFXvuqZMQoVPENd458vTrNA=='}}} Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result.read() Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '8211200c082f4d3dae748d32b355a16d-tempest-keypair-954551146' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 25 03:11:13.036982 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi session.flush() Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result.read() Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 25 03:11:13.040812 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '8211200c082f4d3dae748d32b355a16d-tempest-keypair-954551146' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 25, 3, 11, 12, 944026), 'updated_at': None, 'name': 'tempest-keypair-954551146', 'user_id': '8211200c082f4d3dae748d32b355a16d', 'fingerprint': '5d:d2:04:2a:73:86:6f:15:dc:b3:3f:5e:b6:22:7d:81', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx29NCyioMNioV55n/cZSQ4oTcsc26yvbbzMfDKW2PU1f2z8pX+SrI1hrHuxC7IoAkKMkX7FyppTEzJR08So28GxhJGkiy1ANS9DIwWrZgpFXvuqZMQoVPENd458vTrNA==', 'type': 'ssh'}] Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi keypair.create() Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._create() Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-954551146' already exists. Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 25 03:11:13.047260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-954551146' already exists. Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-954551146' already exists. Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4034139-edd5-4d7c-9a6d-1a78b1595a2c tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 409 to user: Key pair 'tempest-keypair-954551146' already exists. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4034139-edd5-4d7c-9a6d-1a78b1595a2c tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.204823 Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1383/2570] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:11:12 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:11:13.058798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ffd0ff1c-58b6-4e52-a99d-cc4422dacb5a tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Calling method '.version_select at 0x7efd32b67700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:13.077710 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ffd0ff1c-58b6-4e52-a99d-cc4422dacb5a tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954551146" status: 202 len: 0 microversion: 2.1 time: 0.032525 Oct 25 03:11:13.078730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1384/2571] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954551146 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:11:13.091816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f5b581c-532c-47e9-bef5-cdcef70c57df tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd32b67310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE4yo0WmiO8bVxNqzdiA6szQl13Wy8R2vSn65iZeHhZslQVRXf+A165TDM7UjtMqT48bj/EtzQOKweis5qMLnWQyeKTkgrcMNm8+7UCvb0If6Ua8sNdixzgDlfvUTw90Q=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f5b581c-532c-47e9-bef5-cdcef70c57df tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 247 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE4yo0WmiO8bVxNqzdiA6szQl13Wy8R2vSn65iZeHhZslQVRXf+A165TDM7UjtMqT48bj/EtzQOKweis5qMLnWQyeKTkgrcMNm8+7UCvb0If6Ua8sNdixzgDlfvUTw90Q=="}} Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE4yo0WmiO8bVxNqzdiA6szQl13Wy8R2vSn65iZeHhZslQVRXf+A165TDM7UjtMqT48bj/EtzQOKweis5qMLnWQyeKTkgrcMNm8+7UCvb0If6Ua8sNdixzgDlfvUTw90Q=='}}} Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi '' Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:11:13.097261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.101831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f5b581c-532c-47e9-bef5-cdcef70c57df tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:13.103798 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f5b581c-532c-47e9-bef5-cdcef70c57df tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015219 Oct 25 03:11:13.109077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1385/2572] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:11:13 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:11:13.114632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4b059ef-f9a2-4453-b1ca-d1d2fcc1c646 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd32b6e430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-615634443", "public_key": " "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:13.136216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d4b059ef-f9a2-4453-b1ca-d1d2fcc1c646 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:13.141964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d4b059ef-f9a2-4453-b1ca-d1d2fcc1c646 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for user 8211200c082f4d3dae748d32b355a16d and project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:13.197264 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d4b059ef-f9a2-4453-b1ca-d1d2fcc1c646 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4b059ef-f9a2-4453-b1ca-d1d2fcc1c646 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 94 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-615634443", "public_key": " "}} Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: exception: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-615634443', 'public_key': ' '}}} Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.217361 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4b059ef-f9a2-4453-b1ca-d1d2fcc1c646 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:13.222657 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d4b059ef-f9a2-4453-b1ca-d1d2fcc1c646 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.112395 Oct 25 03:11:13.234681 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1386/2573] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Oct 25 03:11:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:11:13.239723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:13.240372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:13.261290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:13.261849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:13.262665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:13.263330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:13.263795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:13.266679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:13.608331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:13.639040 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9fc3551d-94b2-49d1-a8e2-7c9b05adde3e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 1.146371 Oct 25 03:11:13.642354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1188/2574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:12 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:13.670022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1abcb68-11ed-4d2f-9092-f7dd3cc71305 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd3338b550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDksno8Lfyma8rkDZgsFc/o9xxNV1ituQqFMtiqyGOn37ca0NGGCX//WitS3pMkEe4d5+APxCa8Ri+E8TUL5cb5uXk+Q3HAjHD5U0JIUcKPLgZQuJnCpS2FLLhmGeRAhQ=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1abcb68-11ed-4d2f-9092-f7dd3cc71305 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 507 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDksno8Lfyma8rkDZgsFc/o9xxNV1ituQqFMtiqyGOn37ca0NGGCX//WitS3pMkEe4d5+APxCa8Ri+E8TUL5cb5uXk+Q3HAjHD5U0JIUcKPLgZQuJnCpS2FLLhmGeRAhQ=="}} Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDksno8Lfyma8rkDZgsFc/o9xxNV1ituQqFMtiqyGOn37ca0NGGCX//WitS3pMkEe4d5+APxCa8Ri+E8TUL5cb5uXk+Q3HAjHD5U0JIUcKPLgZQuJnCpS2FLLhmGeRAhQ=='}}} Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 25 03:11:13.681380 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 25 03:11:13.686730 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:13.694008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1abcb68-11ed-4d2f-9092-f7dd3cc71305 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:13.699349 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1abcb68-11ed-4d2f-9092-f7dd3cc71305 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.052350 Oct 25 03:11:13.700052 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1189/2575] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:11:13 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:11:13.708645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:13.709160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:13.727946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:13.728453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:13.728926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:13.729735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:13.730279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:13.730707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:13.744720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:13.788433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:13.910673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:13.927028 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c44effc-48fa-41e1-8f61-f42fdc343053 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1463 microversion: 2.1 time: 0.696164 Oct 25 03:11:13.928488 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1387/2576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:13 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1463 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:13.949558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ec70468-a91a-4764-8a8e-957bcc4e8065 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Action: 'create', calling method: .version_select at 0x7efd32b6cd30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2048597133", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:13.995411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5ec70468-a91a-4764-8a8e-957bcc4e8065 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:14.007051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5ec70468-a91a-4764-8a8e-957bcc4e8065 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Getting quotas for user 8211200c082f4d3dae748d32b355a16d and project f2d0897ec1884d2e94a1729c58288277. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:14.057184 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5ec70468-a91a-4764-8a8e-957bcc4e8065 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ec70468-a91a-4764-8a8e-957bcc4e8065 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 118 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2048597133", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: exception: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2048597133', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 25 03:11:14.059585 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ec70468-a91a-4764-8a8e-957bcc4e8065 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5ec70468-a91a-4764-8a8e-957bcc4e8065 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.130905 Oct 25 03:11:14.063337 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1388/2577] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:11:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:11:14.075727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:14.079536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:14.092379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:14.094902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:14.097659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:14.098529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:14.099093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:14.100155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:14.543979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:14.554444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Old instance type m1.heat2, new instance type m1.heat {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:11:14.563324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:11:14.563860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:11:14.564475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:11:14.564888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:11:14.565301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:11:14.735325 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-acfb5f73-c947-4ad9-a0be-95540bc58c3a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718/action" status: 202 len: 0 microversion: 2.1 time: 0.672246 Oct 25 03:11:14.740079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:14.747924 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1389/2578] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:11:14 2022] POST /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:11:14.770364 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad555bb3-2e09-457b-aff7-9187cd4ae390 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 1.066368 Oct 25 03:11:14.774824 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1190/2579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:13 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:14.778301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-76bb48bb-2d18-48ac-86e9-e3338b519a94 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Calling method '.version_select at 0x7efd32b6cee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:14.783532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:14.793976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:14.822161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:14.828201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:14.830359 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-76bb48bb-2d18-48ac-86e9-e3338b519a94 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1795782571 not found for user 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:14.831960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:14.833997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:14.835953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:14.838004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-76bb48bb-2d18-48ac-86e9-e3338b519a94 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Request method failure captured: Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1795782571 HTTP/1.1 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1POXZxHToa7XO3JwlhFWlb7XxExS-xFRtlBPJ3s3KVQccuc9B0JzRTr08CJ4FLxaRJNq8aM63AAEv-hDZyv9DlmWBOYILp77mlQzMZzqEbxZehr70couQp6OGyFvOHKBRctDvfTU2qVg5TPsg46TjxvP7QIzFkBjEXnbF38AsCx4dk Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d0897ec1884d2e94a1729c58288277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d0897ec1884d2e94a1729c58288277", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d0897ec1884d2e94a1729c58288277"}]}] Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f2d0897ec1884d2e94a1729c58288277 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-644927745 Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-KeyPairsNegativeTestJSON-644927745-project Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: exception: Keypair tempest-keypair-non-existent-1795782571 not found for user 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'tempest-keypair-non-existent-1795782571'} Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise self.value Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1795782571 not found for user 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.839752 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1795782571 not found for user 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1795782571 not found for user 8211200c082f4d3dae748d32b355a16d Oct 25 03:11:14.843888 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:14.848348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-76bb48bb-2d18-48ac-86e9-e3338b519a94 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1795782571 not found for user 8211200c082f4d3dae748d32b355a16d {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:14.850694 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-76bb48bb-2d18-48ac-86e9-e3338b519a94 tempest-KeyPairsNegativeTestJSON-644927745 tempest-KeyPairsNegativeTestJSON-644927745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1795782571" status: 404 len: 145 microversion: 2.1 time: 0.101866 Oct 25 03:11:14.853963 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1390/2580] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:11:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1795782571 => generated 145 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:14.900088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:14.902995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:14.925193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:14.929003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:14.929520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:14.930287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:14.934551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:14.936573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.200122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:15.212454 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8383dc72-ff3e-495d-b85d-28e8c93b49a1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1472 microversion: 2.1 time: 0.355721 Oct 25 03:11:15.214285 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1391/2581] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:14 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:15.223515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:15.231134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:15.246238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.247129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.248049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.248331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.248801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.250004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.322951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8420637c-2f9b-423a-a592-fe6529addeab tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107347 Oct 25 03:11:15.324134 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1392/2582] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:11:15 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:11:15.482183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:15.485426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:15.492548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.493927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.494527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.495621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.496015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.496445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.503690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:15.511874 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56b64f2b-3d7b-40a3-a4c3-03e71b0a5e74 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.735698 Oct 25 03:11:15.520590 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1191/2583] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:14 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:15.530663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-74659a1b-930d-4d95-97af-72761f957bae tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053854 Oct 25 03:11:15.531550 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1393/2584] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:11:15 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:11:15.630436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:15.630955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:15.637363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.637883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.638327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.639222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.639858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.640435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.689394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:11:15.800788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:15.802223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:15.813603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.814558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.815256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.816313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.817038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.817891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.906653 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90f4cb2c-4658-496d-acb3-10a9162401b1 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 204 len: 0 microversion: 2.1 time: 0.279491 Oct 25 03:11:15.907718 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1192/2585] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:11:15 2022] DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:15.923249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:15.924188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:15.931956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.932533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.933001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:15.933744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:15.934206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:15.934636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:16.195319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:16.216044 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f62cc90-ad71-4f32-970b-553458253983 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.415154 Oct 25 03:11:16.218402 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1394/2586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:15 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:16.230556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ef3799bf-6785-4400-ad60-657a9b36ef2d req-39eb2c2f-5501-46c1-8ce7-f18fdc1cc9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227a8049-3445-4a56-8f6c-26d85d588b7c", "tag": "333c6ab5-b612-4f7e-83cf-a0b2f87ae317"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:16.259444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ef3799bf-6785-4400-ad60-657a9b36ef2d req-39eb2c2f-5501-46c1-8ce7-f18fdc1cc9e7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:16.260099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ef3799bf-6785-4400-ad60-657a9b36ef2d req-39eb2c2f-5501-46c1-8ce7-f18fdc1cc9e7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:16.260539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ef3799bf-6785-4400-ad60-657a9b36ef2d req-39eb2c2f-5501-46c1-8ce7-f18fdc1cc9e7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:16.286227 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ef3799bf-6785-4400-ad60-657a9b36ef2d req-39eb2c2f-5501-46c1-8ce7-f18fdc1cc9e7 service nova] Creating event network-changed:333c6ab5-b612-4f7e-83cf-a0b2f87ae317 for instance 227a8049-3445-4a56-8f6c-26d85d588b7c on n-h1-862355-1 Oct 25 03:11:16.293008 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ef3799bf-6785-4400-ad60-657a9b36ef2d req-39eb2c2f-5501-46c1-8ce7-f18fdc1cc9e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072829 Oct 25 03:11:16.294615 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1395/2587] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:16.319289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:16.335616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:16.347565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:16.348343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:16.349536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:16.350559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:16.351372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:16.359276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:16.496562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:16.506847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ca61043-da54-428a-92ad-079e750e1675 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1671 microversion: 2.1 time: 0.592889 Oct 25 03:11:16.511155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1193/2588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:15 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1671 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:16.547089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:16.548435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:16.560001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:16.560853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:16.561367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:16.569319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:16.570319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:16.572171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:16.818896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:16.830899 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e174afc2-3d62-409d-8c44-3cc46ebe6def tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.287896 Oct 25 03:11:16.847029 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1194/2589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:16 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:17.240939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:17.241611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:17.249800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:17.250616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:17.251765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:17.253351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:17.254566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:17.255604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:17.400800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:17.413371 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9035f688-a03c-471e-90bd-ead3936a6859 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1472 microversion: 2.1 time: 1.114900 Oct 25 03:11:17.415479 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1396/2590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:16 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1472 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:17.474464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:17.514757 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2da03dc-e805-4490-8876-f2be862a4544 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.275526 Oct 25 03:11:17.517203 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1195/2591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:17 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:17.541410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:17.549602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:17.558774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:17.559539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:17.560129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:17.565700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:17.567076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:17.567841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:17.859214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:17.860074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:17.926558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:17.927416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:17.927965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:17.928798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:17.929364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:17.930671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:18.392593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:18.408732 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-85ab0904-9e7b-492c-bdd9-6330e7057f26 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.555460 Oct 25 03:11:18.411700 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1196/2592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:17 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:18.443541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:18.444866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:18.456781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:18.458706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:18.459357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:18.462847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:18.463577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:18.464920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:18.474435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:18.488729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d4c8926-19fb-48d9-84a3-3f604fb6a581 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1671 microversion: 2.1 time: 0.952907 Oct 25 03:11:18.489336 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1397/2593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:17 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1671 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:18.543418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:18.544236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:18.553669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:18.554889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:18.557030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:18.558051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:18.558738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:18.559363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:18.828130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:18.846155 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b39c006-fe54-4cee-b027-d52c2fa7588f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1472 microversion: 2.1 time: 0.407858 Oct 25 03:11:18.850889 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1197/2594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:18 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:19.445161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:19.448976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:19.480762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:19.482470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:19.484218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:19.485574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:19.486257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:19.487462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:19.693339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:19.705658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c525772-8fa8-4a3a-9046-a2e9d7f13231 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.271258 Oct 25 03:11:19.706493 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1198/2595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:19 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:20.044922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e09e552-418c-49a9-9fd6-af81de761928 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd33acef70>, body: {"keypair": {"name": "tempest-keypair-700289685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUzOaU4dLhlWHxWy1plOtV1kBts8KxrrAMoRPZDJH/HqaMyux6dd/JLD9K051cqny/KHP5rYZhXeRlBpKKCo2pmIReB6fYL6Q0N9Z57rjuNAfgSm7ttETITp53dI0gdjw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:20.049590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:20.061050 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fba67c28-634c-4747-8eae-01d02235829e tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 1.523333 Oct 25 03:11:20.062355 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1398/2596] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:18 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:20.068861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.069574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:20.076405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:20.077159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:20.077824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:20.078518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:20.079202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:20.079991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:20.088149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-7e09e552-418c-49a9-9fd6-af81de761928 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:20.100222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-7e09e552-418c-49a9-9fd6-af81de761928 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:20.141617 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e09e552-418c-49a9-9fd6-af81de761928 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.426284 Oct 25 03:11:20.142415 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1199/2597] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 25 03:11:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 428 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 25 03:11:20.153329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.156129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:20.162740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:20.163372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:20.163922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:20.165089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:20.165670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:20.166334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:20.316082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:20.326096 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b213ee9-b3d9-4e29-9f3c-4dcf203cfea6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1472 microversion: 2.1 time: 0.175915 Oct 25 03:11:20.327501 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1200/2598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:20 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1472 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:20.335431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f7d1b325-6a49-4dd6-a4e3-d05e547526ce tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd33364160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.347214 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f7d1b325-6a49-4dd6-a4e3-d05e547526ce tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-700289685" status: 200 len: 512 microversion: 2.2 time: 0.018400 Oct 25 03:11:20.348198 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1201/2599] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Oct 25 03:11:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-700289685 => generated 512 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:20.363682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6057b4af-dba9-4036-b7c4-015f3a693ff9 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd38046790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.391611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6057b4af-dba9-4036-b7c4-015f3a693ff9 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-700289685" status: 204 len: 0 microversion: 2.2 time: 0.032836 Oct 25 03:11:20.392605 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1202/2600] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Oct 25 03:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-700289685 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:20.408712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a7ac002a-4cb5-4ccb-99ef-ee71b6a1cfb9 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd33afbca0>, body: {"keypair": {"name": "tempest-keypair-199439762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhuLdAj2tqfuU5PXtwNozhn0NMG+PhEyggh357toP0kIliYxlVQdkbujR1dFXHjNyEyHz8gnfa7dybIisFL8PVTa7TsWJd3HKZdHyGkpfy8LmrgMTM3U5f66na3eEjVvw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:20.424751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a7ac002a-4cb5-4ccb-99ef-ee71b6a1cfb9 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:20.430731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a7ac002a-4cb5-4ccb-99ef-ee71b6a1cfb9 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:20.458431 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a7ac002a-4cb5-4ccb-99ef-ee71b6a1cfb9 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.055664 Oct 25 03:11:20.460848 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1203/2601] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 25 03:11:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 25 03:11:20.474536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8b9b30f-b96f-49f6-bb80-f38e24e9e67a tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd33300dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.499374 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8b9b30f-b96f-49f6-bb80-f38e24e9e67a tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-199439762" status: 204 len: 0 microversion: 2.2 time: 0.031421 Oct 25 03:11:20.500204 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1204/2602] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Oct 25 03:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-199439762 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:20.511452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03b8182f-534d-42b1-94e4-146ffa483d75 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd334ce5e0>, body: {"keypair": {"name": "tempest-keypair-1686639260", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:20.539818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03b8182f-534d-42b1-94e4-146ffa483d75 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:20.546364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:20.552951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-03b8182f-534d-42b1-94e4-146ffa483d75 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:20.591159 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03b8182f-534d-42b1-94e4-146ffa483d75 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.085216 Oct 25 03:11:20.599191 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1205/2603] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 25 03:11:20 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 25 03:11:20.605796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3b30ca18-c279-465a-859a-4f23372cc900 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd33555430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.627263 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3b30ca18-c279-465a-859a-4f23372cc900 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686639260" status: 204 len: 0 microversion: 2.2 time: 0.026291 Oct 25 03:11:20.628264 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1206/2604] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Oct 25 03:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686639260 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:20.640442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cb3de54-ebf5-4fa1-a9f7-2caf94dfe5ac tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd38e25940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1429384076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEEj2z73GHJeDp6ApqK8Xy4pfNCmfSE1s0/Xnbifxek3wsw32k5DByGPd0pY+WNc/h576YsfGhj5Ra2bqXyfaH8CGi90aTRh0VWRhH16ic/Wa8c+MYjTs0IEbxW3dRTlA=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:20.658013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-9cb3de54-ebf5-4fa1-a9f7-2caf94dfe5ac tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:20.664748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-9cb3de54-ebf5-4fa1-a9f7-2caf94dfe5ac tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:20.694625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:20.697907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9cb3de54-ebf5-4fa1-a9f7-2caf94dfe5ac tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.061681 Oct 25 03:11:20.698093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:20.707548 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1207/2605] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 25 03:11:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 25 03:11:20.713553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e2abbe84-518d-4f0d-87e2-86dc1d32c73f tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd33312dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1998913060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSOafhDQ/bKsOJiFhxiQxGofdNGPJpiBppGmFurbPaLS5TS/RYEpV9RfZGN/uoIwc+yTh+PnvaSqZPDb/JQoMZ2BHks1agS/k/GcFGAf0yFo6Be+IRx39FeDeCRaPYX6Q=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:20.714394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a16e9e1-e40f-4bf8-b371-87473940afad tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1671 microversion: 2.1 time: 0.650301 Oct 25 03:11:20.723806 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1399/2606] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:20 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1671 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:20.738853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.741282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:20.748978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e2abbe84-518d-4f0d-87e2-86dc1d32c73f tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:20.763858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:20.766783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:20.770464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e2abbe84-518d-4f0d-87e2-86dc1d32c73f tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:20.772197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:20.777439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:20.786283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:20.787280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:20.812075 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e2abbe84-518d-4f0d-87e2-86dc1d32c73f tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.103697 Oct 25 03:11:20.813102 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1208/2607] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 25 03:11:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 25 03:11:20.838072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0982a06-4c1c-4528-bee2-dbdb90ae7ed3 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd334ce820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2108867086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAL6SSX7TnLrdrI+f9+jxsanUqtICso+RN0jUAN33XIVTDyHTr1JAGIKJS5oUb5gG+Wk2qz1YrfwbeS7xPox8O6jCKiwipZvkYaTEkkM3JdpL/IjLHLu5jOmkNlOu0V3Ug=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:20.862612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b0982a06-4c1c-4528-bee2-dbdb90ae7ed3 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:20.873940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b0982a06-4c1c-4528-bee2-dbdb90ae7ed3 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:20.928077 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0982a06-4c1c-4528-bee2-dbdb90ae7ed3 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.095745 Oct 25 03:11:20.935297 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1209/2608] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 25 03:11:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 25 03:11:20.940266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6929635a-0c8a-4d5e-a9a8-496c19f2847c tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd33413a60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.944913 n-d-862355-1 devstack@n-api.service[120563]: WARNING oslo_db.sqlalchemy.utils [None req-6929635a-0c8a-4d5e-a9a8-496c19f2847c tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 25 03:11:20.956779 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6929635a-0c8a-4d5e-a9a8-496c19f2847c tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.019610 Oct 25 03:11:20.963634 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1210/2609] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Oct 25 03:11:20 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:20.970865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b175aa5e-99bc-44a1-bddb-adbbf78e7470 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd33363430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:20.995824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b175aa5e-99bc-44a1-bddb-adbbf78e7470 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2108867086" status: 204 len: 0 microversion: 2.2 time: 0.028880 Oct 25 03:11:21.002090 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1211/2610] 10.222.0.36 () {60 vars in 1321 bytes} [Tue Oct 25 03:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2108867086 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:11:21.014341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42dae401-3790-4fab-93a6-ad6251185c8b tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd33300310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:21.041496 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42dae401-3790-4fab-93a6-ad6251185c8b tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1998913060" status: 204 len: 0 microversion: 2.2 time: 0.035549 Oct 25 03:11:21.045751 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1212/2611] 10.222.0.36 () {60 vars in 1321 bytes} [Tue Oct 25 03:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1998913060 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:21.054482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-090017d3-9cfa-41c8-8c79-d9e4056c7157 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd334ce1f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:21.085089 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-090017d3-9cfa-41c8-8c79-d9e4056c7157 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1429384076" status: 204 len: 0 microversion: 2.2 time: 0.036972 Oct 25 03:11:21.086945 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1213/2612] 10.222.0.36 () {60 vars in 1321 bytes} [Tue Oct 25 03:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1429384076 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:21.094051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:21.094690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:21.133263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:21.133796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:21.134276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:21.138608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:21.138608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:21.138608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:21.461564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:21.472221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e4c00cb-c608-409c-b304-6080361328ad tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.383565 Oct 25 03:11:21.483867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:21.490967 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1214/2613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:21 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:21.495031 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ac4ac15-ca69-4b3a-9825-d395ce8d7fbf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.765399 Oct 25 03:11:21.496249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4aa5e7b1-0051-49d8-9179-18f7e12b3add tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd33809f70>, body: {"keypair": {"name": "tempest-keypair-54801415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBu5Ywz4LuRD2fR5+gYYwL7kClpsAt7AcD97BdtW1EDCQiyGxFavmykatkcvmPm4SD4F5cRqCI/Q6ADhEfAEktL3KotFgmE2Y5OoSBiRbj2CRXqKEar7XnkMFoyFYeUxg=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:21.519694 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1400/2614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:20 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:21.528645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:21.529871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:21.530148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4aa5e7b1-0051-49d8-9179-18f7e12b3add tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:21.539636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4aa5e7b1-0051-49d8-9179-18f7e12b3add tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:21.541114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:21.541931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:21.543687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:21.546352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:21.558384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:21.559194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:21.583382 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4aa5e7b1-0051-49d8-9179-18f7e12b3add tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.091186 Oct 25 03:11:21.584919 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1215/2615] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Oct 25 03:11:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 25 03:11:21.770547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1af5887f-1180-41dc-91ca-30df02236bd0 req-4ee54232-94d0-4b7b-b56a-2285b627e78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdb320-4cd3-48e9-b40e-6b82a74c73c0", "name": "network-vif-plugged", "status": "completed", "tag": "097cb95e-409f-44ca-bc61-b74a15139585"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:21.794156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1af5887f-1180-41dc-91ca-30df02236bd0 req-4ee54232-94d0-4b7b-b56a-2285b627e78f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:21.794650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1af5887f-1180-41dc-91ca-30df02236bd0 req-4ee54232-94d0-4b7b-b56a-2285b627e78f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:21.795085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1af5887f-1180-41dc-91ca-30df02236bd0 req-4ee54232-94d0-4b7b-b56a-2285b627e78f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:21.821708 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1af5887f-1180-41dc-91ca-30df02236bd0 req-4ee54232-94d0-4b7b-b56a-2285b627e78f service nova] Creating event network-vif-plugged:097cb95e-409f-44ca-bc61-b74a15139585 for instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 on n-h2-862355-1 Oct 25 03:11:21.840416 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1af5887f-1180-41dc-91ca-30df02236bd0 req-4ee54232-94d0-4b7b-b56a-2285b627e78f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252624 Oct 25 03:11:21.841949 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1216/2616] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:21.861473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed08a493-6e70-4ebb-83a0-c513e3f546d1 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd334fb310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:21.879419 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed08a493-6e70-4ebb-83a0-c513e3f546d1 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-54801415" status: 200 len: 511 microversion: 2.2 time: 0.034845 Oct 25 03:11:21.881164 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1217/2617] 10.222.0.36 () {60 vars in 1252 bytes} [Tue Oct 25 03:11:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-54801415 => generated 511 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:21.887073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:21.887995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:21.896769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:21.897490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:21.898672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:21.900394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:21.901034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:21.901628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:21.965982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:21.974129 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba16f072-da4a-488a-b07e-04180f49ba79 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1472 microversion: 2.1 time: 0.452534 Oct 25 03:11:21.979293 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1401/2618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:21 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:21.989163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f06b41b9-8692-4220-bb56-6cacbc27f01e tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd32a4a4c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:21.996263 n-d-862355-1 devstack@n-api.service[120562]: WARNING oslo_db.sqlalchemy.utils [None req-f06b41b9-8692-4220-bb56-6cacbc27f01e tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 25 03:11:22.013813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:22.024329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f06b41b9-8692-4220-bb56-6cacbc27f01e tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 368 microversion: 2.2 time: 0.043145 Oct 25 03:11:22.025247 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1402/2619] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Oct 25 03:11:21 2022] GET /compute/v2.1/os-keypairs => generated 368 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:22.029446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-919cd8e4-1def-4d5a-aedb-b0947f991b8d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1604 microversion: 2.1 time: 0.146911 Oct 25 03:11:22.030683 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1218/2620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:21 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:22.044742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50a47012-db51-4550-81b8-1d4729c9455d tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd32a6ef70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:22.072765 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50a47012-db51-4550-81b8-1d4729c9455d tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54801415" status: 204 len: 0 microversion: 2.2 time: 0.031775 Oct 25 03:11:22.087650 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1403/2621] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Oct 25 03:11:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54801415 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:22.111160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Action: 'create', calling method: .version_select at 0x7efd3363ea60>, body: {"keypair": {"name": "tempest-keypair-1726385007", "type": "x509"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:22.129988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:22.136901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:22.159771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.processutils [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmptga2mnar/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptga2mnar/temp.key -subj /CN=4d0e4d53be4f4be695c5e3a8311982f9 -extensions v3_req_client {{(pid=120563) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 25 03:11:22.415223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.processutils [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmptga2mnar/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptga2mnar/temp.key -subj /CN=4d0e4d53be4f4be695c5e3a8311982f9 -extensions v3_req_client" returned: 0 in 0.255s {{(pid=120563) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 25 03:11:22.416321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.processutils [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmptga2mnar/temp.key -password pass: {{(pid=120563) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 25 03:11:22.449263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.processutils [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] CMD "openssl pkcs12 -export -inkey /tmp/tmptga2mnar/temp.key -password pass:" returned: 0 in 0.032s {{(pid=120563) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 25 03:11:22.498778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:22.500351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:22.508205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:22.509285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:22.510395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:22.511768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:22.513501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:22.514261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:22.563167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:22.575049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Getting quotas for user 4d0e4d53be4f4be695c5e3a8311982f9 and project 02d4cd0803dd4f53b731fa7e9654c079. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:22.580830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:22.603539 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b06710f6-c5ed-4b5e-b5de-7fe2f5fd6329 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.506567 Oct 25 03:11:22.610824 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1219/2622] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Oct 25 03:11:22 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 509 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:22.626656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:22.630943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:22.643346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:22.645100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:22.646204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:22.648773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:22.649450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:22.650599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:22.869712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:22.880133 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-05af379f-7f97-409f-ac4b-b500f33147e6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.274118 Oct 25 03:11:22.881474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1220/2623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:22 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:22.902020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70ee2062-cb4b-4350-bfa9-ff4b881c4b4e tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd3383a940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:22.915005 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-70ee2062-cb4b-4350-bfa9-ff4b881c4b4e tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-1726385007" status: 200 len: 1534 microversion: 2.2 time: 0.030314 Oct 25 03:11:22.923990 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1221/2624] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Oct 25 03:11:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1726385007 => generated 1534 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:22.934090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3805b2b-80c9-43b9-8369-ddfca9f171ad tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd334fb160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:22.939034 n-d-862355-1 devstack@n-api.service[120563]: WARNING oslo_db.sqlalchemy.utils [None req-b3805b2b-80c9-43b9-8369-ddfca9f171ad tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 25 03:11:22.945762 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3805b2b-80c9-43b9-8369-ddfca9f171ad tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.019661 Oct 25 03:11:22.953743 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1222/2625] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Oct 25 03:11:22 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:22.960634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-617ae6db-c1a1-4be5-8bff-02453c812225 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] Calling method '.version_select at 0x7efd33363ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:22.991489 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-617ae6db-c1a1-4be5-8bff-02453c812225 tempest-KeyPairsV22TestJSON-1296693915 tempest-KeyPairsV22TestJSON-1296693915-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726385007" status: 204 len: 0 microversion: 2.2 time: 0.036230 Oct 25 03:11:23.002041 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1223/2626] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Oct 25 03:11:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726385007 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:23.026094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:23.028012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:23.035482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.036153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.036763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.037745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.038365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.039754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.190117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:23.206284 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-06f6d215-47b4-40ff-b9ce-8aed54437e64 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.711764 Oct 25 03:11:23.207176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1404/2627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:22 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:23.233438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:23.234102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:23.265631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:23.271969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.273465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.274145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.275709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.277753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.278591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.302007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:23.324245 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99ccf153-0e96-4d80-ba18-19dcb4cc5f9c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.316955 Oct 25 03:11:23.326475 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1224/2628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:23 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:23.346505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-06893aab-4c49-4ae9-9137-6d6a9e9b9bcf req-560d7631-cc20-4eeb-b3e2-e8d8069c9748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b", "name": "network-vif-deleted", "tag": "7dc69e0e-d64b-4150-a446-65d3737a6071"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:23.383884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06893aab-4c49-4ae9-9137-6d6a9e9b9bcf req-560d7631-cc20-4eeb-b3e2-e8d8069c9748 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.384368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06893aab-4c49-4ae9-9137-6d6a9e9b9bcf req-560d7631-cc20-4eeb-b3e2-e8d8069c9748 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.384799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06893aab-4c49-4ae9-9137-6d6a9e9b9bcf req-560d7631-cc20-4eeb-b3e2-e8d8069c9748 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.431286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-06893aab-4c49-4ae9-9137-6d6a9e9b9bcf req-560d7631-cc20-4eeb-b3e2-e8d8069c9748 service nova] Creating event network-vif-deleted:7dc69e0e-d64b-4150-a446-65d3737a6071 for instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b on n-h1-862355-1 Oct 25 03:11:23.440093 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-06893aab-4c49-4ae9-9137-6d6a9e9b9bcf req-560d7631-cc20-4eeb-b3e2-e8d8069c9748 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109509 Oct 25 03:11:23.441030 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1225/2629] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:23.649222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6e67c6afc74b39bb5cfac771f3e7d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493ac819082a42af8d6e3c702c510a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:23.662812 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65610ff3-8e7e-4ce4-aa4d-fdcf6bd92df2 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 200 len: 1321 microversion: 2.1 time: 0.452800 Oct 25 03:11:23.663411 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1405/2630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:23 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:23.893724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7f87059b-830a-4996-b428-975aa0b14a05 req-8ad0366a-3028-4a6a-8aff-9ebb1e6c1e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdb320-4cd3-48e9-b40e-6b82a74c73c0", "name": "network-vif-plugged", "status": "completed", "tag": "12a1bd3a-1f15-4dc5-a880-2fea8d305ef9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:23.905619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:23.906479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:23.921024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.921518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.921977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.929456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.929985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.952050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.961641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7f87059b-830a-4996-b428-975aa0b14a05 req-8ad0366a-3028-4a6a-8aff-9ebb1e6c1e53 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:23.962479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7f87059b-830a-4996-b428-975aa0b14a05 req-8ad0366a-3028-4a6a-8aff-9ebb1e6c1e53 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:23.963127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7f87059b-830a-4996-b428-975aa0b14a05 req-8ad0366a-3028-4a6a-8aff-9ebb1e6c1e53 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:23.990304 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7f87059b-830a-4996-b428-975aa0b14a05 req-8ad0366a-3028-4a6a-8aff-9ebb1e6c1e53 service nova] Creating event network-vif-plugged:12a1bd3a-1f15-4dc5-a880-2fea8d305ef9 for instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 on n-h2-862355-1 Oct 25 03:11:24.002692 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7f87059b-830a-4996-b428-975aa0b14a05 req-8ad0366a-3028-4a6a-8aff-9ebb1e6c1e53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111553 Oct 25 03:11:24.004595 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1226/2631] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:24.032756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=30 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:24.234345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:24.235249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:24.270149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:24.277123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:24.278431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:24.279882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:24.284728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:24.288741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:24.343712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:24.778123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:24.790997 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06d0e487-df45-4c9c-80ca-b6e6b8cd1f0b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.563479 Oct 25 03:11:24.792131 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1227/2632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:24 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:24.803227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:24.805466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:24.824098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:24.831886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:24.833265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:24.838371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:24.838902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:24.839378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:24.888948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:24.898310 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6158eb08-f235-4a07-bfba-51789753587e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.996389 Oct 25 03:11:24.910278 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1406/2633] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:23 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:24.919790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:24.920655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:24.926924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:24.927628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:24.928244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:24.930467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:24.931518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:24.933710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:24.974975 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] HTTP exception thrown: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Request method failure captured: Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b HTTP/1.1 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Jb1broKUreObl3eBApe7nsIPCglEclFB9zyqbEmn9nnfzqo81PPiHFVCFYRsPHU99SxLICxKq_NRQgL7NEc7VV1Oasu-QAi_0TQXUVDMshvo2Q_Sy_ycDEMIU3MVsbbG9RYnRbPJe0-Yp-FZHcYqWgOazabF3VxHTmLCIAmEbjpm0 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_493ac819082a42af8d6e3c702c510a3b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/493ac819082a42af8d6e3c702c510a3b"}]}] Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 6a6e67c6afc74b39bb5cfac771f3e7d7 Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b'} Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:24.980181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:24.985595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Returning 404 to user: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:24.988985 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e6ddb43-f19f-4454-9533-1077ea27335d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 404 len: 111 microversion: 2.1 time: 0.083715 Oct 25 03:11:24.989763 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1407/2634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:24 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:25.164424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:25.183486 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-517ad3cc-0268-4e66-b7c6-45b00bb9d411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.390047 Oct 25 03:11:25.184115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1228/2635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:24 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:25.189432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a04d504-9520-41fe-bd87-e9c0e5d67ca4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '.version_select at 0x7efd339c05e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:25.231673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a04d504-9520-41fe-bd87-e9c0e5d67ca4 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991134758" status: 202 len: 0 microversion: 2.1 time: 0.046229 Oct 25 03:11:25.232424 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1229/2636] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991134758 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:11:25.483169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4637b375-611a-4374-9c24-af2b69ce7288 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Action: 'create', calling method: .version_select at 0x7efd32a6e670>, body: {"keypair": {"name": "tempest-keypair-735665339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsr8C/e/7VE3LNLPppmzM/eNbfeRDN61/s2zOvkcahMz4ogk04pRABn3Nlkw/EpFHej61rukWQEfyQ1ust9wvac2/kdZDTvB+Iqspw3dSf66aT2kXRk6EKAt4YyuHfazQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:25.528218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4637b375-611a-4374-9c24-af2b69ce7288 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Getting quotas for project 25697f99614645ec9d900ebaf8da1cfd. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:25.542613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4637b375-611a-4374-9c24-af2b69ce7288 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Getting quotas for user 102711a2938c4bc4a6951fc200d88721 and project 25697f99614645ec9d900ebaf8da1cfd. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:25.605878 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4637b375-611a-4374-9c24-af2b69ce7288 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.614750 Oct 25 03:11:25.606506 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1408/2637] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:11:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:25.817415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:25.818296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:25.844365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:25.848681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:25.853123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:25.854462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:25.855236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:25.856034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:25.933152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:25.940356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:25.951794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:25.954310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:25.960315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:25.962308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:25.963270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:25.964058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:26.464546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:26.480090 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47190ca5-0aba-4632-baf3-01b6873b42f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 0.554906 Oct 25 03:11:26.484343 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1409/2638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:25 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:26.491298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-84453371-01fe-42d7-bf3e-2843114989f0 req-e9fdc1ea-00b1-42c4-9631-a253b0762a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a8049-3445-4a56-8f6c-26d85d588b7c", "name": "network-vif-plugged", "status": "completed", "tag": "333c6ab5-b612-4f7e-83cf-a0b2f87ae317"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:26.521156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-84453371-01fe-42d7-bf3e-2843114989f0 req-e9fdc1ea-00b1-42c4-9631-a253b0762a3c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:26.522954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-84453371-01fe-42d7-bf3e-2843114989f0 req-e9fdc1ea-00b1-42c4-9631-a253b0762a3c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:26.524174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-84453371-01fe-42d7-bf3e-2843114989f0 req-e9fdc1ea-00b1-42c4-9631-a253b0762a3c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:26.540252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-84453371-01fe-42d7-bf3e-2843114989f0 req-e9fdc1ea-00b1-42c4-9631-a253b0762a3c service nova] Creating event network-vif-plugged:333c6ab5-b612-4f7e-83cf-a0b2f87ae317 for instance 227a8049-3445-4a56-8f6c-26d85d588b7c on n-h1-862355-1 Oct 25 03:11:26.547377 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-84453371-01fe-42d7-bf3e-2843114989f0 req-e9fdc1ea-00b1-42c4-9631-a253b0762a3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061205 Oct 25 03:11:26.548669 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1410/2639] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:26.557384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:26.559059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:26.567756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:26.568818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:26.570513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:26.572022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:26.572724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:26.573367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:26.732096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:26.753221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-adbd4464-fe72-4c10-bcff-cd82011cb92c tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1333 microversion: 2.1 time: 0.940044 Oct 25 03:11:26.753872 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1230/2640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:25 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1333 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:27.506683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:27.507648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:27.520020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:27.522191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:27.524507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:27.525448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:27.526154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:27.527178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:27.533624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:27.536420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ef8f2aa-c4d8-4e95-a3f8-05f6387e5085 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.985829 Oct 25 03:11:27.537027 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1411/2641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:26 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:27.776589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:27.777214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:27.787939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:27.788683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:27.789306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:27.792721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:27.793374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:27.794041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.110539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:28.120831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1caf128-7d98-4c42-a27e-67ef92b095b5 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1668 microversion: 2.1 time: 0.348691 Oct 25 03:11:28.122305 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1412/2642] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:27 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:28.147174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:28.149267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:28.158188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.159531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.160198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.161118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.165481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.166352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.230197 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b17e418c-f07c-4e97-ad29-c06cdcdaf04a tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0/ips" status: 200 len: 179 microversion: 2.1 time: 0.088262 Oct 25 03:11:28.231533 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1413/2643] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:11:28 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0/ips => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:11:28.260627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:28.267162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:28.280214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.283189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.284168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.296631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.299043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.302111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.379002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:11:28.572666 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67ad9b14-0a51-4d10-9034-4279b8cad667 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 204 len: 0 microversion: 2.1 time: 0.333372 Oct 25 03:11:28.574358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1414/2644] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:11:28 2022] DELETE /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:11:28.586821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:28.587568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:28.591142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:28.594469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.595230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.595988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.597015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.597666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.598380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.603265 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ef7572a-b488-4573-b693-e5a30a2839b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1315 microversion: 2.1 time: 1.100723 Oct 25 03:11:28.603893 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1231/2645] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:27 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1315 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:28.618967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:28.618967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:28.632817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.632948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.638204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.641246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:28.642002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:28.642448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:28.845166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:28.857077 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44c5af67-a1ea-42b9-b4f9-6c9a7bdb6cac tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.281309 Oct 25 03:11:28.859128 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1415/2646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:28 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:29.474619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:29.494662 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cab826af-7723-41c2-9b94-3bfef84d81a0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1674 microversion: 2.1 time: 0.889660 Oct 25 03:11:29.495281 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1232/2647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:28 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1674 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:29.642956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:29.644253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:29.659690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:29.661288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:29.665311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:29.667153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:29.669213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:29.670920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:29.882121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:29.886369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:29.907121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:29.907638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:29.910984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:29.912224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:29.914313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:29.916683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:30.095948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:30.115076 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2cc450b-5934-42fc-a1df-b1810fe2726a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1503 microversion: 2.1 time: 0.478486 Oct 25 03:11:30.120498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1416/2648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:29 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:30.433049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:30.459064 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a69336f4-db49-4cfb-beea-a7c3e6ed28f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.576116 Oct 25 03:11:30.462364 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1233/2649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:29 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:30.523664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:30.524717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:30.545271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:30.549529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:30.550250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:30.556093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:30.558124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:30.560213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:31.095951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:31.107314 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05050a84-80cf-4fc0-b830-55fea4ac050b tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1674 microversion: 2.1 time: 0.588749 Oct 25 03:11:31.109710 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1417/2650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:30 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1674 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:31.447454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-11034681", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "19052301-9c01-414d-93f4-28db86f14bd8"}], "security_groups": [{"name": "tempest-securitygroup--1378876103"}], "key_name": "tempest-keypair-735665339", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:31.490082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:31.491413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:31.499093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:31.501461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:31.504776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:31.505931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:31.507076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:31.509974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:31.741078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] validate_networks() for [('19052301-9c01-414d-93f4-28db86f14bd8', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:11:32.412329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:32.422704 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16812af5-2b81-45e3-bf57-112881765925 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.936352 Oct 25 03:11:32.424877 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1418/2651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:31 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:32.434698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:32.437188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:32.457107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:32.459923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:32.460498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:32.475810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:32.476678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:32.477136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:32.518005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:32.588971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=42 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:33.020055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:11:33.020489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:11:33.020997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:11:33.022057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:11:33.022504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:11:33.060427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:33.061219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:33.064213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:33.066285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:33.069910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:33.070741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:33.138261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Getting quotas for project 25697f99614645ec9d900ebaf8da1cfd. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:33.165835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Getting quotas for user 102711a2938c4bc4a6951fc200d88721 and project 25697f99614645ec9d900ebaf8da1cfd. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:33.238829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:11:33.250748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:11:33.347597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:33.357892 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-06d4e409-a3ed-4f9b-a533-078b473e5f5d tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1653 microversion: 2.1 time: 0.929541 Oct 25 03:11:33.371057 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1419/2652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:32 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1653 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:33.385735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b9f75e8e-a835-4ee8-ada8-64a7b9a1b42a req-3e567f3a-4798-4853-a763-9bbe87dfc532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdb320-4cd3-48e9-b40e-6b82a74c73c0", "name": "network-vif-deleted", "tag": "097cb95e-409f-44ca-bc61-b74a15139585"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:33.404803 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-170566a1-c2a2-41c5-aa79-7aad749de311 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.963929 Oct 25 03:11:33.406272 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1234/2653] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:11:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:11:33.411939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95ae8366-542f-4951-b438-5637fb5aa5d1"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:33.419039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:33.427550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:33.428843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:33.429562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b9f75e8e-a835-4ee8-ada8-64a7b9a1b42a req-3e567f3a-4798-4853-a763-9bbe87dfc532 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:33.431450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:33.431782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b9f75e8e-a835-4ee8-ada8-64a7b9a1b42a req-3e567f3a-4798-4853-a763-9bbe87dfc532 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:33.432599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b9f75e8e-a835-4ee8-ada8-64a7b9a1b42a req-3e567f3a-4798-4853-a763-9bbe87dfc532 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:33.432746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:33.434485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:33.435275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:33.484535 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b9f75e8e-a835-4ee8-ada8-64a7b9a1b42a req-3e567f3a-4798-4853-a763-9bbe87dfc532 service nova] Creating event network-vif-deleted:097cb95e-409f-44ca-bc61-b74a15139585 for instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 on n-h2-862355-1 Oct 25 03:11:33.503578 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b9f75e8e-a835-4ee8-ada8-64a7b9a1b42a req-3e567f3a-4798-4853-a763-9bbe87dfc532 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128781 Oct 25 03:11:33.509293 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1420/2654] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:33.522250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-403aa9b0-32bd-4c79-9509-cc14c2a0dd50 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:33.528386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-403aa9b0-32bd-4c79-9509-cc14c2a0dd50 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:33.768716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-403aa9b0-32bd-4c79-9509-cc14c2a0dd50 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:33.785422 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-403aa9b0-32bd-4c79-9509-cc14c2a0dd50 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1239 microversion: 2.1 time: 0.274503 Oct 25 03:11:33.790980 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1421/2655] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:33 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1239 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:33.805772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:33.809181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:33.829841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:33.833003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:33.833826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:33.836923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:33.838879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:33.840659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:34.023092 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d27788a-180a-4500-807a-92eeca669cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613312 Oct 25 03:11:34.034441 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1235/2656] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:11:33 2022] POST /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:34.398066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:34.398066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:34.415697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:34.416487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:34.417146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:34.420230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:34.420897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:34.421518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:34.702407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:34.722173 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-53de35b6-f544-41ba-8614-3a202f22e0fa tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1453 microversion: 2.1 time: 0.330642 Oct 25 03:11:34.727046 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1236/2657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:34 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1453 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:34.817953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b40d7ce6-de06-4d9b-84e6-76967d356e45 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:34.818702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b40d7ce6-de06-4d9b-84e6-76967d356e45 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:35.026508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b40d7ce6-de06-4d9b-84e6-76967d356e45 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:35.049724 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b40d7ce6-de06-4d9b-84e6-76967d356e45 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1239 microversion: 2.1 time: 0.236437 Oct 25 03:11:35.051200 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1237/2658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:34 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1239 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:35.157708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:35.167769 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18456fed-7dfd-4828-9d13-3c2c7c3116a6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 1.374959 Oct 25 03:11:35.170720 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1422/2659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:33 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:35.550934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fdb320-4cd3-48e9-b40e-6b82a74c73c0", "name": "network-vif-deleted", "tag": "12a1bd3a-1f15-4dc5-a880-2fea8d305ef9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:35.588352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:35.588837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:35.589278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:35.620342 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] Creating event network-vif-deleted:12a1bd3a-1f15-4dc5-a880-2fea8d305ef9 for instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 on n-h2-862355-1 Oct 25 03:11:35.641311 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094499 Oct 25 03:11:35.641982 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1238/2660] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:35.751757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:35.752685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:35.775556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:35.776689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:35.776689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:35.778371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:35.780430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:35.781818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:35.892187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:35.893944 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f3e4ed26-37e0-496d-b8a5-cf645739da73 req-99bd9fbd-8246-45bc-acfa-584f3d34ecf6 service nova] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001826 Oct 25 03:11:35.899275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:35.901564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:35.902292 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1239/2661] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 25 03:11:35 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 25 03:11:35.904116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:35.904748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lazy-loading 'fault' on Instance uuid c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:11:36.078950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:36.079655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:36.100613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:36.101131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:36.101577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:36.102339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:36.102882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:36.103395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:36.115764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab41f1b82ab9460e8127e95241317f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee4fd42dd0b405f9549e74a07fe340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:36.143093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9642a275-7d71-434e-8162-a926cb520196 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 200 len: 1302 microversion: 2.1 time: 0.395653 Oct 25 03:11:36.161288 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1423/2662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:35 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 1302 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:36.199842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:36.200759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:36.212776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:36.214853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:36.216160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:36.216893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:36.217354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:36.231283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:36.316646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:36.326178 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0db65ae3-f3b7-4a5e-8009-f91e0698c5af tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1291 microversion: 2.1 time: 0.251287 Oct 25 03:11:36.343890 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1240/2663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:36 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1291 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:37.113511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:37.129074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e90641f-03f5-4271-8abf-f040f1f04b76 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.932276 Oct 25 03:11:37.131919 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1424/2664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:36 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:37.169933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:37.171279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:37.185446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:37.194436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:37.198360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:37.199410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:37.200048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:37.200671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:37.235540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] HTTP exception thrown: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Request method failure captured: Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 HTTP/1.1 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NxE29fE6PrxVpTA3HZGEG3XDX2OcdgGdkoV2IW7Ae3m31NJX9vpRYmanM9bEPkn8Y7751vVuPC-Lr1kalGNj5E3-qMiwyTwUwi-O4enAXu9xxU0SZVRCT22P8jAfTGWOfVyme6fsU3ppLkeYLUjPa3sQFbud9KNvNX8AnWMlHFvCg Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ee4fd42dd0b405f9549e74a07fe340b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ee4fd42dd0b405f9549e74a07fe340b"}]}] Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ab41f1b82ab9460e8127e95241317f05 Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c0fdb320-4cd3-48e9-b40e-6b82a74c73c0'} Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:37.237600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:37.242397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:37.242397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:37.242397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:37.242397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:37.242397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:37.242397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:37.242397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:37.244377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Returning 404 to user: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:37.245858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4b705821-34f4-4ccb-a275-c4df00aae1f0 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 404 len: 111 microversion: 2.1 time: 0.080006 Oct 25 03:11:37.257923 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1241/2665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:37 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:37.373882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:37.376513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:37.402928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:37.404124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:37.405087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:37.407657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:37.408363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:37.410313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:37.722253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:37.739075 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05f29b75-e708-40ec-a3b2-4841be083e8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1297 microversion: 2.1 time: 0.374936 Oct 25 03:11:37.740210 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1425/2666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:37 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1297 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:38.155376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:38.156015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:38.164714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:38.165297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:38.165750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:38.166400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:38.166864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:38.167303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:38.751916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:38.764424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:38.765049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:38.775070 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c7c5399-e1ff-4f0c-a579-d2ffca0e1b01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.623283 Oct 25 03:11:38.776341 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1242/2667] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:38 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:38.780043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:38.780544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:38.780997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:38.781759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:38.782225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:38.782644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:38.916522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:38.917634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:38.938381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:38.940656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:38.943615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:38.947328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:38.948142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:38.952867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:39.007824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] HTTP exception thrown: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Request method failure captured: Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b HTTP/1.1 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Jb1broKUreObl3eBApe7nsIPCglEclFB9zyqbEmn9nnfzqo81PPiHFVCFYRsPHU99SxLICxKq_NRQgL7NEc7VV1Oasu-QAi_0TQXUVDMshvo2Q_Sy_ycDEMIU3MVsbbG9RYnRbPJe0-Yp-FZHcYqWgOazabF3VxHTmLCIAmEbjpm0 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_493ac819082a42af8d6e3c702c510a3b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/493ac819082a42af8d6e3c702c510a3b"}]}] Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 6a6e67c6afc74b39bb5cfac771f3e7d7 Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b'} Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:39.015107 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.020044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Returning 404 to user: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:39.024143 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cbedfeaa-403d-4c8c-ab67-c3450e7b036d tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 404 len: 111 microversion: 2.1 time: 0.109124 Oct 25 03:11:39.025134 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1243/2668] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:11:38 2022] DELETE /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:39.044924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:39.045554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:39.079564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:39.084040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:39.087027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:39.088774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:39.092076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:39.093596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:39.141702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:39.149642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] HTTP exception thrown: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Request method failure captured: Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b HTTP/1.1 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Jb1broKUreObl3eBApe7nsIPCglEclFB9zyqbEmn9nnfzqo81PPiHFVCFYRsPHU99SxLICxKq_NRQgL7NEc7VV1Oasu-QAi_0TQXUVDMshvo2Q_Sy_ycDEMIU3MVsbbG9RYnRbPJe0-Yp-FZHcYqWgOazabF3VxHTmLCIAmEbjpm0 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_493ac819082a42af8d6e3c702c510a3b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/493ac819082a42af8d6e3c702c510a3b"}]}] Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 6a6e67c6afc74b39bb5cfac771f3e7d7 Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b'} Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:39.153800 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.158374 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:39.158374 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:39.158374 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:39.158374 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:39.158374 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:39.158374 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. Oct 25 03:11:39.158374 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:39.158996 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ada3988-ab2d-441f-9a47-1f09e65672f9 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1297 microversion: 2.1 time: 0.393779 Oct 25 03:11:39.160009 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1426/2669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:38 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1297 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:39.163276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Returning 404 to user: Instance 73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:39.165527 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-09d5c2f1-ab7e-4d01-bc1b-83fcda08d9d9 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b" status: 404 len: 111 microversion: 2.1 time: 0.136512 Oct 25 03:11:39.172600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1244/2670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:39 2022] GET /compute/v2.1/servers/73b7c7a5-c09d-4fcc-b8d1-b290c9a6b18b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:39.805263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:39.806043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:39.824140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:39.827766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:39.827766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:39.827766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:39.827766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:39.832028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:40.186535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:40.187151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:40.207278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:40.210114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:40.211036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:40.214001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:40.216738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:40.217854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:40.712798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:40.722479 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f80e8ed2-33d9-4359-9ab7-15d2b269e487 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 0.541367 Oct 25 03:11:40.723067 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1245/2671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:40 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:40.872453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:40.889092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f44a227b-756c-4d3f-8efb-f988d44b72cf tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 1.087951 Oct 25 03:11:40.896786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1427/2672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:39 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:41.411852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8dc9430-29be-4f92-bd19-54cd30b4b55e tempest-ExtensionsTest-168058184 tempest-ExtensionsTest-168058184-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:41.420130 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8dc9430-29be-4f92-bd19-54cd30b4b55e tempest-ExtensionsTest-168058184 tempest-ExtensionsTest-168058184-project] 10.222.0.36 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.694187 Oct 25 03:11:41.424585 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1246/2673] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 25 03:11:40 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:41.432860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c31fb69d-d30e-4ec2-b514-a4594d7decb6 tempest-ExtensionsTest-168058184 tempest-ExtensionsTest-168058184-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:41.434943 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c31fb69d-d30e-4ec2-b514-a4594d7decb6 tempest-ExtensionsTest-168058184 tempest-ExtensionsTest-168058184-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008259 Oct 25 03:11:41.446237 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1428/2674] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 25 03:11:41 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:11:41.750860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:41.751500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:41.775034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:41.775034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:41.775034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:41.775034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:41.775034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:41.775034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:41.925270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:41.925925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:41.941256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:41.949852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:41.950424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:41.951189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:41.951849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:41.952451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:42.392002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:42.401824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fd90dd00-cd66-4656-957c-73a57c963d26 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 0.654701 Oct 25 03:11:42.407179 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1247/2675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:41 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:42.461790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:42.478196 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32fa7c1b-2cc3-42f9-a3f7-0e3e5d968709 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 0.556666 Oct 25 03:11:42.480079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1429/2676] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:41 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:42.850091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:42.851350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:42.863457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:42.865473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:42.866132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:42.868584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:42.869647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:42.871543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:42.902850 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] HTTP exception thrown: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Request method failure captured: Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 HTTP/1.1 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NxE29fE6PrxVpTA3HZGEG3XDX2OcdgGdkoV2IW7Ae3m31NJX9vpRYmanM9bEPkn8Y7751vVuPC-Lr1kalGNj5E3-qMiwyTwUwi-O4enAXu9xxU0SZVRCT22P8jAfTGWOfVyme6fsU3ppLkeYLUjPa3sQFbud9KNvNX8AnWMlHFvCg Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ee4fd42dd0b405f9549e74a07fe340b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ee4fd42dd0b405f9549e74a07fe340b"}]}] Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ab41f1b82ab9460e8127e95241317f05 Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c0fdb320-4cd3-48e9-b40e-6b82a74c73c0'} Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:42.904765 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.910043 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.913291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Returning 404 to user: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:42.914369 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-25fb495f-4ab6-47e1-8ba2-b9348fd21332 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 404 len: 111 microversion: 2.1 time: 0.070750 Oct 25 03:11:42.915462 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1248/2677] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:11:42 2022] DELETE /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:42.930590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:42.931219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: c0fdb320-4cd3-48e9-b40e-6b82a74c73c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:42.944393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:42.945208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:42.945912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:42.946806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:42.948309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:42.950016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:42.979273 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] HTTP exception thrown: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Request method failure captured: Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 HTTP/1.1 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NxE29fE6PrxVpTA3HZGEG3XDX2OcdgGdkoV2IW7Ae3m31NJX9vpRYmanM9bEPkn8Y7751vVuPC-Lr1kalGNj5E3-qMiwyTwUwi-O4enAXu9xxU0SZVRCT22P8jAfTGWOfVyme6fsU3ppLkeYLUjPa3sQFbud9KNvNX8AnWMlHFvCg Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ee4fd42dd0b405f9549e74a07fe340b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ee4fd42dd0b405f9549e74a07fe340b"}]}] Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ab41f1b82ab9460e8127e95241317f05 Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'c0fdb320-4cd3-48e9-b40e-6b82a74c73c0'} Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:42.982923 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Returning 404 to user: Instance c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e57fafbe-b436-490e-b5ac-96933681d514 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0" status: 404 len: 111 microversion: 2.1 time: 0.060667 Oct 25 03:11:42.988601 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1430/2678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:42 2022] GET /compute/v2.1/servers/c0fdb320-4cd3-48e9-b40e-6b82a74c73c0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:11:42.993076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:42.993592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:43.020915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.021420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.021896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.026460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.026762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.027207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.059599 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] HTTP exception thrown: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Request method failure captured: Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b HTTP/1.1 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NxE29fE6PrxVpTA3HZGEG3XDX2OcdgGdkoV2IW7Ae3m31NJX9vpRYmanM9bEPkn8Y7751vVuPC-Lr1kalGNj5E3-qMiwyTwUwi-O4enAXu9xxU0SZVRCT22P8jAfTGWOfVyme6fsU3ppLkeYLUjPa3sQFbud9KNvNX8AnWMlHFvCg Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ee4fd42dd0b405f9549e74a07fe340b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ee4fd42dd0b405f9549e74a07fe340b"}]}] Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ab41f1b82ab9460e8127e95241317f05 Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b'} Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:43.060861 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Returning 404 to user: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-caca6eaa-c75b-4b8e-a4a5-c4c017ca9850 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 404 len: 111 microversion: 2.1 time: 0.073389 Oct 25 03:11:43.065454 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1249/2679] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:11:42 2022] DELETE /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:43.076220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:43.076853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] [instance: ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:43.085046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.085543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.090197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.091375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.092018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.093029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.117320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] HTTP exception thrown: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Request method failure captured: Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b HTTP/1.1 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NxE29fE6PrxVpTA3HZGEG3XDX2OcdgGdkoV2IW7Ae3m31NJX9vpRYmanM9bEPkn8Y7751vVuPC-Lr1kalGNj5E3-qMiwyTwUwi-O4enAXu9xxU0SZVRCT22P8jAfTGWOfVyme6fsU3ppLkeYLUjPa3sQFbud9KNvNX8AnWMlHFvCg Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5ee4fd42dd0b405f9549e74a07fe340b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5ee4fd42dd0b405f9549e74a07fe340b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5ee4fd42dd0b405f9549e74a07fe340b"}]}] Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 5ee4fd42dd0b405f9549e74a07fe340b Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestMultiNic-795862197 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ab41f1b82ab9460e8127e95241317f05 Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestMultiNic-795862197-project Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b'} Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:43.119157 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.125053 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:43.125053 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:43.125053 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:43.125053 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:43.125053 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:43.125053 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. Oct 25 03:11:43.125053 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:43.126914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] Returning 404 to user: Instance ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:43.127786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-29a55e2f-cdbc-4171-9d54-80d8dc857e52 tempest-ServersTestMultiNic-795862197 tempest-ServersTestMultiNic-795862197-project] 10.222.0.36 "GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b" status: 404 len: 111 microversion: 2.1 time: 0.057435 Oct 25 03:11:43.135636 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1431/2680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:43 2022] GET /compute/v2.1/servers/ffc48b27-1a95-4b3a-990e-a89dd9f3cd9b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:43.429401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:43.430147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:43.444046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:43.463069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.463570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.464014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.464736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.465195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.465623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.508729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:43.509350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:43.523549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.527818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.534957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.539365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:43.540074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:43.540768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:43.784079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:44.071682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:44.086805 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-070d2501-81ba-4363-9117-273e3abcc401 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 0.662191 Oct 25 03:11:44.087409 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1250/2681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:43 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:44.660538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3f696d43-e9cc-4e13-87ee-975a06f63bd7 req-c07c42db-63d1-4ee3-8091-83235b9eac59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37182056-b6bc-4b4a-b91e-3ee4f275ba7b", "tag": "08f14943-7c8e-44f8-8c0d-d7fe94ed260c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:44.675378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:44.683658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3f696d43-e9cc-4e13-87ee-975a06f63bd7 req-c07c42db-63d1-4ee3-8091-83235b9eac59 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:44.686216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3f696d43-e9cc-4e13-87ee-975a06f63bd7 req-c07c42db-63d1-4ee3-8091-83235b9eac59 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:44.691549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3f696d43-e9cc-4e13-87ee-975a06f63bd7 req-c07c42db-63d1-4ee3-8091-83235b9eac59 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:44.696637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:44.727367 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f83a664f-c8ac-4cb3-bb34-55d2f0f97528 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1477 microversion: 2.1 time: 1.208848 Oct 25 03:11:44.729507 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3f696d43-e9cc-4e13-87ee-975a06f63bd7 req-c07c42db-63d1-4ee3-8091-83235b9eac59 service nova] Creating event network-changed:08f14943-7c8e-44f8-8c0d-d7fe94ed260c for instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b on n-h1-862355-1 Oct 25 03:11:44.739352 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1432/2682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:43 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1477 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:44.753612 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3f696d43-e9cc-4e13-87ee-975a06f63bd7 req-c07c42db-63d1-4ee3-8091-83235b9eac59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097101 Oct 25 03:11:44.758747 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1251/2683] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:11:45.111626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:45.112827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:45.127025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:45.136218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:45.138441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:45.140961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:45.141609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:45.142984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:45.703548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:45.714635 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b45b3cff-3e2b-4b3e-acd9-6d64149570c2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 0.607697 Oct 25 03:11:45.723375 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1433/2684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:45 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:45.758152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:45.759644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:45.772642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:45.780125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:45.781749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:45.783889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:45.784867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:45.787191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:45.789049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:46.491877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:46.500866 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-257157c9-232c-4cfc-819c-a8a456954e26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1476 microversion: 2.1 time: 0.748236 Oct 25 03:11:46.515119 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1252/2685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:45 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1476 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:46.694862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1071222408", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b7d479e5-7ea5-4e20-a33c-900aef50f435"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:46.748014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:46.748783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:46.764631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:46.765873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:46.766549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:46.767482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:46.768148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:46.768787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:46.856228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] validate_networks() for [('b7d479e5-7ea5-4e20-a33c-900aef50f435', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:11:48.220833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:11:48.221958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:11:48.222598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:11:48.223745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:11:48.224323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:11:48.242613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:48.243350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:48.243953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:48.244874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:48.245494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:48.246151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:48.278761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:48.285737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Getting quotas for project 64bf316f35434551a65596f9207677e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:11:48.292817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a8af4e6b-b0f9-43ad-86b2-b6a7c640c806 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 1.548902 Oct 25 03:11:48.301225 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1253/2686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:46 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:48.308775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Getting quotas for user fb9efa85c53e4db4b3373f0a94d699de and project 64bf316f35434551a65596f9207677e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:11:48.362815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Going to run 2 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:11:48.365624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 449f1213-c005-4cef-b244-b057bd73d68e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:11:48.447008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=449f1213-c005-4cef-b244-b057bd73d68e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:11:48.630560 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-023821d2-1822-45c3-93e8-7e4894738685 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.499210 Oct 25 03:11:48.633719 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1434/2687] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:11:48.792371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-29e74067-027c-4585-b05a-0ae84bfcc211 req-cb73a298-b497-4aeb-aaab-3732f8bb3ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56dad91-2314-4ab2-8f7b-b39e9fb7b718", "name": "network-vif-unplugged", "status": "completed", "tag": "a58f5c84-d26c-4f37-af47-222a12750747"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:48.839481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-29e74067-027c-4585-b05a-0ae84bfcc211 req-cb73a298-b497-4aeb-aaab-3732f8bb3ebf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:48.840397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-29e74067-027c-4585-b05a-0ae84bfcc211 req-cb73a298-b497-4aeb-aaab-3732f8bb3ebf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:48.846278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-29e74067-027c-4585-b05a-0ae84bfcc211 req-cb73a298-b497-4aeb-aaab-3732f8bb3ebf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:48.878767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-29e74067-027c-4585-b05a-0ae84bfcc211 req-cb73a298-b497-4aeb-aaab-3732f8bb3ebf service nova] Creating event network-vif-unplugged:a58f5c84-d26c-4f37-af47-222a12750747 for instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 on n-h1-862355-1 Oct 25 03:11:48.898487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-29e74067-027c-4585-b05a-0ae84bfcc211 req-cb73a298-b497-4aeb-aaab-3732f8bb3ebf service nova] Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:11:48.931182 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-29e74067-027c-4585-b05a-0ae84bfcc211 req-cb73a298-b497-4aeb-aaab-3732f8bb3ebf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.621082 Oct 25 03:11:48.933518 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1254/2688] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:48.949142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:48.953774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:48.999467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:49.003671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:49.008203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:49.009424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:49.018175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:49.024031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:49.074172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24b0c1cc-2da3-48eb-9279-5c2f1b373c57 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Action: 'create', calling method: .version_select at 0x7efd32ab99d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-475967644"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:49.873768 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24b0c1cc-2da3-48eb-9279-5c2f1b373c57 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.236223 Oct 25 03:11:49.885024 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1435/2689] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Oct 25 03:11:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1253 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 25 03:11:49.908238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:49.911407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:49.949341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:49.950882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:49.954232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:49.959485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:49.962886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:49.965533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:50.049119 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] HTTP exception thrown: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Request method failure captured: Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 HTTP/1.1 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Jb1broKUreObl3eBApe7nsIPCglEclFB9zyqbEmn9nnfzqo81PPiHFVCFYRsPHU99SxLICxKq_NRQgL7NEc7VV1Oasu-QAi_0TQXUVDMshvo2Q_Sy_ycDEMIU3MVsbbG9RYnRbPJe0-Yp-FZHcYqWgOazabF3VxHTmLCIAmEbjpm0 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_493ac819082a42af8d6e3c702c510a3b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/493ac819082a42af8d6e3c702c510a3b"}]}] Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 6a6e67c6afc74b39bb5cfac771f3e7d7 Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6faa7633-59e1-4162-803d-193a945d6472'} Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:50.062518 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.068219 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.084483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Returning 404 to user: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:50.090265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0675b5c0-2afe-4631-a296-9c27b9740285 tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 404 len: 111 microversion: 2.1 time: 0.203676 Oct 25 03:11:50.097118 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1436/2690] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:11:49 2022] DELETE /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:50.125460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:50.141331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:50.152492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:50.154870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55f94b1d-7453-4c08-9841-351902eab4fb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1476 microversion: 2.1 time: 1.219061 Oct 25 03:11:50.158845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Searching by: {'deleted': False, 'project_id': '64bf316f35434551a65596f9207677e1'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:11:50.170151 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1255/2691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:48 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1476 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:50.181153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:50.186697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:50.214495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:50.214995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:50.215518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:50.216131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:50.216586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:50.217013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:50.233570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:50.236382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:50.236852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:50.237639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:50.240548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:50.241048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:50.293074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:11:50.351659 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2be9d8a-ca52-4623-b9f4-fddd531e671b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.251347 Oct 25 03:11:50.354600 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1437/2692] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:11:50 2022] GET /compute/v2.1/servers => generated 677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:50.367289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fd74a56-a2cf-42b0-952c-6afeb19ca1ee tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd32b6e040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:50.454627 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fd74a56-a2cf-42b0-952c-6afeb19ca1ee tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 200 len: 344 microversion: 2.1 time: 0.092064 Oct 25 03:11:50.455409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1438/2693] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:11:50 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:50.461101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:50.462282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] [instance: 6faa7633-59e1-4162-803d-193a945d6472] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:50.474426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:50.479587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:50.480472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:50.489297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:50.490679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:50.499287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:50.500388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:50.554584 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] HTTP exception thrown: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Request method failure captured: Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 HTTP/1.1 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Jb1broKUreObl3eBApe7nsIPCglEclFB9zyqbEmn9nnfzqo81PPiHFVCFYRsPHU99SxLICxKq_NRQgL7NEc7VV1Oasu-QAi_0TQXUVDMshvo2Q_Sy_ycDEMIU3MVsbbG9RYnRbPJe0-Yp-FZHcYqWgOazabF3VxHTmLCIAmEbjpm0 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/493ac819082a42af8d6e3c702c510a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_493ac819082a42af8d6e3c702c510a3b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/493ac819082a42af8d6e3c702c510a3b"}]}] Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 493ac819082a42af8d6e3c702c510a3b Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548046667 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 6a6e67c6afc74b39bb5cfac771f3e7d7 Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeTestJSON-1548046667-project Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6faa7633-59e1-4162-803d-193a945d6472'} Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:11:50.559797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.563740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:11:50.563740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:11:50.563740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:11:50.563740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:11:50.563740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:11:50.563740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. Oct 25 03:11:50.563740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:11:50.565282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] Returning 404 to user: Instance 6faa7633-59e1-4162-803d-193a945d6472 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:11:50.589037 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-511f00b5-93c6-4410-8d9d-1f28628ee93f tempest-AttachVolumeTestJSON-1548046667 tempest-AttachVolumeTestJSON-1548046667-project] 10.222.0.36 "GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472" status: 404 len: 111 microversion: 2.1 time: 0.132293 Oct 25 03:11:50.596306 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1439/2694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:50 2022] GET /compute/v2.1/servers/6faa7633-59e1-4162-803d-193a945d6472 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:11:50.618980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24af271d-ec88-4051-b3cd-d2fac61beade tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:50.621455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-24af271d-ec88-4051-b3cd-d2fac61beade tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:50.766908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:50.825335 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-042808ee-b2e5-4c9d-a174-4c3e3d6997e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 0.653969 Oct 25 03:11:50.858261 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1256/2695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:50 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:50.975657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-882adef8-a5c5-44dc-b7cb-0292d88beec7 req-da2d2b00-2b30-4bb6-a30a-2a419e11813e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56dad91-2314-4ab2-8f7b-b39e9fb7b718", "tag": "a58f5c84-d26c-4f37-af47-222a12750747"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:51.044244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-882adef8-a5c5-44dc-b7cb-0292d88beec7 req-da2d2b00-2b30-4bb6-a30a-2a419e11813e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:51.045128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-882adef8-a5c5-44dc-b7cb-0292d88beec7 req-da2d2b00-2b30-4bb6-a30a-2a419e11813e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:51.059007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-882adef8-a5c5-44dc-b7cb-0292d88beec7 req-da2d2b00-2b30-4bb6-a30a-2a419e11813e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:51.196353 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-882adef8-a5c5-44dc-b7cb-0292d88beec7 req-da2d2b00-2b30-4bb6-a30a-2a419e11813e service nova] Creating event network-changed:a58f5c84-d26c-4f37-af47-222a12750747 for instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 on n-h1-862355-1 Oct 25 03:11:51.230780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-882adef8-a5c5-44dc-b7cb-0292d88beec7 req-da2d2b00-2b30-4bb6-a30a-2a419e11813e service nova] Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:11:51.244552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-24af271d-ec88-4051-b3cd-d2fac61beade tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:51.256601 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24af271d-ec88-4051-b3cd-d2fac61beade tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1220 microversion: 2.1 time: 0.656750 Oct 25 03:11:51.258529 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1440/2696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:50 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1220 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:51.280055 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-882adef8-a5c5-44dc-b7cb-0292d88beec7 req-da2d2b00-2b30-4bb6-a30a-2a419e11813e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310339 Oct 25 03:11:51.280680 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1257/2697] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:51.289544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:51.291898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:51.313364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:51.315770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:51.318328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:51.322013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:51.322950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:51.325886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:51.470636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcf203b0-469a-48d4-8fb3-07c8c277927c tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd33064940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:51.583532 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dcf203b0-469a-48d4-8fb3-07c8c277927c tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 200 len: 344 microversion: 2.1 time: 0.117285 Oct 25 03:11:51.585111 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1258/2698] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:11:51 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:51.867393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:51.869421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:51.885255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:51.888150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:51.911163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:51.911944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:51.912420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:51.927672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:52.062219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:52.090056 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18a46a60-536e-4c6d-80d2-07ab7487a546 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1474 microversion: 2.1 time: 0.801646 Oct 25 03:11:52.090913 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1441/2699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:51 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1474 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:52.284510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:52.287282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:52.300430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:52.301867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:52.302534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:52.305576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:52.306326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:52.308445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:52.449884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:52.459233 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d42d613-b57f-45b3-ba7c-233e967fe06d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 0.609963 Oct 25 03:11:52.463154 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1259/2700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:51 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:52.599354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ead82766-4dbe-41dc-8b79-dd445d87bd5a tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd33064d30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:52.658473 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ead82766-4dbe-41dc-8b79-dd445d87bd5a tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 200 len: 345 microversion: 2.1 time: 0.063895 Oct 25 03:11:52.659357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1260/2701] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:11:52 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:11:52.662892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:52.671281 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7226c14f-c1c8-484f-8dfc-aa76086158b7 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1224 microversion: 2.1 time: 0.390191 Oct 25 03:11:52.683345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5e52491-ceb1-4dad-afb9-de37193057bd tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Action: 'create', calling method: .version_select at 0x7efd3b881820>, body: {"snapshot": {"volume_id": "e3fd1cf6-64a7-44c2-b0a2-6b665165f747", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1784008225"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:52.683867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1442/2702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:52 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1224 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:53.028001 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5e52491-ceb1-4dad-afb9-de37193057bd tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.359045 Oct 25 03:11:53.028957 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1261/2703] 10.222.0.36 () {60 vars in 1162 bytes} [Tue Oct 25 03:11:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:11:53.043212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a2520cf-51bc-4d4f-a1c8-5f18c370b176 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd32d63310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:53.116708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:53.118230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:53.128080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:53.133252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:53.133798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:53.135030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:53.137009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:53.137510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:53.138001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:53.155890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a2520cf-51bc-4d4f-a1c8-5f18c370b176 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 287 microversion: 2.1 time: 0.113910 Oct 25 03:11:53.159419 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1443/2704] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:53 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:53.170855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2995e260-c9af-4796-af90-4d1fa10549e3 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd32a6ef70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:53.287310 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2995e260-c9af-4796-af90-4d1fa10549e3 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121353 Oct 25 03:11:53.289607 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1444/2705] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 25 03:11:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:53.309378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad522ef1-95e8-4111-bcad-c268b0bd8a50 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd32a26790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:53.431467 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad522ef1-95e8-4111-bcad-c268b0bd8a50 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 287 microversion: 2.1 time: 0.133617 Oct 25 03:11:53.432578 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1445/2706] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:53 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:53.493350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:53.494415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:53.504433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:53.506035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:53.506971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:53.508812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:53.509535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:53.510807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:53.859285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:53.890129 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cbef79fb-2e6a-4338-b2b4-22d2c23dd9ed tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1474 microversion: 2.1 time: 0.760850 Oct 25 03:11:53.901789 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1262/2707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:53 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1474 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:53.902077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:53.911891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:53.962446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:53.963042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:53.963499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:53.964276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:53.965226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:53.965920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:54.181081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:54.203235 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0cf81cc6-f82f-44c5-aa64-90fcad8aeffe tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1272 microversion: 2.1 time: 0.307341 Oct 25 03:11:54.203792 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1263/2708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:53 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:54.208671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:54.235545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:54.250932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:54.251447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:54.251900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:54.252630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:54.253095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:54.260381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:54.363761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:11:54.571076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:54.579041 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6979e6f9-13e8-47ab-8c89-be68c45c56f1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 204 len: 0 microversion: 2.1 time: 0.372874 Oct 25 03:11:54.582396 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1264/2709] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:11:54 2022] DELETE /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:54.593498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6af701f3-b972-4fe8-870e-c3a6fd05cde2 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd336065e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:54.596269 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6457c821-c642-47c4-8623-627ae193a82f tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 1.108865 Oct 25 03:11:54.605482 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1446/2710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:53 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:54.620602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:54.621598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:54.655687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:54.656328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:54.658788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:54.659778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:54.660752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:54.666259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:54.691955 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6af701f3-b972-4fe8-870e-c3a6fd05cde2 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 287 microversion: 2.1 time: 0.108009 Oct 25 03:11:54.692757 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1265/2711] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:54 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:54.700628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b4faa8c0-2b7d-4f7c-a555-d1f253fcb039 req-4f870c17-f10c-404d-9512-16645796445a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37182056-b6bc-4b4a-b91e-3ee4f275ba7b", "name": "network-vif-plugged", "status": "completed", "tag": "08f14943-7c8e-44f8-8c0d-d7fe94ed260c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:54.738149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:54.752107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b4faa8c0-2b7d-4f7c-a555-d1f253fcb039 req-4f870c17-f10c-404d-9512-16645796445a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:54.761620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b4faa8c0-2b7d-4f7c-a555-d1f253fcb039 req-4f870c17-f10c-404d-9512-16645796445a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:54.762368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b4faa8c0-2b7d-4f7c-a555-d1f253fcb039 req-4f870c17-f10c-404d-9512-16645796445a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:54.803702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b4faa8c0-2b7d-4f7c-a555-d1f253fcb039 req-4f870c17-f10c-404d-9512-16645796445a service nova] Creating event network-vif-plugged:08f14943-7c8e-44f8-8c0d-d7fe94ed260c for instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b on n-h1-862355-1 Oct 25 03:11:54.814072 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b4faa8c0-2b7d-4f7c-a555-d1f253fcb039 req-4f870c17-f10c-404d-9512-16645796445a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119834 Oct 25 03:11:54.819308 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1266/2712] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:54.928322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:54.929046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:54.941603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:54.944495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:54.945111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:54.946061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:54.950511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:54.951289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:55.477655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:55.491951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b4de985-0928-4edd-b934-0433721dfe79 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1555 microversion: 2.1 time: 0.884969 Oct 25 03:11:55.510579 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1447/2713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:54 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1555 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:55.519900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:55.520728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:55.557305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:55.596485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:55.598380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:55.601746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:55.604587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:55.624618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:55.939243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:55.939243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b044273b-7c15-4938-b518-d01321b5f74d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1290 microversion: 2.1 time: 0.404601 Oct 25 03:11:55.939243 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1448/2714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:55 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1290 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:55.944774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:55.945426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:55.959685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:55.960189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:55.960819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:55.961560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:55.962033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:55.962459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.025568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:56.039075 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-63c61855-986b-4e7c-a991-3648b54730b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1471 microversion: 2.1 time: 1.119714 Oct 25 03:11:56.053777 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1267/2715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:54 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1471 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:56.065897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90de9063-1def-44b5-8808-be609f443974 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd3343f040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:56.111947 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90de9063-1def-44b5-8808-be609f443974 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 287 microversion: 2.1 time: 0.065829 Oct 25 03:11:56.113247 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1268/2716] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:56 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:56.135255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:56.135957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:56.148528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:56.151079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:56.151632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.152629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:56.153308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:56.154142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.260228 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6aa4a1c6-f1c3-4777-b7e4-ea1f0e0e32d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718/action" status: 204 len: 0 microversion: 2.1 time: 0.132865 Oct 25 03:11:56.261743 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1269/2717] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:11:56 2022] POST /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718/action => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:11:56.276337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:56.277322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:56.286561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:56.288610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:56.289291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.292590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:56.293567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:56.295474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.742365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:56.760535 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73ee6195-6499-4278-8fe7-596714e0cda9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1471 microversion: 2.1 time: 0.493432 Oct 25 03:11:56.762174 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1270/2718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:56 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1471 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:56.770825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:56.778991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:56.779541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:56.782377 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19f49899-2bb8-4ede-9a1c-d3cfc6763f4d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 0.860224 Oct 25 03:11:56.783415 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1449/2719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:55 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:56.803942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:56.804443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:56.804881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.805593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:56.806206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:56.806631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.895819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-54890e9f-faa3-4b90-8f07-69c2f10d30fd req-8a8b5cbe-facf-445e-9503-22c26c7d19a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56dad91-2314-4ab2-8f7b-b39e9fb7b718", "name": "network-vif-plugged", "status": "completed", "tag": "a58f5c84-d26c-4f37-af47-222a12750747"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:56.915300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-54890e9f-faa3-4b90-8f07-69c2f10d30fd req-8a8b5cbe-facf-445e-9503-22c26c7d19a3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:56.916180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-54890e9f-faa3-4b90-8f07-69c2f10d30fd req-8a8b5cbe-facf-445e-9503-22c26c7d19a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:56.917020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-54890e9f-faa3-4b90-8f07-69c2f10d30fd req-8a8b5cbe-facf-445e-9503-22c26c7d19a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:56.954698 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-54890e9f-faa3-4b90-8f07-69c2f10d30fd req-8a8b5cbe-facf-445e-9503-22c26c7d19a3 service nova] Creating event network-vif-plugged:a58f5c84-d26c-4f37-af47-222a12750747 for instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 on n-h1-862355-1 Oct 25 03:11:56.965381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-54890e9f-faa3-4b90-8f07-69c2f10d30fd req-8a8b5cbe-facf-445e-9503-22c26c7d19a3 service nova] Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:11:57.004762 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-54890e9f-faa3-4b90-8f07-69c2f10d30fd req-8a8b5cbe-facf-445e-9503-22c26c7d19a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112946 Oct 25 03:11:57.005769 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1450/2720] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:57.012201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:57.027387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:57.039861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:57.046555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:57.047360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:57.048328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:57.059157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:57.062539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:57.233194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:57.241022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:11:57.247810 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-09e89c9a-ef1e-4e9f-888d-4c32a8174520 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1555 microversion: 2.1 time: 0.484569 Oct 25 03:11:57.250339 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1271/2721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:56 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1555 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:57.259287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b464b54-6cca-4d8f-9ad6-2ea60c7d3292 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd334f3e50>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:57.336966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b464b54-6cca-4d8f-9ad6-2ea60c7d3292 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 288 microversion: 2.1 time: 0.085182 Oct 25 03:11:57.338739 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1272/2722] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:57 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:57.351704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17244e29-9452-422f-b206-2f1a5a5fde88 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd334ceee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:57.481917 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17244e29-9452-422f-b206-2f1a5a5fde88 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 202 len: 0 microversion: 2.1 time: 0.135545 Oct 25 03:11:57.482710 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1273/2723] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 25 03:11:57 2022] DELETE /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:11:57.493232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-973a6f72-ad1c-40fd-809d-dbdd329037ce tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd3b877ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:57.601205 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-973a6f72-ad1c-40fd-809d-dbdd329037ce tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 287 microversion: 2.1 time: 0.112440 Oct 25 03:11:57.602084 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1274/2724] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:57 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:57.785779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:57.786996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:57.818827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:57.819412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:57.819783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:57.820519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:57.820735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:57.821191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:57.828908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:57.843672 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-701f870b-c569-4028-a1e6-12feb6a4ecf5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1278 microversion: 2.1 time: 0.832573 Oct 25 03:11:57.871772 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1451/2725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:57 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1278 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:57.925956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:57.926867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:57.935057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:57.935916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:57.936576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:57.937604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:57.938350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:57.939082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:58.176720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:58.188378 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19373fee-2d05-4e50-93de-8e3fcd37d066 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1471 microversion: 2.1 time: 0.407468 Oct 25 03:11:58.205864 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1275/2726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:57 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1471 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:58.212599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b5bd5859-fa76-4ac6-9e57-9ed2f87725e8 req-23f89925-69b9-4e7e-b9f5-f094210af561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a8049-3445-4a56-8f6c-26d85d588b7c", "name": "network-vif-deleted", "tag": "333c6ab5-b612-4f7e-83cf-a0b2f87ae317"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:11:58.247818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b5bd5859-fa76-4ac6-9e57-9ed2f87725e8 req-23f89925-69b9-4e7e-b9f5-f094210af561 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:58.248459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b5bd5859-fa76-4ac6-9e57-9ed2f87725e8 req-23f89925-69b9-4e7e-b9f5-f094210af561 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:58.248820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b5bd5859-fa76-4ac6-9e57-9ed2f87725e8 req-23f89925-69b9-4e7e-b9f5-f094210af561 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:58.263961 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b5bd5859-fa76-4ac6-9e57-9ed2f87725e8 req-23f89925-69b9-4e7e-b9f5-f094210af561 service nova] Creating event network-vif-deleted:333c6ab5-b612-4f7e-83cf-a0b2f87ae317 for instance 227a8049-3445-4a56-8f6c-26d85d588b7c on n-h1-862355-1 Oct 25 03:11:58.271540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b5bd5859-fa76-4ac6-9e57-9ed2f87725e8 req-23f89925-69b9-4e7e-b9f5-f094210af561 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064512 Oct 25 03:11:58.272490 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1276/2727] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:11:58.279907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:58.280881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:58.292972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:58.293833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:58.294458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:58.298662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:58.301616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:58.302082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:58.452081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:58.466678 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb5d3cb7-1b44-468d-9945-ed4a03b319c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1346 microversion: 2.1 time: 0.192669 Oct 25 03:11:58.467913 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1277/2728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:58 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:58.613900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3426e773-c5e6-4f29-aed0-333f0a9fd166 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd333121f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:58.678299 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3426e773-c5e6-4f29-aed0-333f0a9fd166 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 287 microversion: 2.1 time: 0.068603 Oct 25 03:11:58.678986 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1278/2729] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:58 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:11:58.878276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:58.879058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:58.890362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:58.890864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:58.891307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:58.897935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:58.900145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:58.900836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:58.928767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:58.943502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89379d4d-a992-4a12-8e0e-7444a5a1dbd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1365 microversion: 2.1 time: 1.067517 Oct 25 03:11:58.944668 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1452/2730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:57 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1365 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:59.053423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:59.064010 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a63631ce-cf5f-422b-b33b-50313d490ca1 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1278 microversion: 2.1 time: 0.191285 Oct 25 03:11:59.073755 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1279/2731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:58 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:11:59.227137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:59.227925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:59.244144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:59.244716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:59.245228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:59.246113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:59.246639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:59.247508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:59.494487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:59.495724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:59.504884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:59.512650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:59.513331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:59.514143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:59.514617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:59.515058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:59.636098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:11:59.655205 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b917a01c-f88d-4b07-b074-7b6c7e480a9b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1346 microversion: 2.1 time: 0.166000 Oct 25 03:11:59.656379 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1280/2732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:59 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:11:59.694628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf0e2156-4993-490d-94f1-5aa46ab2d7dc tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd3334c4c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:59.735368 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf0e2156-4993-490d-94f1-5aa46ab2d7dc tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 200 len: 287 microversion: 2.1 time: 0.047890 Oct 25 03:11:59.742182 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1281/2733] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:11:59 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:11:59.971486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:11:59.972160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:11:59.989893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:59.990402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:59.990842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:11:59.991577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:11:59.992025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:11:59.992459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:00.189947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:00.214483 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a8e8dcf-372d-47ce-ab55-78481ead95cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1556 microversion: 2.1 time: 0.234153 Oct 25 03:12:00.214483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1282/2734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:59 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:00.214483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:00.214483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:00.215723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:00.216416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:00.217165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:00.218587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:00.219203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:00.219788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:00.266756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:00.297632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:00.306111 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2cc2f039-51fb-4072-85d9-858ef25e3ed0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1278 microversion: 2.1 time: 0.102821 Oct 25 03:12:00.307459 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1283/2735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:00 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:00.312950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:00.313590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:00.323900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:00.324775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:00.325492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:00.326591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:00.327273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:00.328427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:00.435427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:00.455432 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8085566-9bd8-4d28-8b6a-5bc0aabebf0e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1471 microversion: 2.1 time: 1.242258 Oct 25 03:12:00.461315 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6bfc5da8-6ab3-480c-898a-09313c91786e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152569 Oct 25 03:12:00.461993 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1284/2736] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:12:00 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:00.477858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1453/2737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:11:59 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1471 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:00.680322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:00.680948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:00.691505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:00.692026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:00.697416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:00.701342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:00.701908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:00.702391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:00.748936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c1da2e66-6486-4818-b8a0-d541191d7782 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd329f0d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:00.782329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-c1da2e66-6486-4818-b8a0-d541191d7782 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] HTTP exception thrown: Snapshot 1fd6f50e-4142-4721-9a32-eecb732d1d4c could not be found. Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c1da2e66-6486-4818-b8a0-d541191d7782 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Request method failure captured: Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c HTTP/1.1 Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1PzfV2DucXIWWaKmkneOnTP9Ypurc19DFy0FoYfSbswmpd5kqpnl8JcOxnxqUgGkCaAJv_cs1IHMjpIYkJ16bhzMZp5HMgU9V8Htf62ZsEVH62iomJaJEjnA6Om6sJo0Y-x8Ps9ySKL7sd7FxZE1fTKKk7daO967hzT-lQkJ28xUCY Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f90f4ed060fe48a7956a1dd821bde1ef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f90f4ed060fe48a7956a1dd821bde1ef"}]}] Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d7b872b1b13f4fbd9455fe0b677c297e Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: exception: Snapshot 1fd6f50e-4142-4721-9a32-eecb732d1d4c could not be found. Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '1fd6f50e-4142-4721-9a32-eecb732d1d4c'} Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1fd6f50e-4142-4721-9a32-eecb732d1d4c could not be found. (HTTP 404) (Request-ID: req-ab534878-73b7-4f7a-ab7c-49380624449e) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:12:00.826493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1fd6f50e-4142-4721-9a32-eecb732d1d4c could not be found. Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1fd6f50e-4142-4721-9a32-eecb732d1d4c could not be found. Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1fd6f50e-4142-4721-9a32-eecb732d1d4c could not be found. Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c1da2e66-6486-4818-b8a0-d541191d7782 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Returning 404 to user: Snapshot 1fd6f50e-4142-4721-9a32-eecb732d1d4c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c1da2e66-6486-4818-b8a0-d541191d7782 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c" status: 404 len: 111 microversion: 2.1 time: 0.083637 Oct 25 03:12:00.831230 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1454/2738] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:12:00 2022] GET /compute/v2.1/os-snapshots/1fd6f50e-4142-4721-9a32-eecb732d1d4c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:12:00.840128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0291d086-acb7-4f7f-a8ff-9f14fd3c9b87 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd329f05e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:00.884327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:00.896412 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc293cc5-de3d-4822-84f1-91d76b6b0816 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1346 microversion: 2.1 time: 0.220592 Oct 25 03:12:00.897305 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1285/2739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:00 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1346 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:00.947694 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0291d086-acb7-4f7f-a8ff-9f14fd3c9b87 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 202 len: 0 microversion: 2.1 time: 0.113019 Oct 25 03:12:00.956496 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1455/2740] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:12:00 2022] DELETE /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:12:00.958676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22f93dea-e10e-442a-b055-1319ab302e1b tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd3b881af0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:01.058388 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-22f93dea-e10e-442a-b055-1319ab302e1b tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 200 len: 344 microversion: 2.1 time: 0.105264 Oct 25 03:12:01.059206 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1286/2741] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:12:00 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:01.332127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:01.337796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:01.338662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:01.351845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:01.352345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:01.352792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:01.353515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:01.359726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:01.360213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:01.482186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:01.482804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:01.494730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:01.495232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:01.497327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:01.498091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:01.503028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:01.504365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:01.842650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:01.871181 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-910c557c-192e-45ee-bedb-25f6e454bc62 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1471 microversion: 2.1 time: 0.384188 Oct 25 03:12:01.887675 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1287/2742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:01 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:01.929456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:01.930114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:01.937904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:01.938413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:01.938835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:01.939550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:01.940256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:01.941292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:02.214885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:02.235868 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-28939dea-1f1d-4e37-bbc3-a117e76f7020 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1346 microversion: 2.1 time: 0.313253 Oct 25 03:12:02.250020 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1288/2743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:01 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1346 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:02.250367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:02.269503 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9936298e-a1c8-449f-bc7e-8cfe7d64b4e4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.932575 Oct 25 03:12:02.272697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-319faa56-e724-46be-a1f2-14f15e6c339b tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd3b81e310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:02.274029 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1456/2744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:01 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:02.394679 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-319faa56-e724-46be-a1f2-14f15e6c339b tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 200 len: 344 microversion: 2.1 time: 0.152817 Oct 25 03:12:02.395650 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1289/2745] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:12:02 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:02.899731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:02.900362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:02.911706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:02.915218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:02.915991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:02.918534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:02.919195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:02.920557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:03.264080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:03.264694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:03.279553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:03.281879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:03.282936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:03.285770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:03.287784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:03.290046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:03.438771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:03.454106 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc3a891f-52ec-4ba7-8466-a40a7b7157fc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1346 microversion: 2.1 time: 0.188820 Oct 25 03:12:03.465703 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1290/2746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:03 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1346 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:03.471665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:03.474517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:03.483290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:03.484047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:03.484842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:03.485885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:03.487332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:03.487934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:03.787402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:03.802950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8af31ede-b87a-4056-9d39-f41cb1fb66f5 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.342822 Oct 25 03:12:03.803619 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1291/2747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:03 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:03.813074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1b67f12-f749-4d27-bff1-0ad9a79f1e5f tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd334fb550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:03.898156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:03.912511 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e0fc17b-78cc-42eb-9793-31f9f7860827 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1463 microversion: 2.1 time: 1.015217 Oct 25 03:12:03.928072 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1457/2748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:02 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1463 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:03.929202 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1b67f12-f749-4d27-bff1-0ad9a79f1e5f tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 200 len: 344 microversion: 2.1 time: 0.121495 Oct 25 03:12:03.937441 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1292/2749] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:12:03 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:03.944735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-090ec971-ba87-469d-9673-642daed71245 req-e8853155-1fb1-41cc-8834-9cd38ad69c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f1213-c005-4cef-b244-b057bd73d68e", "tag": "3f0b07a7-4e00-43b2-b890-3efeb2c0f810"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:03.946805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-304ba62e-2d45-42f6-b96c-ab2d15789bb3 req-1f71ce73-81f1-4e9e-a0bd-1cfe23d4103f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37182056-b6bc-4b4a-b91e-3ee4f275ba7b", "tag": "08f14943-7c8e-44f8-8c0d-d7fe94ed260c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:03.968611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-090ec971-ba87-469d-9673-642daed71245 req-e8853155-1fb1-41cc-8834-9cd38ad69c90 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:03.970367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-304ba62e-2d45-42f6-b96c-ab2d15789bb3 req-1f71ce73-81f1-4e9e-a0bd-1cfe23d4103f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:03.971974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-090ec971-ba87-469d-9673-642daed71245 req-e8853155-1fb1-41cc-8834-9cd38ad69c90 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:03.974254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-304ba62e-2d45-42f6-b96c-ab2d15789bb3 req-1f71ce73-81f1-4e9e-a0bd-1cfe23d4103f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:03.974493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-090ec971-ba87-469d-9673-642daed71245 req-e8853155-1fb1-41cc-8834-9cd38ad69c90 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:03.974754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-304ba62e-2d45-42f6-b96c-ab2d15789bb3 req-1f71ce73-81f1-4e9e-a0bd-1cfe23d4103f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:04.017250 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-304ba62e-2d45-42f6-b96c-ab2d15789bb3 req-1f71ce73-81f1-4e9e-a0bd-1cfe23d4103f service nova] Creating event network-changed:08f14943-7c8e-44f8-8c0d-d7fe94ed260c for instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b on n-h1-862355-1 Oct 25 03:12:04.018644 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-090ec971-ba87-469d-9673-642daed71245 req-e8853155-1fb1-41cc-8834-9cd38ad69c90 service nova] Creating event network-changed:3f0b07a7-4e00-43b2-b890-3efeb2c0f810 for instance 449f1213-c005-4cef-b244-b057bd73d68e on n-h2-862355-1 Oct 25 03:12:04.036093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-304ba62e-2d45-42f6-b96c-ab2d15789bb3 req-1f71ce73-81f1-4e9e-a0bd-1cfe23d4103f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096821 Oct 25 03:12:04.036411 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-090ec971-ba87-469d-9673-642daed71245 req-e8853155-1fb1-41cc-8834-9cd38ad69c90 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096317 Oct 25 03:12:04.038209 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1293/2750] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:04.045646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:04.046792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:04.056793 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1458/2751] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:04.062266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:04.062966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:04.063589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:04.065146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:04.065806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:04.066381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:04.484815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:04.485459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:04.501502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:04.502679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:04.503509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:04.504028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:04.510938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:04.511493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:04.601912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:04.619308 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f3a6f76-4baa-4fdc-945d-86787ed97dc1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1463 microversion: 2.1 time: 0.579603 Oct 25 03:12:04.626819 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1294/2752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:04 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1463 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:04.659573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fc003165-da81-4113-ab63-26da056e0a00 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'create', calling method: .version_select at 0x7efd334fb160>, body: {"keypair": {"name": "tempest-keypair-825503916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUwT9OYlaYvnKMX/jE2qaEwTB/THUO2jvLvE5WKQ6tb7Cm92M9kUE2oAdB6Wy9AWai7qSKCOd3tplUb9hBnfw9Okvpq78aZLm7XZrgRVSmrjiuFOOHLdSdnA4ZgRoslyw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:04.721335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-fc003165-da81-4113-ab63-26da056e0a00 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:12:04.740867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-fc003165-da81-4113-ab63-26da056e0a00 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for user a205c6ef239c44e8b2768df15ea8d943 and project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:12:04.818600 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fc003165-da81-4113-ab63-26da056e0a00 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163339 Oct 25 03:12:04.820710 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1295/2753] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:12:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:04.831469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:04.832495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:04.846612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:04.846612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:04.850561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:04.851647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:04.852417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:04.857216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:05.251562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:05.262621 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e410c42-6664-4abc-aa85-1f589ba52e77 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1346 microversion: 2.1 time: 0.783147 Oct 25 03:12:05.277909 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1459/2754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:04 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1346 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:05.281649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-719bb277-dbc3-4cba-93f1-9435d5a9dc17 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd32b67700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:05.322778 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-719bb277-dbc3-4cba-93f1-9435d5a9dc17 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] HTTP exception thrown: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-719bb277-dbc3-4cba-93f1-9435d5a9dc17 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Request method failure captured: Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 HTTP/1.1 Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1PzfV2DucXIWWaKmkneOnTP9Ypurc19DFy0FoYfSbswmpd5kqpnl8JcOxnxqUgGkCaAJv_cs1IHMjpIYkJ16bhzMZp5HMgU9V8Htf62ZsEVH62iomJaJEjnA6Om6sJo0Y-x8Ps9ySKL7sd7FxZE1fTKKk7daO967hzT-lQkJ28xUCY Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f90f4ed060fe48a7956a1dd821bde1ef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f90f4ed060fe48a7956a1dd821bde1ef"}]}] Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d7b872b1b13f4fbd9455fe0b677c297e Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: exception: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e3fd1cf6-64a7-44c2-b0a2-6b665165f747'} Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. (HTTP 404) (Request-ID: req-cdfc6d43-a837-4b0b-89c7-0b59d546b699) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:12:05.329801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.334928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-719bb277-dbc3-4cba-93f1-9435d5a9dc17 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Returning 404 to user: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:05.338453 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-719bb277-dbc3-4cba-93f1-9435d5a9dc17 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 404 len: 109 microversion: 2.1 time: 0.058392 Oct 25 03:12:05.338453 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1460/2755] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:12:05 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:05.348584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e90f4c13-eb70-45fc-a9b0-7372fcbbeb47 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd32b671f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:05.397436 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e90f4c13-eb70-45fc-a9b0-7372fcbbeb47 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] HTTP exception thrown: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e90f4c13-eb70-45fc-a9b0-7372fcbbeb47 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Request method failure captured: Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 HTTP/1.1 Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1PzfV2DucXIWWaKmkneOnTP9Ypurc19DFy0FoYfSbswmpd5kqpnl8JcOxnxqUgGkCaAJv_cs1IHMjpIYkJ16bhzMZp5HMgU9V8Htf62ZsEVH62iomJaJEjnA6Om6sJo0Y-x8Ps9ySKL7sd7FxZE1fTKKk7daO967hzT-lQkJ28xUCY Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f90f4ed060fe48a7956a1dd821bde1ef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f90f4ed060fe48a7956a1dd821bde1ef"}]}] Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d7b872b1b13f4fbd9455fe0b677c297e Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: exception: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e3fd1cf6-64a7-44c2-b0a2-6b665165f747'} Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. (HTTP 404) (Request-ID: req-cb928d45-b2e8-4a8b-8bb6-0efdb0faf813) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:12:05.399570 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e90f4c13-eb70-45fc-a9b0-7372fcbbeb47 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Returning 404 to user: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:05.404767 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e90f4c13-eb70-45fc-a9b0-7372fcbbeb47 tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 404 len: 109 microversion: 2.1 time: 0.059621 Oct 25 03:12:05.409271 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1461/2756] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:12:05 2022] DELETE /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:05.419013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30f66d7d-e449-4676-904a-99a7c22fc0eb tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Calling method '.version_select at 0x7efd32b67e50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:05.521646 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-30f66d7d-e449-4676-904a-99a7c22fc0eb tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] HTTP exception thrown: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30f66d7d-e449-4676-904a-99a7c22fc0eb tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Request method failure captured: Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 HTTP/1.1 Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1PzfV2DucXIWWaKmkneOnTP9Ypurc19DFy0FoYfSbswmpd5kqpnl8JcOxnxqUgGkCaAJv_cs1IHMjpIYkJ16bhzMZp5HMgU9V8Htf62ZsEVH62iomJaJEjnA6Om6sJo0Y-x8Ps9ySKL7sd7FxZE1fTKKk7daO967hzT-lQkJ28xUCY Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f90f4ed060fe48a7956a1dd821bde1ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f90f4ed060fe48a7956a1dd821bde1ef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f90f4ed060fe48a7956a1dd821bde1ef"}]}] Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f90f4ed060fe48a7956a1dd821bde1ef Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1588002851 Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d7b872b1b13f4fbd9455fe0b677c297e Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1588002851-project Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: exception: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e3fd1cf6-64a7-44c2-b0a2-6b665165f747'} Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. (HTTP 404) (Request-ID: req-166d9632-e2a2-4de3-a593-b164202d23f8) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:12:05.525023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:05.530090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30f66d7d-e449-4676-904a-99a7c22fc0eb tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] Returning 404 to user: Volume e3fd1cf6-64a7-44c2-b0a2-6b665165f747 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:05.534516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30f66d7d-e449-4676-904a-99a7c22fc0eb tempest-VolumesSnapshotsTestJSON-1588002851 tempest-VolumesSnapshotsTestJSON-1588002851-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747" status: 404 len: 109 microversion: 2.1 time: 0.122791 Oct 25 03:12:05.535565 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1462/2757] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:12:05 2022] GET /compute/v2.1/os-volumes/e3fd1cf6-64a7-44c2-b0a2-6b665165f747 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:05.645496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:05.657870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-31c3bd0b-22b6-4da5-adb0-49e7dd41991f tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.835485 Oct 25 03:12:05.660036 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1296/2758] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:04 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:06.292160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:06.293515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:06.311764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:06.312717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:06.313419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:06.315004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:06.320201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:06.320967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:06.637272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:06.657153 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43c2f444-0181-4ffb-915a-f6207ea6caf0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 200 len: 1346 microversion: 2.1 time: 0.372724 Oct 25 03:12:06.660018 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1463/2759] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:06 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 1346 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:06.688751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:06.690776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:06.719169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:06.724166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:06.728041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:06.731722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:06.734240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:06.734718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:07.304666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4a3e867e-f7d7-4811-900b-4b8542c37cdd req-cf15e11a-0306-46f1-9097-354c857e463b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d88d03c-3f54-4a68-8cb1-0fd46723cb7d", "tag": "96c0ad3a-6a00-4019-bbb8-82585b95f4e0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:07.330107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a3e867e-f7d7-4811-900b-4b8542c37cdd req-cf15e11a-0306-46f1-9097-354c857e463b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:07.333233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a3e867e-f7d7-4811-900b-4b8542c37cdd req-cf15e11a-0306-46f1-9097-354c857e463b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:07.335252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4a3e867e-f7d7-4811-900b-4b8542c37cdd req-cf15e11a-0306-46f1-9097-354c857e463b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:07.364070 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4a3e867e-f7d7-4811-900b-4b8542c37cdd req-cf15e11a-0306-46f1-9097-354c857e463b service nova] Creating event network-changed:96c0ad3a-6a00-4019-bbb8-82585b95f4e0 for instance 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d on n-h1-862355-1 Oct 25 03:12:07.379634 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4a3e867e-f7d7-4811-900b-4b8542c37cdd req-cf15e11a-0306-46f1-9097-354c857e463b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079218 Oct 25 03:12:07.380891 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1464/2760] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:07.492700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:07.510629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-85ab1e4e-f165-431e-b873-0b3edeb9728e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.825877 Oct 25 03:12:07.511485 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1297/2761] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:06 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:07.686754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:07.687513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:07.697580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:07.698363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:07.698922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:07.699876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:07.700556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:07.701581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:07.728835 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c HTTP/1.1 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '227a8049-3445-4a56-8f6c-26d85d588b7c'} Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:07.731091 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.735833 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:07.735833 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:07.735833 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:07.735833 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:07.735833 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:07.735833 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.735833 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.740173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:07.741968 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1fdf43cb-1065-4f5a-a3ab-b188603aaab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 404 len: 111 microversion: 2.1 time: 0.062731 Oct 25 03:12:07.743044 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1465/2762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:07 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:07.882298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:07.885730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:07.893649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:07.894695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:07.895327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:07.896209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:07.896827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:07.897411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:07.912902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c/os-volume_attachments HTTP/1.1 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'server_id': '227a8049-3445-4a56-8f6c-26d85d588b7c'} Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:12:07.916214 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:12:07.920179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:07.923083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:07.926083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9acaf52b-9311-4371-bfb4-f21332d30bff tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048126 Oct 25 03:12:07.930598 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1298/2763] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:12:07 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:08.193145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-800715809", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "399e4372-9a26-4378-9554-8714a7affe92"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:08.319210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] validate_networks() for [('399e4372-9a26-4378-9554-8714a7affe92', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:12:08.536178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:08.537496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:08.550833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:08.552931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:08.553822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:08.556130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:08.556752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:08.558562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:08.869997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:08.874387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:08.881877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8955965-d3f4-4995-9ae9-aac78bdcc99c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.350587 Oct 25 03:12:08.883819 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1299/2764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:08 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:09.431961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:12:09.432992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:12:09.433719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:12:09.434318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:12:09.435227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:12:09.473268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:09.477434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:09.480568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:09.481741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:09.482425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:09.484878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:09.542317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:12:09.559182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for user 256827a36f464fe1b535d91f95e48681 and project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:12:09.592456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:12:09.602359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 55f23582-0bbc-4b8d-9b73-549566f8048d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:12:09.720075 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-616572a8-c2bd-4279-ae16-f2084a64fb56 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530672 Oct 25 03:12:09.722045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1466/2765] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:12:09.744223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a43f60c-d7e7-4934-9c7a-144961f74b9a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:09.745236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a43f60c-d7e7-4934-9c7a-144961f74b9a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 55f23582-0bbc-4b8d-9b73-549566f8048d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:09.906007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:09.906695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:09.917376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:09.917922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:09.918373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:09.919094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:09.919562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:09.919995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:09.989282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a43f60c-d7e7-4934-9c7a-144961f74b9a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:09.998111 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a43f60c-d7e7-4934-9c7a-144961f74b9a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d" status: 200 len: 1214 microversion: 2.1 time: 0.269349 Oct 25 03:12:10.002585 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1300/2766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:09 2022] GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:10.025000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-33495977-4fb8-42ca-8e03-da1cdd6283c4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:10.025775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-33495977-4fb8-42ca-8e03-da1cdd6283c4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 55f23582-0bbc-4b8d-9b73-549566f8048d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:10.044459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-33495977-4fb8-42ca-8e03-da1cdd6283c4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 55f23582-0bbc-4b8d-9b73-549566f8048d] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:12:10.249626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-33495977-4fb8-42ca-8e03-da1cdd6283c4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d" status: 204 len: 0 microversion: 2.1 time: 0.228316 Oct 25 03:12:10.256149 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1301/2767] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:12:10 2022] DELETE /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:12:10.262456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd42f076-5dee-458a-b2fd-ab9a62afaa9c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:10.263302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd42f076-5dee-458a-b2fd-ab9a62afaa9c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 55f23582-0bbc-4b8d-9b73-549566f8048d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:10.281785 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-dd42f076-5dee-458a-b2fd-ab9a62afaa9c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd42f076-5dee-458a-b2fd-ab9a62afaa9c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d HTTP/1.1 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '55f23582-0bbc-4b8d-9b73-549566f8048d'} Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 55f23582-0bbc-4b8d-9b73-549566f8048d Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:10.289543 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:10.293808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd42f076-5dee-458a-b2fd-ab9a62afaa9c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:10.295200 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd42f076-5dee-458a-b2fd-ab9a62afaa9c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d" status: 404 len: 111 microversion: 2.1 time: 0.036739 Oct 25 03:12:10.295200 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1302/2768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:10 2022] GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:10.545143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2112179844", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "399e4372-9a26-4378-9554-8714a7affe92"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:10.650489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] validate_networks() for [('399e4372-9a26-4378-9554-8714a7affe92', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:12:11.221335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:11.233088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b0b9cf4-d958-4228-952b-7ad09c4c3ad0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 1.328705 Oct 25 03:12:11.235266 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1467/2769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:09 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:11.740024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80836d38-58ff-4328-b384-43ea98c8cdef tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '.version_select at 0x7efd32d76af0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:11.744140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80836d38-58ff-4328-b384-43ea98c8cdef tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:11.744642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80836d38-58ff-4328-b384-43ea98c8cdef tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:11.745093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80836d38-58ff-4328-b384-43ea98c8cdef tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:11.773241 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80836d38-58ff-4328-b384-43ea98c8cdef tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.038268 Oct 25 03:12:11.784372 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1468/2770] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:12:11 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:12:11.801822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d6fc2ef-da3e-4740-9fbb-b032cd41ae04 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:11.810308 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d6fc2ef-da3e-4740-9fbb-b032cd41ae04 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020808 Oct 25 03:12:11.835181 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1469/2771] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:12:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:12:11.847702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-411a9dad-00d7-4fe6-8a63-ab2d894e099c tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-745390623", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:11.880009 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-411a9dad-00d7-4fe6-8a63-ab2d894e099c tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.043379 Oct 25 03:12:11.880968 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1470/2772] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Oct 25 03:12:11 2022] POST /compute/v2.1/flavors => generated 498 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:11.898379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fec0c9af-666d-4aa6-bfa3-e8926054cccd tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:11.909997 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fec0c9af-666d-4aa6-bfa3-e8926054cccd tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020419 Oct 25 03:12:11.921244 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1471/2773] 10.222.0.36 () {58 vars in 1182 bytes} [Tue Oct 25 03:12:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:12:12.208369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-14889516", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "120c4488-d1b4-4d34-b5a4-6cbe4d0b104f"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:12.293436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:12:12.551418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:12:12.551839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:12:12.552309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:12:12.552707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:12:12.553296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:12:12.576967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:12.578733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:12.580046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:12.581236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:12.581909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:12.582356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:12:12.582814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:12:12.583623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:12:12.583985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:12.584745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:12:12.585179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:12:12.589000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:12.608632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:12.613255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:12.614247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:12.617637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:12.619362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:12.624086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:12.632386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:12:12.647924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for user a205c6ef239c44e8b2768df15ea8d943 and project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:12:12.657009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:12:12.665150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for user 256827a36f464fe1b535d91f95e48681 and project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:12:12.670791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:12:12.676227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:12:12.688044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:12:12.695775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:12:12.793851 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5606965d-9e41-4907-a11e-6aa307d0e4bd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588562 Oct 25 03:12:12.801429 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1472/2774] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:12:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:12:12.815937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:12.821125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:12.852448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:12.852947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:12.853465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:12.854202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:12.854667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:12.861589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:12.883813 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a5e5a4b-3109-4ddc-859a-d61e3f7be955 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.335079 Oct 25 03:12:12.884696 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1303/2775] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:12:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:12:12.906905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e3064f3-3c6f-4ecb-9a50-b16e1cac2dc8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:12.911060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e3064f3-3c6f-4ecb-9a50-b16e1cac2dc8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:13.154281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:13.164831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8cad30c0-dfc4-433f-8749-7bf860dd8e8d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.361355 Oct 25 03:12:13.165604 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1473/2776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:12 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:13.189580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-124f14e7-f1e2-4b45-8b18-bde7062936b1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:13.190899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-124f14e7-f1e2-4b45-8b18-bde7062936b1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:13.260189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-124f14e7-f1e2-4b45-8b18-bde7062936b1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:13.265100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e3064f3-3c6f-4ecb-9a50-b16e1cac2dc8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:13.270752 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-124f14e7-f1e2-4b45-8b18-bde7062936b1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1215 microversion: 2.1 time: 0.102541 Oct 25 03:12:13.273990 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1474/2777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:13 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:13.276249 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e3064f3-3c6f-4ecb-9a50-b16e1cac2dc8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1277 microversion: 2.1 time: 0.390457 Oct 25 03:12:13.277256 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1304/2778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:12 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1277 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:13.971191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d762ec41-d735-435f-b032-99e91dcf7ec1 req-67aa6dd2-910f-491e-94ad-03050a70837c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f1213-c005-4cef-b244-b057bd73d68e", "name": "network-vif-plugged", "status": "completed", "tag": "3f0b07a7-4e00-43b2-b890-3efeb2c0f810"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:14.006959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d762ec41-d735-435f-b032-99e91dcf7ec1 req-67aa6dd2-910f-491e-94ad-03050a70837c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:14.008333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d762ec41-d735-435f-b032-99e91dcf7ec1 req-67aa6dd2-910f-491e-94ad-03050a70837c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:14.009149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d762ec41-d735-435f-b032-99e91dcf7ec1 req-67aa6dd2-910f-491e-94ad-03050a70837c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:14.028260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d762ec41-d735-435f-b032-99e91dcf7ec1 req-67aa6dd2-910f-491e-94ad-03050a70837c service nova] Creating event network-vif-plugged:3f0b07a7-4e00-43b2-b890-3efeb2c0f810 for instance 449f1213-c005-4cef-b244-b057bd73d68e on n-h2-862355-1 Oct 25 03:12:14.038620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d762ec41-d735-435f-b032-99e91dcf7ec1 req-67aa6dd2-910f-491e-94ad-03050a70837c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073329 Oct 25 03:12:14.039996 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1475/2779] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:12:14.193506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:14.197506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:14.217036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:14.217584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:14.218231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:14.219119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:14.219622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:14.220061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:14.303152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:14.304061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:14.314691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:14.315572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:14.316911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:14.318164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:14.319030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:14.319721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:14.450089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:14.472573 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d62fe48f-ede9-4496-8690-a53af9e1990b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1211 microversion: 2.1 time: 0.179099 Oct 25 03:12:14.486122 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1476/2780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:14 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1211 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:14.486122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:14.486122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:14.503393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:14.504353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:14.505144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:14.506167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:14.506805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:14.507543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:14.575679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:14.585283 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ab995f10-0ec9-4c52-b80b-8b8f548c4d5b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.398681 Oct 25 03:12:14.586226 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1305/2781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:14 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:14.651177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:14.659097 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34a56d57-67d1-4504-847d-16d1f66e17ea tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1329 microversion: 2.1 time: 0.180196 Oct 25 03:12:14.675301 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1477/2782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:14 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1329 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:15.501796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:15.502993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:15.522488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:15.534796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:15.536133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:15.536865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:15.537344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:15.537802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:15.615812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:15.617078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:15.629928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:15.638498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:15.640381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:15.640548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:15.641287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:15.641945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:15.648429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:15.652825 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42cdcded-6b6b-4d20-9fde-d021db0cde5b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1267 microversion: 2.1 time: 0.157647 Oct 25 03:12:15.654173 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1306/2783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:15 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:15.685022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:15.685907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:15.711219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:15.711966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:15.712563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:15.714662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:15.716818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:15.717494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:15.729298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:15.847193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:15.861896 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0eb07c8-ab8a-4357-8d8e-3b5d20a9e61f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1347 microversion: 2.1 time: 0.181149 Oct 25 03:12:15.864870 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1307/2784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:15 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1347 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:16.245966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:16.262903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19a2809e-ac92-4c98-996b-177849a30cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.651297 Oct 25 03:12:16.290681 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1478/2785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:15 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:16.680300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:16.681210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:16.696279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:16.698004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:16.701670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:16.704101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:16.706314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:16.707479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:16.820805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-439e90ca-d36d-4273-a3ed-173eac7da054 req-d9864da5-f5bc-4145-a66f-cb8a705124a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d88d03c-3f54-4a68-8cb1-0fd46723cb7d", "name": "network-vif-plugged", "status": "completed", "tag": "96c0ad3a-6a00-4019-bbb8-82585b95f4e0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:16.874651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-439e90ca-d36d-4273-a3ed-173eac7da054 req-d9864da5-f5bc-4145-a66f-cb8a705124a6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:16.875158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-439e90ca-d36d-4273-a3ed-173eac7da054 req-d9864da5-f5bc-4145-a66f-cb8a705124a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:16.876164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-439e90ca-d36d-4273-a3ed-173eac7da054 req-d9864da5-f5bc-4145-a66f-cb8a705124a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:16.902726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-439e90ca-d36d-4273-a3ed-173eac7da054 req-d9864da5-f5bc-4145-a66f-cb8a705124a6 service nova] Creating event network-vif-plugged:96c0ad3a-6a00-4019-bbb8-82585b95f4e0 for instance 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d on n-h1-862355-1 Oct 25 03:12:16.912786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:16.922051 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5023f865-032d-472f-a56c-992c8bb303c6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1285 microversion: 2.1 time: 0.246693 Oct 25 03:12:16.927042 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1308/2786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:16 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:16.935368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:16.936252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-439e90ca-d36d-4273-a3ed-173eac7da054 req-d9864da5-f5bc-4145-a66f-cb8a705124a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114183 Oct 25 03:12:16.951624 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1479/2787] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:12:16.967127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:16.989710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:16.991806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:16.992261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:16.993042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:16.993512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:16.994012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:17.110456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:17.123732 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cdc9a4ab-08cd-4843-9828-4c189c8aba27 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1335 microversion: 2.1 time: 0.188825 Oct 25 03:12:17.126618 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1309/2788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:16 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1335 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:17.321219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:17.322130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:17.330920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:17.331422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:17.332510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:17.334092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:17.336364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:17.336986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:17.956327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:17.958528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:17.987599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:17.988104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:17.988549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:17.989342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:17.989998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:17.990431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:18.123147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:18.132589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:18.138024 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-09e99230-c72b-4ef3-89e3-3076c3293229 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1273 microversion: 2.1 time: 0.188471 Oct 25 03:12:18.139870 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1310/2789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:17 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:18.152020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:18.152646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:18.172488 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8b91a20-3279-4345-b0b1-b62fc99f7514 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1320 microversion: 2.1 time: 0.856702 Oct 25 03:12:18.173094 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1480/2790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:17 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1320 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:18.187944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:18.188533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:18.189042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:18.197775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:18.198514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:18.199116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:18.386752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:18.399162 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-75011f76-689d-4075-bbe2-1a19e3460072 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1335 microversion: 2.1 time: 0.250886 Oct 25 03:12:18.402048 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1311/2791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:18 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1335 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:19.168582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:19.169079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:19.180588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:19.190896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.191616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.192367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:19.193254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.193892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.194469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:19.205252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:19.206104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:19.215300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.216188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.216849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:19.218090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.218785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.219966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:19.431089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:19.442734 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b5139fd-59b6-4c68-8bd0-b506c3c028e7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1273 microversion: 2.1 time: 0.278028 Oct 25 03:12:19.463438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1481/2792] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:19 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:19.468260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:19.468941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:19.495184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.496204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.496912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:19.498173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.499351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.500156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:19.722501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:19.730881 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-64a88e3c-4479-4172-bd80-62aa4dd07a0e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 200 len: 1508 microversion: 2.1 time: 0.531441 Oct 25 03:12:19.731486 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1312/2793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:19 2022] GET /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:19.756853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:19.758213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 449f1213-c005-4cef-b244-b057bd73d68e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:19.781235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.782472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.783109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:19.785432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:19.789220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:19.793272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:20.038679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:20.048749 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0eb83f17-8485-4285-9345-4f4b22b03bbd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/449f1213-c005-4cef-b244-b057bd73d68e" status: 200 len: 1508 microversion: 2.1 time: 0.295465 Oct 25 03:12:20.051036 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1313/2794] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:19 2022] GET /compute/v2.1/servers/449f1213-c005-4cef-b244-b057bd73d68e => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:20.076238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:20.076807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 449f1213-c005-4cef-b244-b057bd73d68e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:20.097260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:20.099793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:20.100404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:20.101188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:20.102532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:20.102971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:20.147899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 449f1213-c005-4cef-b244-b057bd73d68e] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:12:20.217030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:20.228027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-694ffad1-eb60-43b0-beb9-f7f03fef74e6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 0.763569 Oct 25 03:12:20.228726 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1482/2795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:19 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:20.304268 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d39f8a29-ae8f-478e-8a01-7dd6e13dfb3b tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "DELETE /compute/v2.1/servers/449f1213-c005-4cef-b244-b057bd73d68e" status: 204 len: 0 microversion: 2.1 time: 0.231688 Oct 25 03:12:20.306167 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1314/2796] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:12:20 2022] DELETE /compute/v2.1/servers/449f1213-c005-4cef-b244-b057bd73d68e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:12:20.316008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:20.316527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:20.329195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:20.329716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:20.330171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:20.330912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:20.331379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:20.331825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:20.394751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:12:20.471877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:20.472596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:20.484082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:20.486795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:20.487312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:20.488059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:20.494788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:20.495665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:20.612460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e25151d-4516-4446-8a85-2518955078b3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d" status: 204 len: 0 microversion: 2.1 time: 0.301037 Oct 25 03:12:20.614404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1483/2797] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:12:20 2022] DELETE /compute/v2.1/servers/7d88d03c-3f54-4a68-8cb1-0fd46723cb7d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:12:20.891325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:20.902809 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0427b2ad-09ab-4700-9a5f-bce7eefd2ffa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.436628 Oct 25 03:12:20.905619 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1315/2798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:20 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:20.976282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-809077041", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b7d479e5-7ea5-4e20-a33c-900aef50f435"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:21.092523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] validate_networks() for [('b7d479e5-7ea5-4e20-a33c-900aef50f435', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:12:21.253552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:21.254505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:21.270623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:21.272697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:21.273391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:21.274882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:21.277813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:21.278507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:21.574694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:21.588004 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4ee700bb-0027-4435-801c-24015cd01aa7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 0.339152 Oct 25 03:12:21.588987 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1316/2799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:21 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:21.935044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:21.936883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:21.946306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:21.966061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:21.966061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:21.966061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:21.966061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:21.966370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:22.606831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:22.641804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:23.198835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:12:23.199267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:12:23.199827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:12:23.200356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:12:23.200777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:12:23.218418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:23.219262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:23.219919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:23.220844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:23.224596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:23.225272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:23.269590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=16 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:23.276843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Getting quotas for project 64bf316f35434551a65596f9207677e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:12:23.295971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Getting quotas for user fb9efa85c53e4db4b3373f0a94d699de and project 64bf316f35434551a65596f9207677e1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:12:23.321790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Going to run 2 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:12:23.324396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:12:23.382045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=a2a3e49b-5532-4115-9a26-f16832aff4ac,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:12:23.484805 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-99cf5748-c0a5-4573-a741-3fa95fc3ba7d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.514026 Oct 25 03:12:23.489063 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1484/2800] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:12:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 2520 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 25 03:12:23.813616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:23.832846 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d03b6c30-e752-416b-ba9a-2bbe93788f20 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 1.902714 Oct 25 03:12:23.833463 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1317/2801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:21 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:23.841448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:23.845564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:23.867998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:23.875980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:23.879319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:23.883586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:23.886900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:23.887885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:24.298265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-87416487-df0e-405c-82ac-536e5c030c2c req-1b6f2382-2a60-4ab5-81a9-d14a15231466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda42aaf-7c35-41ad-a0d1-d46b9e587561", "tag": "73df9db2-b5ae-4640-b2fc-6789fdb58fc1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:24.320314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87416487-df0e-405c-82ac-536e5c030c2c req-1b6f2382-2a60-4ab5-81a9-d14a15231466 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:24.323054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87416487-df0e-405c-82ac-536e5c030c2c req-1b6f2382-2a60-4ab5-81a9-d14a15231466 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:24.324455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87416487-df0e-405c-82ac-536e5c030c2c req-1b6f2382-2a60-4ab5-81a9-d14a15231466 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:24.346415 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-87416487-df0e-405c-82ac-536e5c030c2c req-1b6f2382-2a60-4ab5-81a9-d14a15231466 service nova] Creating event network-changed:73df9db2-b5ae-4640-b2fc-6789fdb58fc1 for instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 on n-h2-862355-1 Oct 25 03:12:24.379794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-87416487-df0e-405c-82ac-536e5c030c2c req-1b6f2382-2a60-4ab5-81a9-d14a15231466 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.888918 Oct 25 03:12:24.383755 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1485/2802] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:24.395550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:24.408278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:24.409006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Searching by: {'deleted': False, 'project_id': '64bf316f35434551a65596f9207677e1'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:12:24.447684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:24.450129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:24.450583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:24.458121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:24.458656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:24.461107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:24.604558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:12:24.687424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea881e4a-d445-49fc-9a23-27be1f278cf6 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.301376 Oct 25 03:12:24.698763 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1486/2803] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:12:24 2022] GET /compute/v2.1/servers => generated 1335 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:24.711842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-eb26b911-16d4-4428-ad22-e687b56d460d req-5632d3e3-e5b0-43f5-8afe-8b5870478ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f1213-c005-4cef-b244-b057bd73d68e", "name": "network-vif-deleted", "tag": "3f0b07a7-4e00-43b2-b890-3efeb2c0f810"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:24.736612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-eb26b911-16d4-4428-ad22-e687b56d460d req-5632d3e3-e5b0-43f5-8afe-8b5870478ae0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:24.738177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-eb26b911-16d4-4428-ad22-e687b56d460d req-5632d3e3-e5b0-43f5-8afe-8b5870478ae0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:24.738554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-eb26b911-16d4-4428-ad22-e687b56d460d req-5632d3e3-e5b0-43f5-8afe-8b5870478ae0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:24.776077 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-eb26b911-16d4-4428-ad22-e687b56d460d req-5632d3e3-e5b0-43f5-8afe-8b5870478ae0 service nova] Creating event network-vif-deleted:3f0b07a7-4e00-43b2-b890-3efeb2c0f810 for instance 449f1213-c005-4cef-b244-b057bd73d68e on n-h2-862355-1 Oct 25 03:12:24.789176 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-eb26b911-16d4-4428-ad22-e687b56d460d req-5632d3e3-e5b0-43f5-8afe-8b5870478ae0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087405 Oct 25 03:12:24.790964 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1487/2804] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:24.807645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65526421-74f6-4c1a-a77d-91902009e294 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:24.808828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65526421-74f6-4c1a-a77d-91902009e294 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:25.200434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:25.212228 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dfa00d03-bf1a-41df-8180-1194f017b1b5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 1.374857 Oct 25 03:12:25.214277 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1318/2805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:23 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:25.227052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:25.229196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:25.244296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:25.245063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:25.247060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:25.250382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:25.251544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:25.253754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:25.253950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65526421-74f6-4c1a-a77d-91902009e294 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:25.272670 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65526421-74f6-4c1a-a77d-91902009e294 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1217 microversion: 2.1 time: 0.478893 Oct 25 03:12:25.289040 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1488/2806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:24 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1217 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:25.346708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:25.652240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:25.664502 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f7cc9901-0032-402e-a9f1-f6619c57f2b6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.448874 Oct 25 03:12:25.670177 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1319/2807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:25 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:26.240946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:26.241766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:26.262698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.268638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.269715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.270985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.271671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.272382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.319540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:26.320882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:26.332837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.335023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.335635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.337129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.337770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.338735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.498058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:26.514971 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-71f477ab-8ab3-49ae-b292-f8a0e3d20461 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1213 microversion: 2.1 time: 0.200744 Oct 25 03:12:26.519688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1320/2808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:26 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1213 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:26.544885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f67de6dd-0383-41c0-8ad9-8240671d9c43 req-21a82e89-a753-4be2-adc2-4cbc9a8717d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f89739-25c6-4c83-91c6-f723d7ae0d75", "tag": "dd091e9a-5668-4466-8121-f4dcfd44006e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:26.563836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f67de6dd-0383-41c0-8ad9-8240671d9c43 req-21a82e89-a753-4be2-adc2-4cbc9a8717d2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.564605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f67de6dd-0383-41c0-8ad9-8240671d9c43 req-21a82e89-a753-4be2-adc2-4cbc9a8717d2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.565136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f67de6dd-0383-41c0-8ad9-8240671d9c43 req-21a82e89-a753-4be2-adc2-4cbc9a8717d2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.585623 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f67de6dd-0383-41c0-8ad9-8240671d9c43 req-21a82e89-a753-4be2-adc2-4cbc9a8717d2 service nova] Creating event network-changed:dd091e9a-5668-4466-8121-f4dcfd44006e for instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 on n-h2-862355-1 Oct 25 03:12:26.591361 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f67de6dd-0383-41c0-8ad9-8240671d9c43 req-21a82e89-a753-4be2-adc2-4cbc9a8717d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056379 Oct 25 03:12:26.592561 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1321/2809] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:26.679529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:26.695140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:26.695578 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93ac6fe9-5cfe-489d-bbb8-3aeda6618193 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 0.457013 Oct 25 03:12:26.695857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:26.696851 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1489/2810] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:26 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:26.706493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.708940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.709549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.711786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.713775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.714407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.860875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-245cf117-e0c2-4853-af1d-79bd3b71aeab req-3544af74-3b57-4236-bd66-c9d58b635842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d88d03c-3f54-4a68-8cb1-0fd46723cb7d", "name": "network-vif-deleted", "tag": "96c0ad3a-6a00-4019-bbb8-82585b95f4e0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:26.885564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-245cf117-e0c2-4853-af1d-79bd3b71aeab req-3544af74-3b57-4236-bd66-c9d58b635842 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:26.885564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-245cf117-e0c2-4853-af1d-79bd3b71aeab req-3544af74-3b57-4236-bd66-c9d58b635842 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:26.885564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-245cf117-e0c2-4853-af1d-79bd3b71aeab req-3544af74-3b57-4236-bd66-c9d58b635842 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:26.917189 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-245cf117-e0c2-4853-af1d-79bd3b71aeab req-3544af74-3b57-4236-bd66-c9d58b635842 service nova] Creating event network-vif-deleted:96c0ad3a-6a00-4019-bbb8-82585b95f4e0 for instance 7d88d03c-3f54-4a68-8cb1-0fd46723cb7d on n-h1-862355-1 Oct 25 03:12:26.934544 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-245cf117-e0c2-4853-af1d-79bd3b71aeab req-3544af74-3b57-4236-bd66-c9d58b635842 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079409 Oct 25 03:12:26.935163 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1490/2811] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:27.509052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:27.551336 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c6d503c-00a0-4b9e-a0cf-db2adb805426 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.861223 Oct 25 03:12:27.554862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1322/2812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:26 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:27.564163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:27.567073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:27.608099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:27.611826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:27.616814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:27.617977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:27.621392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:27.625501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:27.841555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:27.861448 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7be1cd48-805e-4b63-9d1f-a28d8cd9442d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1269 microversion: 2.1 time: 0.303596 Oct 25 03:12:27.862719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1323/2813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:27 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1269 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:27.902149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:27.906992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:27.938360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:27.939386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:27.940004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:27.942611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:27.948033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:27.948622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.123436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Calling method '.version_select at 0x7efd329f0ca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:28.126146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:28.127852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:28.129575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.185386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:28.186107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:28.187609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.223246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:28.225022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:28.225722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.250682 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-092af57c-f52a-4948-818e-ea04f9374d02 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679 tempest-PortsAdminExtendedAttrsIpV6TestJSON-251457679-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.803419 Oct 25 03:12:28.256360 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1491/2814] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:12:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:12:28.564924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:28.580615 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca5c084f-dd31-4f02-8e0c-a0bc01460752 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 0.716546 Oct 25 03:12:28.580963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:28.581292 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1324/2815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:27 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:28.581897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:28.601032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:28.602796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:28.603498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.611745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:28.613415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:28.614478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.890387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:28.891305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:28.907392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:28.907930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:28.908406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.909142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:28.909599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:28.910055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:28.972840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:28.983198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e13de386-9cc4-49a8-878b-37eaba45fbfe tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.409886 Oct 25 03:12:28.999560 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1492/2816] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:28 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:29.144560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:29.156502 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48d3a5b7-b84e-4787-8cfb-b79eee810fda tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1275 microversion: 2.1 time: 0.270306 Oct 25 03:12:29.159735 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1325/2817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:28 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:29.608962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:29.611694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:29.630584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:29.632615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:29.635229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:29.636962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:29.637654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:29.640626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:29.894178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:29.916892 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb04ef46-b565-4fa6-88a9-eb0e630c04cb tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 0.313455 Oct 25 03:12:29.920340 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1493/2818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:29 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:30.009395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:30.010636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:30.019767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:30.020675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:30.021271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:30.022201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:30.022825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:30.023525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:30.187687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:30.188861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:30.203726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:30.204722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:30.205542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:30.207138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:30.207948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:30.208839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:30.295499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:30.308322 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2663839-9901-4c86-be9e-3581ce8622d0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1275 microversion: 2.1 time: 0.123858 Oct 25 03:12:30.312305 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1494/2819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:30 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:30.919174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:30.951757 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87c60dbd-0aed-445a-8ff1-fcd30f1ae182 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.946697 Oct 25 03:12:30.965992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:30.966511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:30.975515 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1326/2820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:30 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:31.023675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:31.023675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:31.025255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:31.026211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:31.026853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:31.027388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:31.341182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:31.342027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:31.352486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:31.352486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:31.353591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:31.356899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:31.357396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:31.357983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:32.023250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:32.039612 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb800c0a-9fca-4a47-9f82-30a54aa5db30 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.700056 Oct 25 03:12:32.039612 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1327/2821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:31 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:32.046019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-8db19d55-9a73-474a-8a1d-45da5defe183 req-10397935-5038-4f3d-88fb-816b3165d470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda42aaf-7c35-41ad-a0d1-d46b9e587561", "name": "network-vif-plugged", "status": "completed", "tag": "73df9db2-b5ae-4640-b2fc-6789fdb58fc1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:32.072813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8db19d55-9a73-474a-8a1d-45da5defe183 req-10397935-5038-4f3d-88fb-816b3165d470 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:32.073357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8db19d55-9a73-474a-8a1d-45da5defe183 req-10397935-5038-4f3d-88fb-816b3165d470 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:32.074112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8db19d55-9a73-474a-8a1d-45da5defe183 req-10397935-5038-4f3d-88fb-816b3165d470 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:32.081537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:32.090585 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-8db19d55-9a73-474a-8a1d-45da5defe183 req-10397935-5038-4f3d-88fb-816b3165d470 service nova] Creating event network-vif-plugged:73df9db2-b5ae-4640-b2fc-6789fdb58fc1 for instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 on n-h2-862355-1 Oct 25 03:12:32.091189 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7918819e-9631-479a-8ceb-bd5aa540ae4b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 1.150148 Oct 25 03:12:32.101907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-8db19d55-9a73-474a-8a1d-45da5defe183 req-10397935-5038-4f3d-88fb-816b3165d470 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060964 Oct 25 03:12:32.102055 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1495/2822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:30 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:32.103118 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1328/2823] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:32.107043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:32.107923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:32.130091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:32.130958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:32.131606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:32.132510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:32.133387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:32.134304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:32.639489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:32.658853 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e56f8337-57b1-47bc-b00d-424c6f221c3d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.553351 Oct 25 03:12:32.660170 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1496/2824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:32 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:33.073948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:33.075437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:33.096889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:33.097667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:33.098447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:33.100127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:33.101019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:33.101885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:33.120829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:33.122201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:33.138331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:33.141118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:33.141768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:33.143077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:33.144818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:33.146191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:33.159510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:33.547392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:33.557335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:33.562281 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5deecdc7-3b6a-45d7-bf0b-5dda81227cd8 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.494127 Oct 25 03:12:33.570086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1329/2825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:33 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:33.588825 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-afeff50a-e062-4fb8-b65e-a114893354f3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1377 microversion: 2.1 time: 0.473311 Oct 25 03:12:33.589665 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1497/2826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:33 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1377 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:33.652903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e629c645-d67d-4b3f-ba10-1ac3251c398f req-72cecfb6-4b92-48c1-98e2-619c5dae1225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a3e49b-5532-4115-9a26-f16832aff4ac", "tag": "d8669128-bb5d-4a1f-9015-3b0a160e044b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:33.685187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:33.685856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:33.691848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e629c645-d67d-4b3f-ba10-1ac3251c398f req-72cecfb6-4b92-48c1-98e2-619c5dae1225 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:33.692348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e629c645-d67d-4b3f-ba10-1ac3251c398f req-72cecfb6-4b92-48c1-98e2-619c5dae1225 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:33.692772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e629c645-d67d-4b3f-ba10-1ac3251c398f req-72cecfb6-4b92-48c1-98e2-619c5dae1225 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:33.696100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:33.699324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:33.700114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:33.704656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:33.706038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:33.706872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:33.724541 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e629c645-d67d-4b3f-ba10-1ac3251c398f req-72cecfb6-4b92-48c1-98e2-619c5dae1225 service nova] Creating event network-changed:d8669128-bb5d-4a1f-9015-3b0a160e044b for instance a2a3e49b-5532-4115-9a26-f16832aff4ac on n-h1-862355-1 Oct 25 03:12:33.739318 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e629c645-d67d-4b3f-ba10-1ac3251c398f req-72cecfb6-4b92-48c1-98e2-619c5dae1225 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095090 Oct 25 03:12:33.740639 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1330/2827] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:12:34.092969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:34.101394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dfa13a84-d393-46a7-b277-1d0f992f0bef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.420421 Oct 25 03:12:34.115129 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1498/2828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:33 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:34.254537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-12b3a192-0aec-446b-a57f-6325efd4d1ac req-3f76058b-4e18-4527-98ca-daf9cb423969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02626a9-fe74-403a-a0b8-fe08b1a990cc", "tag": "748285ed-64ed-49b9-80ee-dc9790be9f1c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:34.292906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-12b3a192-0aec-446b-a57f-6325efd4d1ac req-3f76058b-4e18-4527-98ca-daf9cb423969 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:34.293830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-12b3a192-0aec-446b-a57f-6325efd4d1ac req-3f76058b-4e18-4527-98ca-daf9cb423969 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:34.294493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-12b3a192-0aec-446b-a57f-6325efd4d1ac req-3f76058b-4e18-4527-98ca-daf9cb423969 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:34.316950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-12b3a192-0aec-446b-a57f-6325efd4d1ac req-3f76058b-4e18-4527-98ca-daf9cb423969 service nova] Creating event network-changed:748285ed-64ed-49b9-80ee-dc9790be9f1c for instance d02626a9-fe74-403a-a0b8-fe08b1a990cc on n-h1-862355-1 Oct 25 03:12:34.324116 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-12b3a192-0aec-446b-a57f-6325efd4d1ac req-3f76058b-4e18-4527-98ca-daf9cb423969 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077298 Oct 25 03:12:34.325721 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1331/2829] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:34.593463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:34.599482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:34.600354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:34.617093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:34.618349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:34.635804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:34.638254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:34.638929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:34.640358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:34.641578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:34.644970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:34.646256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:34.646493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:34.647440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:34.648096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:34.650890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:34.651814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:35.059956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:35.074283 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66f3547c-2b9f-4bb0-bf0a-9d63b50be0c4 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.483289 Oct 25 03:12:35.081828 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1499/2830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:34 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:35.125985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:35.126610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:35.142332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:35.142836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:35.146303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:35.147254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:35.148063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:35.148674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:35.268314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=22 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:35.411947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:35.423246 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a8f94b6-00a2-4065-8088-b3814204a69f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.301162 Oct 25 03:12:35.424969 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1500/2831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:35 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:35.751258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:35.764010 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a463d86-c592-4e85-932a-e94b170ba78b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1526 microversion: 2.1 time: 1.150864 Oct 25 03:12:35.765729 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1332/2832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:34 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1526 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:35.795298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:35.796945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:35.815101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:35.815778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:35.816496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:35.817496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:35.818220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:35.818873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.102517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:36.103342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:36.126387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.129924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.132371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.133839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.136446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.137981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.214386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:36.228585 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-879d42c3-3146-414d-a64e-9cbdcf2622ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1526 microversion: 2.1 time: 0.436459 Oct 25 03:12:36.230898 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1501/2833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:35 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1526 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:36.256150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-07499cd8-1fc7-44d0-9657-0203b3d46e24 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:36.296384 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-07499cd8-1fc7-44d0-9657-0203b3d46e24 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/120c4488-d1b4-4d34-b5a4-6cbe4d0b104f" status: 202 len: 0 microversion: 2.1 time: 0.045102 Oct 25 03:12:36.304512 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1502/2834] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:12:36 2022] DELETE /compute/v2.1/flavors/120c4488-d1b4-4d34-b5a4-6cbe4d0b104f => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:12:36.316956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0733bb22-0f51-4ee6-ad37-75d847fd29f7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:36.393632 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0733bb22-0f51-4ee6-ad37-75d847fd29f7 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085559 Oct 25 03:12:36.395058 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1503/2835] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:12:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:36.417475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:36.422932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:36.431153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.431670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.432201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.432982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.433850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.434344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.514936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:36.523796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Old instance type tempest-test_resize_flavor_-745390623, new instance type m1.heat {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:12:36.559909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:12:36.560375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:12:36.561460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:12:36.563966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:12:36.567123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:12:36.730619 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-664c13bb-5195-4be6-9251-6c64476ef09f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561/action" status: 202 len: 0 microversion: 2.1 time: 0.319407 Oct 25 03:12:36.741126 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1504/2836] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:12:36 2022] POST /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:12:36.754500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:36.755364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:36.770119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:36.770851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.771625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.776188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.777055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.777713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.778302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.807405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d321da79-c0f7-4f32-8f47-54273c6e692e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.706665 Oct 25 03:12:36.821711 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1333/2837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:36 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:36.825755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:36.830503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:36.858371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.859478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.860101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:36.860852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:36.861306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:36.865225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:37.165297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:37.187726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fcb04e7d-64d5-4048-8aa9-29c7ea51dd80 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.445049 Oct 25 03:12:37.191892 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1505/2838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:36 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:37.709900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-26c6f23e-a0c0-4440-aba9-3825cd4ea780 req-13b0d22e-9ea7-48f2-b02a-7901517a83e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f89739-25c6-4c83-91c6-f723d7ae0d75", "name": "network-vif-plugged", "status": "completed", "tag": "dd091e9a-5668-4466-8121-f4dcfd44006e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:37.745261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26c6f23e-a0c0-4440-aba9-3825cd4ea780 req-13b0d22e-9ea7-48f2-b02a-7901517a83e5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:37.745995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26c6f23e-a0c0-4440-aba9-3825cd4ea780 req-13b0d22e-9ea7-48f2-b02a-7901517a83e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:37.746455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26c6f23e-a0c0-4440-aba9-3825cd4ea780 req-13b0d22e-9ea7-48f2-b02a-7901517a83e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:37.754654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:37.765593 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f3aa2956-c624-4236-86c9-ed3b7df00f0c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1535 microversion: 2.1 time: 0.952593 Oct 25 03:12:37.766220 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1334/2839] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:36 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1535 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:37.814978 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-26c6f23e-a0c0-4440-aba9-3825cd4ea780 req-13b0d22e-9ea7-48f2-b02a-7901517a83e5 service nova] Creating event network-vif-plugged:dd091e9a-5668-4466-8121-f4dcfd44006e for instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 on n-h2-862355-1 Oct 25 03:12:37.831421 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-26c6f23e-a0c0-4440-aba9-3825cd4ea780 req-13b0d22e-9ea7-48f2-b02a-7901517a83e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125877 Oct 25 03:12:37.834360 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1506/2840] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:37.837256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:37.848714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:37.863083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:37.865174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:37.867217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:37.869198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:37.872600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:37.874953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:38.214555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:38.216216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:38.254164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:38.256555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:38.258216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:38.261169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:38.262096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:38.263128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:38.562452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:38.573857 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e776ab48-8aa2-4deb-a281-411166c76dfa tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.738571 Oct 25 03:12:38.578556 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1335/2841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:37 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:38.798942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:38.801141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:38.836568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:38.843978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:38.845653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:38.846764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:38.850411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:38.857141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:39.109717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:39.120682 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b90c05af-2e33-43b1-b0a8-e89c38b83ba6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1315 microversion: 2.1 time: 0.911295 Oct 25 03:12:39.129272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1507/2842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:38 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:39.152039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4340e433-83ab-45cb-aecd-65917812a4bb"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:39.159729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:39.181278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:39.182074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:39.182673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:39.183553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:39.184167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:39.184902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:39.450239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:39.462592 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d615bd7f-8f50-4587-a591-e030857727f2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1535 microversion: 2.1 time: 0.673753 Oct 25 03:12:39.469740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1336/2843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:38 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1535 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:39.601453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:39.602336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:39.621403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:39.621925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:39.622361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:39.635676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:39.636189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:39.636745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:39.810254 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4787b781-dab7-4f0e-99dc-6c660f6898e4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "POST /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674657 Oct 25 03:12:39.813493 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1508/2844] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:12:39 2022] POST /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:39.984710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:40.017264 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-106d979b-cf77-41c9-85e2-b113992ac11c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.414617 Oct 25 03:12:40.017264 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1337/2845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:39 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:40.150394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:40.151101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:40.170460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.173154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.175740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:40.177500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.181708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.183283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:40.494650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:40.506041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:40.508792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:40.524962 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb02a4b8-7496-4bb5-8061-7d700f3a67ca tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1503 microversion: 2.1 time: 0.377751 Oct 25 03:12:40.526357 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1509/2846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:40 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:40.532708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.533513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.534582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:40.536031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.537388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.538229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:40.558315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:40.559919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:40.586295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.588026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.592667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:40.596797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.599761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.602654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:40.860417 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-161d2f71-7279-4f5a-b8c6-2ca23e2bce83 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75/action" status: 202 len: 0 microversion: 2.1 time: 0.307339 Oct 25 03:12:40.866215 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1510/2847] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:12:40 2022] POST /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:12:40.882911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:40.884827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:40.908069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.910931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.911927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:40.914434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:40.915316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:40.916836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:41.270953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:41.277658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:41.286260 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f0247f0c-7470-459b-bb44-a2ef35e4522a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1535 microversion: 2.1 time: 0.798856 Oct 25 03:12:41.287826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1338/2848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:40 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1535 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:41.303000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:41.305648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:41.334350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:41.334857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:41.336161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:41.336883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:41.337349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:41.337813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:41.760922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:41.795593 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b591ddd-f956-4c9d-8c54-8b99b69a7fb3 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.505250 Oct 25 03:12:41.798340 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1339/2849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:41 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:41.839917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c53e00b1-75b7-4c3a-bdf7-5b126b3eefe3 req-1c6fbded-6b0b-4f69-aae9-f755a425b10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02626a9-fe74-403a-a0b8-fe08b1a990cc", "name": "network-vif-plugged", "status": "completed", "tag": "748285ed-64ed-49b9-80ee-dc9790be9f1c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:41.877509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c53e00b1-75b7-4c3a-bdf7-5b126b3eefe3 req-1c6fbded-6b0b-4f69-aae9-f755a425b10c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:41.879626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c53e00b1-75b7-4c3a-bdf7-5b126b3eefe3 req-1c6fbded-6b0b-4f69-aae9-f755a425b10c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:41.880222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c53e00b1-75b7-4c3a-bdf7-5b126b3eefe3 req-1c6fbded-6b0b-4f69-aae9-f755a425b10c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:41.906975 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c53e00b1-75b7-4c3a-bdf7-5b126b3eefe3 req-1c6fbded-6b0b-4f69-aae9-f755a425b10c service nova] Creating event network-vif-plugged:748285ed-64ed-49b9-80ee-dc9790be9f1c for instance d02626a9-fe74-403a-a0b8-fe08b1a990cc on n-h1-862355-1 Oct 25 03:12:41.915283 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c53e00b1-75b7-4c3a-bdf7-5b126b3eefe3 req-1c6fbded-6b0b-4f69-aae9-f755a425b10c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088349 Oct 25 03:12:41.921240 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1340/2850] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:42.273666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:42.286361 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5dab24cb-eb48-449d-aeb3-7cdacae97c8c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1508 microversion: 2.1 time: 1.418138 Oct 25 03:12:42.287502 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1511/2851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:40 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1508 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:42.319826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:42.321657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:42.335257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:42.336276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:42.336904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:42.339635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:42.340295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:42.341115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:42.642636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:42.664357 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa99b035-4cc6-450c-9e6f-bd36111fe555 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1535 microversion: 2.1 time: 0.349397 Oct 25 03:12:42.664958 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1341/2852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:42 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1535 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:42.821273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:42.821982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:42.851441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:42.851944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:42.852391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:42.866950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:42.867598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:42.868191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:43.315613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:43.316240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:43.329021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:43.330592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:43.331099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:43.331546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:43.332292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:43.332758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:43.333470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:43.548731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:43.551548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:43.578164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-201ca822-ce50-45c7-9eb6-caa78bbf5fef tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1317 microversion: 2.1 time: 0.760920 Oct 25 03:12:43.587497 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1512/2853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:42 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:43.697756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:43.699024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:43.703483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:43.728466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:43.734268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:43.736063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:43.739097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:43.744044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:43.744789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:43.771897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:43.788474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5f743d73-8fb3-48d2-8ce4-e313418074be tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1488 microversion: 2.1 time: 0.478491 Oct 25 03:12:43.798176 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1342/2854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:43 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1488 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:43.823795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:43.824306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:43.835927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:43.836430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:43.836878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:43.837604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:43.838261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:43.839870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:43.901615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:12:44.145125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81180d9a-8a43-4419-ac9d-d939bc194421 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 204 len: 0 microversion: 2.1 time: 0.324774 Oct 25 03:12:44.147181 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1343/2855] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:12:43 2022] DELETE /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:12:44.166252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-126bca55-0480-4940-be27-f0b298a09a64 req-de63598f-5fa1-4a98-a9f9-c9d38f2515c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a3e49b-5532-4115-9a26-f16832aff4ac", "name": "network-vif-plugged", "status": "completed", "tag": "d8669128-bb5d-4a1f-9015-3b0a160e044b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:44.191082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-126bca55-0480-4940-be27-f0b298a09a64 req-de63598f-5fa1-4a98-a9f9-c9d38f2515c9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:44.191589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-126bca55-0480-4940-be27-f0b298a09a64 req-de63598f-5fa1-4a98-a9f9-c9d38f2515c9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:44.192020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-126bca55-0480-4940-be27-f0b298a09a64 req-de63598f-5fa1-4a98-a9f9-c9d38f2515c9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:44.216781 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-126bca55-0480-4940-be27-f0b298a09a64 req-de63598f-5fa1-4a98-a9f9-c9d38f2515c9 service nova] Creating event network-vif-plugged:d8669128-bb5d-4a1f-9015-3b0a160e044b for instance a2a3e49b-5532-4115-9a26-f16832aff4ac on n-h1-862355-1 Oct 25 03:12:44.222820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-126bca55-0480-4940-be27-f0b298a09a64 req-de63598f-5fa1-4a98-a9f9-c9d38f2515c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073839 Oct 25 03:12:44.227356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1344/2856] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:44.234622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:44.235740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:44.246091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:44.246832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:44.247587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:44.249626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:44.250429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:44.251044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:44.705247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:44.713245 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f59fc7a5-4fb2-4357-a06c-bd22911f0447 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1494 microversion: 2.1 time: 0.484614 Oct 25 03:12:44.717894 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1345/2857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:44 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1494 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:44.722896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:44.724993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:44.741604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:44.742540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:44.744647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:44.745613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:44.748816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:44.749635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:44.897710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:44.908493 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-60b8b061-a750-4d62-b0d9-5f9b7cc048da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 1.217065 Oct 25 03:12:44.925299 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1513/2858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:43 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:45.301104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:45.310364 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-edb006db-661f-41a5-94e2-e1d3c136fac0 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 200 len: 1506 microversion: 2.1 time: 0.590578 Oct 25 03:12:45.311141 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1346/2859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:44 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 1506 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:45.342480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:45.343676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:45.358373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:45.369081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:45.370892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:45.372807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:45.378761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:45.379406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:45.672105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:45.684057 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8635ada9-6455-4a8b-990d-4e635a92d484 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 200 len: 1317 microversion: 2.1 time: 0.346323 Oct 25 03:12:45.685995 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1514/2860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:45 2022] GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:45.746920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:45.748729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:45.762273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:45.763629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:45.764298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:45.767254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:45.768572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:45.770192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:45.932875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:45.934580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:45.947269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:45.953819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:45.954943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:45.955942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:45.956696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:45.957414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:46.420593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:46.439801 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ae4d2f3f-e47a-4118-b0d5-dc8d90eb83d7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1494 microversion: 2.1 time: 0.689235 Oct 25 03:12:46.464330 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1347/2861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:45 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1494 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:46.709236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:46.710615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:46.720170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:46.755886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:46.758644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:46.759739 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d5b144aa-cc8c-4d96-b8f9-d4079f6abc7a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.831168 Oct 25 03:12:46.762973 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1515/2862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:45 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:46.763581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:46.765230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:46.770538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e6a2b027-847c-40fd-881d-ccdd11fb3bf9 req-6446ca35-4f2c-41c5-890e-ce2f105a224d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f89739-25c6-4c83-91c6-f723d7ae0d75", "name": "network-vif-deleted", "tag": "dd091e9a-5668-4466-8121-f4dcfd44006e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:46.772173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:46.774135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:46.828148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e6a2b027-847c-40fd-881d-ccdd11fb3bf9 req-6446ca35-4f2c-41c5-890e-ce2f105a224d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:46.834746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e6a2b027-847c-40fd-881d-ccdd11fb3bf9 req-6446ca35-4f2c-41c5-890e-ce2f105a224d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:46.839621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e6a2b027-847c-40fd-881d-ccdd11fb3bf9 req-6446ca35-4f2c-41c5-890e-ce2f105a224d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:46.879939 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e6a2b027-847c-40fd-881d-ccdd11fb3bf9 req-6446ca35-4f2c-41c5-890e-ce2f105a224d service nova] Creating event network-vif-deleted:dd091e9a-5668-4466-8121-f4dcfd44006e for instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 on n-h2-862355-1 Oct 25 03:12:46.894623 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e6a2b027-847c-40fd-881d-ccdd11fb3bf9 req-6446ca35-4f2c-41c5-890e-ce2f105a224d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127536 Oct 25 03:12:46.896942 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1516/2863] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:47.129171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:47.142987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-141a9de7-62ba-488e-b61b-b40d8adf9cdd tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 200 len: 1505 microversion: 2.1 time: 0.437832 Oct 25 03:12:47.143600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1348/2864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:46 2022] GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:47.174610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:47.176183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:47.187482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.188637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.189573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.191106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.191801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.192959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.239272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:12:47.394650 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d59ac34-71f7-44c1-bdf6-bd710429ec54 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 204 len: 0 microversion: 2.1 time: 0.225714 Oct 25 03:12:47.396457 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1517/2865] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:12:47 2022] DELETE /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:12:47.406245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:47.406977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:47.424340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.424847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.428729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.431078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.432904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.434290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.471719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:47.474067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:47.489522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.492733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.495755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.496881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.504348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.504850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.510608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:12:47.607614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.608126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.608844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.610252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lazy-loading 'fault' on Instance uuid 40f89739-25c6-4c83-91c6-f723d7ae0d75 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:12:47.771807 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7afd9925-19a1-4979-a1c5-d62580e7527e tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 204 len: 0 microversion: 2.1 time: 0.368797 Oct 25 03:12:47.775070 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1349/2866] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:12:47 2022] DELETE /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:12:47.793407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:47.795663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:47.814027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.816547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.820146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:47.822572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:47.823240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:47.824423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:48.098826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:48.107890 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1c86abe-b18e-4612-91c8-8e7ff4981537 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 200 len: 1511 microversion: 2.1 time: 0.323818 Oct 25 03:12:48.109986 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1350/2867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:47 2022] GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:48.114754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:48.115605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:48.121460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:48.122499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:48.123109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:48.123983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:48.124607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:48.125197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:48.152169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:48.162669 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d67facb-493e-4e08-ab6c-1558c0bf6524 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 200 len: 1305 microversion: 2.1 time: 0.696619 Oct 25 03:12:48.178289 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1518/2868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:47 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 1305 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:48.278692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:48.288710 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81c3e770-2828-4a4f-b5cc-203784e7cc4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.177344 Oct 25 03:12:48.289314 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1351/2869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:48 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:49.135477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:49.136124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:49.145415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:49.145771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:49.146181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:49.147575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:49.148047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:49.148481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:49.188853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:49.189477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:49.204666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:49.205456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:49.206216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:49.207165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:49.208749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:49.210269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:49.235806 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 HTTP/1.1 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '40f89739-25c6-4c83-91c6-f723d7ae0d75'} Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:49.237901 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:49.243468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:49.244623 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-49b7e75b-db4b-49fb-bc84-ecf3127ca319 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 404 len: 111 microversion: 2.1 time: 0.059411 Oct 25 03:12:49.246488 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1352/2870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:49 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:12:49.315932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:49.316932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:49.332318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:49.334317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:49.334992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:49.337370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:49.338116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:49.343045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:49.416920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:49.446382 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef5db8eb-5073-4f9e-9d42-fab833c6994a tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 200 len: 1511 microversion: 2.1 time: 0.312909 Oct 25 03:12:49.448432 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1519/2871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:49 2022] GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:49.573360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-135154361", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "399e4372-9a26-4378-9554-8714a7affe92"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:49.606892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:49.619700 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e29a4d23-2693-4b80-bf1b-996e69486819 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.308370 Oct 25 03:12:49.634500 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1353/2872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:49 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:49.678512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] validate_networks() for [('399e4372-9a26-4378-9554-8714a7affe92', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:12:50.474713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:50.475945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:50.488112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:50.490569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:50.491195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:50.492083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:50.493290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:50.495321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:50.505514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:51.033751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:51.048480 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-228c4df4-be42-467d-be6e-847a1767ab19 tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 200 len: 1511 microversion: 2.1 time: 0.578673 Oct 25 03:12:51.049986 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1354/2873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:50 2022] GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:51.054914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:51.055747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:51.062673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:51.063431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:51.064094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:51.065073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:51.066246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:51.066966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:51.318205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:51.339141 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35fa742f-89fe-45d7-93e0-84fdd31b5cf2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.280160 Oct 25 03:12:51.340026 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1355/2874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:51 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:51.348599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f49de0c2-265d-481e-a50b-2691f18095e8 req-501ea616-c48e-4380-b04a-58a36a81a4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02626a9-fe74-403a-a0b8-fe08b1a990cc", "name": "network-vif-deleted", "tag": "748285ed-64ed-49b9-80ee-dc9790be9f1c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:51.397438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f49de0c2-265d-481e-a50b-2691f18095e8 req-501ea616-c48e-4380-b04a-58a36a81a4e7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:51.398459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f49de0c2-265d-481e-a50b-2691f18095e8 req-501ea616-c48e-4380-b04a-58a36a81a4e7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:51.399230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f49de0c2-265d-481e-a50b-2691f18095e8 req-501ea616-c48e-4380-b04a-58a36a81a4e7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:51.448957 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f49de0c2-265d-481e-a50b-2691f18095e8 req-501ea616-c48e-4380-b04a-58a36a81a4e7 service nova] Creating event network-vif-deleted:748285ed-64ed-49b9-80ee-dc9790be9f1c for instance d02626a9-fe74-403a-a0b8-fe08b1a990cc on n-h1-862355-1 Oct 25 03:12:51.475574 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f49de0c2-265d-481e-a50b-2691f18095e8 req-501ea616-c48e-4380-b04a-58a36a81a4e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132495 Oct 25 03:12:51.480577 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1356/2875] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:51.618577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:12:51.619806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:12:51.629365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:12:51.629934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:12:51.630584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:12:51.649536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:51.661624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:51.662944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:51.667116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:51.668181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:51.674766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:51.744096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:12:51.753570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for user 256827a36f464fe1b535d91f95e48681 and project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:12:51.793328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:12:51.816244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:12:51.822912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-8f2c8be6-68f9-4555-a239-9752a53036d9 req-635cbf04-5c9f-469e-861e-7c70d124f6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a3e49b-5532-4115-9a26-f16832aff4ac", "name": "network-vif-deleted", "tag": "d8669128-bb5d-4a1f-9015-3b0a160e044b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:51.858758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8f2c8be6-68f9-4555-a239-9752a53036d9 req-635cbf04-5c9f-469e-861e-7c70d124f6d7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:51.859150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8f2c8be6-68f9-4555-a239-9752a53036d9 req-635cbf04-5c9f-469e-861e-7c70d124f6d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:51.859655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8f2c8be6-68f9-4555-a239-9752a53036d9 req-635cbf04-5c9f-469e-861e-7c70d124f6d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:51.891465 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-8f2c8be6-68f9-4555-a239-9752a53036d9 req-635cbf04-5c9f-469e-861e-7c70d124f6d7 service nova] Creating event network-vif-deleted:d8669128-bb5d-4a1f-9015-3b0a160e044b for instance a2a3e49b-5532-4115-9a26-f16832aff4ac on n-h1-862355-1 Oct 25 03:12:51.899600 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-8f2c8be6-68f9-4555-a239-9752a53036d9 req-635cbf04-5c9f-469e-861e-7c70d124f6d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099070 Oct 25 03:12:51.906656 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1357/2876] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:51.965082 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-513c6e04-32b7-464f-814d-3b8c97891e03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.396029 Oct 25 03:12:51.974097 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1520/2877] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:12:51.990162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef697735-38b5-468a-9882-1e8d41a0b72e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:51.992714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ef697735-38b5-468a-9882-1e8d41a0b72e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:52.077157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:52.078532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:52.080640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef697735-38b5-468a-9882-1e8d41a0b72e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:52.089310 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef697735-38b5-468a-9882-1e8d41a0b72e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1214 microversion: 2.1 time: 0.106165 Oct 25 03:12:52.092169 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1358/2878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:51 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:52.102450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:52.105630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:52.107295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:52.110309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:52.111395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:52.113774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:52.319709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb9efa85c53e4db4b3373f0a94d699de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64bf316f35434551a65596f9207677e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:52.331666 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d73e29ef-c45a-4990-a227-343117d6089c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 200 len: 1302 microversion: 2.1 time: 0.257700 Oct 25 03:12:52.333009 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1521/2879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:52 2022] GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 1302 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:12:52.366939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:52.367556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:52.380372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:52.381669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:52.384397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:52.394289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:52.395164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:52.396842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:52.765291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:52.776146 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef6e1153-7abe-462c-86be-00868bd39c8a tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.414100 Oct 25 03:12:52.780544 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1359/2880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:52 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:53.117296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:53.118078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:53.132874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.135758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.142313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:53.147822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.148702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.150646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:53.270670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:53.287966 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d2822ea-ad6d-4d21-967d-7a0babf368a8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1210 microversion: 2.1 time: 0.176630 Oct 25 03:12:53.288487 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1522/2881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:53 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1210 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:53.361975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:53.362627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: a2a3e49b-5532-4115-9a26-f16832aff4ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:53.373587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.374113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.375426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:53.376979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.379136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.382523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:53.406569 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] HTTP exception thrown: Instance a2a3e49b-5532-4115-9a26-f16832aff4ac could not be found. Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Request method failure captured: Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac HTTP/1.1 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Pxu1xDxWCl-nCKnEpYIb-77x557gOoPVMZqrga52e7OmP3vkQtZZIrknLKJ0SlDCabDJ5ni78gyldZbRA_u1MRK1kMiY3f7ZAZqi3kcv5VtWZVnOgOYSy7zx5K1ouwZ_00NODbJAg4gEY3kDLR_T2wfpwgTQwE0twuu4wp647H8jo Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 64bf316f35434551a65596f9207677e1 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-MultipleCreateTestJSON-1214595466 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/64bf316f35434551a65596f9207677e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/64bf316f35434551a65596f9207677e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_64bf316f35434551a65596f9207677e1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/64bf316f35434551a65596f9207677e1"}]}] Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-MultipleCreateTestJSON-1214595466 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 64bf316f35434551a65596f9207677e1 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1214595466 Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-MultipleCreateTestJSON-1214595466-project Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fb9efa85c53e4db4b3373f0a94d699de Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-MultipleCreateTestJSON-1214595466-project Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance a2a3e49b-5532-4115-9a26-f16832aff4ac could not be found. Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'a2a3e49b-5532-4115-9a26-f16832aff4ac'} Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a3e49b-5532-4115-9a26-f16832aff4ac could not be found. Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a3e49b-5532-4115-9a26-f16832aff4ac could not be found. Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:53.410395 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a3e49b-5532-4115-9a26-f16832aff4ac could not be found. Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Returning 404 to user: Instance a2a3e49b-5532-4115-9a26-f16832aff4ac could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:53.416275 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-10b1489e-7a3e-460d-8e92-b60b8e17cb2c tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac" status: 404 len: 111 microversion: 2.1 time: 0.056302 Oct 25 03:12:53.423737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1360/2882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:53 2022] GET /compute/v2.1/servers/a2a3e49b-5532-4115-9a26-f16832aff4ac => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:53.428678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:53.429307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] [instance: d02626a9-fe74-403a-a0b8-fe08b1a990cc] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:53.441191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.441860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.443051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:53.445903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.447903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.448418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:53.476411 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] HTTP exception thrown: Instance d02626a9-fe74-403a-a0b8-fe08b1a990cc could not be found. Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Request method failure captured: Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc HTTP/1.1 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Pxu1xDxWCl-nCKnEpYIb-77x557gOoPVMZqrga52e7OmP3vkQtZZIrknLKJ0SlDCabDJ5ni78gyldZbRA_u1MRK1kMiY3f7ZAZqi3kcv5VtWZVnOgOYSy7zx5K1ouwZ_00NODbJAg4gEY3kDLR_T2wfpwgTQwE0twuu4wp647H8jo Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 64bf316f35434551a65596f9207677e1 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-MultipleCreateTestJSON-1214595466 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/64bf316f35434551a65596f9207677e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/64bf316f35434551a65596f9207677e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_64bf316f35434551a65596f9207677e1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/64bf316f35434551a65596f9207677e1"}]}] Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-MultipleCreateTestJSON-1214595466 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 64bf316f35434551a65596f9207677e1 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1214595466 Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-MultipleCreateTestJSON-1214595466-project Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fb9efa85c53e4db4b3373f0a94d699de Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-MultipleCreateTestJSON-1214595466-project Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance d02626a9-fe74-403a-a0b8-fe08b1a990cc could not be found. Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'd02626a9-fe74-403a-a0b8-fe08b1a990cc'} Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02626a9-fe74-403a-a0b8-fe08b1a990cc could not be found. Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02626a9-fe74-403a-a0b8-fe08b1a990cc could not be found. Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:53.478251 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02626a9-fe74-403a-a0b8-fe08b1a990cc could not be found. Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] Returning 404 to user: Instance d02626a9-fe74-403a-a0b8-fe08b1a990cc could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2d37fa1-7065-46c3-a786-397dc372218d tempest-MultipleCreateTestJSON-1214595466 tempest-MultipleCreateTestJSON-1214595466-project] 10.222.0.36 "GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc" status: 404 len: 111 microversion: 2.1 time: 0.055454 Oct 25 03:12:53.483027 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1523/2883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:53 2022] GET /compute/v2.1/servers/d02626a9-fe74-403a-a0b8-fe08b1a990cc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:12:53.809520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:53.810167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:53.830178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.832125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.832587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:53.833326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:53.835160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:53.837668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:54.134188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:54.148221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15ceffb3-08a3-48c6-ba42-643c7a3793f5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.343680 Oct 25 03:12:54.165383 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1361/2884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:53 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:54.319477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:54.320369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:54.334423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:54.335192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:54.336116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:54.337261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:54.337790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:54.339319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:54.521963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:54.541668 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc683298-2101-4546-bdb3-4bd2d02ac6ef tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1272 microversion: 2.1 time: 0.229828 Oct 25 03:12:54.543907 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1524/2885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:54 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:55.175019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:55.175840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:55.199809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:55.200803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:55.202151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:55.203507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:55.204176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:55.205086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:55.573802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:55.575937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:55.601041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:55.601550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:55.602017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:55.609158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:55.609633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:55.616744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:55.725600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:55.744842 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f8b0e44-311d-4673-8ae1-7357e0800344 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.573971 Oct 25 03:12:55.759025 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1362/2886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:55 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:56.205018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:56.235890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4ee8575-fdc1-49b9-a25c-ceb0284af36e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 0.671221 Oct 25 03:12:56.238440 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1525/2887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:55 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:56.785359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:56.786008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:56.798548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:56.816523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:56.817172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:56.820736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:56.822247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:56.826228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:57.277104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:57.292186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-83ac949d-f7fc-4db9-8f09-81da38b0819f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.511749 Oct 25 03:12:57.317331 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1363/2888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:56 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:57.331447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:57.332818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:57.359599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:57.361181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:57.362582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:57.364795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:57.366376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:57.367089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:57.428413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "038a8caf-0cb8-4235-836b-e0f827f9fba2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:57.442600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:57.458175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:57.458680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:57.459166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:57.459893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:57.460356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:57.460789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:57.762908 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] HTTP exception thrown: Volume 038a8caf-0cb8-4235-836b-e0f827f9fba2 could not be found. Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Request method failure captured: Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments/4340e433-83ab-45cb-aecd-65917812a4bb HTTP/1.1 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 74 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1PcVPXoJX3cBX3q73Dmbak4bUACoNV4E5gECVbW-r3sAMs5pKBKyD_8TTnQ4vN6FPo28x8gjesFQE6SFJEJW5wI8Pv8shAibWRFPILXNzPHuF2EpssfggKT7AvT6e7oQ9EjUHpLP1etBtBBc-eYkcRsdaZYBwqyh_-SNdhOx-aaXfc Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 7f724e593dcf4705972f965471bad3c6 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesAdminNegativeTest-881022761 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f724e593dcf4705972f965471bad3c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f724e593dcf4705972f965471bad3c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f724e593dcf4705972f965471bad3c6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f724e593dcf4705972f965471bad3c6"}]}] Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesAdminNegativeTest-881022761 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 7f724e593dcf4705972f965471bad3c6 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-881022761 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesAdminNegativeTest-881022761-project-admin Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 26364024191d4897a962ca16e1a547c3 Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesAdminNegativeTest-881022761-project-admin Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: {"volumeAttachment": {"volumeId": "038a8caf-0cb8-4235-836b-e0f827f9fba2"}} Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: exception: Volume 038a8caf-0cb8-4235-836b-e0f827f9fba2 could not be found. Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '37182056-b6bc-4b4a-b91e-3ee4f275ba7b', 'id': '4340e433-83ab-45cb-aecd-65917812a4bb', 'body': {'volumeAttachment': {'volumeId': '038a8caf-0cb8-4235-836b-e0f827f9fba2'}}} Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 038a8caf-0cb8-4235-836b-e0f827f9fba2 could not be found. (HTTP 404) (Request-ID: req-88c7d601-47e0-4f19-9efc-b5c9cfc500b8) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:12:57.765022 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 038a8caf-0cb8-4235-836b-e0f827f9fba2 could not be found. Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 038a8caf-0cb8-4235-836b-e0f827f9fba2 could not be found. Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 038a8caf-0cb8-4235-836b-e0f827f9fba2 could not be found. Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Returning 400 to user: Volume 038a8caf-0cb8-4235-836b-e0f827f9fba2 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c80296e-1fb0-4332-b441-3d7ec3610f96 tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments/4340e433-83ab-45cb-aecd-65917812a4bb" status: 400 len: 107 microversion: 2.1 time: 0.674777 Oct 25 03:12:57.771197 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1526/2889] 10.222.0.36 () {60 vars in 1433 bytes} [Tue Oct 25 03:12:57 2022] PUT /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments/4340e433-83ab-45cb-aecd-65917812a4bb => generated 107 bytes in 677 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:12:57.944813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:57.945245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:57.956471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:57.960658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:57.961171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:57.961814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:57.966869 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93156a8f-4d34-4843-a447-8df86c0c9783 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 0.647261 Oct 25 03:12:57.967082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:57.967636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:57.968105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:57.981742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1364/2890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:57 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:58.194934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lazy-loading 'services' on Instance uuid 37182056-b6bc-4b4a-b91e-3ee4f275ba7b {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:12:58.324960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:58.325595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:58.338265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:58.338774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:58.339225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:58.340066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:58.340461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:58.341002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:58.381105 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6869f44-bc2f-4095-b7c4-780826afc1c5 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments/4340e433-83ab-45cb-aecd-65917812a4bb" status: 202 len: 0 microversion: 2.1 time: 0.439196 Oct 25 03:12:58.381729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1527/2891] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:12:57 2022] DELETE /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments/4340e433-83ab-45cb-aecd-65917812a4bb => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:12:58.420972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:58.431961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:58.474571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:58.485355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:58.486414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:58.489943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:58.490521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:58.492361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:58.583143 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-179ae1b2-b183-46a4-bb46-79a0e4714a70 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196419 Oct 25 03:12:58.590498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1528/2892] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:12:58 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:59.028390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:59.029293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:59.048732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:59.052502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:59.052961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:59.054962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:59.062011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:59.064285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:59.093318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:12:59.165660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:59.178673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-69eae85f-9746-45fa-8e85-6bd1930279d9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.858595 Oct 25 03:12:59.179376 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1365/2893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:58 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:12:59.481157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-8b4cda8c-5e72-4a9a-a41f-59bba1ca32e5 req-b790854e-f78b-4504-a9b1-cd0e3179c9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3124ad5d-3bef-4651-b4f4-b205d004398d", "tag": "21871249-17d0-43b2-a55d-b7bee5257446"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:12:59.500099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8b4cda8c-5e72-4a9a-a41f-59bba1ca32e5 req-b790854e-f78b-4504-a9b1-cd0e3179c9f7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:59.500842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8b4cda8c-5e72-4a9a-a41f-59bba1ca32e5 req-b790854e-f78b-4504-a9b1-cd0e3179c9f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:59.501515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8b4cda8c-5e72-4a9a-a41f-59bba1ca32e5 req-b790854e-f78b-4504-a9b1-cd0e3179c9f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:59.529159 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-8b4cda8c-5e72-4a9a-a41f-59bba1ca32e5 req-b790854e-f78b-4504-a9b1-cd0e3179c9f7 service nova] Creating event network-changed:21871249-17d0-43b2-a55d-b7bee5257446 for instance 3124ad5d-3bef-4651-b4f4-b205d004398d on n-h2-862355-1 Oct 25 03:12:59.541930 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-8b4cda8c-5e72-4a9a-a41f-59bba1ca32e5 req-b790854e-f78b-4504-a9b1-cd0e3179c9f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067825 Oct 25 03:12:59.543213 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1366/2894] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:59.596874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:12:59.599720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:12:59.622993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:59.624282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:59.627006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:59.631336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:12:59.632139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:12:59.637522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:12:59.753614 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-df5e4875-5a4a-4d85-947e-1fdc43aca443 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161043 Oct 25 03:12:59.754636 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1367/2895] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:12:59 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:12:59.857967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:12:59.891531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ae3e439-b98d-4209-bd81-7094b52a7177 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 0.877730 Oct 25 03:12:59.898501 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1529/2896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:12:58 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:00.206900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:00.207546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:00.217132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:00.217631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:00.218155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:00.218883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:00.219332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:00.219770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:00.770396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:00.774014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:00.797934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:00.798728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:00.799748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:00.800885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:00.801568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:00.817054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:00.889758 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc1f2d60-d073-4a06-8739-2ff0f05d6e5c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124814 Oct 25 03:13:00.891543 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1530/2897] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:00 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:00.902925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:00.912437 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8c1599c-6f0a-4123-9939-27c610cd5429 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.709318 Oct 25 03:13:00.913032 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1368/2898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:00 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:00.942809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:00.945329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:00.972642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:00.973405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:00.976124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:00.977921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:00.979357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:00.981552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:01.697641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:01.777740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:01.906420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:01.909237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:01.949392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:01.981063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:01.982576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:01.983037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:01.983794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:01.984264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:01.989924 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad43e8e6-d0fd-4ab0-b0ba-95deeb52fc14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 1.063092 Oct 25 03:13:01.990550 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1531/2899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:00 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:01.991195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:02.015841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:02.018941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:02.044427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:02.048750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:02.049983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:02.072191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:02.075374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:02.076358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:02.087282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:02.131379 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-26c510a7-7aa2-4e18-a6d3-881cd8612e8c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231800 Oct 25 03:13:02.157178 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1369/2900] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:01 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:02.643422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:02.685133 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc09e34a-f4c4-436f-b8e1-f1ddf920afde tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.689385 Oct 25 03:13:02.688969 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1532/2901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:01 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:03.015525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:03.016135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:03.039607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:03.040110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:03.040557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:03.041275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:03.052618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:03.053555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:03.169507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:03.172503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:03.191437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:03.191944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:03.192409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:03.194536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:03.195006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:03.200483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:03.310456 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c70f1ef4-d79c-4476-9c38-b67664e2c645 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143460 Oct 25 03:13:03.313157 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1533/2902] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:03 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:03.717090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:03.718507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:03.736799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:03.743774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:03.743774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:03.743774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:03.743774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:03.743774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:03.775723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:03.787046 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-554093d0-81d8-4c0f-86cf-2e0cf720bdac tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 0.775588 Oct 25 03:13:03.787644 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1370/2903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:03 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:04.326182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:04.329280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:04.354214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:04.356534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:04.357149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:04.362803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:04.363666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:04.364374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:04.475815 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c293a3ff-49b9-4cb0-8216-86280ecefa61 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154248 Oct 25 03:13:04.476883 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1371/2904] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:04 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:04.694781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:04.710852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0960d73d-844e-43e8-825a-34e32dddbaef tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.999621 Oct 25 03:13:04.711519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1534/2905] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:03 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:04.812770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:04.821583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:04.852415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:04.853095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:04.853653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:04.854549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:04.856493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:04.858446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:05.322529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:05.337197 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-719e41c2-e164-4d5b-8bfd-99dabf5b28f3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 0.528983 Oct 25 03:13:05.342431 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1372/2906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:04 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:05.499898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:05.502468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:05.541878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:05.545702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:05.546590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:05.547944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:05.549129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:05.549857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:05.612148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-14cc50a3-06ab-44ca-9de1-1d06869b04f4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127009 Oct 25 03:13:05.613627 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1535/2907] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:05 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:05.736215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:05.736766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:05.748495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:05.749142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:05.749599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:05.761734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:05.762245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:05.762777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:06.307432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:06.326789 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-566694fc-bed6-48d0-a699-25365f9c63ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1540 microversion: 2.1 time: 0.593425 Oct 25 03:13:06.332399 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1373/2908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:05 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1540 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:06.374313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:06.379361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:06.405278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:06.406379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:06.406977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:06.408027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:06.408720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:06.409593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:06.626747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:06.629420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:06.646081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:06.647069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:06.647942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:06.649179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:06.649968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:06.650563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:06.676103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:06.710842 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba9271c1-2bac-40f7-9778-6ce83f4c2c2d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089607 Oct 25 03:13:06.713938 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1374/2909] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:06 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:07.244810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:07.264250 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad8fce19-ee13-4151-ab93-b2feba265f02 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 0.899853 Oct 25 03:13:07.287796 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1536/2910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:06 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:07.363451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:07.366146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:07.437504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:07.440894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:07.446812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:07.449535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:07.451124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:07.453097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:07.610908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-05a4a970-9694-4340-bcd6-1c8c981f1dfb req-d6098146-054a-438d-80f2-86e7f68105ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3124ad5d-3bef-4651-b4f4-b205d004398d", "name": "network-vif-plugged", "status": "completed", "tag": "21871249-17d0-43b2-a55d-b7bee5257446"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:07.642015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-05a4a970-9694-4340-bcd6-1c8c981f1dfb req-d6098146-054a-438d-80f2-86e7f68105ab service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:07.642505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-05a4a970-9694-4340-bcd6-1c8c981f1dfb req-d6098146-054a-438d-80f2-86e7f68105ab service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:07.644294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-05a4a970-9694-4340-bcd6-1c8c981f1dfb req-d6098146-054a-438d-80f2-86e7f68105ab service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:07.685012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-05a4a970-9694-4340-bcd6-1c8c981f1dfb req-d6098146-054a-438d-80f2-86e7f68105ab service nova] Creating event network-vif-plugged:21871249-17d0-43b2-a55d-b7bee5257446 for instance 3124ad5d-3bef-4651-b4f4-b205d004398d on n-h2-862355-1 Oct 25 03:13:07.720014 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-05a4a970-9694-4340-bcd6-1c8c981f1dfb req-d6098146-054a-438d-80f2-86e7f68105ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111024 Oct 25 03:13:07.722909 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1537/2911] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:07.775167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:07.781254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:07.805010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:07.805522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:07.806003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:07.806739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:07.807204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:07.807683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:07.904726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:07.908262 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f299987d-e5a2-4d6d-9b5f-3dcd0e89f110 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170817 Oct 25 03:13:07.909391 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1538/2912] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:07 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:07.929576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5860c7a2-8039-4e96-8ac9-4e68eea43bb8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1539 microversion: 2.1 time: 0.561113 Oct 25 03:13:07.930365 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1375/2913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:07 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1539 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:08.295921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:08.296806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:08.319901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:08.320679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:08.324093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:08.325254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:08.326382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:08.326984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:08.912409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:08.920594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:08.923233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:08.927910 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c60fcea-747e-4cba-9943-190ffbce6958 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1314 microversion: 2.1 time: 0.635644 Oct 25 03:13:08.928800 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1539/2914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:08 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:08.949781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:08.961386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:08.962398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:08.963073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:08.967440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:08.970454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:08.971194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:08.973088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:08.983040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:08.983544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:08.990490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:08.993149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:08.996299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:08.998261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:09.110546 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3548af53-f924-4e84-806d-03e5ca3ae7f7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193805 Oct 25 03:13:09.113222 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1376/2915] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:08 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:13:09.661579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:09.704716 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4595ecf2-1ef9-4206-a7be-26a416e7b3c3 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1539 microversion: 2.1 time: 0.753167 Oct 25 03:13:09.708420 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1540/2916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:08 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1539 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:09.766858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d7ee2029-be91-4fd2-9410-726bb2d9ef21 req-77d882ac-02ea-4dc4-a766-1d87b3b254a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda42aaf-7c35-41ad-a0d1-d46b9e587561", "name": "network-vif-unplugged", "status": "completed", "tag": "73df9db2-b5ae-4640-b2fc-6789fdb58fc1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:09.795368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d7ee2029-be91-4fd2-9410-726bb2d9ef21 req-77d882ac-02ea-4dc4-a766-1d87b3b254a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:09.796621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d7ee2029-be91-4fd2-9410-726bb2d9ef21 req-77d882ac-02ea-4dc4-a766-1d87b3b254a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:09.797258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d7ee2029-be91-4fd2-9410-726bb2d9ef21 req-77d882ac-02ea-4dc4-a766-1d87b3b254a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:09.841391 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d7ee2029-be91-4fd2-9410-726bb2d9ef21 req-77d882ac-02ea-4dc4-a766-1d87b3b254a7 service nova] Creating event network-vif-unplugged:73df9db2-b5ae-4640-b2fc-6789fdb58fc1 for instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 on n-h2-862355-1 Oct 25 03:13:09.867110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-d7ee2029-be91-4fd2-9410-726bb2d9ef21 req-77d882ac-02ea-4dc4-a766-1d87b3b254a7 service nova] Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:13:09.883559 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d7ee2029-be91-4fd2-9410-726bb2d9ef21 req-77d882ac-02ea-4dc4-a766-1d87b3b254a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120569 Oct 25 03:13:09.894125 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1377/2917] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:09.957411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:09.959291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:09.973009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:09.974158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:09.975474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:09.978167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:09.979962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:09.981592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:10.127856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:10.130163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:10.157236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:10.161627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:10.162308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:10.163219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:10.163683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:10.168661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:10.194847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:10.217836 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-545beaf9-aa0e-470d-a32a-71852512c1ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1501 microversion: 2.1 time: 0.265213 Oct 25 03:13:10.223187 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1541/2918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:09 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:10.228514 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91345256-ced3-4c9a-8137-37799fbfe33d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107468 Oct 25 03:13:10.229459 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1378/2919] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:13:10 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:13:10.245315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:10.249459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:10.259635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:10.260811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:10.261416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:10.262370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:10.263215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:10.263863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:10.295849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lazy-loading 'flavor' on Instance uuid 3124ad5d-3bef-4651-b4f4-b205d004398d {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:13:10.632864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1871732386", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "19052301-9c01-414d-93f4-28db86f14bd8"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:10.759917 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b836b599-b7e7-428f-846a-dff1599bb0f2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d/action" status: 202 len: 0 microversion: 2.1 time: 0.519730 Oct 25 03:13:10.767981 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1542/2920] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:13:10 2022] POST /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:13:10.781910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] validate_networks() for [('19052301-9c01-414d-93f4-28db86f14bd8', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:13:10.787094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:10.792788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:10.802591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:10.810396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:10.811198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:10.812181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:10.814889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:10.815898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:11.177374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:11.190301 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-132e2890-4317-4478-aff3-18a0720a3caa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1471 microversion: 2.1 time: 0.417463 Oct 25 03:13:11.193015 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1543/2921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:10 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:11.202267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:11.214893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:11.238476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:11.243945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:11.244300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:11.245132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:11.246605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:11.247047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:11.327098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:11.683156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:11.721000 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-13739c2c-e320-4c9e-85e1-0149ba7f4a91 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.525669 Oct 25 03:13:11.722011 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1544/2922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:11 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:11.952427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:13:11.955640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:13:11.956426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:13:11.957080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:13:11.957832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:13:11.972101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:11.973361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:11.975530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:11.976565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:11.977314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:11.977996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:11.999916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Getting quotas for project 25697f99614645ec9d900ebaf8da1cfd. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:13:12.007151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Getting quotas for user 102711a2938c4bc4a6951fc200d88721 and project 25697f99614645ec9d900ebaf8da1cfd. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:13:12.026453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:13:12.029422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:13:12.043580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:12.140640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e85c0ec5-c8e0-448a-9a77-27ec71213013 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512280 Oct 25 03:13:12.155465 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1379/2923] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:13:12.160766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54411ffb-38be-4f7f-a32c-5f6e4a581fbb tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:12.161444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54411ffb-38be-4f7f-a32c-5f6e4a581fbb tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:12.224285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:12.224860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:12.248294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:12.248823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:12.252752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:12.254171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:12.254650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:12.259697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:12.259864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54411ffb-38be-4f7f-a32c-5f6e4a581fbb tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:12.268356 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54411ffb-38be-4f7f-a32c-5f6e4a581fbb tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1218 microversion: 2.1 time: 0.111618 Oct 25 03:13:12.271047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1545/2924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:12 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:12.630012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:12.652667 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14cd266f-181f-45b0-9498-c9ea12f13da0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1471 microversion: 2.1 time: 0.434285 Oct 25 03:13:12.658260 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1380/2925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:12 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:12.750805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:12.751788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:12.762762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:12.767710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:12.768538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:12.773947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:12.776364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:12.778224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:13.300220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:13.301395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:13.318913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:13.320979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:13.322138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:13.324383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:13.325192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:13.325945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:13.451423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:13.482978 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-056a59b3-6711-4257-8961-14000c280a9e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1222 microversion: 2.1 time: 0.186757 Oct 25 03:13:13.484296 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1381/2926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:13 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1222 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:13.583451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:13.595991 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd017003-2418-4dca-be03-a00e499bd2f5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.849186 Oct 25 03:13:13.629126 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1546/2927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:12 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:13.686978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:13.687971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:13.702368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:13.703865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:13.710091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:13.711299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:13.714025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:13.719788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.283851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:14.299901 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ab03910-f6c4-4b0c-9f48-fd8ba9b11551 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1468 microversion: 2.1 time: 0.617717 Oct 25 03:13:14.300425 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1382/2928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:13 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1468 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:14.327059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:14.327338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:14.366595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:14.379736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.380257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.384431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.389865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.390353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.390805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.508477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:14.509251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:14.524064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.524555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.527572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.529422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.531498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.533223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.548040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.549771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.551175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.554678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.557378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.558197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.666926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:13:14.699491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for user a205c6ef239c44e8b2768df15ea8d943 and project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:13:14.741991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:14.755385 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-723b4921-c7aa-409e-addb-feef5914f2e7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1270 microversion: 2.1 time: 0.250198 Oct 25 03:13:14.760804 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1383/2929] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:14 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:14.774506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:14.778644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:14.800463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.814724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.815342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:14.819335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:14.839775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:14.844047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:15.030195 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6afc13ae-c156-457c-ae14-b129b5edc2d4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561/action" status: 202 len: 0 microversion: 2.1 time: 0.707337 Oct 25 03:13:15.032750 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1547/2930] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:13:14 2022] POST /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:13:15.059872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:15.063049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:15.077486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:15.078815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:15.093377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:15.097977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:15.100201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:15.101965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:15.568630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:15.586903 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-970c4ce0-475c-4aa0-a8ee-114bf00d55a2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.824496 Oct 25 03:13:15.606717 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1384/2931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:14 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:15.790562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:15.792520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:15.818668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:15.823230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:15.823732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:15.828514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:15.829291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:15.830239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:15.897438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:15.916450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09e5fb02-31a5-4787-b6b7-11ed73885ce4 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1467 microversion: 2.1 time: 0.878235 Oct 25 03:13:15.933359 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1548/2932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:15 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1467 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:16.023250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c57811bb-1ac8-4c4e-be00-6d30555433d1 req-70406a78-2053-463e-a7b2-0a60d0101612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda42aaf-7c35-41ad-a0d1-d46b9e587561", "name": "network-vif-plugged", "status": "completed", "tag": "73df9db2-b5ae-4640-b2fc-6789fdb58fc1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:16.042471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c57811bb-1ac8-4c4e-be00-6d30555433d1 req-70406a78-2053-463e-a7b2-0a60d0101612 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:16.048009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c57811bb-1ac8-4c4e-be00-6d30555433d1 req-70406a78-2053-463e-a7b2-0a60d0101612 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:16.048818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c57811bb-1ac8-4c4e-be00-6d30555433d1 req-70406a78-2053-463e-a7b2-0a60d0101612 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:16.077434 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c57811bb-1ac8-4c4e-be00-6d30555433d1 req-70406a78-2053-463e-a7b2-0a60d0101612 service nova] Creating event network-vif-plugged:73df9db2-b5ae-4640-b2fc-6789fdb58fc1 for instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 on n-h2-862355-1 Oct 25 03:13:16.093757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-c57811bb-1ac8-4c4e-be00-6d30555433d1 req-70406a78-2053-463e-a7b2-0a60d0101612 service nova] Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:13:16.113081 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c57811bb-1ac8-4c4e-be00-6d30555433d1 req-70406a78-2053-463e-a7b2-0a60d0101612 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094471 Oct 25 03:13:16.114458 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1549/2933] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:13:16.127856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:16.139837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d9ebb854-7e1e-4452-8593-7038109723cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1276 microversion: 2.1 time: 0.354719 Oct 25 03:13:16.142529 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1385/2934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:15 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:16.615606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:16.616791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:16.630794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:16.633292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:16.634039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:16.637406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:16.639576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:16.640212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:16.940425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:16.941777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:16.956719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:16.958322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:16.958980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:16.959895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:16.960558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:16.961309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:17.290260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:17.305102 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a027c0c9-bcfb-4f92-a209-70473bb5bed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1467 microversion: 2.1 time: 0.363216 Oct 25 03:13:17.317730 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1386/2935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:16 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1467 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:17.326425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:17.327119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:17.340005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:17.342631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:17.343080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:17.345755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:17.346177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:17.347535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:17.449985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:17.465232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:17.474996 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2491861-4a12-4aab-a323-cdadc889b5c6 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1276 microversion: 2.1 time: 0.166355 Oct 25 03:13:17.476294 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1387/2936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:17 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:17.503547 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ca1cf4b-f50c-4123-9137-5ba1a0214a76 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.892697 Oct 25 03:13:17.507922 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1550/2937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:16 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:18.334573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:18.335194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:18.347326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:18.354640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:18.355344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:18.363202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:18.363706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:18.364145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:18.501779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:18.502374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:18.527830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:18.528758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:18.529411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:18.530344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:18.530977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:18.531564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:18.947864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:18.961415 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-618bd521-99b3-4a45-afe9-197bd482d177 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1467 microversion: 2.1 time: 0.630775 Oct 25 03:13:18.962042 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1388/2938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:18 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1467 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:18.992478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:18.993104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:19.020629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:19.024596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:19.031095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:19.032161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:19.034125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:19.034980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:19.361097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:19.372078 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ff06fe8-8248-462a-994e-0e46c53334fa tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.874170 Oct 25 03:13:19.375287 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1551/2939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:18 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:19.711101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:19.734711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-49a75c2f-4bc6-4d63-8b3d-5df7184f2187 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.747550 Oct 25 03:13:19.737269 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1389/2940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:18 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:19.987126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:19.988431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:20.006505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:20.007057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:20.007513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:20.008257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:20.008729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:20.009160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:20.400856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:20.402084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:20.427401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:20.428013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:20.428631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:20.429546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:20.430210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:20.430799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:20.913337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:20.931726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4344fc2b-ff7e-4ee1-b407-6f2a0824af72 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1467 microversion: 2.1 time: 0.947283 Oct 25 03:13:20.936223 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1552/2941] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:19 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1467 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:20.955928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:20.957742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:21.006612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:21.007216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:21.007539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:21.008259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:21.008725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:21.009155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:21.491593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:21.521723 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03cc7cb1-7fbb-4d97-ada1-56ff295eecf7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 1.117440 Oct 25 03:13:21.526572 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1390/2942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:20 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:21.972506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:21.973589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:21.981849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:21.995527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:22.006613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:22.007228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:22.007707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:22.008410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:22.008901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:22.075179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:22.267376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:22.690998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:22.700907 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b004d23-5430-453f-a4ae-0c8c8c870899 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 1.762336 Oct 25 03:13:22.713527 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1553/2943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:20 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:22.723507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:22.724135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:22.765002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:22.765694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:22.765869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:22.766617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:22.767067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:22.767500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:23.023374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:23.032642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e2395f1d-c9fe-4b4a-8c74-f539edfa64ce tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1533 microversion: 2.1 time: 1.063943 Oct 25 03:13:23.033428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1391/2944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:21 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1533 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:23.728690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:23.729277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:23.747540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:23.748044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:23.748514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:23.749200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:23.749641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:23.750098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:23.785768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:23.985980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:24.025902 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e2a2f58-c7f3-4723-8c8d-490f0f379a90 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 1.298857 Oct 25 03:13:24.028988 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1554/2945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:22 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:24.042909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-48a63b17-8ed6-46b3-8066-4e3ad5c52850 req-9564cf02-2623-4f43-8b9e-b87ab08c8c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda42aaf-7c35-41ad-a0d1-d46b9e587561", "name": "network-vif-unplugged", "status": "completed", "tag": "73df9db2-b5ae-4640-b2fc-6789fdb58fc1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:24.084082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48a63b17-8ed6-46b3-8066-4e3ad5c52850 req-9564cf02-2623-4f43-8b9e-b87ab08c8c8a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:24.085041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48a63b17-8ed6-46b3-8066-4e3ad5c52850 req-9564cf02-2623-4f43-8b9e-b87ab08c8c8a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:24.085664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-48a63b17-8ed6-46b3-8066-4e3ad5c52850 req-9564cf02-2623-4f43-8b9e-b87ab08c8c8a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:24.104027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-48a63b17-8ed6-46b3-8066-4e3ad5c52850 req-9564cf02-2623-4f43-8b9e-b87ab08c8c8a service nova] Creating event network-vif-unplugged:73df9db2-b5ae-4640-b2fc-6789fdb58fc1 for instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 on n-h2-862355-1 Oct 25 03:13:24.128186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-48a63b17-8ed6-46b3-8066-4e3ad5c52850 req-9564cf02-2623-4f43-8b9e-b87ab08c8c8a service nova] Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:13:24.147687 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-48a63b17-8ed6-46b3-8066-4e3ad5c52850 req-9564cf02-2623-4f43-8b9e-b87ab08c8c8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117107 Oct 25 03:13:24.153298 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1555/2946] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:24.159042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d6980a11-4c87-4757-aeca-6d4e73e95ce3 req-d7127a2a-f1fd-411c-bd81-1b148a60766c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54494c68-58e6-44f6-980f-f122df750e53", "tag": "8fe4d469-59f1-4d36-9324-706bce3ca342"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:24.177393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d6980a11-4c87-4757-aeca-6d4e73e95ce3 req-d7127a2a-f1fd-411c-bd81-1b148a60766c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:24.178370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d6980a11-4c87-4757-aeca-6d4e73e95ce3 req-d7127a2a-f1fd-411c-bd81-1b148a60766c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:24.178964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d6980a11-4c87-4757-aeca-6d4e73e95ce3 req-d7127a2a-f1fd-411c-bd81-1b148a60766c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:24.230069 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d6980a11-4c87-4757-aeca-6d4e73e95ce3 req-d7127a2a-f1fd-411c-bd81-1b148a60766c service nova] Creating event network-changed:8fe4d469-59f1-4d36-9324-706bce3ca342 for instance 54494c68-58e6-44f6-980f-f122df750e53 on n-h1-862355-1 Oct 25 03:13:24.237392 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d6980a11-4c87-4757-aeca-6d4e73e95ce3 req-d7127a2a-f1fd-411c-bd81-1b148a60766c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081528 Oct 25 03:13:24.238557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1556/2947] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:24.247896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:24.248795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:24.257338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:24.258106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:24.258729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:24.261074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:24.261742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:24.262633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:24.456683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:24.471567 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f7637a4-b0ea-4b4d-974f-6e3267fc4733 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.746368 Oct 25 03:13:24.473457 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1392/2948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:23 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:24.603293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:24.919706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:24.934599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0486c4c1-649c-4429-ab3a-52a47e62de14 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1533 microversion: 2.1 time: 0.694644 Oct 25 03:13:24.950180 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1557/2949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:24 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1533 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:25.055339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:25.057875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:25.069317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:25.074160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:25.074160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:25.074958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:25.075430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:25.075852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:25.497644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:25.498899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:25.506205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:25.507017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:25.507675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:25.508598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:25.509817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:25.510578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:25.522515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:25.537055 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-721e612c-44f0-4f25-b2db-76dee44acbb8 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.487421 Oct 25 03:13:25.537982 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1393/2950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:25 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:25.973770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:25.974445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:25.984055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:25.985648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:25.986313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:25.987322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:25.987999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:25.988630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:26.139327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:26.158532 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1db2e59-597a-44ed-8565-9c1489e28ae3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.665061 Oct 25 03:13:26.159482 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1558/2951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:25 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:26.380457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:26.389712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-736611b0-9560-40e0-ab7f-1048c164ad5b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1533 microversion: 2.1 time: 0.430605 Oct 25 03:13:26.391294 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1394/2952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:25 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1533 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:26.566783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:26.568266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:26.584027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:26.584536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:26.588210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:26.589206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:26.589831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:26.590474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:26.943315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:26.955170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d312e4e3-00e8-4e6e-8100-92d5528c39b0 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.394417 Oct 25 03:13:26.957208 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1559/2953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:26 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:27.186610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:27.187745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:27.200697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:27.201217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:27.201667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:27.205517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:27.206268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:27.206722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:27.271148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:27.590192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0323190a-1d6d-45fc-8b21-3a3c4aabf444 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'create', calling method: .version_select at 0x7efd3b7b18b0>, body: {"keypair": {"name": "tempest-keypair-1119071789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2a+2q8QspVtUuuRLa1LeaDPyY+6zdx44rfjT+d3RuW2jBv68Kt7QlHTDlUuUG1lJ0VeX80FBB+sqmzrOfg7jIFlPs1TvY8goKeT9k/ybH/6OqK5ReDgj1C1VxO+dUTdg=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:27.657814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0323190a-1d6d-45fc-8b21-3a3c4aabf444 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:13:27.672506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0323190a-1d6d-45fc-8b21-3a3c4aabf444 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for user 41342d3f5062457aaee26cf5d836e441 and project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:13:27.774389 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0323190a-1d6d-45fc-8b21-3a3c4aabf444 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.727478 Oct 25 03:13:27.775416 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1395/2954] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:13:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:27.797477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:27.798148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:27.808082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:27.808591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:27.809031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:27.809779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:27.810236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:27.810663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:27.986871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:28.018066 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a22b188-ac29-46ef-8075-84d5dc3285ce tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.833747 Oct 25 03:13:28.021319 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1560/2955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:27 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:28.038402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:28.039420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:28.047594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:28.048313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:28.049572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:28.050513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:28.051140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:28.051724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:28.344081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:28.359540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d29c746-bb7c-4352-aa5b-d232cb3a95c2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1533 microversion: 2.1 time: 0.573738 Oct 25 03:13:28.360672 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1396/2956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:27 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1533 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:28.772358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:28.785748 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1459e114-55b3-47fd-af0f-0752069986b2 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.758190 Oct 25 03:13:28.787651 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1561/2957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:28 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:29.045488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:29.047341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:29.061341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:29.062969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:29.063424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:29.066523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:29.067007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:29.069423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:29.384426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:29.385160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:29.401385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:29.401986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:29.402457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:29.403220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:29.403690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:29.404132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:29.517606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:29.531925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b5fdd48d-b076-4c30-84f9-05e90cd9496f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.490728 Oct 25 03:13:29.542628 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1397/2958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:29 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:29.815350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:29.816169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:29.834282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:29.835047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:29.835646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:29.836793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:29.838952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:29.839553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:30.262611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:30.291765 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-153c5e09-235e-4b4a-bce7-a63a83170ed2 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1526 microversion: 2.1 time: 0.911319 Oct 25 03:13:30.298496 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1562/2959] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:29 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1526 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:30.331050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:30.332898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:30.365458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:30.375882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:30.376773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:30.378232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:30.381240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:30.390939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:30.406888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:30.416588 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d2884a1-525c-48be-8bca-a3d481835dd4 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.605938 Oct 25 03:13:30.436159 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1398/2960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:29 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:30.566295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:30.567238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:30.581963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:30.583626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:30.585236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:30.586205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:30.586902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:30.587954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:31.126142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:31.171692 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ef85ee8-baca-4c07-acfb-8e6cf7f991b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1526 microversion: 2.1 time: 0.846270 Oct 25 03:13:31.174204 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1563/2961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:30 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1526 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:31.198930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0625e1d1-3d3d-4d81-b966-01924ecdb82b tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:31.205132 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0625e1d1-3d3d-4d81-b966-01924ecdb82b tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] HTTP exception thrown: Flavor 120c4488-d1b4-4d34-b5a4-6cbe4d0b104f could not be found. Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0625e1d1-3d3d-4d81-b966-01924ecdb82b tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Request method failure captured: Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/flavors/120c4488-d1b4-4d34-b5a4-6cbe4d0b104f HTTP/1.1 Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NoMlxxYE6ABVIypWk9fq9OwPQmLwqyjJlGPJysjCLGh9FpIUZb1tJBRjBAFFV29VwazvvqEs0JDo7r947rG8R5ifZ18XS5P4dhbEZ2IhFPqVidDVX0h7pqNkYFGw7yYxPoSKr_HL756d5t_q3YQcRJRp_7WzSdFKZ88wp38pJz2gc Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: c0d3cf652470468580d897b652684f8f Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-MigrationsAdminTest-1267347640 Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c0d3cf652470468580d897b652684f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c0d3cf652470468580d897b652684f8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c0d3cf652470468580d897b652684f8f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c0d3cf652470468580d897b652684f8f"}]}] Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-MigrationsAdminTest-1267347640 Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: c0d3cf652470468580d897b652684f8f Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-MigrationsAdminTest-1267347640 Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-MigrationsAdminTest-1267347640-project-admin Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d48828366c8e48c08984ae6f8074554d Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-MigrationsAdminTest-1267347640-project-admin Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: exception: Flavor 120c4488-d1b4-4d34-b5a4-6cbe4d0b104f could not be found. Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '120c4488-d1b4-4d34-b5a4-6cbe4d0b104f'} Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 120c4488-d1b4-4d34-b5a4-6cbe4d0b104f could not be found. Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 120c4488-d1b4-4d34-b5a4-6cbe4d0b104f could not be found. Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:31.214394 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 120c4488-d1b4-4d34-b5a4-6cbe4d0b104f could not be found. Oct 25 03:13:31.219897 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:31.221764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0625e1d1-3d3d-4d81-b966-01924ecdb82b tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Returning 404 to user: Flavor 120c4488-d1b4-4d34-b5a4-6cbe4d0b104f could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:13:31.222933 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0625e1d1-3d3d-4d81-b966-01924ecdb82b tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/120c4488-d1b4-4d34-b5a4-6cbe4d0b104f" status: 404 len: 109 microversion: 2.1 time: 0.029343 Oct 25 03:13:31.230907 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1564/2962] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:13:31 2022] DELETE /compute/v2.1/flavors/120c4488-d1b4-4d34-b5a4-6cbe4d0b104f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:13:31.445060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-638504694", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:31.545330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:31.620973 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-613183c0-c80b-4506-886e-191e77ba5f81 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 1.058441 Oct 25 03:13:31.642071 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1399/2963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:30 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:31.655623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:13:31.665623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:31.673244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:31.697320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:31.702474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:31.706925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:31.707783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:31.708273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:31.708873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:32.234464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:32.244306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96053401-e960-4921-9d81-939cac39d73d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.606599 Oct 25 03:13:32.244921 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1400/2964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:31 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:32.659378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:32.660774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:32.674144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:32.674908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:32.677787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:32.678755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:32.681078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:32.685090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:32.795550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:13:32.796039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:13:32.796534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:13:32.796953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:13:32.797371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:13:32.818685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:32.819432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:32.819881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:32.821482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:32.827029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:32.829248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:32.870774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:13:32.886850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Getting quotas for user a205c6ef239c44e8b2768df15ea8d943 and project 0db5b33c47fc46c2afca333ac440cf37. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:13:32.916089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:13:32.918541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:13:33.072554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27db0fa3-3661-4700-8605-3e2a13d031b0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630001 Oct 25 03:13:33.075498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1565/2965] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:13:33.112889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d78c5aa6-7a48-4754-9a9c-2c634d28b16e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:33.113798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d78c5aa6-7a48-4754-9a9c-2c634d28b16e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:33.262750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:33.278346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5cc83d81-d909-49bf-ab52-59145b9d15bb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.621815 Oct 25 03:13:33.279257 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1401/2966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:32 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:33.304374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:33.310003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:33.330520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:33.332486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:33.333812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:33.335726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:33.338076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:33.338864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:33.968980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:33.981332 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6113d2c-2801-4bdc-9502-d929911359ec tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.700620 Oct 25 03:13:33.986380 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1402/2967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:33 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:33.997968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-708438528", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5"}], "security_groups": [{"name": "tempest-securitygroup--2049037100"}], "key_name": "tempest-keypair-1119071789", "user_data": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:34.162668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d78c5aa6-7a48-4754-9a9c-2c634d28b16e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:34.194722 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d78c5aa6-7a48-4754-9a9c-2c634d28b16e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1212 microversion: 2.1 time: 1.109489 Oct 25 03:13:34.201959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1566/2968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:33 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1212 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:34.215205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6fb04f4-d2ae-4fe4-9c95-bed27d970eb6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Action: 'create', calling method: .version_select at 0x7efd381e8940>, body: {"keypair": {"name": "tempest-keypair-887684521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6VYvVUMsfb/LMMxkrTHrayfOQwPwLx1ismUvRnKN+c7ReARwhOT1Z28f04udGiX7J8IUtwF4fB2KlZzXyPpzPmo7thr2p1j4vdz2r0cY1LtRWTUR/iMpcHcJO16M1UBw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:34.286016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b6fb04f4-d2ae-4fe4-9c95-bed27d970eb6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Getting quotas for project 70fc8d491ccb43629333e60609380230. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:13:34.324294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b6fb04f4-d2ae-4fe4-9c95-bed27d970eb6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Getting quotas for user adb6b1dd7a634ce4be57353d3fcdeb5f and project 70fc8d491ccb43629333e60609380230. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:13:34.378665 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b6fb04f4-d2ae-4fe4-9c95-bed27d970eb6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [a953044b-09c0-478b-a7ea-489143a581d5] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 03:13:34.418828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] validate_networks() for [('0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:13:35.389093 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [None req-b6fb04f4-d2ae-4fe4-9c95-bed27d970eb6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [a953044b-09c0-478b-a7ea-489143a581d5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51066. Oct 25 03:13:35.421864 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6fb04f4-d2ae-4fe4-9c95-bed27d970eb6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 1.213683 Oct 25 03:13:35.422468 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1567/2969] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:13:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1216 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 25 03:13:35.434506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:35.444542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:35.468663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:35.469997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:35.470353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:35.471687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:35.474347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:35.474799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.035545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:13:36.036059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:13:36.036716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:13:36.037194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:13:36.037688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:13:36.053923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:36.054528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:36.055792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.057078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:36.057585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:36.058301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.083334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:13:36.089782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for user 41342d3f5062457aaee26cf5d836e441 and project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:13:36.108320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:13:36.111018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:13:36.175266 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d62f818-1ee8-4761-b255-6aa6f55f06e8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.187167 Oct 25 03:13:36.176527 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1403/2970] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:13:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:13:36.182474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7ada473a-25b4-4df8-b680-9c14d675f538 req-e498de09-2873-4486-9c7f-fd0aae72259c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54494c68-58e6-44f6-980f-f122df750e53", "name": "network-vif-plugged", "status": "completed", "tag": "8fe4d469-59f1-4d36-9324-706bce3ca342"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:36.194085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7ada473a-25b4-4df8-b680-9c14d675f538 req-e498de09-2873-4486-9c7f-fd0aae72259c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:36.194842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7ada473a-25b4-4df8-b680-9c14d675f538 req-e498de09-2873-4486-9c7f-fd0aae72259c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:36.195628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7ada473a-25b4-4df8-b680-9c14d675f538 req-e498de09-2873-4486-9c7f-fd0aae72259c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.209405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7ada473a-25b4-4df8-b680-9c14d675f538 req-e498de09-2873-4486-9c7f-fd0aae72259c service nova] Creating event network-vif-plugged:8fe4d469-59f1-4d36-9324-706bce3ca342 for instance 54494c68-58e6-44f6-980f-f122df750e53 on n-h1-862355-1 Oct 25 03:13:36.218483 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7ada473a-25b4-4df8-b680-9c14d675f538 req-e498de09-2873-4486-9c7f-fd0aae72259c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040497 Oct 25 03:13:36.219519 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1404/2971] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:36.225195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:36.226340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:36.234436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:36.235860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:36.236534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.237459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:36.238164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:36.238804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.395594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:36.409289 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c11a1f5-021f-43a9-9731-65660828d935 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.985764 Oct 25 03:13:36.411087 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1568/2972] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:35 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:36.417025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:36.417995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:36.427312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:36.428043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:36.428729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.430197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:36.431134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:36.431912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:36.560260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:36.585869 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d77c299-c0b0-446f-b44b-b8993768343a tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.362663 Oct 25 03:13:36.588733 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1405/2973] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:36 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:36.615186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e065d53-f471-4ff3-9f94-938bcfe2e7e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:36.622566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e065d53-f471-4ff3-9f94-938bcfe2e7e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:36.682121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:36.695191 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a5029fb-1739-4534-940a-d51f3f5d5893 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1270 microversion: 2.1 time: 0.282523 Oct 25 03:13:36.696739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1569/2974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:36 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:36.862066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e065d53-f471-4ff3-9f94-938bcfe2e7e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:36.881093 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e065d53-f471-4ff3-9f94-938bcfe2e7e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1238 microversion: 2.1 time: 0.288870 Oct 25 03:13:36.893945 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1406/2975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:36 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1238 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:37.434358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:37.434907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:37.445728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:37.446237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:37.450746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:37.451571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:37.452061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:37.453016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:37.613664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:37.614310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:37.623648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:37.625079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:37.625966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:37.626916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:37.627623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:37.628317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:37.956565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:37.965599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ebb17a9-0e06-44ba-9981-63b3ee8772c2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1507 microversion: 2.1 time: 0.536632 Oct 25 03:13:37.978512 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1570/2976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:37 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1507 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:37.984268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:37.984899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:38.017021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:38.017766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:38.018288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:38.019015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:38.019630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:38.020068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:38.135795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:38.146950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4c9b058f-65ec-4c1f-9487-d6418698a4ce tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1318 microversion: 2.1 time: 0.536949 Oct 25 03:13:38.147908 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1407/2977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:37 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:38.149468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:38.155397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:38.157038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:38.163250 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eea38ee6-2086-4a6a-9a0a-0cfe51ef646e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1270 microversion: 2.1 time: 0.182081 Oct 25 03:13:38.165131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1571/2978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:37 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:38.193849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:38.194427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:38.194941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:38.196698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:38.197465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:38.198002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:38.257404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3e817831-f3de-4c6e-a7ac-dedd87caa48d req-b1d52e8a-aeaa-4889-9ef0-8c7dab787577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda42aaf-7c35-41ad-a0d1-d46b9e587561", "name": "network-vif-plugged", "status": "completed", "tag": "73df9db2-b5ae-4640-b2fc-6789fdb58fc1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:38.268604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3e817831-f3de-4c6e-a7ac-dedd87caa48d req-b1d52e8a-aeaa-4889-9ef0-8c7dab787577 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:38.269176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3e817831-f3de-4c6e-a7ac-dedd87caa48d req-b1d52e8a-aeaa-4889-9ef0-8c7dab787577 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:38.269610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3e817831-f3de-4c6e-a7ac-dedd87caa48d req-b1d52e8a-aeaa-4889-9ef0-8c7dab787577 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:38.284041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3e817831-f3de-4c6e-a7ac-dedd87caa48d req-b1d52e8a-aeaa-4889-9ef0-8c7dab787577 service nova] Creating event network-vif-plugged:73df9db2-b5ae-4640-b2fc-6789fdb58fc1 for instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 on n-h2-862355-1 Oct 25 03:13:38.291880 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3e817831-f3de-4c6e-a7ac-dedd87caa48d req-b1d52e8a-aeaa-4889-9ef0-8c7dab787577 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038167 Oct 25 03:13:38.295345 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1572/2979] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:13:38.397963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:38.408719 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f107ebc-dcf7-4bc5-ba61-db85a1534be2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1290 microversion: 2.1 time: 0.259123 Oct 25 03:13:38.422125 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1408/2980] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:38 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1290 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:39.006014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:39.010086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:39.033240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.033971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.036127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.038026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.040524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.042793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.175785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:39.177156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:39.185281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.188432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.189054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.190001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.190628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.191221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.510811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:39.521087 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfc6b6b1-06b1-40c8-8d22-5525f1224bdc tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1528 microversion: 2.1 time: 0.521095 Oct 25 03:13:39.521711 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1573/2981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:38 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1528 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:39.538425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:39.539482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:39.555408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.555992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.556945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.558090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.558766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.559364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.707961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:39.720432 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77fbb5d7-1afa-4de7-95d3-de8413c17ccd tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1508 microversion: 2.1 time: 0.549406 Oct 25 03:13:39.734993 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1409/2982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:39 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1508 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:39.757208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:39.761269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:39.770791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.780973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.781356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.782136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:39.782609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:39.783043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:39.907845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:39.928372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:39.940816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ebc4339-88b0-4808-a86b-cce92f72c9af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1296 microversion: 2.1 time: 0.204402 Oct 25 03:13:39.942149 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50f8aa70-e5ee-4b5c-9a03-a75d55ed04af tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1312 microversion: 2.1 time: 0.415483 Oct 25 03:13:39.943353 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1574/2983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:39 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:39.960214 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1410/2984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:39 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1296 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:40.548482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:40.549113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:40.563924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:40.569965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:40.570905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:40.582058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:40.583223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:40.583958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:40.970523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:40.979674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:40.994846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:40.996080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:40.998725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:41.003967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:41.004811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:41.005482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:41.534861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:41.545357 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-329c2a9e-38be-41cd-9ed8-4b0efa0a657a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1528 microversion: 2.1 time: 1.001060 Oct 25 03:13:41.546452 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1575/2985] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:40 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1528 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:41.571405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:41.572063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:41.575083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:41.580276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:41.580780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:41.581211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:41.581942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:41.582399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:41.582824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:41.614383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:41.624901 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ebbf497d-034e-4447-b7ff-a3906119aef1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1312 microversion: 2.1 time: 0.658961 Oct 25 03:13:41.625890 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1411/2986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:40 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1312 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:41.636804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-127915207", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "50343000-edea-4eed-85ae-6d4668a2dcd2"}, {"port": "141be093-c60d-42b1-9db8-3125a19fb6bd", "tag": "port-1"}, {"port": "e1d5c65f-29a1-4d46-81b5-e60b72731e38", "tag": "port-2"}, {"uuid": "ca2f5225-0a69-4f1e-b7cd-4b9a63b88271", "tag": "net-1"}, {"uuid": "ca2f5225-0a69-4f1e-b7cd-4b9a63b88271"}, {"uuid": "27ebaeb8-e64c-47af-95b3-efbc871003f5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "27ebaeb8-e64c-47af-95b3-efbc871003f5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "abc80a78-6d40-4b4c-a057-e2cd49f8bed5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2effd03d-0fbf-453d-849d-5eacfa23949f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "53977637-ce08-45db-8218-5c3cf62fcca6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2067241192"}], "key_name": "tempest-keypair-887684521", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:41.872247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] validate_networks() for [('50343000-edea-4eed-85ae-6d4668a2dcd2', None, None, None, None, None), (None, None, '141be093-c60d-42b1-9db8-3125a19fb6bd', None, None, None), (None, None, 'e1d5c65f-29a1-4d46-81b5-e60b72731e38', None, None, None), ('ca2f5225-0a69-4f1e-b7cd-4b9a63b88271', None, None, None, None, None), ('ca2f5225-0a69-4f1e-b7cd-4b9a63b88271', None, None, None, None, None), ('27ebaeb8-e64c-47af-95b3-efbc871003f5', '10.2.2.100', None, None, None, None), ('27ebaeb8-e64c-47af-95b3-efbc871003f5', '10.2.2.200', None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:13:42.140438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:42.154782 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2fcecf27-db92-4c4a-a98f-d36b2cbc6d23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1364 microversion: 2.1 time: 0.594079 Oct 25 03:13:42.155998 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1576/2987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:41 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1364 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:42.173072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0eae5c3d-8100-4bfc-9073-e1dd30d0c162 req-8b87d3ff-cef5-41f8-8cbb-b13c52b7e7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:42.191589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0eae5c3d-8100-4bfc-9073-e1dd30d0c162 req-8b87d3ff-cef5-41f8-8cbb-b13c52b7e7d7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:42.192286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0eae5c3d-8100-4bfc-9073-e1dd30d0c162 req-8b87d3ff-cef5-41f8-8cbb-b13c52b7e7d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:42.193068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0eae5c3d-8100-4bfc-9073-e1dd30d0c162 req-8b87d3ff-cef5-41f8-8cbb-b13c52b7e7d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:42.210419 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0eae5c3d-8100-4bfc-9073-e1dd30d0c162 req-8b87d3ff-cef5-41f8-8cbb-b13c52b7e7d7 service nova] Creating event network-changed:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h2-862355-1 Oct 25 03:13:42.217105 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0eae5c3d-8100-4bfc-9073-e1dd30d0c162 req-8b87d3ff-cef5-41f8-8cbb-b13c52b7e7d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059197 Oct 25 03:13:42.218008 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1577/2988] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:42.225089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7e1286e0-f732-43f1-9063-cd28dbfa01a7 req-4f284257-4d27-4611-844d-815c19ffd5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3124ad5d-3bef-4651-b4f4-b205d004398d", "name": "network-vif-plugged", "status": "completed", "tag": "21871249-17d0-43b2-a55d-b7bee5257446"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:42.240928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7e1286e0-f732-43f1-9063-cd28dbfa01a7 req-4f284257-4d27-4611-844d-815c19ffd5a3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:42.242974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7e1286e0-f732-43f1-9063-cd28dbfa01a7 req-4f284257-4d27-4611-844d-815c19ffd5a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:42.243596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7e1286e0-f732-43f1-9063-cd28dbfa01a7 req-4f284257-4d27-4611-844d-815c19ffd5a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:42.261266 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7e1286e0-f732-43f1-9063-cd28dbfa01a7 req-4f284257-4d27-4611-844d-815c19ffd5a3 service nova] Creating event network-vif-plugged:21871249-17d0-43b2-a55d-b7bee5257446 for instance 3124ad5d-3bef-4651-b4f4-b205d004398d on n-h2-862355-1 Oct 25 03:13:42.275333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7e1286e0-f732-43f1-9063-cd28dbfa01a7 req-4f284257-4d27-4611-844d-815c19ffd5a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055115 Oct 25 03:13:42.275962 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1578/2989] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:42.353654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c74901fb-f4bf-4aec-a5d1-6fb8cffa120b"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:42.356261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:42.362529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:42.363466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:42.363910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:42.364611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:42.365242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:42.365694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:42.427867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] HTTP exception thrown: Volume 3cbbd10d-a203-4479-ba9a-19e4d65459fb could not be found. Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Request method failure captured: Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53/os-volume_attachments/3cbbd10d-a203-4479-ba9a-19e4d65459fb HTTP/1.1 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 74 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1PcVPXoJX3cBX3q73Dmbak4bUACoNV4E5gECVbW-r3sAMs5pKBKyD_8TTnQ4vN6FPo28x8gjesFQE6SFJEJW5wI8Pv8shAibWRFPILXNzPHuF2EpssfggKT7AvT6e7oQ9EjUHpLP1etBtBBc-eYkcRsdaZYBwqyh_-SNdhOx-aaXfc Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 7f724e593dcf4705972f965471bad3c6 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesAdminNegativeTest-881022761 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f724e593dcf4705972f965471bad3c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7f724e593dcf4705972f965471bad3c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7f724e593dcf4705972f965471bad3c6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7f724e593dcf4705972f965471bad3c6"}]}] Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesAdminNegativeTest-881022761 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 7f724e593dcf4705972f965471bad3c6 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-881022761 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesAdminNegativeTest-881022761-project-admin Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 26364024191d4897a962ca16e1a547c3 Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesAdminNegativeTest-881022761-project-admin Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: {"volumeAttachment": {"volumeId": "c74901fb-f4bf-4aec-a5d1-6fb8cffa120b"}} Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: exception: Volume 3cbbd10d-a203-4479-ba9a-19e4d65459fb could not be found. Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '54494c68-58e6-44f6-980f-f122df750e53', 'id': '3cbbd10d-a203-4479-ba9a-19e4d65459fb', 'body': {'volumeAttachment': {'volumeId': 'c74901fb-f4bf-4aec-a5d1-6fb8cffa120b'}}} Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3cbbd10d-a203-4479-ba9a-19e4d65459fb could not be found. (HTTP 404) (Request-ID: req-879430c6-e9d0-4c8e-9cd7-89ad69a9cb81) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:13:42.430446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3cbbd10d-a203-4479-ba9a-19e4d65459fb could not be found. Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3cbbd10d-a203-4479-ba9a-19e4d65459fb could not be found. Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3cbbd10d-a203-4479-ba9a-19e4d65459fb could not be found. Oct 25 03:13:42.434876 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:13:42.439230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] Returning 404 to user: Volume 3cbbd10d-a203-4479-ba9a-19e4d65459fb could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:13:42.440282 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-317f882a-307e-41f8-8242-701ed4b2154e tempest-VolumesAdminNegativeTest-881022761 tempest-VolumesAdminNegativeTest-881022761-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53/os-volume_attachments/3cbbd10d-a203-4479-ba9a-19e4d65459fb" status: 404 len: 109 microversion: 2.1 time: 0.093006 Oct 25 03:13:42.441057 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1579/2990] 10.222.0.36 () {60 vars in 1433 bytes} [Tue Oct 25 03:13:42 2022] PUT /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53/os-volume_attachments/3cbbd10d-a203-4479-ba9a-19e4d65459fb => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:13:42.580774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:42.582627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:42.598887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:42.599392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:42.599844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:42.600553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:42.601532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:42.615082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:42.847193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=91 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:42.860042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:43.178108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:43.189352 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a09d1f3-dfaf-4d6d-8472-c1c913c59586 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1528 microversion: 2.1 time: 0.619701 Oct 25 03:13:43.198138 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1580/2991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:42 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1528 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:43.211362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:43.212389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:43.219095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:43.219930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:43.220538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:43.221565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:43.222200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:43.222789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:43.714966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:43.723970 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e325f965-dddf-4fbf-8baf-eaae58d76af8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1312 microversion: 2.1 time: 0.517043 Oct 25 03:13:43.734551 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1581/2992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:43 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1312 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:43.739890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:43.740700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:43.751360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:43.762526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:43.763262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:43.764197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:43.764825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:43.765437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:44.227110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:44.242567 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5df26838-f19e-4992-9814-2d16803047ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1364 microversion: 2.1 time: 0.506599 Oct 25 03:13:44.243333 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1582/2993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:43 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1364 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:44.248129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:44.258630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:44.265170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:44.265957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:44.266600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:44.267533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:44.268188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:44.278784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:44.283564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:44.350411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:45.114603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:45.122749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4da6f82-a0c1-4e56-8454-8ebd63a0e19a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.878030 Oct 25 03:13:45.127206 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1583/2994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:44 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:45.140393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-68313675-632c-4f0f-a3ea-f04a022030d6 req-5d40e498-2607-40ec-97a0-534aed6f3f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:45.158001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-68313675-632c-4f0f-a3ea-f04a022030d6 req-5d40e498-2607-40ec-97a0-534aed6f3f90 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:45.167190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-68313675-632c-4f0f-a3ea-f04a022030d6 req-5d40e498-2607-40ec-97a0-534aed6f3f90 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:45.168072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-68313675-632c-4f0f-a3ea-f04a022030d6 req-5d40e498-2607-40ec-97a0-534aed6f3f90 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:45.186805 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-68313675-632c-4f0f-a3ea-f04a022030d6 req-5d40e498-2607-40ec-97a0-534aed6f3f90 service nova] Creating event network-changed:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:13:45.205141 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-68313675-632c-4f0f-a3ea-f04a022030d6 req-5d40e498-2607-40ec-97a0-534aed6f3f90 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076394 Oct 25 03:13:45.206209 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1584/2995] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:45.212429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:45.214003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:45.227574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:45.228383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:45.229007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:45.229934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:45.230563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:45.231166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:45.897342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:45.907307 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c3aeeb10-0f16-4fd6-83ae-ee4b260a7dc9 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1312 microversion: 2.1 time: 0.699749 Oct 25 03:13:45.918721 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1585/2996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:45 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1312 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:45.934873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:45.946267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:46.017478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:46.021990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:46.023330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:46.026765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:46.029223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:46.029985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:46.070620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:46.876569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:47.015172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:47.033480 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fcfa98da-66f9-4fd9-a8b6-002925a2aa75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1364 microversion: 2.1 time: 1.111861 Oct 25 03:13:47.036079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1586/2997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:45 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1364 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:47.050615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:47.053134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:47.073365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.074322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.074929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:47.077837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.080149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.081076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:47.162945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:13:47.308549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:13:47.309093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:13:47.309608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:13:47.310116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:13:47.310637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:13:47.328650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.329148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.329720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:47.330641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.335744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.336504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:47.353290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:47.354634 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e61b3eae-3f0c-4263-8873-a46e1396725c tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 204 len: 0 microversion: 2.1 time: 0.316867 Oct 25 03:13:47.360912 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1587/2998] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:13:47 2022] DELETE /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:13:47.372699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:47.389226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:47.398504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Getting quotas for project 70fc8d491ccb43629333e60609380230. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:13:47.404669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Getting quotas for user adb6b1dd7a634ce4be57353d3fcdeb5f and project 70fc8d491ccb43629333e60609380230. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:13:47.407684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.408191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.414708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:47.419245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.422051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.425645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:47.697747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:13:47.702056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='abc80a78-6d40-4b4c-a057-e2cd49f8bed5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2effd03d-0fbf-453d-849d-5eacfa23949f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='53977637-ce08-45db-8218-5c3cf62fcca6',volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:13:47.792794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:47.806540 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-58f3f415-161c-42fb-b93e-a3b10a62489c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.441394 Oct 25 03:13:47.827749 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1588/2999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:47 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:47.835634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:47.836657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:47.844883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.845611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.846326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:47.848508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:47.851149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:47.851831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:48.108269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:48.119370 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7bd90850-f0ef-4f35-a598-668183a33db6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1312 microversion: 2.1 time: 0.288972 Oct 25 03:13:48.121838 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1589/3000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:47 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:48.137831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:48.138868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:48.170149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:48.176862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:48.180407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:48.182522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:48.183973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:48.185837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:48.323707 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-310ed94a-ebb4-4838-88ea-5682e9a50cd4 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.696275 Oct 25 03:13:48.331591 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1412/3001] 10.222.0.36 () {62 vars in 1189 bytes} [Tue Oct 25 03:13:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 6704 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:13:48.353501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:48.353501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:48.365408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:48.367318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:48.367787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:48.370007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:48.378700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:48.381323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:48.765006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:48.776760 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6eda0083-5e09-4db8-b481-b96d55fc0f1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1364 microversion: 2.1 time: 0.441998 Oct 25 03:13:48.779017 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1413/3002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:48 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1364 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:48.789475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a116c570-1abe-4737-9e5f-03994ef6f30b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:48.790593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a116c570-1abe-4737-9e5f-03994ef6f30b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:48.992952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a116c570-1abe-4737-9e5f-03994ef6f30b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:49.007423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a116c570-1abe-4737-9e5f-03994ef6f30b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:49.011648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a116c570-1abe-4737-9e5f-03994ef6f30b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:49.013515 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a116c570-1abe-4737-9e5f-03994ef6f30b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1284 microversion: 2.42 time: 0.233297 Oct 25 03:13:49.015225 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1414/3003] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:13:48 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:13:49.020696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-129e1654-7603-4ad3-99e9-b789c5434f3d req-b1c7a675-7a3a-4d85-bb29-0132a7a91c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "name": "network-vif-plugged", "status": "completed", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:49.038191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-129e1654-7603-4ad3-99e9-b789c5434f3d req-b1c7a675-7a3a-4d85-bb29-0132a7a91c1a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:49.051913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-129e1654-7603-4ad3-99e9-b789c5434f3d req-b1c7a675-7a3a-4d85-bb29-0132a7a91c1a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:49.052904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-129e1654-7603-4ad3-99e9-b789c5434f3d req-b1c7a675-7a3a-4d85-bb29-0132a7a91c1a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:49.078950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-129e1654-7603-4ad3-99e9-b789c5434f3d req-b1c7a675-7a3a-4d85-bb29-0132a7a91c1a service nova] Creating event network-vif-plugged:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h2-862355-1 Oct 25 03:13:49.090584 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-129e1654-7603-4ad3-99e9-b789c5434f3d req-b1c7a675-7a3a-4d85-bb29-0132a7a91c1a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071455 Oct 25 03:13:49.092190 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1415/3004] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:49.119113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:49.123323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:49.154292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:49.154932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:49.159301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:49.160614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:49.161318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:49.164548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:49.212972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:49.229961 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3dd8f74e-b291-4171-8d81-f1b0782f4bc7 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1514 microversion: 2.1 time: 1.103795 Oct 25 03:13:49.231401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1590/3005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:48 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1514 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:49.247014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:49.255778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:49.271324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:49.279425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:49.282840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:49.283793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:49.284420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:49.289538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:49.815959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:49.831801 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7ecb1511-962a-4300-9a00-68409481ad6e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1312 microversion: 2.1 time: 0.591779 Oct 25 03:13:49.842864 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1591/3006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:49 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1312 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:49.848751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:49.857124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:49.887208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:49.887713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:49.888291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:49.889004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:49.889493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:49.889938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:50.284431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:50.301323 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-218fbc7a-df99-4654-83f3-6f3d9e9adbab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1364 microversion: 2.1 time: 0.452344 Oct 25 03:13:50.322447 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1592/3007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:49 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1364 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:50.328573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d0d60fd-0c45-4163-877a-78ec6547531e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:50.332593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1d0d60fd-0c45-4163-877a-78ec6547531e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:50.484151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d0d60fd-0c45-4163-877a-78ec6547531e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:50.502422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d0d60fd-0c45-4163-877a-78ec6547531e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:50.507515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d0d60fd-0c45-4163-877a-78ec6547531e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:50.509025 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d0d60fd-0c45-4163-877a-78ec6547531e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1284 microversion: 2.42 time: 0.185202 Oct 25 03:13:50.516279 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1593/3008] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:13:50 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:13:50.534145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:50.538521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:50.558904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:50.560343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:50.562269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:50.563280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:50.570311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:50.572069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:50.604706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:50.617525 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86a6acbb-f5af-4516-8a32-a1fca08ab917 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 1.523579 Oct 25 03:13:50.620046 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1416/3009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:49 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:50.870630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:50.871437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:50.885296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:50.886231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:50.886740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:50.891855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:50.893054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:50.895343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:51.178067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:51.208661 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-153f7d98-592b-4004-89ee-95b2230d27cf tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 200 len: 1514 microversion: 2.1 time: 0.690099 Oct 25 03:13:51.210498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1594/3010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:50 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 1514 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:51.331273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:51.332872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:51.363151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:51.367840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:51.369425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:51.371708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:51.372607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:51.373770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:51.918904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:51.945154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a7fa8ca-f7d3-4b9d-b193-4bb2ad3b2254 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1312 microversion: 2.1 time: 1.078156 Oct 25 03:13:51.969776 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1417/3011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:50 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1312 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:51.975202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e0bb852c-4fe3-4621-8751-c631e7d696cc req-aa6f71a6-1148-420c-bdd1-0c33ccabd8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "name": "network-vif-plugged", "status": "completed", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:51.986192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e0bb852c-4fe3-4621-8751-c631e7d696cc req-aa6f71a6-1148-420c-bdd1-0c33ccabd8bb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:51.986869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e0bb852c-4fe3-4621-8751-c631e7d696cc req-aa6f71a6-1148-420c-bdd1-0c33ccabd8bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:51.987485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e0bb852c-4fe3-4621-8751-c631e7d696cc req-aa6f71a6-1148-420c-bdd1-0c33ccabd8bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:52.030987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e0bb852c-4fe3-4621-8751-c631e7d696cc req-aa6f71a6-1148-420c-bdd1-0c33ccabd8bb service nova] Creating event network-vif-plugged:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:13:52.040950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e0bb852c-4fe3-4621-8751-c631e7d696cc req-aa6f71a6-1148-420c-bdd1-0c33ccabd8bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069139 Oct 25 03:13:52.042982 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1418/3012] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:52.052801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:52.058290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:52.066715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:52.067876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:52.070129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:52.072651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:52.073452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:52.075974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:52.900667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:52.913750 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-555172e1-dbe8-4349-9b27-1931fc54e50a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1364 microversion: 2.1 time: 1.587311 Oct 25 03:13:52.917896 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1595/3013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:51 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1364 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:52.933654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:52.934706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:52.950525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:52.951902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:52.956262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:52.957255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:52.957998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:52.958696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:53.615856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:53.637602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:53.640663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:53.644703 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f757a30-a958-4e25-aebc-ab9b6c39d52f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1574 microversion: 2.42 time: 1.599781 Oct 25 03:13:53.646357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1419/3014] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:13:52 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1574 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:13:53.659889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a4f699eb-da09-4441-b818-43741456fb28 req-0789cfab-70ac-4347-9d01-41e8a8d92551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54494c68-58e6-44f6-980f-f122df750e53", "name": "network-vif-deleted", "tag": "8fe4d469-59f1-4d36-9324-706bce3ca342"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:53.683290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4f699eb-da09-4441-b818-43741456fb28 req-0789cfab-70ac-4347-9d01-41e8a8d92551 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:53.686030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4f699eb-da09-4441-b818-43741456fb28 req-0789cfab-70ac-4347-9d01-41e8a8d92551 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:53.686782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4f699eb-da09-4441-b818-43741456fb28 req-0789cfab-70ac-4347-9d01-41e8a8d92551 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:53.728802 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a4f699eb-da09-4441-b818-43741456fb28 req-0789cfab-70ac-4347-9d01-41e8a8d92551 service nova] Creating event network-vif-deleted:8fe4d469-59f1-4d36-9324-706bce3ca342 for instance 54494c68-58e6-44f6-980f-f122df750e53 on n-h1-862355-1 Oct 25 03:13:53.742515 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a4f699eb-da09-4441-b818-43741456fb28 req-0789cfab-70ac-4347-9d01-41e8a8d92551 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091187 Oct 25 03:13:53.750108 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1420/3015] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:53.755813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:53.762057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 54494c68-58e6-44f6-980f-f122df750e53] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:53.775994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:53.778965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:53.779530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:53.780380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:53.782185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:53.782727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:53.818292 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] HTTP exception thrown: Instance 54494c68-58e6-44f6-980f-f122df750e53 could not be found. Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Request method failure captured: Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 HTTP/1.1 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1PEup75Euwc6OZxIMwr5usK1NQyS9WernaNW5C8QaQAD7m3cndYL18Pdhj3OK6FjrMDgdCElGeX_O46JMUvnJnR0KOwajW-wYT_kMryieEhxuNUaN_Fd47URh99YbIcPsbn79BQQAnylIK1XdfV10rOIMKGVSJ6GlH6sRz3E3b8gVw Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 25697f99614645ec9d900ebaf8da1cfd Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-VolumesAdminNegativeTest-563027251 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25697f99614645ec9d900ebaf8da1cfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25697f99614645ec9d900ebaf8da1cfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25697f99614645ec9d900ebaf8da1cfd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25697f99614645ec9d900ebaf8da1cfd"}]}] Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-VolumesAdminNegativeTest-563027251 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 25697f99614645ec9d900ebaf8da1cfd Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-563027251 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-VolumesAdminNegativeTest-563027251-project Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 102711a2938c4bc4a6951fc200d88721 Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-VolumesAdminNegativeTest-563027251-project Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 54494c68-58e6-44f6-980f-f122df750e53 could not be found. Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '54494c68-58e6-44f6-980f-f122df750e53'} Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54494c68-58e6-44f6-980f-f122df750e53 could not be found. Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54494c68-58e6-44f6-980f-f122df750e53 could not be found. Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:13:53.822126 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54494c68-58e6-44f6-980f-f122df750e53 could not be found. Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Returning 404 to user: Instance 54494c68-58e6-44f6-980f-f122df750e53 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:13:53.828718 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e97ae1a6-7a8c-4a1e-a052-9fb4a9deba02 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53" status: 404 len: 111 microversion: 2.1 time: 0.074975 Oct 25 03:13:53.830293 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1421/3016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:53 2022] GET /compute/v2.1/servers/54494c68-58e6-44f6-980f-f122df750e53 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:13:53.842268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:53.842966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:53.858399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:53.858917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:53.860987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:53.861786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:53.862265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:53.862703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:54.037225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:54.048270 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ab2bca6-c54a-413c-a48a-cd490cb6617e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 1.128749 Oct 25 03:13:54.058502 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1596/3017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:52 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:54.082187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:54.090141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:54.104309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:54.109741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:54.114667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:54.115658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:54.120918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:54.123837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:54.453062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:54.469585 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-abee6a61-1c95-45a9-8a35-f1c5331235b6 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1462 microversion: 2.1 time: 0.639205 Oct 25 03:13:54.472974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1422/3018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:53 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1462 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:54.499908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:54.500532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:54.510301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:54.517412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:54.518395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:54.519479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:54.523464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:54.524196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:54.920685 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3fb1bee-5a70-4c1f-acd9-7cdd485c33e2 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1613 microversion: 2.1 time: 0.424622 Oct 25 03:13:54.942076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1423/3019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:54 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1613 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:13:54.958385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:54.961051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:54.973817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:54.996049 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ba93910-09f8-4855-9d41-f04e4e011fcc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1364 microversion: 2.1 time: 0.935659 Oct 25 03:13:54.999898 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1597/3020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:54 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1364 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:55.005321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:55.010148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:13:55.012849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:55.013646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:55.017938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:55.018693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:55.019516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:55.021537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:55.047254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:55.048569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:55.049969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:55.054162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:55.056053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:55.056794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:55.325178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:55.336764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:55.351285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:55.352620 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3a37ac33-d574-46ae-b8ed-3c2addb6f3a2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1592 microversion: 2.42 time: 0.409221 Oct 25 03:13:55.362943 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1424/3021] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:13:54 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1592 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:13:55.377373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:55.378034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:55.404130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:55.404631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:55.405973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:55.405973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:55.406575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:55.407005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:55.410819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd48828366c8e48c08984ae6f8074554d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d3cf652470468580d897b652684f8f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:55.411842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] flavor_id is None. Assuming migration. {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 25 03:13:55.413162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:13:55.833023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:55.860634 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e2513a5-6383-441a-9359-7ce7a26ac5c9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.496419 Oct 25 03:13:55.867645 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1425/3022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:55 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:56.027875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:56.029290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:56.039837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.041453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:56.043930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.045888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.047213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.048968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.050041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.107801 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08743e14-9450-40d3-83ac-f72ff2a34f4e tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a/action" status: 202 len: 0 microversion: 2.1 time: 1.103946 Oct 25 03:13:56.112023 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1598/3023] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:13:55 2022] POST /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a/action => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:13:56.123941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:56.124949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:56.141468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.142098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.142676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.143475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.146407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.148181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.511755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:56.539073 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b28af2fc-a165-40a9-97e5-42bbe118962b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1550 microversion: 2.1 time: 0.516789 Oct 25 03:13:56.540771 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1426/3024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:56 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1550 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:56.554614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:56.557825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:56.581041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.581947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.585098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.589579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.590444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.591622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.805965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:56.816221 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e867ccbe-7011-4fcd-b962-1f27bc268e01 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1471 microversion: 2.1 time: 0.702951 Oct 25 03:13:56.851283 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1599/3025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:56 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1471 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:56.876486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:56.878173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:56.906344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.908836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.910563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:56.914427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.918292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:56.919369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:56.921887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:56.934658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:56.947576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:56.977472 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4b430eeb-0117-4e66-821e-7c4256da451c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1592 microversion: 2.42 time: 0.410610 Oct 25 03:13:56.979450 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1427/3026] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:13:56 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1592 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:13:56.991762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:56.992738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:57.029966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:57.036010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:57.039115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:57.041608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:57.047264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:57.050550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:57.353843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:57.414554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:57.427534 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e847c3c4-bd7d-4d0e-b9de-d21ef66f3ef6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.446803 Oct 25 03:13:57.432178 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1428/3027] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:56 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:57.882555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:57.885587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:57.903765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:57.904799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:57.906971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:57.911664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:57.913881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:57.914977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:58.392206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:58.392871 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0c8abc4f-6d5d-4142-a74d-7c703f9674c9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.536585 Oct 25 03:13:58.392871 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1600/3028] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:13:56 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/os-interface => generated 284 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:13:58.402451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:58.403823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:58.411818 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c6262da0-6a29-469c-bf16-f731e9979d43 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1471 microversion: 2.1 time: 0.546160 Oct 25 03:13:58.435069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1429/3029] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:57 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1471 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:58.452716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:58.466081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:58.468041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:58.468726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:58.469670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:58.471599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:58.477096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:58.480137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:58.507813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:58.514723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:58.517633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:58.518877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:58.525540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:58.528919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:59.006250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:13:59.821277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:13:59.833764 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dea68335-3c0f-42c9-b4be-dc4a55adee5f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 1.372034 Oct 25 03:13:59.835849 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1430/3030] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:58 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:13:59.856234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:13:59.857228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:13:59.871753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:59.874260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:59.875051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:13:59.875865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:13:59.880567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:13:59.884232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:00.069430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:00.095158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:00.101057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:00.105202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-576ba4e4-fd47-4d13-99d6-c5470c79c69f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1592 microversion: 2.42 time: 1.710647 Oct 25 03:14:00.107255 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1601/3031] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:13:58 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1592 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:00.656981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:00.670896 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3bbcc9a5-9f64-4be7-acad-7109787cca75 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1471 microversion: 2.1 time: 0.833586 Oct 25 03:14:00.672356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1431/3032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:13:59 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1471 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:00.873991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:00.875246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:00.891707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:00.899789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:00.902932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:00.903810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:00.904724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:00.906867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:00.907766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:01.138611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:01.139457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:01.173651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:01.174814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:01.176888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:01.178539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:01.181293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:01.185122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:01.626202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:01.645827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:01.664129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:01.667262 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41c53c49-14a8-464b-8308-58f5a18b39e1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1660 microversion: 2.42 time: 0.532923 Oct 25 03:14:01.674639 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1432/3033] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:01 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1660 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:01.697311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:01.699398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:01.721873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:01.727555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:01.731307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:01.732147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:01.732641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:01.733087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:01.801883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:02.104790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:02.121980 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8069da5f-186d-4593-806f-7d4d076e263e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 1.247235 Oct 25 03:14:02.123327 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1602/3034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:00 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:14:02.701126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:02.701665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:02.713966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:02.714759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:02.715365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:02.716385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:02.717003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:02.717591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:03.327578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:03.347208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:03.348769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:03.360465 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-005f6547-dc08-47a6-933b-97cfc582725c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1707 microversion: 2.42 time: 0.653576 Oct 25 03:14:03.361545 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1603/3035] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:02 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1707 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:14:03.376993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:03.377665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:03.399054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:03.399560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:03.400004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:03.407434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:03.408030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:03.412702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:03.667702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:03.682083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8843a8b4-8b6f-4d53-acf9-a826e70b4169 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1471 microversion: 2.1 time: 1.989234 Oct 25 03:14:03.686961 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1433/3036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:01 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1471 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:03.697157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:03.705473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:03.717003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:03.721136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:03.721889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:03.725729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:03.726487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:03.728311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:03.829143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:14:04.053931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:04.090569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9d42625-6508-4f8d-9597-d06644cd848e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.725730 Oct 25 03:14:04.099347 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1604/3037] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:03 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:04.121636 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9fac08db-9eca-4a2b-a059-6ac4c8293231 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 204 len: 0 microversion: 2.1 time: 0.432845 Oct 25 03:14:04.131835 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1434/3038] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:14:03 2022] DELETE /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:14:04.145922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:04.150006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:04.169927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:04.170726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:04.171451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:04.172391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:04.175918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:04.176619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:04.420706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:04.421932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:04.446653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:04.449924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:04.452234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:04.461067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:04.480678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:04.481736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:04.948315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:04.979206 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-034f3780-f4b0-4805-a0f2-948cb9756d2b tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1680 microversion: 2.1 time: 0.843313 Oct 25 03:14:04.979839 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1605/3039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:04 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1680 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:05.001391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:05.002051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:05.033417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:05.033936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:05.034376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:05.035086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:05.035543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:05.035966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:05.577854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:05.598428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3237859f-d584-420b-a5b1-87c644eb3bba tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 0.608337 Oct 25 03:14:05.622631 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1606/3040] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:04 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:05.647528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:05.648375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:05.679297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:05.679818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:05.680263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:05.684984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:05.685481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:05.685946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:05.716582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:05.734798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:05.737724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:05.746856 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60593606-38fe-4032-b1af-c5f870ec052e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1707 microversion: 2.42 time: 1.335124 Oct 25 03:14:05.749571 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1435/3041] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:04 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1707 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:06.004361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:06.005104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:06.026015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:06.026907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:06.027789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:06.029103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:06.031009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:06.031677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:06.376966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:06.387108 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7ea82c54-7495-4d43-8e1e-578016a63c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.763293 Oct 25 03:14:06.402147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1607/3042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:05 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:06.562676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a4931dd8-e4f7-4533-ac55-c4ad1d49e6af req-08e2d7e4-cdfd-4dff-868f-b2754a0f53a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:06.584958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a4931dd8-e4f7-4533-ac55-c4ad1d49e6af req-08e2d7e4-cdfd-4dff-868f-b2754a0f53a8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:06.585263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a4931dd8-e4f7-4533-ac55-c4ad1d49e6af req-08e2d7e4-cdfd-4dff-868f-b2754a0f53a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:06.592137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a4931dd8-e4f7-4533-ac55-c4ad1d49e6af req-08e2d7e4-cdfd-4dff-868f-b2754a0f53a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:06.657120 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a4931dd8-e4f7-4533-ac55-c4ad1d49e6af req-08e2d7e4-cdfd-4dff-868f-b2754a0f53a8 service nova] Creating event network-changed:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:14:06.679556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a4931dd8-e4f7-4533-ac55-c4ad1d49e6af req-08e2d7e4-cdfd-4dff-868f-b2754a0f53a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120432 Oct 25 03:14:06.690051 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1608/3043] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:06.695827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:06.704013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:06.718771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:06.721535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:06.723009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:06.730051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:06.730816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:06.731456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:07.116241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:07.133370 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58422f0a-8ace-4983-8d62-8065faad4ad1 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1680 microversion: 2.1 time: 1.132625 Oct 25 03:14:07.134784 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1436/3044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:05 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1680 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:07.139754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:07.143328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:07.171535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:07.172467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:07.179314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:07.180464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:07.181786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:07.182792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:08.142382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:08.154588 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c20f556-d1ee-4f4f-8851-a2a5de1b7318 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 1.462915 Oct 25 03:14:08.159027 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1609/3045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:06 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:08.172709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:08.174039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:08.191778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:08.199042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:08.200137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:08.201082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:08.201772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:08.202390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:08.332073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:08.342273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:08.350423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:08.351659 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34d50708-280c-4a0a-9cca-945d3d083322 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1754 microversion: 2.42 time: 1.215686 Oct 25 03:14:08.357160 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1437/3046] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:07 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1754 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:08.368137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:08.370153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:08.385669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:08.386195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:08.386638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:08.387351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:08.393557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:08.394185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:09.345938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:09.357180 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb000221-1da5-4683-87d8-b5f25d1b33e2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 1.196895 Oct 25 03:14:09.362390 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1610/3047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:08 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:09.375256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:09.382721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:09.405976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:09.406475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:09.406918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:09.407624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:09.408081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:09.426291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:09.649239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:09.663408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58daa71f-3f7b-453c-a5d6-f8cfa35d4c8e tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1680 microversion: 2.1 time: 1.300830 Oct 25 03:14:09.669715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1438/3048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:08 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1680 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:09.674879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:09.684398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:09.711404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:09.711911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:09.712353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:09.713073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:09.713536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:09.713993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:10.492385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:10.505561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:10.523690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:10.524833 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8f643aa1-c42f-42f0-adc1-ea707badaee5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1754 microversion: 2.42 time: 0.853867 Oct 25 03:14:10.537726 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1439/3049] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:09 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1754 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:10.552574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:10.553231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:10.574460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:10.574951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:10.575390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:10.576117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:10.576575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:10.577003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:10.882647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:10.890884 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9c87b82-389a-4072-b2e0-5f3a58f8dd63 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 1.525766 Oct 25 03:14:10.898670 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1611/3050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:09 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:10.905973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:10.906682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:10.940148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:10.940721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:10.941161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:10.949875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:10.953520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:10.955583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:11.284030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102711a2938c4bc4a6951fc200d88721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25697f99614645ec9d900ebaf8da1cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:11.295775 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1a476db-9f7d-45c2-a604-d8ce07546769 tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 200 len: 1612 microversion: 2.1 time: 0.395942 Oct 25 03:14:11.306214 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1612/3051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:10 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 1612 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:11.450233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:11.473025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e09b3970-49e0-4513-a817-69a78182680d req-003ec096-4aa3-440d-bddd-c5a1667a60bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37182056-b6bc-4b4a-b91e-3ee4f275ba7b", "name": "network-vif-deleted", "tag": "08f14943-7c8e-44f8-8c0d-d7fe94ed260c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:11.474235 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5acd68bd-6557-4034-97a0-8e1add522b1d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.944254 Oct 25 03:14:11.474915 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1440/3052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:10 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:11.498141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e09b3970-49e0-4513-a817-69a78182680d req-003ec096-4aa3-440d-bddd-c5a1667a60bc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:11.506700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e09b3970-49e0-4513-a817-69a78182680d req-003ec096-4aa3-440d-bddd-c5a1667a60bc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:11.507364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e09b3970-49e0-4513-a817-69a78182680d req-003ec096-4aa3-440d-bddd-c5a1667a60bc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:11.532736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e09b3970-49e0-4513-a817-69a78182680d req-003ec096-4aa3-440d-bddd-c5a1667a60bc service nova] Creating event network-vif-deleted:08f14943-7c8e-44f8-8c0d-d7fe94ed260c for instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b on n-h1-862355-1 Oct 25 03:14:11.541817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e09b3970-49e0-4513-a817-69a78182680d req-003ec096-4aa3-440d-bddd-c5a1667a60bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072250 Oct 25 03:14:11.553360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:11.554251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:11.560204 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1613/3053] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:14:11.570408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:11.571669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:11.572418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:11.573408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:11.574799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:11.576296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:11.921264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:11.922831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:11.933354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:11.937129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:11.942929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:11.945797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:11.946869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:11.954552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:11.957249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:12.946519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:12.953055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:12.954583 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-75caca06-1bd5-47d6-8f61-9b3dc2939c09 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 1.041769 Oct 25 03:14:12.958565 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1614/3054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:11 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:12.963518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:12.986653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] [instance: 37182056-b6bc-4b4a-b91e-3ee4f275ba7b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:12.987836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:12.990635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:12.992101 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8b02a75-cfa7-4de1-b5ab-176f378bad63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1801 microversion: 2.42 time: 1.443445 Oct 25 03:14:13.007585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:13.013941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:13.014586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:13.017712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:13.023310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:13.024387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:13.031442 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1441/3055] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:11 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1801 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:13.038414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:13.039214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:13.048520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:13.050950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:13.053740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:13.055109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:13.056700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:13.057329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:13.057969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:13.106287 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] HTTP exception thrown: Instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b could not be found. Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Request method failure captured: Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b HTTP/1.1 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1PEup75Euwc6OZxIMwr5usK1NQyS9WernaNW5C8QaQAD7m3cndYL18Pdhj3OK6FjrMDgdCElGeX_O46JMUvnJnR0KOwajW-wYT_kMryieEhxuNUaN_Fd47URh99YbIcPsbn79BQQAnylIK1XdfV10rOIMKGVSJ6GlH6sRz3E3b8gVw Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 25697f99614645ec9d900ebaf8da1cfd Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesAdminNegativeTest-563027251 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25697f99614645ec9d900ebaf8da1cfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25697f99614645ec9d900ebaf8da1cfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25697f99614645ec9d900ebaf8da1cfd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25697f99614645ec9d900ebaf8da1cfd"}]}] Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesAdminNegativeTest-563027251 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 25697f99614645ec9d900ebaf8da1cfd Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-563027251 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesAdminNegativeTest-563027251-project Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 102711a2938c4bc4a6951fc200d88721 Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesAdminNegativeTest-563027251-project Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b could not be found. Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '37182056-b6bc-4b4a-b91e-3ee4f275ba7b'} Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b could not be found. Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b could not be found. Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:14:13.118049 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:13.124039 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:14:13.124039 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:14:13.124039 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:14:13.124039 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:14:13.124039 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:14:13.124039 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b could not be found. Oct 25 03:14:13.124039 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:13.133403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Returning 404 to user: Instance 37182056-b6bc-4b4a-b91e-3ee4f275ba7b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:14:13.138126 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5202c21e-ae82-42cd-bd89-66a11f3049ad tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b" status: 404 len: 111 microversion: 2.1 time: 0.178188 Oct 25 03:14:13.143737 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1615/3056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:12 2022] GET /compute/v2.1/servers/37182056-b6bc-4b4a-b91e-3ee4f275ba7b => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:14:13.175060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d832703d-2bd9-46f4-bf2b-cd5678bc1d3d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] Calling method '.version_select at 0x7efd3814e9d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:13.247402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:13.254800 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d832703d-2bd9-46f4-bf2b-cd5678bc1d3d tempest-VolumesAdminNegativeTest-563027251 tempest-VolumesAdminNegativeTest-563027251-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735665339" status: 202 len: 0 microversion: 2.1 time: 0.106872 Oct 25 03:14:13.261810 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1616/3057] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735665339 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:14:13.270115 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7a7eb34-368d-4389-a260-dd129d6955ee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.235956 Oct 25 03:14:13.274669 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1442/3058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:13 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:13.982993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:13.984261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:14.021055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:14.021987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:14.040087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:14.041753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:14.043383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:14.044348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:14.044949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:14.045628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:14.046662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:14.049057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:14.050090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:14.052175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:14.053974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:14.055391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:15.041772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:15.053075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:15.057634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:15.061096 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58b31da2-407c-4d85-93d3-6b9cdd0bfe1b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1801 microversion: 2.42 time: 1.045475 Oct 25 03:14:15.065813 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1443/3059] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:14 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1801 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:14:15.071520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:15.072343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:15.093975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:15.099306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:15.100040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:15.100958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:15.108008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:15.108636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:15.429714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:15.432121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:15.443062 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7a539de2-73b7-4952-8224-f5e05e18b686 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1523 microversion: 2.1 time: 0.375659 Oct 25 03:14:15.443252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b316feec-50bb-467c-976a-fc241d8718d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 1.465667 Oct 25 03:14:15.443690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1617/3060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:13 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:15.465873 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1444/3061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:15 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:16.095004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:16.095635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:16.107953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:16.108577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:16.109417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:16.111530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:16.113062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:16.114835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:16.184240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:16.470941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:16.472305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:16.497420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:16.498245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:16.498845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:16.499786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:16.500577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:16.503094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:16.651856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:16.686471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:16.688020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:16.689253 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8b2e535d-2f35-490f-aa51-1108bac522d3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1801 microversion: 2.42 time: 0.598362 Oct 25 03:14:16.690336 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1618/3062] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:16 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1801 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:16.707273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:16.708679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:16.714738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:16.715446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:16.717199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:16.718151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:16.718768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:16.719168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:16.824258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:16.837218 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51c885bf-ba6f-476b-abf9-9e3420531b57 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 0.371523 Oct 25 03:14:16.856717 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1445/3063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:16 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:17.624985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:17.642754 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f2f80ce-adda-458c-a774-217742804dfb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1505 microversion: 2.1 time: 0.950432 Oct 25 03:14:17.644108 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1619/3064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:16 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1505 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:17.721972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:17.722972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:17.744047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:17.745194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:17.747245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:17.748520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:17.749004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:17.749449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:17.868382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:17.869848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:17.924191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:17.924852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:17.933854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:17.936166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:17.939017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:17.944302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:18.934118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:18.944475 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-693e8cf9-df35-49ba-88ee-a6f923f5e584 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 1.086232 Oct 25 03:14:18.953745 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1620/3065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:17 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:18.959704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:18.961831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:18.977946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:18.978938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:18.979577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:18.980542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:18.981929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:18.983015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:18.985712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:19.002723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:19.005634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:19.017199 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd799448-4ece-4d59-83a5-5ca6ab710b6d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1848 microversion: 2.42 time: 1.300080 Oct 25 03:14:19.018419 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1446/3066] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:17 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1848 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:19.730260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:19.743198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20d9eff9-a06a-4b48-aa62-69018c82c265 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1505 microversion: 2.1 time: 0.787910 Oct 25 03:14:19.743997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1621/3067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:18 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1505 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:19.981070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:19.981704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:19.995590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:19.996925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:20.000531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:20.001714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:20.002345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:20.002945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:20.050348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:20.050768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:20.061340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:20.068190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:20.068929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:20.069840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:20.070414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:20.070969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:20.480297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:20.489530 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd94639f-6ceb-4649-b083-2f3dafde361c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 0.512168 Oct 25 03:14:20.496061 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1447/3068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:19 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:20.768541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:20.769102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:20.775960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:20.776466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:20.776909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:20.780167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:20.780167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:20.780167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:20.788086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:20.857537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:20.879696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:20.881362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:20.886045 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65f83048-7c71-4afa-8494-a4fffe7f627d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1848 microversion: 2.42 time: 0.837956 Oct 25 03:14:20.897878 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1622/3069] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:20 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1848 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:14:21.321235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3da55f4a-d247-4b87-bee2-e1a5d957b036 req-584c06e3-7f3a-4023-ace5-7c24f59702be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3124ad5d-3bef-4651-b4f4-b205d004398d", "name": "network-vif-unplugged", "status": "completed", "tag": "21871249-17d0-43b2-a55d-b7bee5257446"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:21.338404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3da55f4a-d247-4b87-bee2-e1a5d957b036 req-584c06e3-7f3a-4023-ace5-7c24f59702be service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:21.338876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3da55f4a-d247-4b87-bee2-e1a5d957b036 req-584c06e3-7f3a-4023-ace5-7c24f59702be service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:21.348594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3da55f4a-d247-4b87-bee2-e1a5d957b036 req-584c06e3-7f3a-4023-ace5-7c24f59702be service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:21.384975 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3da55f4a-d247-4b87-bee2-e1a5d957b036 req-584c06e3-7f3a-4023-ace5-7c24f59702be service nova] Creating event network-vif-unplugged:21871249-17d0-43b2-a55d-b7bee5257446 for instance 3124ad5d-3bef-4651-b4f4-b205d004398d on n-h2-862355-1 Oct 25 03:14:21.391449 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3da55f4a-d247-4b87-bee2-e1a5d957b036 req-584c06e3-7f3a-4023-ace5-7c24f59702be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074413 Oct 25 03:14:21.392252 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1623/3070] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:14:21.478752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:21.491800 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-963f7d38-d0d9-48aa-b576-599c4fcccb7e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1505 microversion: 2.1 time: 0.727208 Oct 25 03:14:21.500367 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1448/3071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:20 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1505 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:21.522117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:21.523205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:21.533580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:21.540802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:21.541592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:21.542796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:21.543420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:21.544026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:21.912962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:21.913831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:21.921027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:21.928740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:21.929455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:21.930399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:21.931022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:21.931648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:22.076291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:22.086030 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-353f8ec3-c3a0-42c1-b385-ac1cdcbe8867 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1476 microversion: 2.1 time: 0.567723 Oct 25 03:14:22.090462 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1624/3072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:21 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1476 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:22.238145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9300fb78-c095-40ca-8eff-8746f1811c58 req-f453d871-c0b4-4151-8b11-c912f3a9ea86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "b72ec6e2-76b3-491d-b4dc-5e311cf014e2"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:22.251287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9300fb78-c095-40ca-8eff-8746f1811c58 req-f453d871-c0b4-4151-8b11-c912f3a9ea86 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:22.251778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9300fb78-c095-40ca-8eff-8746f1811c58 req-f453d871-c0b4-4151-8b11-c912f3a9ea86 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:22.252216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9300fb78-c095-40ca-8eff-8746f1811c58 req-f453d871-c0b4-4151-8b11-c912f3a9ea86 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:22.294327 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9300fb78-c095-40ca-8eff-8746f1811c58 req-f453d871-c0b4-4151-8b11-c912f3a9ea86 service nova] Creating event network-changed:b72ec6e2-76b3-491d-b4dc-5e311cf014e2 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:14:22.304073 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9300fb78-c095-40ca-8eff-8746f1811c58 req-f453d871-c0b4-4151-8b11-c912f3a9ea86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069388 Oct 25 03:14:22.305278 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1625/3073] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:22.525332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:22.526799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:22.543234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:22.543734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:22.544174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:22.544920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:22.545454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:22.545922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:23.016579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:23.029385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:23.036330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:23.037878 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c30e678f-8d1a-473b-b45a-c1f8018267ee tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1848 microversion: 2.42 time: 1.129107 Oct 25 03:14:23.054437 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1449/3074] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:21 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1848 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:23.074414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:23.095216 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0c7b9e5c-7a4a-49a3-a5dc-a3e1813c8658 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 200 len: 1508 microversion: 2.1 time: 0.572057 Oct 25 03:14:23.096039 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1626/3075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:22 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:14:23.116323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:23.122955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:23.127486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:23.141435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:23.142434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:23.147365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:23.149994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:23.150925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:23.151856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:23.153412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:23.158639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:23.162363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:23.163008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:23.163943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:23.164583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:23.168417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:23.247064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:14:23.262389 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.compute.api [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Working on deleting snapshot f9f43eb9-e3c5-460c-a294-17ee47290704 from shelved instance... Oct 25 03:14:24.500849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:24.516013 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-916b8459-c67a-4177-a876-c4c946b92447 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1475 microversion: 2.1 time: 1.404159 Oct 25 03:14:24.522936 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1450/3076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:23 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1475 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:24.527849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:24.536939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:24.559608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:24.563496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:24.564104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:24.565581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:24.567728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Doing local delete in cell 10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=120562) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 25 03:14:24.568882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:24.569700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:24.578450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:24.579260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:24.580471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:24.585385 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.compute.api [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 25 03:14:24.590840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] deallocate_for_instance() {{(pid=120562) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 25 03:14:25.651790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:25.662726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:25.664192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:25.665406 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ff0a7fb-a91a-4932-ae54-d914bddcbefd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1848 microversion: 2.42 time: 1.141363 Oct 25 03:14:25.682082 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1451/3077] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:24 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1848 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:25.687183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:25.698450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:25.704864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:25.705625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:25.706292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:25.707887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:25.708516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:25.709117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:26.712731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:26.751165 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2544efe7-ace3-4ddf-ba2a-d8c05f8bcad7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1475 microversion: 2.1 time: 1.050021 Oct 25 03:14:26.751887 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1452/3078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:25 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1475 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:26.778413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-483cb4bd-3a07-42b4-a813-96100fc7a129 req-65299ab6-31c9-4f04-861f-f45f131e2462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "name": "network-vif-unplugged", "status": "completed", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:26.797267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-483cb4bd-3a07-42b4-a813-96100fc7a129 req-65299ab6-31c9-4f04-861f-f45f131e2462 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:26.798068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-483cb4bd-3a07-42b4-a813-96100fc7a129 req-65299ab6-31c9-4f04-861f-f45f131e2462 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:26.800385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-483cb4bd-3a07-42b4-a813-96100fc7a129 req-65299ab6-31c9-4f04-861f-f45f131e2462 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:26.823443 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-483cb4bd-3a07-42b4-a813-96100fc7a129 req-65299ab6-31c9-4f04-861f-f45f131e2462 service nova] Creating event network-vif-unplugged:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h1-862355-1 Oct 25 03:14:26.831356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-483cb4bd-3a07-42b4-a813-96100fc7a129 req-65299ab6-31c9-4f04-861f-f45f131e2462 service nova] Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:14:26.851388 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-483cb4bd-3a07-42b4-a813-96100fc7a129 req-65299ab6-31c9-4f04-861f-f45f131e2462 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093209 Oct 25 03:14:26.852688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1453/3079] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:26.865139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:26.870203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:26.886369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:26.887952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:26.889945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:26.891805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:26.892607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:26.893219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:27.382153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Updating instance_info_cache with network_info: [] {{(pid=120562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:14:27.672633 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a75a975f-ca5c-42ae-93c4-753557254a78 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 204 len: 0 microversion: 2.1 time: 4.548969 Oct 25 03:14:27.674226 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1627/3080] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:14:23 2022] DELETE /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 0 bytes in 4556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:14:27.682418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0a6769fa-2ceb-43f4-a6fe-62c0c177fdea req-4a8ff70d-231a-4848-b401-30675a0dcbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3124ad5d-3bef-4651-b4f4-b205d004398d", "name": "network-vif-deleted", "tag": "21871249-17d0-43b2-a55d-b7bee5257446"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:27.695667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0a6769fa-2ceb-43f4-a6fe-62c0c177fdea req-4a8ff70d-231a-4848-b401-30675a0dcbe6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:27.696765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0a6769fa-2ceb-43f4-a6fe-62c0c177fdea req-4a8ff70d-231a-4848-b401-30675a0dcbe6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:27.697430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0a6769fa-2ceb-43f4-a6fe-62c0c177fdea req-4a8ff70d-231a-4848-b401-30675a0dcbe6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:27.711858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_external_events [req-0a6769fa-2ceb-43f4-a6fe-62c0c177fdea req-4a8ff70d-231a-4848-b401-30675a0dcbe6 service nova] Unable to find a host for instance 3124ad5d-3bef-4651-b4f4-b205d004398d. Dropping event network-vif-deleted {{(pid=120562) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 25 03:14:27.713142 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0a6769fa-2ceb-43f4-a6fe-62c0c177fdea req-4a8ff70d-231a-4848-b401-30675a0dcbe6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.037608 Oct 25 03:14:27.714630 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1628/3081] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 25 03:14:27.719388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:27.720401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:27.728763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:27.729664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:27.730609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:27.731627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:27.732422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:27.733079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:27.752367 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d HTTP/1.1 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '3124ad5d-3bef-4651-b4f4-b205d004398d'} Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:14:27.755245 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:27.762073 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:14:27.762073 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:14:27.762073 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:14:27.762073 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:14:27.762073 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:14:27.762073 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:14:27.762073 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:14:27.764971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:14:27.766257 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57268229-6331-4d1d-8596-cb80ca4611da tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 404 len: 111 microversion: 2.1 time: 0.050419 Oct 25 03:14:27.777398 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1629/3082] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:27 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:14:27.787826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:27.788902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:27.815050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:27.817932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:27.818520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:27.819350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:27.822701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:27.823475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:28.059099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:28.074092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:28.078005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:28.081181 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb615c86-33be-45c8-a639-81340a363dc6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1869 microversion: 2.42 time: 1.225624 Oct 25 03:14:28.083354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1454/3083] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:26 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1869 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:28.092237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-660903869", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "399e4372-9a26-4378-9554-8714a7affe92"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:28.195011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] validate_networks() for [('399e4372-9a26-4378-9554-8714a7affe92', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:14:28.288745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:28.297284 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ae2b8cde-c7af-4fe0-888d-392b6da37f4f tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1475 microversion: 2.1 time: 0.514126 Oct 25 03:14:28.298476 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1630/3084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:27 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1475 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:28.883644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b6ed5405-374b-413f-9bf6-b5847f1eca6a req-4f41beb6-410f-4945-b7cd-a923c260fd55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:28.902661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b6ed5405-374b-413f-9bf6-b5847f1eca6a req-4f41beb6-410f-4945-b7cd-a923c260fd55 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:28.904455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b6ed5405-374b-413f-9bf6-b5847f1eca6a req-4f41beb6-410f-4945-b7cd-a923c260fd55 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:28.906366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b6ed5405-374b-413f-9bf6-b5847f1eca6a req-4f41beb6-410f-4945-b7cd-a923c260fd55 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:28.913898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:28.932469 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b6ed5405-374b-413f-9bf6-b5847f1eca6a req-4f41beb6-410f-4945-b7cd-a923c260fd55 service nova] Creating event network-changed:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h1-862355-1 Oct 25 03:14:28.942697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-b6ed5405-374b-413f-9bf6-b5847f1eca6a req-4f41beb6-410f-4945-b7cd-a923c260fd55 service nova] Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:14:28.960252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b6ed5405-374b-413f-9bf6-b5847f1eca6a req-4f41beb6-410f-4945-b7cd-a923c260fd55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082356 Oct 25 03:14:28.962298 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1631/3085] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:29.117244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:29.118253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:29.127409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:29.128246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:29.129753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:29.132169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:29.132908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:29.133565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:29.990692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:30.015987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:30.018042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:30.020926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f0fd1dee-d724-46f9-8c61-b4a1659225c0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.909767 Oct 25 03:14:30.021522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1632/3086] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:29 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:14:30.294989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:30.295964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:30.305007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:30.306106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:30.307159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:30.308394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:30.309485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:30.310536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:30.482494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:14:30.484419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:14:30.485103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:14:30.485717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:14:30.486375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:14:30.508240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:30.509929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:30.512936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:30.516315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:30.516984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:30.520659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:30.569564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:14:30.579402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for user 256827a36f464fe1b535d91f95e48681 and project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:14:30.611752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:14:30.616631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:14:30.824683 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9eea0a6e-1592-42c9-8272-8d560a8d7f8d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.727682 Oct 25 03:14:30.829646 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1455/3087] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:14:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:14:30.853806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f57036aa-f25c-49ce-bf2e-d17dd93979b8 req-7c4ae767-edeb-457f-85d8-377319f3b883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "141be093-c60d-42b1-9db8-3125a19fb6bd"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:30.877503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f57036aa-f25c-49ce-bf2e-d17dd93979b8 req-7c4ae767-edeb-457f-85d8-377319f3b883 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:30.878886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f57036aa-f25c-49ce-bf2e-d17dd93979b8 req-7c4ae767-edeb-457f-85d8-377319f3b883 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:30.892283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f57036aa-f25c-49ce-bf2e-d17dd93979b8 req-7c4ae767-edeb-457f-85d8-377319f3b883 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:30.939050 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f57036aa-f25c-49ce-bf2e-d17dd93979b8 req-7c4ae767-edeb-457f-85d8-377319f3b883 service nova] Creating event network-changed:141be093-c60d-42b1-9db8-3125a19fb6bd for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:14:30.954165 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f57036aa-f25c-49ce-bf2e-d17dd93979b8 req-7c4ae767-edeb-457f-85d8-377319f3b883 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110321 Oct 25 03:14:30.958188 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1456/3088] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:30.965508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:30.968195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:30.976248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:30.977018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:30.978180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:30.979086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:30.979744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:30.980364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:31.021785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:31.032119 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-48721d56-b1cd-4373-bfc4-39377d26aac5 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1475 microversion: 2.1 time: 1.009127 Oct 25 03:14:31.052358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1633/3089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:30 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1475 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:31.061714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c026e03-1044-4dfc-ba2c-f4a9a5be3d14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:31.069219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c026e03-1044-4dfc-ba2c-f4a9a5be3d14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:31.217703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c026e03-1044-4dfc-ba2c-f4a9a5be3d14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:31.225266 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c026e03-1044-4dfc-ba2c-f4a9a5be3d14 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1214 microversion: 2.1 time: 0.171235 Oct 25 03:14:31.228028 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1634/3090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:31 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:31.247853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:31.248469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:31.266060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:31.266635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:31.267601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:31.268561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:31.269210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:31.269824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:31.801764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:31.815325 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b9f9111c-8e01-495f-994a-276315d27662 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.855551 Oct 25 03:14:31.817063 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1457/3091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:30 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:31.846473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:31.848889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:31.859471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:31.860533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:31.861081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:31.861904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:31.862648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:31.863302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:32.137232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:32.151832 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aceb363e-f42b-4c5f-97a6-b3efd71f17dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.313890 Oct 25 03:14:32.153390 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1458/3092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:31 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:32.166394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:32.168379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:32.186513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:32.187426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:32.188102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:32.190890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:32.192126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:32.192834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:32.628037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:32.647754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:32.654919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:32.656490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee70f869-b244-4bca-9dc9-34431e3c6c9d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.427514 Oct 25 03:14:32.660452 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1635/3093] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:31 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:32.669580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:32.677065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:32.697668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:32.701473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:32.702170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:32.703122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:32.705532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:32.707742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:32.842938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:32.856466 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c811f40-710f-450a-bdd5-d2171b7cf7d1 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1473 microversion: 2.1 time: 0.700749 Oct 25 03:14:32.860876 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1459/3094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:32 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1473 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:32.876311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:32.877220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:32.911822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:32.926669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:32.927321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:32.928250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:32.928874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:32.930139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:33.594154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:33.612346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3b332843-7bf7-4c03-addb-50f555b91fc1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1266 microversion: 2.1 time: 0.746164 Oct 25 03:14:33.613283 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1460/3095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:32 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1266 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:33.625318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-000c9d03-e878-46cd-90bb-55ea20cfe3df req-e534a7d5-a14b-4162-8ec9-efc0ea294c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "e1d5c65f-29a1-4d46-81b5-e60b72731e38"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:33.664415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-000c9d03-e878-46cd-90bb-55ea20cfe3df req-e534a7d5-a14b-4162-8ec9-efc0ea294c51 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:33.665580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-000c9d03-e878-46cd-90bb-55ea20cfe3df req-e534a7d5-a14b-4162-8ec9-efc0ea294c51 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:33.666272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-000c9d03-e878-46cd-90bb-55ea20cfe3df req-e534a7d5-a14b-4162-8ec9-efc0ea294c51 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:33.694265 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-000c9d03-e878-46cd-90bb-55ea20cfe3df req-e534a7d5-a14b-4162-8ec9-efc0ea294c51 service nova] Creating event network-changed:e1d5c65f-29a1-4d46-81b5-e60b72731e38 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:14:33.710047 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-000c9d03-e878-46cd-90bb-55ea20cfe3df req-e534a7d5-a14b-4162-8ec9-efc0ea294c51 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095079 Oct 25 03:14:33.711713 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1461/3096] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:33.737472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:33.740878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:33.751868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:33.752303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:33.752747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:33.753462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:33.754056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:33.754500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:34.167811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:34.176238 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c033bea-3907-4ef8-a355-34e89751a16c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 1.511670 Oct 25 03:14:34.197934 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1636/3097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:32 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:34.209481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:34.210379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:34.226793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:34.236246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:34.239009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:34.245509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15064889-776a-495a-b93a-d0bd9a647b07 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.532010 Oct 25 03:14:34.246337 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1462/3098] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:33 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:34.249280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:34.252970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:34.254617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:34.257171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1821566289"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:34.259616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:34.264565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:34.265079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:34.265509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:34.283981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:34.284746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:34.285373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:34.286309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:34.286935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:34.287531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:34.589429 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb8a405f-1b9b-4703-a313-f8d218cd01ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.341215 Oct 25 03:14:34.590965 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1463/3099] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:14:34 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 25 03:14:34.646762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:34.648932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:34.669238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:34.669970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:34.670754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:34.671652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:34.672405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:34.673025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:34.885638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:34.914272 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d85d0c1f-7574-4f40-9712-7a7b0b279b34 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1272 microversion: 2.1 time: 0.279337 Oct 25 03:14:34.918511 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1464/3100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:34 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:35.207958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:35.217764 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-84cea5c7-360a-428c-a760-25771b4217da tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1470 microversion: 2.1 time: 1.017427 Oct 25 03:14:35.218347 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1637/3101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:34 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1470 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:35.242823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:35.244120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:35.259327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:35.260088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:35.260779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:35.263806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:35.264562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:35.270504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:35.277160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:35.277960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:35.294089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:35.294937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:35.296931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:35.297827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:35.298538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:35.299198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:35.336608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:35.503812 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1fade184-e490-49c9-b0e4-62b3eb445e34 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "POST /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a/action" status: 202 len: 0 microversion: 2.1 time: 0.266222 Oct 25 03:14:35.504562 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1465/3102] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:14:35 2022] POST /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:14:35.514762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:35.516090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:35.524831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:35.525851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:35.526750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:35.527833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:35.528524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:35.529219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:36.011998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:36.044819 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-194be782-fe2c-4fa5-87f8-a9b2575c9225 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.534979 Oct 25 03:14:36.050932 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1466/3103] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:35 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:36.072921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:36.073554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:36.080021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:36.080527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:36.080993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:36.082387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:36.082851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:36.083924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:36.099777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:36.126486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:36.143287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:36.145188 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43bb4a55-5728-46e4-9419-9e35829fe4b8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.873398 Oct 25 03:14:36.146363 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1638/3104] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:35 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:36.202038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:36.215372 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e99feb42-7625-42da-b41b-696c01f3ea1a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1272 microversion: 2.1 time: 0.146840 Oct 25 03:14:36.218006 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1467/3105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:36 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:36.797007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-18e50a89-69fc-4d65-82c2-08abe1b6ab2c req-26438c2a-acbd-4a76-8696-725b29ae6a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "49f692b2-342c-4715-a3bf-8de914655333"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:36.819816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-18e50a89-69fc-4d65-82c2-08abe1b6ab2c req-26438c2a-acbd-4a76-8696-725b29ae6a27 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:36.833450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-18e50a89-69fc-4d65-82c2-08abe1b6ab2c req-26438c2a-acbd-4a76-8696-725b29ae6a27 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:36.838408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-18e50a89-69fc-4d65-82c2-08abe1b6ab2c req-26438c2a-acbd-4a76-8696-725b29ae6a27 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:36.872922 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-18e50a89-69fc-4d65-82c2-08abe1b6ab2c req-26438c2a-acbd-4a76-8696-725b29ae6a27 service nova] Creating event network-changed:49f692b2-342c-4715-a3bf-8de914655333 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:14:36.897744 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-18e50a89-69fc-4d65-82c2-08abe1b6ab2c req-26438c2a-acbd-4a76-8696-725b29ae6a27 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109605 Oct 25 03:14:36.902736 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1639/3106] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:37.084363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:37.084996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:37.099276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:37.100075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:37.100715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:37.101620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:37.102274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:37.103236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:37.176924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:37.177712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:37.193553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:37.194088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:37.194529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:37.195347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:37.195702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:37.196117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:37.921256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:37.946558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:37.998082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:38.001944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:38.002363 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37bab21e-351e-4b78-b3b0-aa7d9376093b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.918787 Oct 25 03:14:38.003104 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1468/3107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:37 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:38.008067 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-253c424f-c307-449f-9511-0a87bd5361dd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.835724 Oct 25 03:14:38.009856 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1640/3108] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:37 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:38.014936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ce4e5d95-1070-48e4-a64c-0704e38ff350 req-bc8dc3f0-4b89-4674-b63b-f673ba2c27f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "name": "network-vif-plugged", "status": "completed", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:38.024293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:38.024948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:38.039320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ce4e5d95-1070-48e4-a64c-0704e38ff350 req-bc8dc3f0-4b89-4674-b63b-f673ba2c27f4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:38.041211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ce4e5d95-1070-48e4-a64c-0704e38ff350 req-bc8dc3f0-4b89-4674-b63b-f673ba2c27f4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:38.042206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ce4e5d95-1070-48e4-a64c-0704e38ff350 req-bc8dc3f0-4b89-4674-b63b-f673ba2c27f4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:38.051529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:38.053731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:38.054354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:38.057358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:38.058688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:38.059685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:38.072287 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ce4e5d95-1070-48e4-a64c-0704e38ff350 req-bc8dc3f0-4b89-4674-b63b-f673ba2c27f4 service nova] Creating event network-vif-plugged:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h1-862355-1 Oct 25 03:14:38.080721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-ce4e5d95-1070-48e4-a64c-0704e38ff350 req-bc8dc3f0-4b89-4674-b63b-f673ba2c27f4 service nova] Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:14:38.106364 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ce4e5d95-1070-48e4-a64c-0704e38ff350 req-bc8dc3f0-4b89-4674-b63b-f673ba2c27f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092155 Oct 25 03:14:38.107667 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1641/3109] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:38.708790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:38.717193 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c17d32ec-dbd9-4e97-ab83-32da578e3c3a tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 0.713040 Oct 25 03:14:38.733628 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1469/3110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:38 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:38.960684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ec467134-3bc7-4a0b-8558-914adfd73279 req-970e8afb-9ddc-4cae-8360-6b1763d7c3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "42f8ac95-4a46-470d-9f6c-1d1045fbf922"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:38.970416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ec467134-3bc7-4a0b-8558-914adfd73279 req-970e8afb-9ddc-4cae-8360-6b1763d7c3b8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:38.970986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ec467134-3bc7-4a0b-8558-914adfd73279 req-970e8afb-9ddc-4cae-8360-6b1763d7c3b8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:38.971537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ec467134-3bc7-4a0b-8558-914adfd73279 req-970e8afb-9ddc-4cae-8360-6b1763d7c3b8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:38.983438 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ec467134-3bc7-4a0b-8558-914adfd73279 req-970e8afb-9ddc-4cae-8360-6b1763d7c3b8 service nova] Creating event network-changed:42f8ac95-4a46-470d-9f6c-1d1045fbf922 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:14:38.989228 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ec467134-3bc7-4a0b-8558-914adfd73279 req-970e8afb-9ddc-4cae-8360-6b1763d7c3b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034089 Oct 25 03:14:38.989962 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1642/3111] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:39.029588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:39.030524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:39.036169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:39.036972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:39.039650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:39.040334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:39.040936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:39.042367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:39.045651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:39.045651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:39.056510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:39.057378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:39.058126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:39.058925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:39.059447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:39.059909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:39.534873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:39.548792 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50bb3463-b57a-4ae6-aa8a-c8a1f7bb0d42 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.525651 Oct 25 03:14:39.549390 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1470/3112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:39 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:39.667319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:39.687973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:39.693372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:39.696480 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-40e00c27-2fd7-4c47-8c25-7a77c39c65b6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.664302 Oct 25 03:14:39.699702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1643/3113] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:39 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:14:39.742465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:39.744096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:39.757502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:39.759157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:39.761224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:39.762636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:39.765845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:39.767578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:40.318765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:40.328164 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a539218e-05cb-4ce0-91c1-3ab6fbbc7af1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 0.591316 Oct 25 03:14:40.329519 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1471/3114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:39 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:40.573963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:40.574586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:40.589471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:40.590111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:40.590430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:40.591290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:40.591597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:40.592023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:40.728714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:40.729254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:40.750711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:40.756694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:40.765368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:40.766146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:40.769722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:40.771255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:40.773275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:40.775440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:40.970298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:40.980664 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57cd8efb-779e-4fcd-ab7d-ad23a7fda53c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.410454 Oct 25 03:14:41.000326 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1644/3115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:40 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:41.043375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-94f99b07-7105-4d82-ab76-379532de380c req-17c5f36b-d641-40c2-af34-4077c69ac7cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "5328eb15-eb4f-4c5d-a324-41e317e5b958"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:41.073206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-94f99b07-7105-4d82-ab76-379532de380c req-17c5f36b-d641-40c2-af34-4077c69ac7cc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:41.076772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-94f99b07-7105-4d82-ab76-379532de380c req-17c5f36b-d641-40c2-af34-4077c69ac7cc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:41.078082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-94f99b07-7105-4d82-ab76-379532de380c req-17c5f36b-d641-40c2-af34-4077c69ac7cc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:41.115443 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-94f99b07-7105-4d82-ab76-379532de380c req-17c5f36b-d641-40c2-af34-4077c69ac7cc service nova] Creating event network-changed:5328eb15-eb4f-4c5d-a324-41e317e5b958 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:14:41.125634 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-94f99b07-7105-4d82-ab76-379532de380c req-17c5f36b-d641-40c2-af34-4077c69ac7cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113418 Oct 25 03:14:41.126997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1645/3116] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:41.359054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:41.360620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:41.369440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:41.374341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:41.375768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:41.376715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:41.377720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:41.378370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:41.379009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:41.741084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:41.763026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:41.764588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:41.765858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-918ad0a5-3484-4109-9eb7-73644fefecc8 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.042938 Oct 25 03:14:41.766443 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1472/3117] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:40 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:41.789995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-38c05700-ef7f-4a02-a75f-e740bb696c02 req-cec9cccd-bc59-4e90-a8b7-0bb05bb45a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "name": "network-vif-plugged", "status": "completed", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:41.800368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-38c05700-ef7f-4a02-a75f-e740bb696c02 req-cec9cccd-bc59-4e90-a8b7-0bb05bb45a53 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:41.800806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-38c05700-ef7f-4a02-a75f-e740bb696c02 req-cec9cccd-bc59-4e90-a8b7-0bb05bb45a53 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:41.801234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-38c05700-ef7f-4a02-a75f-e740bb696c02 req-cec9cccd-bc59-4e90-a8b7-0bb05bb45a53 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:41.818867 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-38c05700-ef7f-4a02-a75f-e740bb696c02 req-cec9cccd-bc59-4e90-a8b7-0bb05bb45a53 service nova] Creating event network-vif-plugged:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:14:41.836651 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-38c05700-ef7f-4a02-a75f-e740bb696c02 req-cec9cccd-bc59-4e90-a8b7-0bb05bb45a53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053579 Oct 25 03:14:41.838306 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1473/3118] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:42.010425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:42.011155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:42.030275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:42.030797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:42.031232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:42.031959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:42.032436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:42.032995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:42.314472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:42.336011 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-702291b9-1c1b-467b-92d2-f6720e401a0c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 0.981800 Oct 25 03:14:42.337953 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1646/3119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:41 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:42.652493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:42.662658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ae3f7b5-6df8-4a89-8850-a9917d90e610 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.657078 Oct 25 03:14:42.670483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1474/3120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:42 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:14:42.798254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:42.799179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:42.808194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:42.821339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:42.833421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:42.851797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:42.853571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:42.855073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:42.857652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:43.360247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:43.360868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:43.384732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:43.385821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:43.386224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:43.386858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:43.387734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:43.388282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:43.388901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:43.900656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:43.908384 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c851aa51-12cd-47c0-aad1-0939acf3ea9f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 0.552045 Oct 25 03:14:43.909067 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1475/3121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:43 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:43.914511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f86da827-a817-48bc-9a2a-66792dde808b req-fd86ba85-40a8-4c99-97e7-94ed9b643145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "4e479d1c-2ec3-4733-93c5-74f7e16c3d8e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:43.928832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f86da827-a817-48bc-9a2a-66792dde808b req-fd86ba85-40a8-4c99-97e7-94ed9b643145 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:43.929315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f86da827-a817-48bc-9a2a-66792dde808b req-fd86ba85-40a8-4c99-97e7-94ed9b643145 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:43.930112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f86da827-a817-48bc-9a2a-66792dde808b req-fd86ba85-40a8-4c99-97e7-94ed9b643145 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:43.944258 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f86da827-a817-48bc-9a2a-66792dde808b req-fd86ba85-40a8-4c99-97e7-94ed9b643145 service nova] Creating event network-changed:4e479d1c-2ec3-4733-93c5-74f7e16c3d8e for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:14:43.949509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f86da827-a817-48bc-9a2a-66792dde808b req-fd86ba85-40a8-4c99-97e7-94ed9b643145 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038879 Oct 25 03:14:43.951015 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1476/3122] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:43.960699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:43.961639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:43.975395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:43.976508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:43.977133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:43.978083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:43.980047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:43.980628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:44.193099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:44.206763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:44.208515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:44.210075 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb28f6a8-0eec-4160-a9aa-79817ad8f9c5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.417441 Oct 25 03:14:44.212788 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1647/3123] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:42 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:44.381604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:44.399308 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e6359a0-ea21-461d-9803-75e94d7eb5f0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.446832 Oct 25 03:14:44.418743 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1477/3124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:43 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:44.936036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:44.937613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:44.970289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:44.973325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:44.976032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:44.980384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:44.980893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:44.981361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:45.241248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:45.241893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:45.248555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:45.249414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:45.250218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:45.251213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:45.251979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:45.253460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:45.971944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:45.985311 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfe709bd-48af-47a8-8e5a-4098be29a9a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 1.056406 Oct 25 03:14:45.988089 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1648/3125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:44 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:45.996098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:46.000731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:46.032422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:46.033194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:46.034830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:46.035861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:46.036602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:46.037216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:46.493511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:46.504263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:46.505745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:46.506949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e966a19a-15d6-4a08-b09c-30f8ba85db3d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.270805 Oct 25 03:14:46.518799 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1478/3126] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:45 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:46.523704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7a2b8793-0740-4e07-b3af-013bd730f2f9 req-b2097ce5-e24a-41ca-9939-fd8d924472ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8438c652-4512-4af6-8e0f-c5e12b415d88", "tag": "d275481c-fcc6-441a-89cc-e10f6c02df4f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:46.552047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a2b8793-0740-4e07-b3af-013bd730f2f9 req-b2097ce5-e24a-41ca-9939-fd8d924472ea service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:46.552534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a2b8793-0740-4e07-b3af-013bd730f2f9 req-b2097ce5-e24a-41ca-9939-fd8d924472ea service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:46.552972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a2b8793-0740-4e07-b3af-013bd730f2f9 req-b2097ce5-e24a-41ca-9939-fd8d924472ea service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:46.575438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7a2b8793-0740-4e07-b3af-013bd730f2f9 req-b2097ce5-e24a-41ca-9939-fd8d924472ea service nova] Creating event network-changed:d275481c-fcc6-441a-89cc-e10f6c02df4f for instance 8438c652-4512-4af6-8e0f-c5e12b415d88 on n-h1-862355-1 Oct 25 03:14:46.591682 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7a2b8793-0740-4e07-b3af-013bd730f2f9 req-b2097ce5-e24a-41ca-9939-fd8d924472ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071366 Oct 25 03:14:46.592699 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1479/3127] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:46.712022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:46.738831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5ab0e757-a6c2-4808-9c5d-470af2e1061c tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.746549 Oct 25 03:14:46.739933 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1649/3128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:45 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:47.019708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:47.020736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:47.030461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:47.031317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:47.031980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:47.032947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:47.033658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:47.034356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:47.536994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:47.537728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:47.548610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:47.549704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:47.550290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:47.551253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:47.551920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:47.552575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:47.761073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:47.774964 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5386982e-b160-4aa8-82ba-574b6f690725 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 0.761346 Oct 25 03:14:47.776414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1480/3129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:47 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:47.782239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:47.783046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:47.790816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:47.791814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:47.792421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:47.793292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:47.794071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:47.795205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:48.386804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:48.410035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:48.413704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:48.418421 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5ee28c4f-0c99-4a8a-873a-cf4e47e43332 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.885484 Oct 25 03:14:48.419227 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1650/3130] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:47 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:14:48.616167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:48.632292 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-578b7a28-0b91-4581-97c6-d8bccedf219e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.851601 Oct 25 03:14:48.634545 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1481/3131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:47 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:48.699385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-16fad2c0-961e-441f-b826-1ae1ab268597 req-9700de2f-45a9-4e4b-a46d-84e73992a660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "name": "network-vif-unplugged", "status": "completed", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:48.723996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-16fad2c0-961e-441f-b826-1ae1ab268597 req-9700de2f-45a9-4e4b-a46d-84e73992a660 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:48.725467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-16fad2c0-961e-441f-b826-1ae1ab268597 req-9700de2f-45a9-4e4b-a46d-84e73992a660 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:48.727556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-16fad2c0-961e-441f-b826-1ae1ab268597 req-9700de2f-45a9-4e4b-a46d-84e73992a660 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:48.759761 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-16fad2c0-961e-441f-b826-1ae1ab268597 req-9700de2f-45a9-4e4b-a46d-84e73992a660 service nova] Creating event network-vif-unplugged:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h2-862355-1 Oct 25 03:14:48.773614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:48.777834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-16fad2c0-961e-441f-b826-1ae1ab268597 req-9700de2f-45a9-4e4b-a46d-84e73992a660 service nova] Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:14:48.802562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:48.803203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:48.813126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:48.813597 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-16fad2c0-961e-441f-b826-1ae1ab268597 req-9700de2f-45a9-4e4b-a46d-84e73992a660 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112889 Oct 25 03:14:48.813816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:48.814076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:48.815173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:48.815658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:48.816108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:48.816262 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1651/3132] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:49.451888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:49.452665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:49.475373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:49.482834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:49.483513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:49.484418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:49.485035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:49.485622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:49.906233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:49.910188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:14:49.928681 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b03f8ba3-48bf-4b8b-96c2-f966de4a3f55 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 1.131010 Oct 25 03:14:49.929734 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1482/3133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:48 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:49.939407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:49.941192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:49.957593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:49.958491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:49.960280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:49.961195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:49.963778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:49.964454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:50.805454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:50.818799 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4670753f-f55e-4715-99a2-8bf1a4bfe694 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.887750 Oct 25 03:14:50.819867 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1483/3134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:49 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:50.957278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:50.958160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:50.971418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:50.972583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:50.973269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:50.974288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:50.974988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:50.975649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:51.069599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:51.087211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:51.089077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:51.090574 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f49f76d-2794-4c61-af3d-81859d7051ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.644172 Oct 25 03:14:51.098495 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1652/3135] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:49 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:14:51.639006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-af608389-88f8-40e2-8f57-57a551a65504 req-3e95448f-2245-48fc-a05b-e6e2b55a77b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:51.654397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-af608389-88f8-40e2-8f57-57a551a65504 req-3e95448f-2245-48fc-a05b-e6e2b55a77b9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:51.660195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-af608389-88f8-40e2-8f57-57a551a65504 req-3e95448f-2245-48fc-a05b-e6e2b55a77b9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:51.661249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-af608389-88f8-40e2-8f57-57a551a65504 req-3e95448f-2245-48fc-a05b-e6e2b55a77b9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:51.701724 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-af608389-88f8-40e2-8f57-57a551a65504 req-3e95448f-2245-48fc-a05b-e6e2b55a77b9 service nova] Creating event network-changed:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h2-862355-1 Oct 25 03:14:51.712388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-af608389-88f8-40e2-8f57-57a551a65504 req-3e95448f-2245-48fc-a05b-e6e2b55a77b9 service nova] Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:14:51.739715 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-af608389-88f8-40e2-8f57-57a551a65504 req-3e95448f-2245-48fc-a05b-e6e2b55a77b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104397 Oct 25 03:14:51.742677 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1653/3136] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:14:51.848937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:51.850072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:51.863623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:51.870578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:51.871718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:51.874667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:51.875414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:51.876110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:52.274533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:52.283275 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11e305df-375f-4a20-bbb3-9c93de62f4b9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 1.330554 Oct 25 03:14:52.286549 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1484/3137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:50 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:14:52.294637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:52.300331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:52.312934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:52.318438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:52.318900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:52.319658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:52.320120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:52.320552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:52.509060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:52.525089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55a90ef4-b9a4-475f-a503-54755c2fe411 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.681295 Oct 25 03:14:52.542292 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1654/3138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:51 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:14:53.315061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:53.316060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:53.349393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:53.353950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:53.359040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:53.360087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:53.362863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:53.372388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:53.685428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:53.715058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:53.717015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:53.722231 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8237975-a823-4dbb-b64f-ecbf8fc08949 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.430274 Oct 25 03:14:53.723974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1485/3139] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:52 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:53.737633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:53.738275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:53.755536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:53.756408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:53.756560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:53.757194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:53.757656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:53.761967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:53.963893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:53.975268 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ebc3719-3593-41ac-a35c-1d55bc21fb03 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 0.664923 Oct 25 03:14:53.977496 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1655/3140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:53 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:54.633925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:54.649126 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-98326b11-1d41-4dd0-9548-1196fc7d5d70 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.923855 Oct 25 03:14:54.667134 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1486/3141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:53 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:54.750249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:54.750752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:54.757570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:54.762554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:54.763030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:54.774221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:54.775046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:54.775679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:55.016151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:55.017329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:55.030039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:55.033785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:55.034517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:55.036837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:55.037500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:55.043485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:56.006231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:56.015912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:56.017920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:56.019096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd70cefd-faf1-4e16-ab0c-7294be678ee3 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.272883 Oct 25 03:14:56.036319 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1656/3142] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:54 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:56.054798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:56.055479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:56.068360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:56.077585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:56.078121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:56.078385 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb2283ef-000b-42a0-a47a-9cca55e61217 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 1.083514 Oct 25 03:14:56.078557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:56.079269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:56.080242 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1487/3143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:54 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:14:56.080379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:56.080749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:56.533914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4d788c1e-5d12-48bc-9389-f3ed054d5271 req-9d58237d-d2b9-44c6-af89-39242f1025f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8438c652-4512-4af6-8e0f-c5e12b415d88", "name": "network-vif-plugged", "status": "completed", "tag": "d275481c-fcc6-441a-89cc-e10f6c02df4f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:14:56.545611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d788c1e-5d12-48bc-9389-f3ed054d5271 req-9d58237d-d2b9-44c6-af89-39242f1025f7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:56.557724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d788c1e-5d12-48bc-9389-f3ed054d5271 req-9d58237d-d2b9-44c6-af89-39242f1025f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:56.558371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d788c1e-5d12-48bc-9389-f3ed054d5271 req-9d58237d-d2b9-44c6-af89-39242f1025f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:56.559179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:56.572096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36215d62-3df4-43a6-aef4-4d83a535dd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1469 microversion: 2.1 time: 0.534654 Oct 25 03:14:56.589926 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1657/3144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:56 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1469 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:56.594218 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4d788c1e-5d12-48bc-9389-f3ed054d5271 req-9d58237d-d2b9-44c6-af89-39242f1025f7 service nova] Creating event network-vif-plugged:d275481c-fcc6-441a-89cc-e10f6c02df4f for instance 8438c652-4512-4af6-8e0f-c5e12b415d88 on n-h1-862355-1 Oct 25 03:14:56.609485 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4d788c1e-5d12-48bc-9389-f3ed054d5271 req-9d58237d-d2b9-44c6-af89-39242f1025f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079029 Oct 25 03:14:56.610175 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1488/3145] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:14:57.048863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:57.049522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:57.062680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:57.063167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:57.063601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:57.066678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:57.067152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:57.067591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:57.106196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:57.108143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:57.127043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:57.127467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:57.127902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:57.129164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:57.129632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:57.134270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:57.842367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:57.852016 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-886ed64d-ba65-41b6-af0f-e3f0e2198aee tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 0.749992 Oct 25 03:14:57.866248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1489/3146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:57 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:14:57.871386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:57.872178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:57.892324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:57.896840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:57.900637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:57.901616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:57.902306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:57.906086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:58.310217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:58.332398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:58.336732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:58.341367 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d6eedd9b-440a-47c3-90c8-6acc3f78ec01 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.297350 Oct 25 03:14:58.342705 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1658/3147] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:14:57 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:14:58.884057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:14:58.894219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:58.895099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:58.908451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b02c8d9e-6b5c-4531-9fc3-251d77b4afaa tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1462 microversion: 2.1 time: 1.039960 Oct 25 03:14:58.909629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:58.910347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:58.927297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:58.927862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1490/3148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:57 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1462 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:14:58.932430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:58.934664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:58.937957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:59.538785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:14:59.539738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:14:59.551434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:59.555508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:59.556764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:59.557625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:14:59.563894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:14:59.565745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:14:59.986333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:00.006280 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e78d627-57b1-472f-854f-deafeb987311 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1314 microversion: 2.1 time: 1.117136 Oct 25 03:15:00.006912 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1659/3149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:58 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1314 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:00.020542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:00.021162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:00.039981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:00.041651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:00.042167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:00.044390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:00.045050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:00.046408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:00.707055 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bdd99088-1a01-45cf-af85-1d03054d7bd8 tempest-MigrationsAdminTest-1267347640 tempest-MigrationsAdminTest-1267347640-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1613 microversion: 2.1 time: 1.773162 Oct 25 03:15:00.708592 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1491/3150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:14:58 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1613 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:00.753351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:00.755127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:00.777995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:00.779927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:00.780593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:00.787119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:00.824743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:00.826944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:00.920193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:15:01.171805 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4d005793-513a-43b7-b0b1-1936aca846dc tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 204 len: 0 microversion: 2.1 time: 0.425935 Oct 25 03:15:01.182135 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1492/3151] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:15:00 2022] DELETE /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:15:01.202146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-74d801d7-a01b-4e26-9822-c2136524a84b req-1f0ad479-b000-4907-9bff-3f47b3411566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "name": "network-vif-plugged", "status": "completed", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:01.224355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-74d801d7-a01b-4e26-9822-c2136524a84b req-1f0ad479-b000-4907-9bff-3f47b3411566 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:01.226469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-74d801d7-a01b-4e26-9822-c2136524a84b req-1f0ad479-b000-4907-9bff-3f47b3411566 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:01.227226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-74d801d7-a01b-4e26-9822-c2136524a84b req-1f0ad479-b000-4907-9bff-3f47b3411566 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:01.249028 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-74d801d7-a01b-4e26-9822-c2136524a84b req-1f0ad479-b000-4907-9bff-3f47b3411566 service nova] Creating event network-vif-plugged:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h2-862355-1 Oct 25 03:15:01.258382 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-74d801d7-a01b-4e26-9822-c2136524a84b req-1f0ad479-b000-4907-9bff-3f47b3411566 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063146 Oct 25 03:15:01.263916 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1493/3152] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:01.280609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:01.292537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:01.306634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:01.308582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:01.309825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:01.313025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:01.315466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:01.316045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:02.060493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:02.081994 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eaa67da6-0c41-4166-ad6d-8eac04345806 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1502 microversion: 2.1 time: 0.816594 Oct 25 03:15:02.082942 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1494/3153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:01 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1502 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:02.094480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:02.096098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:02.113148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:02.118360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:02.119049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:02.119968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:02.120624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:02.121233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:02.386221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:02.414154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:02.425478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:02.431604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4553054e-38b5-41c6-91ce-ed7cd066cb63 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 2.423640 Oct 25 03:15:02.436423 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1660/3154] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:00 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:02.448070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d4d05ad-e6b4-47a7-9412-dd491217684b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:02.466773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4d05ad-e6b4-47a7-9412-dd491217684b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:02.467590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4d05ad-e6b4-47a7-9412-dd491217684b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:02.468255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4d05ad-e6b4-47a7-9412-dd491217684b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:02.507097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d4d05ad-e6b4-47a7-9412-dd491217684b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:15:02.606311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:02.622999 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13f411ad-e1e9-41fe-8d2a-07fdd986b6ae tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1468 microversion: 2.1 time: 0.537516 Oct 25 03:15:02.624135 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1495/3155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:02 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1468 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:02.842726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d4d05ad-e6b4-47a7-9412-dd491217684b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88/action" status: 202 len: 0 microversion: 2.1 time: 0.404573 Oct 25 03:15:02.849609 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1661/3156] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:15:02 2022] POST /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:15:02.872596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:02.879236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:02.932906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1707178605", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "6427d142-9820-4b57-8069-4f18bec800ed"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:02.937791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:02.941103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:02.942386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:02.944711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:02.945427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:02.946973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:03.113147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] validate_networks() for [('6427d142-9820-4b57-8069-4f18bec800ed', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:15:03.663184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:03.673069 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d2417ea-6bde-4ad9-9b12-3047f576ec13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.818391 Oct 25 03:15:03.689706 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1662/3157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:02 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:03.689706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:03.689706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:03.708847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:03.709348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:03.709813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:03.710545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:03.710995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:03.711485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:04.252852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:04.271332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:04.273314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:04.277055 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-671964d9-539a-43f8-b144-9fc630c63c2e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.596480 Oct 25 03:15:04.278433 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1663/3158] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:03 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:04.285633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:04.299734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:04.316882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:04.321495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:04.322169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:04.323141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:04.323816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:04.324477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:04.649849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:04.659725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:15:04.660932 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1193b4b-d55f-4cae-ab11-04fad364ad40 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 200 len: 1426 microversion: 2.1 time: 0.380334 Oct 25 03:15:04.661243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:15:04.661787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:15:04.665926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:15:04.668205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:15:04.677229 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1664/3159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:04 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 1426 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:04.692120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:04.693045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:04.696075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:04.697778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:04.698688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:04.699897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:04.704815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:04.705439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:04.715494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:04.717807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:04.718527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:04.719439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:04.722286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:04.722934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:04.739944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Getting quotas for project 06f909703b14420996925ac2850f536a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:15:04.753189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Getting quotas for user 35575a22b7ce49b3b390e4578a00dfd5 and project 06f909703b14420996925ac2850f536a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:15:04.780027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:15:04.785838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:15:04.935375 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0498b07d-3a7c-4125-8f45-3d3c8831ec51 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.303160 Oct 25 03:15:04.941803 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1496/3160] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:15:04.961938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-efdec5a0-c0eb-4c04-9e29-344398868c34 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:04.977306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-efdec5a0-c0eb-4c04-9e29-344398868c34 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:05.098461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-efdec5a0-c0eb-4c04-9e29-344398868c34 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:05.105549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-efdec5a0-c0eb-4c04-9e29-344398868c34 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1224 microversion: 2.1 time: 0.156353 Oct 25 03:15:05.115600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1497/3161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:04 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1224 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:05.306490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:05.307269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:05.320777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:05.321281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:05.321746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:05.322618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:05.322915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:05.323346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.296910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:06.302754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:06.315137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:06.316815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:06.318199 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a97872ea-ec61-4821-aa2d-a25fb34ccdfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.015677 Oct 25 03:15:06.322463 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f45f4d2a-c8bc-4eb0-9bee-c66edabc917d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 1.619450 Oct 25 03:15:06.334812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1498/3162] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:05 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:15:06.341478 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1665/3163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:04 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:06.351724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:06.352952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 4cc0cffd-1c0d-4854-8a8a-855ace65a54a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:06.357212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-001c7a2b-b2c8-45b4-a6bd-d7584bc91ac1 req-8ac16912-a837-4c6b-9dfc-ade1e3523b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc0cffd-1c0d-4854-8a8a-855ace65a54a", "name": "network-vif-deleted", "tag": "e64f28d1-eadf-4c24-b766-5a5daeca6ff5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:06.371605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.372377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.373047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.374111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.380630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.381455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.397926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-001c7a2b-b2c8-45b4-a6bd-d7584bc91ac1 req-8ac16912-a837-4c6b-9dfc-ade1e3523b95 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.398479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-001c7a2b-b2c8-45b4-a6bd-d7584bc91ac1 req-8ac16912-a837-4c6b-9dfc-ade1e3523b95 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.398932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-001c7a2b-b2c8-45b4-a6bd-d7584bc91ac1 req-8ac16912-a837-4c6b-9dfc-ade1e3523b95 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.417536 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] HTTP exception thrown: Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a could not be found. Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Request method failure captured: Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a HTTP/1.1 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1NnWUYjsgv6RCrN4IzV-ys6xlgWQzo23QnbhEtYQcTSiKITKO-i3XTVRRnDjer4dbLc9DPs1BJGD-HM6E25FSDnC-DbzT0Ueb33eRqCOMKJo1lybD0Al_L-4x2m986MWDPzvxJK1COE6KBfiZ4qSpEK3aRNVLu1THZyWYJBoS8x02Q Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0db5b33c47fc46c2afca333ac440cf37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0db5b33c47fc46c2afca333ac440cf37"}]}] Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: a205c6ef239c44e8b2768df15ea8d943 Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a could not be found. Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '4cc0cffd-1c0d-4854-8a8a-855ace65a54a'} Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a could not be found. Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a could not be found. Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:06.426813 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:06.431245 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:06.431245 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:06.431245 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:06.431245 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:15:06.431245 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:15:06.431245 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a could not be found. Oct 25 03:15:06.431245 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:06.434883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Returning 404 to user: Instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:15:06.436030 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c949f28-fb39-4f17-8fc2-6d5904e092e7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a" status: 404 len: 111 microversion: 2.1 time: 0.099811 Oct 25 03:15:06.437294 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1499/3164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:06 2022] GET /compute/v2.1/servers/4cc0cffd-1c0d-4854-8a8a-855ace65a54a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:15:06.447686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:06.452350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:06.462638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.480217 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-001c7a2b-b2c8-45b4-a6bd-d7584bc91ac1 req-8ac16912-a837-4c6b-9dfc-ade1e3523b95 service nova] Creating event network-vif-deleted:e64f28d1-eadf-4c24-b766-5a5daeca6ff5 for instance 4cc0cffd-1c0d-4854-8a8a-855ace65a54a on n-h2-862355-1 Oct 25 03:15:06.482563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.483563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.484640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.486256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.487633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.530495 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-001c7a2b-b2c8-45b4-a6bd-d7584bc91ac1 req-8ac16912-a837-4c6b-9dfc-ade1e3523b95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170555 Oct 25 03:15:06.536096 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1666/3165] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:06.560876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:06.571959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:06.604961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.606050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.606741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.618123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.619207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.619675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.683203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:15:06.705318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:06.714407 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f476b798-e26a-483e-a27f-7f5efd5ef920 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1276 microversion: 2.1 time: 0.275782 Oct 25 03:15:06.722599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1500/3166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:06 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1276 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:06.749357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:06.894890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec6a597f-868f-41fb-b2d8-5c436cf3d870 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 204 len: 0 microversion: 2.1 time: 0.355818 Oct 25 03:15:06.896370 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1667/3167] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:15:06 2022] DELETE /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:15:06.904839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:06.906953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:06.930319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.930989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.931547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.936868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:06.942624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:06.943222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:06.993098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:07.351971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:07.354416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:07.380066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:07.393155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:07.393606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:07.398873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:07.399366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:07.399818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:07.605110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:07.614993 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d004432d-cdbb-479d-a27d-66a84240ce26 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1532 microversion: 2.1 time: 0.714371 Oct 25 03:15:07.620217 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1501/3168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:06 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1532 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:07.640505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:07.642193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:07.669464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:07.670390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:07.671074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:07.672027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:07.674245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:07.682122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:07.870467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:07.884731 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d30df50-dbd8-49b7-acd0-f5ddf61ae56d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.539907 Oct 25 03:15:07.889212 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1668/3169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:07 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:07.906910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:07.912336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:07.928935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:07.933406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:07.936365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:07.940155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:07.942001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:07.943525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:08.222122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:08.237962 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7749a69-13b8-4636-a9b5-bafa3795d7e1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1282 microversion: 2.1 time: 0.344700 Oct 25 03:15:08.240101 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1669/3170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:07 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1282 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:08.647006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:08.648338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:08.663206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:08.664097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:08.664717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:08.665880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:08.666562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:08.667143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:08.780428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:08.798728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:08.801950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:08.803206 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c08f2af4-401c-4978-8342-939f86cd2911 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.181699 Oct 25 03:15:08.807051 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1502/3171] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:07 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:08.916259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:08.916954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:08.934684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:08.935221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:08.935681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:08.936441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:08.945298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:08.946473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:09.385083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:09.395116 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67b7cb23-42c5-45f5-b609-0aaf464c645e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1532 microversion: 2.1 time: 0.751946 Oct 25 03:15:09.400913 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1670/3172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:08 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1532 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:09.405962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:09.415710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:09.427411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:09.428261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:09.428954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:09.429942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:09.430639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:09.431177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:09.654574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:09.663569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b24da875-be8e-4ff2-b1c8-31117f96b120 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1282 microversion: 2.1 time: 0.261150 Oct 25 03:15:09.674419 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1671/3173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:09 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:09.743404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:09.758788 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c0bf7277-d2b2-4381-88b8-c5d3dbc5e9c7 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.844957 Oct 25 03:15:09.769975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1503/3174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:08 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:09.835447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:09.836452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:09.846256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:09.850432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:09.851383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:09.852391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:09.853082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:09.866448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:10.427680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:10.428476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:10.450433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:10.451506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:10.452435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:10.455042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:10.455757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:10.456343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:10.675708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:10.696548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:10.699501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:10.709559 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c8a7796e-6165-4edb-a383-c127cf8e0b9b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.877848 Oct 25 03:15:10.710455 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1672/3175] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:09 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:15:10.715360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:10.716268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:10.737256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:10.737798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:10.738245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:10.738979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:10.739441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:10.739870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:10.914679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:10.928755 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8133f055-cc2f-49c2-ac6d-ae241cf0595f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1282 microversion: 2.1 time: 0.217055 Oct 25 03:15:10.948434 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1673/3176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:10 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:10.956680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:10.957495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:10.967820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:10.968327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:10.968769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:10.974580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:10.975074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:10.975525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:11.280244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:11.318864 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a44a5e99-06b9-4ffd-9c28-7524563017b7 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1532 microversion: 2.1 time: 0.893739 Oct 25 03:15:11.323273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1504/3177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:10 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1532 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:11.743732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:11.744445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:11.754620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:11.759858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:11.760565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:11.761524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:11.762806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:11.767371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:11.879345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:11.894139 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-72d4a1e7-19fd-4e56-9e74-5d1326eee850 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.936956 Oct 25 03:15:11.894832 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1674/3178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:10 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:11.952698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:11.953613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:11.960616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:11.972010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:11.972909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:11.973956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:11.974660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:11.975319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:12.455341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:12.474823 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9939724-e544-405b-b2fb-7a0f765d157e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.526370 Oct 25 03:15:12.475661 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1675/3179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:11 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:12.480306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-46e0f2c9-2f84-4266-9ff6-80326ead1f0f req-2cb7a569-cdb0-4c5d-b744-8c0c3d4ee465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda42aaf-7c35-41ad-a0d1-d46b9e587561", "name": "network-vif-deleted", "tag": "73df9db2-b5ae-4640-b2fc-6789fdb58fc1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:12.500052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-46e0f2c9-2f84-4266-9ff6-80326ead1f0f req-2cb7a569-cdb0-4c5d-b744-8c0c3d4ee465 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:12.500922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-46e0f2c9-2f84-4266-9ff6-80326ead1f0f req-2cb7a569-cdb0-4c5d-b744-8c0c3d4ee465 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:12.501632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-46e0f2c9-2f84-4266-9ff6-80326ead1f0f req-2cb7a569-cdb0-4c5d-b744-8c0c3d4ee465 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:12.514527 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-46e0f2c9-2f84-4266-9ff6-80326ead1f0f req-2cb7a569-cdb0-4c5d-b744-8c0c3d4ee465 service nova] Creating event network-vif-deleted:73df9db2-b5ae-4640-b2fc-6789fdb58fc1 for instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 on n-h2-862355-1 Oct 25 03:15:12.522477 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-46e0f2c9-2f84-4266-9ff6-80326ead1f0f req-2cb7a569-cdb0-4c5d-b744-8c0c3d4ee465 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045414 Oct 25 03:15:12.526191 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1676/3180] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:12.537771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:12.538479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:12.568535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:12.569038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:12.569484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:12.570235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:12.570705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:12.571133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:12.664658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:12.669821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:12.671478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:12.675528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lazy-loading 'fault' on Instance uuid eda42aaf-7c35-41ad-a0d1-d46b9e587561 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:15:12.754950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:12.776153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:12.783421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:12.789012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e200e8a5-819b-446b-8af0-effd94416767 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.049871 Oct 25 03:15:12.790597 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1505/3181] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:11 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:12.794748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:12.807883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f0455ed-b722-4f77-8220-07065b023401 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 200 len: 1367 microversion: 2.1 time: 0.280220 Oct 25 03:15:12.814687 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1677/3182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:12 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:12.922425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:12.923529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:12.941831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:12.944939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:12.945611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:12.947346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:12.948028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:12.948904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:13.246437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:13.257755 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11752e3c-f79d-4229-81ed-3b9971e394a6 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.339973 Oct 25 03:15:13.261077 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1506/3183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:12 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:13.506319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:13.507736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:13.510791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:13.522233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:13.529125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:13.530005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:13.531010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:13.533802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:13.534692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:13.541387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:13.542281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:13.556515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:13.558371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:13.559074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:13.560495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:13.562155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:13.565158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:13.566053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:13.903962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:13.927791 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ee3d44b-1ca1-4d57-9e89-08d340ad8324 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.388611 Oct 25 03:15:13.941702 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1507/3184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:13 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:13.941702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:13.941702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:13.944931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:13.946810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:13.947521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:13.948632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:13.949329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:13.950580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:14.120529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:14.139369 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb48b6b2-041b-40e1-9efd-9fe72f433a71 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.642714 Oct 25 03:15:14.141884 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1678/3185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:13 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:14.158633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:14.159600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: eda42aaf-7c35-41ad-a0d1-d46b9e587561] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:14.184898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:14.188256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:14.189054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:14.190449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:14.191680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:14.193090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:14.227390 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] HTTP exception thrown: Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 could not be found. Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Request method failure captured: Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 HTTP/1.1 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NnWUYjsgv6RCrN4IzV-ys6xlgWQzo23QnbhEtYQcTSiKITKO-i3XTVRRnDjer4dbLc9DPs1BJGD-HM6E25FSDnC-DbzT0Ueb33eRqCOMKJo1lybD0Al_L-4x2m986MWDPzvxJK1COE6KBfiZ4qSpEK3aRNVLu1THZyWYJBoS8x02Q Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0db5b33c47fc46c2afca333ac440cf37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0db5b33c47fc46c2afca333ac440cf37"}]}] Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: a205c6ef239c44e8b2768df15ea8d943 Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 could not be found. Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'eda42aaf-7c35-41ad-a0d1-d46b9e587561'} Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 could not be found. Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 could not be found. Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:14.232881 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 could not be found. Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Returning 404 to user: Instance eda42aaf-7c35-41ad-a0d1-d46b9e587561 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e031a0f3-833e-4f84-8cbd-2896bd2a778d tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561" status: 404 len: 111 microversion: 2.1 time: 0.093275 Oct 25 03:15:14.238270 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1679/3186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:14 2022] GET /compute/v2.1/servers/eda42aaf-7c35-41ad-a0d1-d46b9e587561 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:15:14.244163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-384880395"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:14.246757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:14.253799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:14.254461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:14.254907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:14.255603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:14.256188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:14.256889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:14.462716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:14.481473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:14.495509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:14.499869 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d13f9176-534b-4039-8d0d-c32764cfb589 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.569623 Oct 25 03:15:14.515600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1508/3187] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:13 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:14.524545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-6f464448-6580-4c14-8e2e-7b49e3fe74dc req-956dc05b-11c4-44eb-937c-e50cf4216714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b29de76-21f4-4f1e-9888-48fa586ee4d4", "tag": "c5ee39e9-f93c-425d-ac84-30fba25672de"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:14.548267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6f464448-6580-4c14-8e2e-7b49e3fe74dc req-956dc05b-11c4-44eb-937c-e50cf4216714 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:14.554117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6f464448-6580-4c14-8e2e-7b49e3fe74dc req-956dc05b-11c4-44eb-937c-e50cf4216714 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:14.554942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6f464448-6580-4c14-8e2e-7b49e3fe74dc req-956dc05b-11c4-44eb-937c-e50cf4216714 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:14.583987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-6f464448-6580-4c14-8e2e-7b49e3fe74dc req-956dc05b-11c4-44eb-937c-e50cf4216714 service nova] Creating event network-changed:c5ee39e9-f93c-425d-ac84-30fba25672de for instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 on n-h1-862355-1 Oct 25 03:15:14.591514 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-6f464448-6580-4c14-8e2e-7b49e3fe74dc req-956dc05b-11c4-44eb-937c-e50cf4216714 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072843 Oct 25 03:15:14.592814 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1509/3188] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:14.607153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-78e9c76e-9e99-4516-afe1-051c779ee9d8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '.version_select at 0x7efd33064940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:14.632699 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b066a566-5396-4485-b078-5b60e694c515 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.394303 Oct 25 03:15:14.636571 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1680/3189] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:15:14 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 25 03:15:14.643627 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-78e9c76e-9e99-4516-afe1-051c779ee9d8 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825503916" status: 202 len: 0 microversion: 2.1 time: 0.048294 Oct 25 03:15:14.644244 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1510/3190] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:15:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825503916 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:15:14.644480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:14.646422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:14.654407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:14.654905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:14.655347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:14.657534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:14.658038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:14.658526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:15.106711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:15.117545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ece3defd-2dd5-4d9a-9646-98aee075b1f8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.482313 Oct 25 03:15:15.122515 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1681/3191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:14 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:15.169998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:15.171484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:15.177450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:15.182515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:15.197331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:15.200460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:15.201348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:15.202456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:15.204065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:15.208397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:15.510061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:15.519611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-631684c4-ec3a-4c17-b7d3-141d5a64a959 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.356688 Oct 25 03:15:15.520816 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1511/3192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:15 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:15.554453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:15.555341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:15.562439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:15.564525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:15.565148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:15.566103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:15.570709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:15.571164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:16.143316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:16.147971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:16.148807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:16.157721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:16.158185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:16.158626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:16.159340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:16.159798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:16.160230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:16.197704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:16.209361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:16.211108 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-367a72d8-eb64-4f8f-8dca-2f2aaedaa425 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.669696 Oct 25 03:15:16.222153 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1682/3193] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:15 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:16.548433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:16.549067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:16.566483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:16.567249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:16.567866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:16.568787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:16.569416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:16.570055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:16.585146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:16.731177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:16.746594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-891f950f-a9e2-4b52-8b3c-d2819c4c2fa9 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.602297 Oct 25 03:15:16.747913 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1512/3194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:16 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:17.246104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:17.247128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:17.264203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:17.265094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:17.266674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:17.274399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:17.274967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:17.276194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:17.337084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:17.351119 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33051a2c-f6bb-4330-b8a2-4bfa96b25b10 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.806435 Oct 25 03:15:17.352402 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1683/3195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:16 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:17.369023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:17.370021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:17.387748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:17.392976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:17.393837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:17.395470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:17.398044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:17.400488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:17.450262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:15:17.552161 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-642b55b8-ce23-48b7-a60b-00d94a1389d0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 204 len: 0 microversion: 2.1 time: 0.186807 Oct 25 03:15:17.553488 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1684/3196] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:15:17 2022] DELETE /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:15:17.563922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:17.564968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:17.572564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:17.573417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:17.574012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:17.575453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:17.576135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:17.576677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:17.971194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:17.974332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:17.984296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:17.989567 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c853335f-f3ad-4ceb-83b2-f70c2956af1b tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1469 microversion: 2.1 time: 0.431278 Oct 25 03:15:17.991675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:17.992904 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce7f0a9d-6e99-41a4-b80e-514ac37a1927 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.751130 Oct 25 03:15:17.995599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1513/3197] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:17 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:15:18.007707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:18.008556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:18.016803 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1685/3198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:17 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:18.017441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:18.018184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:18.018790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:18.019681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:18.020299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:18.020893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:18.381953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:18.386659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:18.401207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:18.402438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:18.403160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:18.404074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:18.405747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:18.406444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:18.420427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:18.439699 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08095739-09b3-47ef-8217-3c67429abc22 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.433621 Oct 25 03:15:18.441474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1514/3199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:18 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:18.883255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:18.905476 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-29b3638d-ac8d-4d41-bea5-8579a4eed66f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.531305 Oct 25 03:15:18.909385 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1686/3200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:18 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:19.020619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:19.021353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:19.023659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:19.025080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:19.035454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.036596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.038690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:19.040067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.040691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.041352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.042783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.043355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:19.044187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:19.045298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.046979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.048506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:19.490078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:19.505371 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58b1fa31-336a-4f4a-851f-fce43ecc59cd tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1469 microversion: 2.1 time: 0.489895 Oct 25 03:15:19.506737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1515/3201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:19 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1469 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:19.512234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:19.513445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:19.529545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.530389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.531685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:19.532714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.533660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.534280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:19.537094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:19.549010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:19.558650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:19.566808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0641c0a5-713c-4837-8619-8abe0504af25 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.547409 Oct 25 03:15:19.568558 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1687/3202] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:19 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:19.886880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:19.898900 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f0a3f59e-a03d-46c0-84be-9b873cc61a9d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.390756 Oct 25 03:15:19.917141 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1516/3203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:19 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:19.941227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:19.942462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:19.964563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.965309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.966262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:19.967540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:19.970747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:19.971379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:20.464179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7a7324f1-23d7-46bc-97de-f6f453f99100 req-a8346b72-dc32-4522-b2f2-c427fec8e864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56dad91-2314-4ab2-8f7b-b39e9fb7b718", "name": "network-vif-deleted", "tag": "a58f5c84-d26c-4f37-af47-222a12750747"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:20.493049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a7324f1-23d7-46bc-97de-f6f453f99100 req-a8346b72-dc32-4522-b2f2-c427fec8e864 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:20.493552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a7324f1-23d7-46bc-97de-f6f453f99100 req-a8346b72-dc32-4522-b2f2-c427fec8e864 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:20.495823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a7324f1-23d7-46bc-97de-f6f453f99100 req-a8346b72-dc32-4522-b2f2-c427fec8e864 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:20.524781 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7a7324f1-23d7-46bc-97de-f6f453f99100 req-a8346b72-dc32-4522-b2f2-c427fec8e864 service nova] Creating event network-vif-deleted:a58f5c84-d26c-4f37-af47-222a12750747 for instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 on n-h1-862355-1 Oct 25 03:15:20.536379 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7a7324f1-23d7-46bc-97de-f6f453f99100 req-a8346b72-dc32-4522-b2f2-c427fec8e864 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076294 Oct 25 03:15:20.537009 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1517/3204] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:20.565291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:20.566488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:20.576348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:20.577162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:20.578734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:20.579724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:20.580348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:20.581022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:20.785976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:20.794491 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe885ba4-28ef-49ad-a7b4-e3d18adbd688 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 200 len: 1298 microversion: 2.1 time: 0.248487 Oct 25 03:15:20.797971 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1518/3205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:20 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 1298 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:20.806019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:20.814274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:20.850220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:20.850728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:20.853348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:20.855273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:20.856048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:20.865544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:20.877649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:20.890429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a564a5c0-bf01-4062-9151-275a9ef735d1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.959546 Oct 25 03:15:20.892616 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1688/3206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:19 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:20.925348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:20.931744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:20.956474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:20.956933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:20.959583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:20.960503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:20.967334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:20.968684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:21.336953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:21.351372 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fbb0e9a2-8515-4a5c-bfd9-703fa342337b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.428211 Oct 25 03:15:21.370951 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1689/3207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:20 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:21.431697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:21.442936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:21.444389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:21.464246 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-45851e78-53e9-4fb3-b509-d98711a32698 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.664921 Oct 25 03:15:21.465940 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1519/3208] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:20 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:21.826819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:21.827445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: c56dad91-2314-4ab2-8f7b-b39e9fb7b718] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:21.832805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-90cfb1cb-1b96-40ad-99a5-4f5cd249da37 req-d87561bc-5a0b-407d-94d7-fd8295fcc7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "name": "network-vif-plugged", "status": "completed", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:21.846008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:21.846881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:21.847831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:21.848511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:21.848958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:21.849386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:21.852215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-90cfb1cb-1b96-40ad-99a5-4f5cd249da37 req-d87561bc-5a0b-407d-94d7-fd8295fcc7c4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:21.856206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-90cfb1cb-1b96-40ad-99a5-4f5cd249da37 req-d87561bc-5a0b-407d-94d7-fd8295fcc7c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:21.861911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-90cfb1cb-1b96-40ad-99a5-4f5cd249da37 req-d87561bc-5a0b-407d-94d7-fd8295fcc7c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:21.897540 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] HTTP exception thrown: Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 could not be found. Oct 25 03:15:21.901067 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-90cfb1cb-1b96-40ad-99a5-4f5cd249da37 req-d87561bc-5a0b-407d-94d7-fd8295fcc7c4 service nova] Creating event network-vif-plugged:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Request method failure captured: Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 HTTP/1.1 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NnWUYjsgv6RCrN4IzV-ys6xlgWQzo23QnbhEtYQcTSiKITKO-i3XTVRRnDjer4dbLc9DPs1BJGD-HM6E25FSDnC-DbzT0Ueb33eRqCOMKJo1lybD0Al_L-4x2m986MWDPzvxJK1COE6KBfiZ4qSpEK3aRNVLu1THZyWYJBoS8x02Q Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0db5b33c47fc46c2afca333ac440cf37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0db5b33c47fc46c2afca333ac440cf37"}]}] Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: a205c6ef239c44e8b2768df15ea8d943 Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 could not be found. Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'c56dad91-2314-4ab2-8f7b-b39e9fb7b718'} Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 could not be found. Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 could not be found. Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:21.910312 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:21.915634 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:21.915634 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:21.915634 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:21.915634 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:15:21.915634 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:15:21.915634 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 could not be found. Oct 25 03:15:21.915634 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:21.925164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Returning 404 to user: Instance c56dad91-2314-4ab2-8f7b-b39e9fb7b718 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:15:21.925596 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-90cfb1cb-1b96-40ad-99a5-4f5cd249da37 req-d87561bc-5a0b-407d-94d7-fd8295fcc7c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091366 Oct 25 03:15:21.926710 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1520/3209] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:21.927795 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d7415813-0fe6-464d-aee8-76fdb73157e0 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718" status: 404 len: 111 microversion: 2.1 time: 0.105908 Oct 25 03:15:21.932604 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1690/3210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:21 2022] GET /compute/v2.1/servers/c56dad91-2314-4ab2-8f7b-b39e9fb7b718 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:15:21.942899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:21.943908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:21.950948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:21.951628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:21.957702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:21.963988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:21.964826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:21.968725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:21.969530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:21.970225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:21.976927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:22.001321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.014727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.015434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:22.016830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.016925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.017341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:22.091866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:15:22.284326 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f732f0d-68b4-4280-8465-8ff3e7fef12e tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 204 len: 0 microversion: 2.1 time: 0.349346 Oct 25 03:15:22.287884 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1691/3211] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:15:21 2022] DELETE /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:15:22.293876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:22.294431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:22.309185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.309930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.310539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:22.314199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.314867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.316970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:22.425272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:22.439240 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a53aded-510e-4a8d-aea2-92b519d873c7 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.509583 Oct 25 03:15:22.441039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1521/3212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:21 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:22.449063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:22.455460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:22.467549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.471738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.472398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:22.473293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.473959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.474565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:22.633052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:22.643769 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2bb0191-4c3f-49f1-89cf-d51983c16208 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1468 microversion: 2.1 time: 0.354403 Oct 25 03:15:22.646694 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1692/3213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:22 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:22.669316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:22.672514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:22.692538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.693414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.694142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:22.697410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:22.701708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:22.705874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:23.403806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:23.431656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:23.435309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:23.440482 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-48cac9a5-afe0-46c5-8b65-fc0ae38508fe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.792482 Oct 25 03:15:23.441476 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1693/3214] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:22 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:23.465068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:23.465787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:23.476057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:23.476569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:23.477008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:23.480152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:23.480701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:23.481346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:23.900726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:23.910592 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f1245fa-1496-4bec-a990-5a67666fc1a2 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.450015 Oct 25 03:15:23.916760 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1694/3215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:23 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:23.922046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:23.936854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:23.949941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:23.957142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:23.957974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:23.959027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:23.959729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:23.960380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:24.122265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:24.130911 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1eac3922-bfdd-473b-946b-6c2c07c52c5c tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 1.688091 Oct 25 03:15:24.156839 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1522/3216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:22 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:24.177424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-07b96dea-eba1-4bf3-b47b-2f6a400f5dd4 req-87bb584c-6969-4f25-870f-9b3b14c73049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b29de76-21f4-4f1e-9888-48fa586ee4d4", "name": "network-vif-plugged", "status": "completed", "tag": "c5ee39e9-f93c-425d-ac84-30fba25672de"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:24.241212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-07b96dea-eba1-4bf3-b47b-2f6a400f5dd4 req-87bb584c-6969-4f25-870f-9b3b14c73049 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:24.244005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-07b96dea-eba1-4bf3-b47b-2f6a400f5dd4 req-87bb584c-6969-4f25-870f-9b3b14c73049 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:24.244629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-07b96dea-eba1-4bf3-b47b-2f6a400f5dd4 req-87bb584c-6969-4f25-870f-9b3b14c73049 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:24.283591 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-07b96dea-eba1-4bf3-b47b-2f6a400f5dd4 req-87bb584c-6969-4f25-870f-9b3b14c73049 service nova] Creating event network-vif-plugged:c5ee39e9-f93c-425d-ac84-30fba25672de for instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 on n-h1-862355-1 Oct 25 03:15:24.300595 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-07b96dea-eba1-4bf3-b47b-2f6a400f5dd4 req-87bb584c-6969-4f25-870f-9b3b14c73049 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142081 Oct 25 03:15:24.305909 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1523/3217] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:24.474078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:24.475024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:24.490209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:24.491426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:24.493167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:24.494138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:24.498279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:24.499113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:24.616849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:24.633895 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-807f490c-e888-4c2b-9322-4dce38012493 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1468 microversion: 2.1 time: 0.715331 Oct 25 03:15:24.637599 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1695/3218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:23 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1468 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:24.944048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:24.945082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:24.958648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:24.962524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:24.963950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:24.965642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:24.966525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:24.967215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:25.163347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:25.183867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:25.189770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:25.191937 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-357305f1-54e1-4d3e-905f-2b176c903fc1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.725302 Oct 25 03:15:25.193519 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1524/3219] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:24 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:25.201492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:25.203327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:25.222791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:25.223616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:25.224434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:25.225554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:25.226201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:25.226800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:25.627897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:25.640942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc3b6595-f340-4c39-8d4c-80c03aa131df tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1324 microversion: 2.1 time: 0.704787 Oct 25 03:15:25.646424 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1696/3220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:24 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1324 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:25.667548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:25.668588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:25.684438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:25.685230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:25.689019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:25.690967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:25.694156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:25.694820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:25.703179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:25.920722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:25.936963 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ec78372-606b-4c62-b713-f08c3be707df tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.739371 Oct 25 03:15:25.958628 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1525/3221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:25 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:26.224542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:26.226423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:26.249796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:26.250906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:26.251523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:26.255307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:26.259130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:26.262153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:26.328453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:26.340651 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9be03b4e-585d-4df0-adc6-f0c96549e601 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1468 microversion: 2.1 time: 0.677325 Oct 25 03:15:26.345009 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1697/3222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:25 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1468 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:26.674380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:26.676274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:26.694790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:26.695378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:26.695724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:26.697151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:26.699548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:26.700767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:26.820871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:26.838471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:26.840060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:26.841401 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f50b4ad6-ebae-422b-8d5b-e910e9ebf090 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.622321 Oct 25 03:15:26.842091 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1526/3223] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:26 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:26.849231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c4d242cd-8bca-4db5-bbce-a800b13416bf req-001fdddb-4169-47eb-aea3-40fdee6a61df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb018e4-b858-42fa-9832-79fbfe052184", "name": "network-vif-deleted", "tag": "69d5e780-5c64-43de-bb3f-d32a4862274d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:26.877560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c4d242cd-8bca-4db5-bbce-a800b13416bf req-001fdddb-4169-47eb-aea3-40fdee6a61df service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:26.878071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c4d242cd-8bca-4db5-bbce-a800b13416bf req-001fdddb-4169-47eb-aea3-40fdee6a61df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:26.878508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c4d242cd-8bca-4db5-bbce-a800b13416bf req-001fdddb-4169-47eb-aea3-40fdee6a61df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:26.903883 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c4d242cd-8bca-4db5-bbce-a800b13416bf req-001fdddb-4169-47eb-aea3-40fdee6a61df service nova] Creating event network-vif-deleted:69d5e780-5c64-43de-bb3f-d32a4862274d for instance 2eb018e4-b858-42fa-9832-79fbfe052184 on n-h2-862355-1 Oct 25 03:15:26.922197 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c4d242cd-8bca-4db5-bbce-a800b13416bf req-001fdddb-4169-47eb-aea3-40fdee6a61df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078383 Oct 25 03:15:26.923174 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1527/3224] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:26.964546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:26.965792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:26.978101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:26.978883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:26.979502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:26.983462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:26.984206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:26.984817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:27.329050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:27.340836 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-731d8d52-327c-4a76-94af-239aef1fe746 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1520 microversion: 2.1 time: 0.671341 Oct 25 03:15:27.342047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1698/3225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:26 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1520 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:27.369357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:27.370012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:27.380457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:27.381928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:27.382602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:27.384299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:27.384981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:27.388567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:27.514550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:27.515598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:27.516063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:27.516718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lazy-loading 'fault' on Instance uuid 2eb018e4-b858-42fa-9832-79fbfe052184 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:15:27.613802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:27.630556 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d367285-74af-45fc-995f-3e261b8daeb0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1512 microversion: 2.1 time: 0.671460 Oct 25 03:15:27.642989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a205c6ef239c44e8b2768df15ea8d943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db5b33c47fc46c2afca333ac440cf37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:27.654435 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1528/3226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:26 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1512 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:27.660124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b42e629c-9d07-47cf-887a-a802136a7eee tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 200 len: 1302 microversion: 2.1 time: 0.293262 Oct 25 03:15:27.661889 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1699/3227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:27 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 1302 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:27.681364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f992206-fafa-49d5-95e6-ab473d86f9f9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'create', calling method: .version_select at 0x7efd3b81eaf0>, body: {"pool": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:27.872104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:27.873629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:27.901590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:27.905190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:27.910629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:27.911674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:27.912361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:27.913179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:28.386028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:28.401571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:28.407998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:28.409593 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d79cfa0b-0abf-4af3-a6d6-4c622228abd7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.541750 Oct 25 03:15:28.410757 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1700/3228] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:27 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:28.660091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:28.660684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:28.674190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:28.674694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:28.675141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:28.675858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:28.676315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:28.680617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:29.222818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:29.236502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff9e1714-01af-4556-83d0-9b8992aa92bd tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1489 microversion: 2.1 time: 0.583378 Oct 25 03:15:29.242053 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1701/3229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:28 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1489 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:29.250573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:29.251235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] [instance: 2eb018e4-b858-42fa-9832-79fbfe052184] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:29.262544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:29.268311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:29.268990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:29.270004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:29.270634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:29.271253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:29.304686 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] HTTP exception thrown: Instance 2eb018e4-b858-42fa-9832-79fbfe052184 could not be found. Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Request method failure captured: Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 HTTP/1.1 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1NnWUYjsgv6RCrN4IzV-ys6xlgWQzo23QnbhEtYQcTSiKITKO-i3XTVRRnDjer4dbLc9DPs1BJGD-HM6E25FSDnC-DbzT0Ueb33eRqCOMKJo1lybD0Al_L-4x2m986MWDPzvxJK1COE6KBfiZ4qSpEK3aRNVLu1THZyWYJBoS8x02Q Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0db5b33c47fc46c2afca333ac440cf37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0db5b33c47fc46c2afca333ac440cf37", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0db5b33c47fc46c2afca333ac440cf37"}]}] Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0db5b33c47fc46c2afca333ac440cf37 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-MigrationsAdminTest-508861197 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: a205c6ef239c44e8b2768df15ea8d943 Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-MigrationsAdminTest-508861197-project Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 2eb018e4-b858-42fa-9832-79fbfe052184 could not be found. Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2eb018e4-b858-42fa-9832-79fbfe052184'} Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb018e4-b858-42fa-9832-79fbfe052184 could not be found. Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb018e4-b858-42fa-9832-79fbfe052184 could not be found. Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:29.306740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:29.312815 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:29.312815 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:29.312815 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:29.312815 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:15:29.312815 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:15:29.312815 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb018e4-b858-42fa-9832-79fbfe052184 could not be found. Oct 25 03:15:29.312815 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:15:29.317073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] Returning 404 to user: Instance 2eb018e4-b858-42fa-9832-79fbfe052184 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:15:29.320125 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a97edbb7-9803-4566-b9a7-bfe5ad94cd66 tempest-MigrationsAdminTest-508861197 tempest-MigrationsAdminTest-508861197-project] 10.222.0.36 "GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184" status: 404 len: 111 microversion: 2.1 time: 0.075059 Oct 25 03:15:29.321703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1702/3230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:29 2022] GET /compute/v2.1/servers/2eb018e4-b858-42fa-9832-79fbfe052184 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:15:29.329284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:29.330741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:29.372972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:29.379965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:29.380702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:29.382348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:29.388447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:29.389100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:29.449492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:15:29.736552 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eba8309b-3dff-4c33-b1ea-0f0fb57dcd99 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 204 len: 0 microversion: 2.1 time: 0.413116 Oct 25 03:15:29.739936 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1703/3231] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:15:29 2022] DELETE /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:15:29.747573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:29.748662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:29.757696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:29.758643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:29.759752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:29.761068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:29.761929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:29.762636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:30.328640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:30.349138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:30.352653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:30.356730 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd5b5186-d2ab-47fa-b6b0-9c47f288c0bc tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.613114 Oct 25 03:15:30.384145 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1704/3232] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:29 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:30.392595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:30.394162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:30.407915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:30.408724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:30.409334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:30.411853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:30.412933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:30.415001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:31.184416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:31.202829 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6f61398-b8ec-49bc-91ff-ac85feb0dd27 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1495 microversion: 2.1 time: 0.816749 Oct 25 03:15:31.206957 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1705/3233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:30 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1495 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:31.219888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1b2283d6-85d9-4496-9693-bb8f4aaa85a0 req-c9375295-a68b-4f0e-9112-07507e1fdebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-plugged", "status": "completed", "tag": "5328eb15-eb4f-4c5d-a324-41e317e5b958"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:31.245153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1b2283d6-85d9-4496-9693-bb8f4aaa85a0 req-c9375295-a68b-4f0e-9112-07507e1fdebe service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:31.247412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1b2283d6-85d9-4496-9693-bb8f4aaa85a0 req-c9375295-a68b-4f0e-9112-07507e1fdebe service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:31.248576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1b2283d6-85d9-4496-9693-bb8f4aaa85a0 req-c9375295-a68b-4f0e-9112-07507e1fdebe service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:31.298046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1b2283d6-85d9-4496-9693-bb8f4aaa85a0 req-c9375295-a68b-4f0e-9112-07507e1fdebe service nova] Creating event network-vif-plugged:5328eb15-eb4f-4c5d-a324-41e317e5b958 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:31.313479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1b2283d6-85d9-4496-9693-bb8f4aaa85a0 req-c9375295-a68b-4f0e-9112-07507e1fdebe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102388 Oct 25 03:15:31.316737 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1706/3234] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:31.402383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:31.406349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:31.419086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:31.419968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:31.420752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:31.422285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:31.423388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:31.427907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:31.900800 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f992206-fafa-49d5-95e6-ab473d86f9f9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.242449 Oct 25 03:15:31.902845 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1529/3235] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:15:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:32.113258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-19139886", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "6427d142-9820-4b57-8069-4f18bec800ed"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:32.253589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] validate_networks() for [('6427d142-9820-4b57-8069-4f18bec800ed', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:15:32.890344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:32.908930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:32.923815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:32.925071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2e4cf36b-37f5-4f0d-b258-a111a46d9e67 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.536771 Oct 25 03:15:32.937078 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1707/3236] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:31 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:32.956352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:32.956974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:32.973159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:32.973661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:32.974155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:32.974883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:32.975378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:32.975814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:33.691830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:33.708141 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09cb246e-cb85-4c03-a2d5-13680103f3bf tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1495 microversion: 2.1 time: 0.769419 Oct 25 03:15:33.718420 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1708/3237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:32 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1495 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:33.729036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6215e9d1-c0b7-4889-8766-53beb9822c42 req-f20814b2-8ad7-47f3-8993-909bb37c1938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-plugged", "status": "completed", "tag": "4e479d1c-2ec3-4733-93c5-74f7e16c3d8e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:33.740361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6215e9d1-c0b7-4889-8766-53beb9822c42 req-f20814b2-8ad7-47f3-8993-909bb37c1938 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:33.741262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6215e9d1-c0b7-4889-8766-53beb9822c42 req-f20814b2-8ad7-47f3-8993-909bb37c1938 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:33.743566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6215e9d1-c0b7-4889-8766-53beb9822c42 req-f20814b2-8ad7-47f3-8993-909bb37c1938 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:33.771325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:15:33.771963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:15:33.772456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:15:33.772865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:15:33.773480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:15:33.788845 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6215e9d1-c0b7-4889-8766-53beb9822c42 req-f20814b2-8ad7-47f3-8993-909bb37c1938 service nova] Creating event network-vif-plugged:4e479d1c-2ec3-4733-93c5-74f7e16c3d8e for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:33.795013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6215e9d1-c0b7-4889-8766-53beb9822c42 req-f20814b2-8ad7-47f3-8993-909bb37c1938 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075095 Oct 25 03:15:33.800036 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1709/3238] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:33.800697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:33.801194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:33.803405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:33.804209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:33.804682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:33.805115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:33.890385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Getting quotas for project 06f909703b14420996925ac2850f536a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:15:33.902562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Getting quotas for user 35575a22b7ce49b3b390e4578a00dfd5 and project 06f909703b14420996925ac2850f536a. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:15:33.951466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:15:33.958105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:15:33.971526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:33.972291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:33.991947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:33.993153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:33.993620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:33.994401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:33.995431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:33.996635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:34.156114 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ae2d927b-3552-48c1-ae2d-40fed45eb7da tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.047109 Oct 25 03:15:34.157546 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1530/3239] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:15:34.172981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-919079ad-e908-496e-9807-5f3db8308cd6 req-ab86e730-3a7d-41fe-ad56-58c18609ef29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8438c652-4512-4af6-8e0f-c5e12b415d88", "name": "network-vif-deleted", "tag": "d275481c-fcc6-441a-89cc-e10f6c02df4f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:34.201588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-919079ad-e908-496e-9807-5f3db8308cd6 req-ab86e730-3a7d-41fe-ad56-58c18609ef29 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:34.204665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-919079ad-e908-496e-9807-5f3db8308cd6 req-ab86e730-3a7d-41fe-ad56-58c18609ef29 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:34.205445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-919079ad-e908-496e-9807-5f3db8308cd6 req-ab86e730-3a7d-41fe-ad56-58c18609ef29 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:34.244530 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-919079ad-e908-496e-9807-5f3db8308cd6 req-ab86e730-3a7d-41fe-ad56-58c18609ef29 service nova] Creating event network-vif-deleted:d275481c-fcc6-441a-89cc-e10f6c02df4f for instance 8438c652-4512-4af6-8e0f-c5e12b415d88 on n-h1-862355-1 Oct 25 03:15:34.276770 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-919079ad-e908-496e-9807-5f3db8308cd6 req-ab86e730-3a7d-41fe-ad56-58c18609ef29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117417 Oct 25 03:15:34.278176 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1531/3240] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:34.288696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ae95e0b6-ec98-4a64-8034-dd3582ea9d07 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:34.290465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ae95e0b6-ec98-4a64-8034-dd3582ea9d07 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:34.571052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ae95e0b6-ec98-4a64-8034-dd3582ea9d07 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:34.602266 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ae95e0b6-ec98-4a64-8034-dd3582ea9d07 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1222 microversion: 2.1 time: 0.318226 Oct 25 03:15:34.607031 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1532/3241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:34 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:34.874932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:34.890188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:34.899832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:34.911726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d81c745-7d31-4b50-8d14-fb633d24c0f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 0.948607 Oct 25 03:15:34.917916 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1710/3242] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:33 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:15:35.278803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:35.279427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:35.308207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.308711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.309155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:35.310064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.341588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.342250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:35.465199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.469340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.471932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:35.472720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lazy-loading 'fault' on Instance uuid 8438c652-4512-4af6-8e0f-c5e12b415d88 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:15:35.639270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:35.639824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:35.652667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:35.666171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.668270 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dfeb07f7-1ed8-4c6f-b506-68a6c36d7506 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 200 len: 1304 microversion: 2.1 time: 0.933618 Oct 25 03:15:35.670177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.689721 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1533/3243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:34 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 1304 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:35.691240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:35.692230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.692719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.695785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:35.828350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-027a79ad-e1b4-41ac-9f65-350ecbece5c1 req-64c53691-d9ca-4ef8-8938-3b95b71f3fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-plugged", "status": "completed", "tag": "141be093-c60d-42b1-9db8-3125a19fb6bd"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:35.850663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-027a79ad-e1b4-41ac-9f65-350ecbece5c1 req-64c53691-d9ca-4ef8-8938-3b95b71f3fad service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.851730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-027a79ad-e1b4-41ac-9f65-350ecbece5c1 req-64c53691-d9ca-4ef8-8938-3b95b71f3fad service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.852828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-027a79ad-e1b4-41ac-9f65-350ecbece5c1 req-64c53691-d9ca-4ef8-8938-3b95b71f3fad service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:35.886273 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-027a79ad-e1b4-41ac-9f65-350ecbece5c1 req-64c53691-d9ca-4ef8-8938-3b95b71f3fad service nova] Creating event network-vif-plugged:141be093-c60d-42b1-9db8-3125a19fb6bd for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:35.898949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-027a79ad-e1b4-41ac-9f65-350ecbece5c1 req-64c53691-d9ca-4ef8-8938-3b95b71f3fad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075570 Oct 25 03:15:35.902676 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1534/3244] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:15:35.953691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:35.954655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:35.971535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.972739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.974510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:35.977491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:35.978529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:35.980743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:36.767330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:36.779729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0beac301-e14e-4122-88db-79c3645015ba tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1226 microversion: 2.1 time: 1.145420 Oct 25 03:15:36.798957 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1711/3245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:35 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1226 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:36.960118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Action: 'update', calling method: .version_select at 0x7efd3b8ba280>, body: {"quota_set": {"ram": "5120"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:37.163647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.165863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.167437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.170207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.171607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.174273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.270638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:37.287460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:37.290842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:37.292452 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d7ef305-28af-43ba-8831-f76824e7072f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.345388 Oct 25 03:15:37.293971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:37.294430 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1535/3246] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:35 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:15:37.296157 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6345b452-3e55-4421-80ef-a2d3b0574fc0 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822" status: 200 len: 148 microversion: 2.57 time: 0.493196 Oct 25 03:15:37.296783 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1712/3247] 10.222.0.36 () {62 vars in 1303 bytes} [Tue Oct 25 03:15:36 2022] PUT /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822 => generated 148 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:15:37.313561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Calling method '.version_select at 0x7efd3b872040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:37.315779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:37.318371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:37.338546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.340070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.340752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.341836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.343260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.343947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.363679 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 HTTP/1.1 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '8438c652-4512-4af6-8e0f-c5e12b415d88'} Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:15:37.365864 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:37.370369 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:15:37.370369 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:15:37.370369 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:15:37.370369 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:15:37.370369 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:15:37.370369 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:15:37.370369 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:15:37.375458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:15:37.376653 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-463c9e73-2f96-42ac-8da7-5d7622e7c030 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 404 len: 111 microversion: 2.1 time: 0.081059 Oct 25 03:15:37.377903 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1536/3248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:37 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:15:37.644598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1626026450", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "399e4372-9a26-4378-9554-8714a7affe92"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:37.739690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.743252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.743722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.745148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.745617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.747938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.810494 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-618028fc-97c4-422a-850d-fc8e011717a9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822/detail" status: 200 len: 463 microversion: 2.57 time: 0.504998 Oct 25 03:15:37.815629 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1713/3249] 10.222.0.36 () {60 vars in 1304 bytes} [Tue Oct 25 03:15:37 2022] GET /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822/detail => generated 463 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:15:37.830711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:37.833490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:37.848362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.848865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.849539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.850467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:37.852495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:37.853121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:37.921802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] validate_networks() for [('399e4372-9a26-4378-9554-8714a7affe92', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:15:38.350948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:38.362905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5da518ec-b9f2-4b09-93a5-4c50aa44d028 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1280 microversion: 2.1 time: 0.539335 Oct 25 03:15:38.365835 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1714/3250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:37 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1280 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:38.388334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7edc8c2b-d06c-4055-822a-d1908e91f018 req-7d0821b2-cddd-425b-947d-53e2f12285c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-plugged", "status": "completed", "tag": "e1d5c65f-29a1-4d46-81b5-e60b72731e38"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:38.417184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7edc8c2b-d06c-4055-822a-d1908e91f018 req-7d0821b2-cddd-425b-947d-53e2f12285c3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:38.419445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7edc8c2b-d06c-4055-822a-d1908e91f018 req-7d0821b2-cddd-425b-947d-53e2f12285c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:38.420130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7edc8c2b-d06c-4055-822a-d1908e91f018 req-7d0821b2-cddd-425b-947d-53e2f12285c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:38.425192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:38.464915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7edc8c2b-d06c-4055-822a-d1908e91f018 req-7d0821b2-cddd-425b-947d-53e2f12285c3 service nova] Creating event network-vif-plugged:e1d5c65f-29a1-4d46-81b5-e60b72731e38 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:38.486621 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7edc8c2b-d06c-4055-822a-d1908e91f018 req-7d0821b2-cddd-425b-947d-53e2f12285c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118070 Oct 25 03:15:38.491409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1715/3251] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:38.504447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Action: 'update', calling method: .version_select at 0x7efd3373af70>, body: {"quota_set": {"ram": "2048"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:39.101184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.101833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.102919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.103664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.104128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.104560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.187834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.188334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.188783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.198673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.200952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:15:39.202626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:15:39.202786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.203140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.203862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:15:39.204486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:15:39.205301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:15:39.219835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.220710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.221364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.222428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.223244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.224006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.246444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:15:39.254985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Getting quotas for user 256827a36f464fe1b535d91f95e48681 and project ec96fdcf66774081b73265ebef1577c9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:15:39.273021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:15:39.276700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:15:39.343965 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-10c4723b-b4b3-43af-80f6-10a7276cf1b9 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822?user_id=d2558c78f7c543c5afba9de7ae794a1d" status: 200 len: 148 microversion: 2.57 time: 0.851008 Oct 25 03:15:39.355716 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1716/3252] 10.222.0.36 () {62 vars in 1384 bytes} [Tue Oct 25 03:15:38 2022] PUT /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822?user_id=d2558c78f7c543c5afba9de7ae794a1d => generated 148 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:15:39.361046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:39.361822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:39.374899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.375541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.377151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.378068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.380122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.380774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.381588 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3dcc5bc1-23ce-492e-8075-8b3186a3b0b5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743895 Oct 25 03:15:39.382955 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1537/3253] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:15:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:15:39.388135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10fc78f8-8192-4cf8-9887-125b6b95a839 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] Calling method '.version_select at 0x7efd330645e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:39.608455 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-10fc78f8-8192-4cf8-9887-125b6b95a839 tempest-QuotasAdminTestV257-2008864456 tempest-QuotasAdminTestV257-2008864456-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822?user_id=d2558c78f7c543c5afba9de7ae794a1d" status: 200 len: 190 microversion: 2.57 time: 0.220361 Oct 25 03:15:39.612632 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1538/3254] 10.222.0.36 () {60 vars in 1364 bytes} [Tue Oct 25 03:15:39 2022] GET /compute/v2.1/os-quota-sets/57b22552257041299a51b5526fe03822?user_id=d2558c78f7c543c5afba9de7ae794a1d => generated 190 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:15:39.630738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:39.632690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:39.652134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:39.658969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.663142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.664091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.666988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:39.669088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:39.670537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:39.842517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:39.857790 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ccd4b86-58d2-4715-8c5b-324422ae89f3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1280 microversion: 2.1 time: 0.243750 Oct 25 03:15:39.859608 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1539/3255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:39 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:39.882461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a18d9cb0-7718-4669-9860-71cbf051e6fb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:39.883108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a18d9cb0-7718-4669-9860-71cbf051e6fb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:40.048318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a18d9cb0-7718-4669-9860-71cbf051e6fb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:40.062739 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a18d9cb0-7718-4669-9860-71cbf051e6fb tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1215 microversion: 2.1 time: 0.201963 Oct 25 03:15:40.064172 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1540/3256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:39 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:40.533083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-plugged", "status": "completed", "tag": "49f692b2-342c-4715-a3bf-8de914655333"}, {"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-plugged", "status": "completed", "tag": "42f8ac95-4a46-470d-9f6c-1d1045fbf922"}, {"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-plugged", "status": "completed", "tag": "b72ec6e2-76b3-491d-b4dc-5e311cf014e2"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:40.561763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:40.564776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:40.568793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:40.601534 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] Creating event network-vif-plugged:49f692b2-342c-4715-a3bf-8de914655333 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:40.602281 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] Creating event network-vif-plugged:42f8ac95-4a46-470d-9f6c-1d1045fbf922 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:40.603131 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] Creating event network-vif-plugged:b72ec6e2-76b3-491d-b4dc-5e311cf014e2 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:40.662472 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-00cf34db-485f-4ad4-bad1-a2d79658710e req-1dab067c-fdf6-46d5-9a5d-f8f12a3194ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.124821 Oct 25 03:15:40.663212 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1541/3257] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:40.710885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:40.733288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:40.738668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:40.745064 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f845e221-1df0-45e8-a600-9aad7d30cab9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.387097 Oct 25 03:15:40.767381 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1717/3258] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:39 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:40.923088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:40.928905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:40.955621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:40.956127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:40.956569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:40.962897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:40.963403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:40.968996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:41.094121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:41.095137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:41.117882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:41.120841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:41.121799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:41.127391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:41.129029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:41.132050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:41.437101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:41.446053 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c8dc6b3-ebf2-4957-b3c9-a4330aecb6cf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1322 microversion: 2.1 time: 0.565032 Oct 25 03:15:41.465765 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1542/3259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:40 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:41.500850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:41.510768 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-540cbdef-01dd-4f19-8e50-86095522bafa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1267 microversion: 2.1 time: 0.423000 Oct 25 03:15:41.528291 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1718/3260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:41 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1267 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:41.781588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:41.782897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:41.794002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:41.794505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:41.794948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:41.798542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:41.799453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:41.800136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:42.472544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:42.473763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:42.487051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:42.491024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:42.491714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:42.492620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:42.495196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:42.495855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:42.770543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:42.788205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:42.794338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:42.796404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42f654c0-c243-477d-8d00-63281fb459f2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1878 microversion: 2.42 time: 1.019261 Oct 25 03:15:42.798429 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1543/3261] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:41 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1878 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:42.815914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:42.816857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:42.829883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:42.834085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:42.834883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:42.835779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:42.839636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:42.840748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:43.151739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:43.166385 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-396ea5da-a1db-4be9-a697-af0ce28edc6e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1322 microversion: 2.1 time: 0.694118 Oct 25 03:15:43.182560 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1719/3262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:42 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1322 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:43.286277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:43.299480 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07f3bd1b-fc3d-46ec-a205-44f357b39f15 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1273 microversion: 2.1 time: 0.499586 Oct 25 03:15:43.300129 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1544/3263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:42 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1273 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:43.723659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d2d9ebde-b348-462a-9439-25b1f956815d req-3b6883ab-99c6-48fb-99b3-e1569bd0e3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b005fb5c-ecfe-44f8-a41e-624bf0dc7043", "tag": "dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:43.748023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d2d9ebde-b348-462a-9439-25b1f956815d req-3b6883ab-99c6-48fb-99b3-e1569bd0e3fe service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:43.749115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d2d9ebde-b348-462a-9439-25b1f956815d req-3b6883ab-99c6-48fb-99b3-e1569bd0e3fe service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:43.749548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d2d9ebde-b348-462a-9439-25b1f956815d req-3b6883ab-99c6-48fb-99b3-e1569bd0e3fe service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:43.798431 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d2d9ebde-b348-462a-9439-25b1f956815d req-3b6883ab-99c6-48fb-99b3-e1569bd0e3fe service nova] Creating event network-changed:dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1 for instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 on n-h1-862355-1 Oct 25 03:15:43.823613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d2d9ebde-b348-462a-9439-25b1f956815d req-3b6883ab-99c6-48fb-99b3-e1569bd0e3fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103573 Oct 25 03:15:43.829614 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1720/3264] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:43.831595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:43.833774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:43.890068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:43.897671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:43.898347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:43.902312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:43.906782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:43.913202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:44.197558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:44.198315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:44.216279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:44.222362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:44.222922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:44.223706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:44.224186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:44.224621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:44.926612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:44.953401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:44.956302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:44.959908 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc3b4ffd-7108-4d6d-8002-b3491c4ec58f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2833 microversion: 2.42 time: 1.137790 Oct 25 03:15:44.974692 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1545/3265] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:15:43 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2833 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:15:44.974692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:44.974692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:45.007244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:45.008196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:45.008981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:45.009919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:45.011144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:45.013200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:45.190367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:45.207549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:45.211902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3524d7b-1485-4c8e-ace1-2ab41fe5d333 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1273 microversion: 2.1 time: 0.250402 Oct 25 03:15:45.219119 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1546/3266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:44 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:45.237563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:45.239382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:45.255239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:45.259353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:45.259986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:45.264312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:45.266985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:45.267594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:45.423720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:45.432883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df77a52a-bd5a-4052-9cfb-0838c318d1b9 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1322 microversion: 2.1 time: 1.245371 Oct 25 03:15:45.436483 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1721/3267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:44 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1322 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:45.477548 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6672d09e-7386-4e95-9287-9f84e7d6d18f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.256950 Oct 25 03:15:45.478411 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1547/3268] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 25 03:15:45 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b/os-interface => generated 1830 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:15:46.244463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:46.245093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:46.252112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:46.252586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:46.253321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:46.254341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:46.255083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:46.255754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:46.454419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:46.458316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:46.465386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:46.465927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:46.466460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:46.467831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:46.468332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:46.468764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:46.683669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:46.697519 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d97ca6d-a7b0-43ed-a168-eebcbda2020d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.247969 Oct 25 03:15:46.699710 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1548/3269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:46 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:46.705620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:46.706477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:46.714135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:46.715520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:46.716394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:46.718056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:46.718773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:46.719291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:46.942058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:46.950654 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3aa0b5b9-d30a-4425-900c-8b4700528505 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1322 microversion: 2.1 time: 0.248823 Oct 25 03:15:46.966251 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1549/3270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:46 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:47.111569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:47.123979 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd2efa99-a474-4aae-add7-3e8594ab5655 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.882246 Oct 25 03:15:47.126053 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1722/3271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:46 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:47.724277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:47.724888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:47.738791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:47.739959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:47.740597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:47.741535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:47.751404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:47.755354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:47.981807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:47.982620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:47.990765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:47.991281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:47.991763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:47.992428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:47.993056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:47.993492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:48.047670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:48.056740 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6545c676-675b-4543-ba5b-935cb2fecb6a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.336315 Oct 25 03:15:48.067697 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1550/3272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:47 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:48.093170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-329267022"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:48.096092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:48.115678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:48.116378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:48.117177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:48.118125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:48.118762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:48.119363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:48.487413 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b075c254-8794-4e1b-8bc8-e7e52aafe971 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.398552 Oct 25 03:15:48.490593 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1551/3273] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:15:48 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 25 03:15:48.507968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:48.512186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:48.536643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:48.537919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:48.539348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:48.541774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:48.545337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:48.546382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:48.794436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:48.808241 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef1e0d9c-0b1c-4e83-9df2-241a9e528129 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.315069 Oct 25 03:15:48.809725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1552/3274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:48 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:48.814247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:48.816583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:48.818359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:48.825319 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eda31e12-1a1f-4d1d-877d-84decb64814f tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1322 microversion: 2.1 time: 0.846969 Oct 25 03:15:48.827552 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1723/3275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:47 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:48.830861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:48.831369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:48.831819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:48.832603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:48.833073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:48.833509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:49.087094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:49.096482 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-29f40a13-047e-410d-8e34-7ecf7da819ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.285583 Oct 25 03:15:49.098847 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1553/3276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:48 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:49.342347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=9 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:49.343553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=22 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:49.624959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1071470969", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:49.706551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:15:49.816523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-98d0ebfa-c94b-446e-b837-8c8d966a863d req-f311fb51-458b-40fa-8f17-59c565a5fac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b005fb5c-ecfe-44f8-a41e-624bf0dc7043", "name": "network-vif-plugged", "status": "completed", "tag": "dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:49.828623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:49.832891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-98d0ebfa-c94b-446e-b837-8c8d966a863d req-f311fb51-458b-40fa-8f17-59c565a5fac0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:49.833891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-98d0ebfa-c94b-446e-b837-8c8d966a863d req-f311fb51-458b-40fa-8f17-59c565a5fac0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:49.834573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-98d0ebfa-c94b-446e-b837-8c8d966a863d req-f311fb51-458b-40fa-8f17-59c565a5fac0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:49.852636 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-98d0ebfa-c94b-446e-b837-8c8d966a863d req-f311fb51-458b-40fa-8f17-59c565a5fac0 service nova] Creating event network-vif-plugged:dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1 for instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 on n-h1-862355-1 Oct 25 03:15:49.858253 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-98d0ebfa-c94b-446e-b837-8c8d966a863d req-f311fb51-458b-40fa-8f17-59c565a5fac0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045525 Oct 25 03:15:49.859594 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1554/3277] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:49.867273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:49.868616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:49.878203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:49.879083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:49.879777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:49.880844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:49.881552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:49.882293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:50.053194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=20 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:50.113790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:50.121878 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6605519-0890-4167-bd51-f9e7651a24e8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.260564 Oct 25 03:15:50.126552 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1555/3278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:49 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:50.143243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:50.144244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:50.156731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:50.157231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:50.157691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:50.158543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:50.158857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:50.159283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:50.472888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:50.484003 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0b1ac6d-0dc8-4fe4-8335-523e69460b53 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1322 microversion: 2.1 time: 0.355837 Oct 25 03:15:50.484596 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1556/3279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:50 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:50.497015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:50.499982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:50.530380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:50.534410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:50.535694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:50.538141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:50.540023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:50.542076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:50.949255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:50.965791 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5df0dac-0333-4fc3-85bd-607165917b9c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1686 microversion: 2.1 time: 0.479959 Oct 25 03:15:50.968110 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1557/3280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:50 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1686 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:50.978752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-45388c9f-4d77-43ee-a228-64409aca1c9d req-9f0ed683-6183-4427-97ef-e52fd71c8b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "tag": "b72ec6e2-76b3-491d-b4dc-5e311cf014e2"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:51.015577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-45388c9f-4d77-43ee-a228-64409aca1c9d req-9f0ed683-6183-4427-97ef-e52fd71c8b38 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.016709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-45388c9f-4d77-43ee-a228-64409aca1c9d req-9f0ed683-6183-4427-97ef-e52fd71c8b38 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.017151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-45388c9f-4d77-43ee-a228-64409aca1c9d req-9f0ed683-6183-4427-97ef-e52fd71c8b38 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.039395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-45388c9f-4d77-43ee-a228-64409aca1c9d req-9f0ed683-6183-4427-97ef-e52fd71c8b38 service nova] Creating event network-changed:b72ec6e2-76b3-491d-b4dc-5e311cf014e2 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:15:51.047383 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-45388c9f-4d77-43ee-a228-64409aca1c9d req-9f0ed683-6183-4427-97ef-e52fd71c8b38 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076808 Oct 25 03:15:51.050565 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1558/3281] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:51.143102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:15:51.143584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:15:51.143969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:15:51.144381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:15:51.144800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:15:51.151594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:51.152587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:51.157508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.159682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.160391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.161391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.162120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.162763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.163247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.163949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.167568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.168313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.168780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.176973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.199227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Getting quotas for project 08fac472c3ce42adbece8aed49aa9073. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:15:51.209317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Getting quotas for user 86f1785d7d4a476ea54a4c2f0ceb3609 and project 08fac472c3ce42adbece8aed49aa9073. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:15:51.230228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:15:51.236480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:15:51.314780 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a48d7405-70ec-44d5-aabb-f7ed3ba0f0d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979069 Oct 25 03:15:51.316203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1724/3282] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:15:51.333349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-400a641b-42fc-4423-ae1d-f44faee78c42 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:51.335455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-400a641b-42fc-4423-ae1d-f44faee78c42 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:51.566907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-400a641b-42fc-4423-ae1d-f44faee78c42 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:51.573220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:51.575185 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-400a641b-42fc-4423-ae1d-f44faee78c42 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1222 microversion: 2.1 time: 0.251733 Oct 25 03:15:51.578121 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1725/3283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:51 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:15:51.581789 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2f70899f-a10e-43ac-9536-8f05973dd70b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.435959 Oct 25 03:15:51.594665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:51.595477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:51.607958 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1559/3284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:51 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:51.609281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.617464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.620554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.621718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.622361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.624182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.916005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-03f9f6eb-a0cc-49ec-9ca3-6c45a79f1f08 req-49188ceb-15bf-4a1a-801d-178e95073f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "name": "network-vif-unplugged", "status": "completed", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:51.940002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-03f9f6eb-a0cc-49ec-9ca3-6c45a79f1f08 req-49188ceb-15bf-4a1a-801d-178e95073f4d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:51.940499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-03f9f6eb-a0cc-49ec-9ca3-6c45a79f1f08 req-49188ceb-15bf-4a1a-801d-178e95073f4d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:51.940949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-03f9f6eb-a0cc-49ec-9ca3-6c45a79f1f08 req-49188ceb-15bf-4a1a-801d-178e95073f4d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:51.971468 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-03f9f6eb-a0cc-49ec-9ca3-6c45a79f1f08 req-49188ceb-15bf-4a1a-801d-178e95073f4d service nova] Creating event network-vif-unplugged:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:15:51.985183 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-03f9f6eb-a0cc-49ec-9ca3-6c45a79f1f08 req-49188ceb-15bf-4a1a-801d-178e95073f4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073536 Oct 25 03:15:51.990409 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1560/3285] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:15:52.019391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:52.020363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:52.040011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:52.040519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:52.040960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:52.049801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:52.050347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:52.050796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:52.489351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:52.500821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19a8225e-5909-4570-86b9-723540b4162c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1322 microversion: 2.1 time: 0.921256 Oct 25 03:15:52.502567 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1726/3286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:51 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1322 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:52.603928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:52.604278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:52.614140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:52.614994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:52.615689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:52.616651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:52.617384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:52.618076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:52.936715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:52.954739 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f8f6f8a1-7b17-4563-a5d9-e89e79deacb2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1686 microversion: 2.1 time: 0.961583 Oct 25 03:15:52.977412 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1561/3287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:51 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1686 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:52.987869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:52.988495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:53.028674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:53.034007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:53.035095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:53.036466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:53.037610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:53.040412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:53.224557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:53.241263 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-163eda5c-1e66-4c5c-8e7f-b5db2e96a17c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1218 microversion: 2.1 time: 0.641692 Oct 25 03:15:53.243290 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1727/3288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:52 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1218 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:53.251802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-70de8acd-3dc1-4e3b-901f-845c28b8b868 req-c17eb2c7-8be3-4299-89b1-61e224abe2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5a50018-0a6d-4bc6-b6fe-c14435b3121b", "tag": "c086db93-eb6f-4686-9f46-ddbd9a174148"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:53.276780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-70de8acd-3dc1-4e3b-901f-845c28b8b868 req-c17eb2c7-8be3-4299-89b1-61e224abe2af service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:53.277279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-70de8acd-3dc1-4e3b-901f-845c28b8b868 req-c17eb2c7-8be3-4299-89b1-61e224abe2af service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:53.279755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-70de8acd-3dc1-4e3b-901f-845c28b8b868 req-c17eb2c7-8be3-4299-89b1-61e224abe2af service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:53.309652 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-70de8acd-3dc1-4e3b-901f-845c28b8b868 req-c17eb2c7-8be3-4299-89b1-61e224abe2af service nova] Creating event network-changed:c086db93-eb6f-4686-9f46-ddbd9a174148 for instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b on n-h2-862355-1 Oct 25 03:15:53.329093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-70de8acd-3dc1-4e3b-901f-845c28b8b868 req-c17eb2c7-8be3-4299-89b1-61e224abe2af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084455 Oct 25 03:15:53.333515 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1728/3289] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:53.346254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:53.360351 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5362ac2a-75a5-4ed4-9645-cb04720b0ea4 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.381627 Oct 25 03:15:53.365839 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1562/3290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:52 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:53.548927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:53.558494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:53.571229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:53.572031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:53.572669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:53.573606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:53.574249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:53.574842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:53.987192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:53.987829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:54.001894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.002674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.005647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:54.008549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.009236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.011677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:54.482779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:54.498747 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f3f6ce3e-14ec-4fa1-9228-f6cfabfbff3c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 200 len: 1518 microversion: 2.1 time: 0.977028 Oct 25 03:15:54.550982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:54.575101 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e82be9b8-71f0-4775-95a9-d47d2023b262 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.594244 Oct 25 03:15:54.575704 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1729/3291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:53 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 1518 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:54.604137 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1563/3292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:53 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:54.614147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:54.633909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:54.641443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:54.642305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:54.677466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.679055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.681110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:54.686312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.687212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.689471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.692176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:54.692461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.696033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:54.697715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.703950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.705725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:54.756374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:15:54.854554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:54.867230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77eae0a5-d4fe-4fab-bbf3-9ba48c61ed11 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1280 microversion: 2.1 time: 0.289739 Oct 25 03:15:54.867863 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1730/3293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:54 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:54.884228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.180"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:54.903502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:54.955251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.959827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.960460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:54.961402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:54.965133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:54.965871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:55.065574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:15:55.066017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquired lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:15:55.191703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:55.213573 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36aa6c4b-9602-4b36-923f-9ba9377e0df5 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.607947 Oct 25 03:15:55.214306 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1564/3294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:54 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:55.636116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:55.636780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:55.652373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:55.657608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:55.658094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:55.658900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:55.659371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:55.659809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:56.839671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:56.853927 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca338f0a-0cba-4824-8869-b584f35221f5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 1.221738 Oct 25 03:15:56.859653 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1565/3295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:55 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:56.875949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:56.877209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:56.891580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:56.895922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:56.897371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:56.898489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:56.899592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:56.900637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:57.087673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:57.102288 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-789366d5-fe3b-463b-965a-a8614e0674d4 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1280 microversion: 2.1 time: 0.241165 Oct 25 03:15:57.103306 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1566/3296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:56 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:57.118376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:57.119241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:57.134724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:57.135565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:57.136291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:57.137230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:57.138627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:57.142110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:57.759472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:57.768852 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-127069ef-7dcf-4ef2-9265-466ea6a5e2c3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.664299 Oct 25 03:15:57.782164 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1567/3297] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:57 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:57.788174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-402100bd-f8c3-4e07-9946-df604b0dbcfa req-59bdca24-ccc3-48af-acf8-de522defd295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "name": "network-vif-plugged", "status": "completed", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:15:57.808069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-402100bd-f8c3-4e07-9946-df604b0dbcfa req-59bdca24-ccc3-48af-acf8-de522defd295 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:57.810475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-402100bd-f8c3-4e07-9946-df604b0dbcfa req-59bdca24-ccc3-48af-acf8-de522defd295 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:57.813008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-402100bd-f8c3-4e07-9946-df604b0dbcfa req-59bdca24-ccc3-48af-acf8-de522defd295 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:57.845170 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-402100bd-f8c3-4e07-9946-df604b0dbcfa req-59bdca24-ccc3-48af-acf8-de522defd295 service nova] Creating event network-vif-plugged:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:15:57.861248 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-402100bd-f8c3-4e07-9946-df604b0dbcfa req-59bdca24-ccc3-48af-acf8-de522defd295 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077322 Oct 25 03:15:57.862604 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1568/3298] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:15:57.887196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:57.887916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:57.902828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:57.905116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:57.905116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:57.905434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:57.909733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:57.910645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:58.281608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:58.296765 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-27129d2e-75c1-43de-a608-e4ad30469a1d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.413998 Oct 25 03:15:58.298688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1569/3299] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:57 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:58.312568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:58.313558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:58.325456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:58.328521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:58.329155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:58.332522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:58.334212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:58.334871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:58.898833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:15:58.924400 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b09467c1-cfc0-41da-baeb-a4afbeb28f7a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1322 microversion: 2.1 time: 0.624399 Oct 25 03:15:58.930442 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1570/3300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:58 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:15:58.940612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:15:58.943180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:15:58.954410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:58.956515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:58.958385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:15:58.959292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:15:58.961805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:15:58.963301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:00.498454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Building network info cache for instance {{(pid=120562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:16:00.851114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:00.861438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84d8c538-2f67-4ae8-9574-5af51707a65e tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 1.929409 Oct 25 03:16:00.875679 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1571/3301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:15:58 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:00.903129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:00.906839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:00.950188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:00.978612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:00.979151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:00.979931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:00.980402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:00.980839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:01.182252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:01.580828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:01.587691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:01.617859 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb84bf70-8bd7-4ba9-b4ce-d9a4c9b69f74 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.734326 Oct 25 03:16:01.643404 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1572/3302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:00 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:01.678899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:01.690505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:01.723726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:01.724242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:01.727054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:01.734172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:01.734983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:01.737910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:02.266646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Updating instance_info_cache with network_info: [{"id": "c5ee39e9-f93c-425d-ac84-30fba25672de", "address": "fa:16:3e:d9:9d:e3", "network": {"id": "6427d142-9820-4b57-8069-4f18bec800ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1957352803-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "06f909703b14420996925ac2850f536a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5ee39e9-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:16:02.293875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Releasing lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:16:02.295596 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d9652f49-9cec-4227-b376-dd2b14dd3b97 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action" status: 202 len: 0 microversion: 2.1 time: 7.418825 Oct 25 03:16:02.296358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1731/3303] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:15:54 2022] POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action => generated 0 bytes in 7420 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 25 03:16:02.310156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-82d8e1f6-7671-4b78-9bb8-1408ded2a406 req-3f7bfc3b-1d64-452b-a5a5-a33b4167020e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b29de76-21f4-4f1e-9888-48fa586ee4d4", "tag": "c5ee39e9-f93c-425d-ac84-30fba25672de"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:02.341713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-82d8e1f6-7671-4b78-9bb8-1408ded2a406 req-3f7bfc3b-1d64-452b-a5a5-a33b4167020e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:02.343148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-82d8e1f6-7671-4b78-9bb8-1408ded2a406 req-3f7bfc3b-1d64-452b-a5a5-a33b4167020e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:02.343148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-82d8e1f6-7671-4b78-9bb8-1408ded2a406 req-3f7bfc3b-1d64-452b-a5a5-a33b4167020e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:02.396027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-82d8e1f6-7671-4b78-9bb8-1408ded2a406 req-3f7bfc3b-1d64-452b-a5a5-a33b4167020e service nova] Creating event network-changed:c5ee39e9-f93c-425d-ac84-30fba25672de for instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 on n-h1-862355-1 Oct 25 03:16:02.405243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-82d8e1f6-7671-4b78-9bb8-1408ded2a406 req-3f7bfc3b-1d64-452b-a5a5-a33b4167020e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107526 Oct 25 03:16:02.408304 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1732/3304] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:02.422292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:02.426066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:02.446946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:02.448588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:02.449036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:02.453185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:02.455125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:02.456091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:02.790871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:02.800289 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7a6c0b2c-ad68-4ec8-811c-bb46c611c0e1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1322 microversion: 2.1 time: 1.149783 Oct 25 03:16:02.800812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1573/3305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:01 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1322 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:02.840063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'action', calling method: .version_select at 0x7efd392b0af0>, body: {"addFloatingIp": {"address": "172.25.3.180"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:02.852525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:02.874995 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ac03f13b-f9f8-457f-aa17-f462d983efe0 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1315 microversion: 2.1 time: 0.464322 Oct 25 03:16:02.875610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:02.878524 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1733/3306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:02 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:02.916574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:02.917709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:02.919622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-409dcc2d-ddaf-4aeb-bcdf-6f52d5294ae9 req-72ae7f2a-18e8-4bae-98a2-b8417e0fea99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a50018-0a6d-4bc6-b6fe-c14435b3121b", "name": "network-vif-plugged", "status": "completed", "tag": "c086db93-eb6f-4686-9f46-ddbd9a174148"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:02.922867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:02.927161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:02.928755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:02.929456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:02.958383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-409dcc2d-ddaf-4aeb-bcdf-6f52d5294ae9 req-72ae7f2a-18e8-4bae-98a2-b8417e0fea99 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:02.960625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-409dcc2d-ddaf-4aeb-bcdf-6f52d5294ae9 req-72ae7f2a-18e8-4bae-98a2-b8417e0fea99 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:02.962498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-409dcc2d-ddaf-4aeb-bcdf-6f52d5294ae9 req-72ae7f2a-18e8-4bae-98a2-b8417e0fea99 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:03.018971 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-409dcc2d-ddaf-4aeb-bcdf-6f52d5294ae9 req-72ae7f2a-18e8-4bae-98a2-b8417e0fea99 service nova] Creating event network-vif-plugged:c086db93-eb6f-4686-9f46-ddbd9a174148 for instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b on n-h2-862355-1 Oct 25 03:16:03.034033 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-409dcc2d-ddaf-4aeb-bcdf-6f52d5294ae9 req-72ae7f2a-18e8-4bae-98a2-b8417e0fea99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129461 Oct 25 03:16:03.034373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "refresh_cache-b005fb5c-ecfe-44f8-a41e-624bf0dc7043" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:16:03.034905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquired lock "refresh_cache-b005fb5c-ecfe-44f8-a41e-624bf0dc7043" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:16:03.036315 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1734/3307] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:03.053418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:03.061152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:03.076327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:03.077143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:03.077805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:03.080137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:03.081859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:03.082377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:03.686480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:03.702797 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1260dd16-329c-4c37-8b56-99ad06ff19b7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.659580 Oct 25 03:16:03.705037 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1735/3308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:03 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:03.826529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:03.827169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:03.854119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:03.854757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:03.855136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:03.855887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:03.856460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:03.857460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:03.868301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:05.220383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:05.239054 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4bf40eb-3461-4ac9-9ab5-2cea264905ad tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1322 microversion: 2.1 time: 1.419130 Oct 25 03:16:05.239685 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1736/3309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:03 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1322 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:05.261437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:05.264818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:05.280689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:05.283282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:05.285974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:05.287850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:05.288826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:05.290327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:05.604997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:05.633012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c3850b9-d063-4403-8269-921689e158b2 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1503 microversion: 2.1 time: 0.378988 Oct 25 03:16:05.634597 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1737/3310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:05 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:05.665398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:05.667750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:05.678422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:05.679389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:05.680099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:05.681079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:05.682286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:05.682991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:06.257432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:06.274855 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ddf9dba4-745d-4a1d-bda3-9dcf19db7332 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.617063 Oct 25 03:16:06.285706 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1738/3311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:05 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:06.289093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b1b6d980-7bec-4e33-979c-1af8c9d37f17 req-1280d10b-6dd9-4fb6-a351-1c8a137c2b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1755534-5ca4-47f2-ba94-a464160b6169", "tag": "fd861e0a-467e-4b26-9e99-a3e9a6449962"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:06.337566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b1b6d980-7bec-4e33-979c-1af8c9d37f17 req-1280d10b-6dd9-4fb6-a351-1c8a137c2b09 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:06.338164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b1b6d980-7bec-4e33-979c-1af8c9d37f17 req-1280d10b-6dd9-4fb6-a351-1c8a137c2b09 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:06.338602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b1b6d980-7bec-4e33-979c-1af8c9d37f17 req-1280d10b-6dd9-4fb6-a351-1c8a137c2b09 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:06.352145 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b1b6d980-7bec-4e33-979c-1af8c9d37f17 req-1280d10b-6dd9-4fb6-a351-1c8a137c2b09 service nova] Creating event network-changed:fd861e0a-467e-4b26-9e99-a3e9a6449962 for instance d1755534-5ca4-47f2-ba94-a464160b6169 on n-h1-862355-1 Oct 25 03:16:06.358532 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b1b6d980-7bec-4e33-979c-1af8c9d37f17 req-1280d10b-6dd9-4fb6-a351-1c8a137c2b09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079048 Oct 25 03:16:06.359777 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1739/3312] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:06.366317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:06.367245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:06.375945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:06.376852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:06.377603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:06.378503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:06.379133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:06.379750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:06.459416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lazy-loading 'flavor' on Instance uuid d5a50018-0a6d-4bc6-b6fe-c14435b3121b {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:16:06.656570 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9beae0fe-008b-4cc6-8eb9-70d1cee8deec tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "POST /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b/action" status: 202 len: 0 microversion: 2.1 time: 0.294873 Oct 25 03:16:06.669972 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1740/3313] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:06 2022] POST /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:16:06.693637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:06.698228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:06.712510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:06.716618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:06.719514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:06.722564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:06.723550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:06.724190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:06.724806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:07.114827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:07.123984 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d7d707a-35bb-4a62-9144-3c5584b04fa7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1322 microversion: 2.1 time: 0.449336 Oct 25 03:16:07.128475 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1741/3314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:06 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:07.134761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:07.135574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:07.145098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:07.149575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:07.150967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:07.152266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:07.154047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:07.154734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:07.486844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:07.500773 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5303d854-a877-4d5c-9408-9dc417518f69 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1511 microversion: 2.1 time: 0.367365 Oct 25 03:16:07.504250 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1742/3315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:07 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:07.521620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:07.527772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:07.544984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:07.546004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:07.546631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:07.547539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:07.548178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:07.548770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:07.808156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:07.820368 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd44fe22-21d3-4a47-acaf-ea7f8254d61f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.313009 Oct 25 03:16:07.821234 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1743/3316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:07 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:08.156682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:08.157881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:08.178040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:08.178939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:08.185953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:08.186997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:08.187947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:08.188556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:08.561142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:08.583702 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3bf69207-d47a-4e7f-85be-9052f1c96113 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1322 microversion: 2.1 time: 0.429991 Oct 25 03:16:08.584468 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1744/3317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:08 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:08.596149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7b983847-9d52-4fb1-9c07-59a9f6274501 req-d953a6a2-f9fe-4601-a02a-ab6c5d55b67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1755534-5ca4-47f2-ba94-a464160b6169", "name": "network-vif-plugged", "status": "completed", "tag": "fd861e0a-467e-4b26-9e99-a3e9a6449962"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:08.617309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7b983847-9d52-4fb1-9c07-59a9f6274501 req-d953a6a2-f9fe-4601-a02a-ab6c5d55b67a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:08.618527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7b983847-9d52-4fb1-9c07-59a9f6274501 req-d953a6a2-f9fe-4601-a02a-ab6c5d55b67a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:08.619697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7b983847-9d52-4fb1-9c07-59a9f6274501 req-d953a6a2-f9fe-4601-a02a-ab6c5d55b67a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:08.645412 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7b983847-9d52-4fb1-9c07-59a9f6274501 req-d953a6a2-f9fe-4601-a02a-ab6c5d55b67a service nova] Creating event network-vif-plugged:fd861e0a-467e-4b26-9e99-a3e9a6449962 for instance d1755534-5ca4-47f2-ba94-a464160b6169 on n-h1-862355-1 Oct 25 03:16:08.661821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7b983847-9d52-4fb1-9c07-59a9f6274501 req-d953a6a2-f9fe-4601-a02a-ab6c5d55b67a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074641 Oct 25 03:16:08.663335 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1745/3318] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:08.676836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:08.677891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:08.705379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:08.709848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:08.710436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:08.712170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:08.713470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:08.714191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:09.063636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:09.072048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f1b4fbf-e535-49bc-b94f-b6d587cef22f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1494 microversion: 2.1 time: 0.402156 Oct 25 03:16:09.082784 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1746/3319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:08 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1494 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:09.089085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:09.089922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:09.101711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:09.102475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:09.103098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:09.104150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:09.114428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:09.115220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:09.337415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:09.350956 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-506fe2b1-b1bd-4381-92ff-63a2d7513342 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.266783 Oct 25 03:16:09.352082 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1747/3320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:09 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:09.381460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:09.382862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:09.390647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:09.391834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:09.392285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:09.393919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:09.394515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:09.395165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:09.423978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:16:09.608783 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bb35963e-ff69-414a-b04d-583666737ec1 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 204 len: 0 microversion: 2.1 time: 0.240434 Oct 25 03:16:09.610194 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1748/3321] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:09 2022] DELETE /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:16:09.624365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:09.624365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:09.626169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:09.626879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:09.627533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:09.628567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:09.629240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:09.630088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:10.009968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:10.023738 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17018c58-4e5f-4d32-9e00-63779a314708 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1322 microversion: 2.1 time: 0.411420 Oct 25 03:16:10.038143 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1749/3322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:09 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:10.038143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:10.038711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:10.049753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:10.050248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:10.056937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:10.057822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:10.058375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:10.058926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:10.350172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:10.352607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:10.362662 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-986dea89-b0e9-47cd-a817-e77b2f1138b8 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1500 microversion: 2.1 time: 0.337194 Oct 25 03:16:10.363260 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1750/3323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:10 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1500 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:10.382090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:10.389183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:10.405663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:10.408298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:10.408945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:10.414214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:10.414938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:10.415668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:10.719136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:10.733723 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2409a74a-e92a-4440-a2ff-5e6b1738cc66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.352076 Oct 25 03:16:10.734387 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1751/3324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:10 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:11.071739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:11.073015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:11.081749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:11.082770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:11.083473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:11.084398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:11.085125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:11.085745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:11.472511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:11.496214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88411866-9771-4ccb-98c4-0ea3a4a7d7e7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1472 microversion: 2.1 time: 0.441049 Oct 25 03:16:11.503432 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1752/3325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:11 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1472 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:11.538922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:11.545101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:11.582742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:11.585849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:11.594007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:11.601733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:11.604871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:11.605581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:11.701470 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.network.neutron [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] re-assign floating IP 172.25.3.180 from instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 Oct 25 03:16:11.843619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Building network info cache for instance {{(pid=120563) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:16:12.169769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256827a36f464fe1b535d91f95e48681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96fdcf66774081b73265ebef1577c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:12.189504 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd202057-1c2c-4540-9b2c-71b7cd711868 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 200 len: 1500 microversion: 2.1 time: 0.682946 Oct 25 03:16:12.191307 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1753/3326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:11 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 1500 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:12.198367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6676b0d4-3398-4606-ae81-261b9f871185 req-2ae3a0de-8d60-4a17-a19d-9a7f07219802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b29de76-21f4-4f1e-9888-48fa586ee4d4", "tag": "c5ee39e9-f93c-425d-ac84-30fba25672de"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:12.247149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6676b0d4-3398-4606-ae81-261b9f871185 req-2ae3a0de-8d60-4a17-a19d-9a7f07219802 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:12.247999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6676b0d4-3398-4606-ae81-261b9f871185 req-2ae3a0de-8d60-4a17-a19d-9a7f07219802 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:12.251659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6676b0d4-3398-4606-ae81-261b9f871185 req-2ae3a0de-8d60-4a17-a19d-9a7f07219802 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:12.291747 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6676b0d4-3398-4606-ae81-261b9f871185 req-2ae3a0de-8d60-4a17-a19d-9a7f07219802 service nova] Creating event network-changed:c5ee39e9-f93c-425d-ac84-30fba25672de for instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 on n-h1-862355-1 Oct 25 03:16:12.318810 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6676b0d4-3398-4606-ae81-261b9f871185 req-2ae3a0de-8d60-4a17-a19d-9a7f07219802 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125843 Oct 25 03:16:12.325782 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1754/3327] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:12.916428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=73 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:12.924218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73e25c17-5ee3-4f1d-a180-eefc30387780 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:12.924937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73e25c17-5ee3-4f1d-a180-eefc30387780 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] [instance: 426a52e8-ed0f-4b60-bed2-2fb45e016079] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:12.944914 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-73e25c17-5ee3-4f1d-a180-eefc30387780 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] HTTP exception thrown: Instance 426a52e8-ed0f-4b60-bed2-2fb45e016079 could not be found. Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73e25c17-5ee3-4f1d-a180-eefc30387780 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Request method failure captured: Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/426a52e8-ed0f-4b60-bed2-2fb45e016079/action HTTP/1.1 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1TlYENugsk8OtFyROPk-y0w2QgjDXE_jHz6ni8jfwLxJA8kVxE5N9Q04f0MSXszNLB0UvsGihsevqU-sBxDMMHp2OBjc7yxlxzaifkWfZAhaWOCz57kT1bRRxebrqRIGWjsXkKnI3azXJ2mKOr6IlAFNRy7F9UD8elyqFo5NfJ1OP8 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1c1f5a775814b5391863c3e2d1ac037", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1c1f5a775814b5391863c3e2d1ac037"}]}] Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d061a5be306c4a698bec0eb1c1cdb4ad Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: {"migrate": {}} Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 426a52e8-ed0f-4b60-bed2-2fb45e016079 could not be found. Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '426a52e8-ed0f-4b60-bed2-2fb45e016079', 'body': {'migrate': {}}} Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426a52e8-ed0f-4b60-bed2-2fb45e016079 could not be found. Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426a52e8-ed0f-4b60-bed2-2fb45e016079 could not be found. Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:12.946639 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:12.952738 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:12.952738 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:12.952738 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:12.952738 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:12.952738 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426a52e8-ed0f-4b60-bed2-2fb45e016079 could not be found. Oct 25 03:16:12.952738 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:12.954540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73e25c17-5ee3-4f1d-a180-eefc30387780 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Returning 404 to user: Instance 426a52e8-ed0f-4b60-bed2-2fb45e016079 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:12.955603 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73e25c17-5ee3-4f1d-a180-eefc30387780 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/426a52e8-ed0f-4b60-bed2-2fb45e016079/action" status: 404 len: 111 microversion: 2.1 time: 0.626506 Oct 25 03:16:12.957309 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1755/3328] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:12 2022] POST /compute/v2.1/servers/426a52e8-ed0f-4b60-bed2-2fb45e016079/action => generated 111 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:12.970415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:12.971228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:12.991077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:12.994295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:12.995458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:12.996041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:12.997321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:13.006428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:13.329512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:13.339703 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a2cade2e-8f35-4532-bdc1-382bcc4171f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.381096 Oct 25 03:16:13.346971 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1756/3329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:12 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:13.353058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1982530997", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:13.483938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:16:14.486212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:16:14.486901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:16:14.487177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:16:14.487829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:16:14.488380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:16:14.514615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:14.515515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:14.516228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:14.517251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:14.521207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:14.522322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:14.573717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Getting quotas for project 08fac472c3ce42adbece8aed49aa9073. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:16:14.582814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Updating instance_info_cache with network_info: [{"id": "c5ee39e9-f93c-425d-ac84-30fba25672de", "address": "fa:16:3e:d9:9d:e3", "network": {"id": "6427d142-9820-4b57-8069-4f18bec800ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1957352803-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "06f909703b14420996925ac2850f536a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5ee39e9-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120563) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:16:14.588865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Getting quotas for user 86f1785d7d4a476ea54a4c2f0ceb3609 and project 08fac472c3ce42adbece8aed49aa9073. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:16:14.614212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Building network info cache for instance {{(pid=120563) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:16:14.623198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:16:14.625533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:16:14.738565 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e21a1cee-417e-405e-b733-82625a2df3b0 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.390161 Oct 25 03:16:14.742580 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1757/3330] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:16:14.753119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:14.767806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:14.792712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:14.793783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:14.794223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:14.794942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:14.795417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:14.796063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:14.830909 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b HTTP/1.1 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'd5a50018-0a6d-4bc6-b6fe-c14435b3121b'} Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:14.838587 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9a6cde8e-dc99-4d77-a59f-e94fff581770 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 404 len: 111 microversion: 2.1 time: 0.096678 Oct 25 03:16:14.850409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1758/3331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:14 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:14.851129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-24f6d170-e91c-454d-98c2-99ab6b61dba4 req-d962ba76-2adc-4c09-8925-e210502c3670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a50018-0a6d-4bc6-b6fe-c14435b3121b", "name": "network-vif-deleted", "tag": "c086db93-eb6f-4686-9f46-ddbd9a174148"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:14.872416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-24f6d170-e91c-454d-98c2-99ab6b61dba4 req-d962ba76-2adc-4c09-8925-e210502c3670 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:14.872917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-24f6d170-e91c-454d-98c2-99ab6b61dba4 req-d962ba76-2adc-4c09-8925-e210502c3670 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:14.873351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-24f6d170-e91c-454d-98c2-99ab6b61dba4 req-d962ba76-2adc-4c09-8925-e210502c3670 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:14.897707 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-24f6d170-e91c-454d-98c2-99ab6b61dba4 req-d962ba76-2adc-4c09-8925-e210502c3670 service nova] Creating event network-vif-deleted:c086db93-eb6f-4686-9f46-ddbd9a174148 for instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b on n-h2-862355-1 Oct 25 03:16:14.916207 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-24f6d170-e91c-454d-98c2-99ab6b61dba4 req-d962ba76-2adc-4c09-8925-e210502c3670 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073143 Oct 25 03:16:14.917665 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1759/3332] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:14.931429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:14.932310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:14.946649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:14.947150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:14.949526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:14.951188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:14.957177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:14.957795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:15.348710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:15.366887 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-899bdb8a-31d1-447c-aaa7-6d3762e346ad tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.445813 Oct 25 03:16:15.373203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1760/3333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:14 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:15.383046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef3f73c8-a476-42ed-a3da-9885926bb182 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:15.387128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef3f73c8-a476-42ed-a3da-9885926bb182 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:15.563824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ef3f73c8-a476-42ed-a3da-9885926bb182 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:15.571599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef3f73c8-a476-42ed-a3da-9885926bb182 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1222 microversion: 2.1 time: 0.197063 Oct 25 03:16:15.572193 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1761/3334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:15 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:15.585386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:15.587667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:15.613274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:15.621325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:15.622280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:15.627024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:15.628556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:15.629247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:15.712917 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b HTTP/1.1 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'd5a50018-0a6d-4bc6-b6fe-c14435b3121b'} Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:15.725771 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.735974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:15.738492 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a81ee58-5ed4-4791-a882-a1adb9b59081 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 404 len: 111 microversion: 2.1 time: 0.160714 Oct 25 03:16:15.740489 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1762/3335] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:15 2022] DELETE /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:15.745393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dc72e0ee-81b2-4c9c-8e98-a353901cb95d req-dd0db0e4-8245-4c08-a57e-fe8f637a131e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b005fb5c-ecfe-44f8-a41e-624bf0dc7043", "tag": "dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:15.775662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dc72e0ee-81b2-4c9c-8e98-a353901cb95d req-dd0db0e4-8245-4c08-a57e-fe8f637a131e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:15.776148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dc72e0ee-81b2-4c9c-8e98-a353901cb95d req-dd0db0e4-8245-4c08-a57e-fe8f637a131e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:15.776581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dc72e0ee-81b2-4c9c-8e98-a353901cb95d req-dd0db0e4-8245-4c08-a57e-fe8f637a131e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:15.833268 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dc72e0ee-81b2-4c9c-8e98-a353901cb95d req-dd0db0e4-8245-4c08-a57e-fe8f637a131e service nova] Creating event network-changed:dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1 for instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 on n-h1-862355-1 Oct 25 03:16:15.851655 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dc72e0ee-81b2-4c9c-8e98-a353901cb95d req-dd0db0e4-8245-4c08-a57e-fe8f637a131e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109754 Oct 25 03:16:15.862494 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1763/3336] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:15.868508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:15.869073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: d5a50018-0a6d-4bc6-b6fe-c14435b3121b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:15.890568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:15.891356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:15.892005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:15.893374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:15.894356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:15.895497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:15.935604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b HTTP/1.1 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'd5a50018-0a6d-4bc6-b6fe-c14435b3121b'} Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:15.937663 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.942889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:15.942889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:15.942889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:15.942889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:15.942889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:15.942889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. Oct 25 03:16:15.942889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:15.956280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance d5a50018-0a6d-4bc6-b6fe-c14435b3121b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:15.957219 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a2baac09-6606-4523-8812-ed68cdca28d3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b" status: 404 len: 111 microversion: 2.1 time: 0.093119 Oct 25 03:16:15.957925 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1764/3337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:15 2022] GET /compute/v2.1/servers/d5a50018-0a6d-4bc6-b6fe-c14435b3121b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:15.969994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:15.979807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.009140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.009958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.010604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.013469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.014143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.014744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.073133 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 HTTP/1.1 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8438c652-4512-4af6-8e0f-c5e12b415d88'} Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:16.075027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f63a0846-29b6-4177-82cc-365d2a00c862 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 404 len: 111 microversion: 2.1 time: 0.110446 Oct 25 03:16:16.081549 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1765/3338] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:15 2022] DELETE /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:16.099697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:16.102889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 8438c652-4512-4af6-8e0f-c5e12b415d88] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.122962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.123888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.124601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.125578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.126817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.127558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.147298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 HTTP/1.1 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8438c652-4512-4af6-8e0f-c5e12b415d88'} Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.150524 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.155165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.155165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.155165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.155165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:16.155165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:16.155165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. Oct 25 03:16:16.155165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.159788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 8438c652-4512-4af6-8e0f-c5e12b415d88 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:16.160836 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01c2099a-affc-4006-adb5-6d2525c9d09f tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88" status: 404 len: 111 microversion: 2.1 time: 0.077679 Oct 25 03:16:16.161646 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1766/3339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:16 2022] GET /compute/v2.1/servers/8438c652-4512-4af6-8e0f-c5e12b415d88 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:16.173839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:16.174644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.181900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.182749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.183426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.184986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.185707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.186390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.205278 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d HTTP/1.1 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '3124ad5d-3bef-4651-b4f4-b205d004398d'} Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:16.207609 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.213002 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.216643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:16.217818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-78bbd934-d400-4879-a31c-019b0cd7b59b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 404 len: 111 microversion: 2.1 time: 0.050800 Oct 25 03:16:16.222357 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1767/3340] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:16 2022] DELETE /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:16:16.228080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:16.229005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 3124ad5d-3bef-4651-b4f4-b205d004398d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.237585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.238729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.240105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.241125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.241928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.242602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.282542 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d HTTP/1.1 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '3124ad5d-3bef-4651-b4f4-b205d004398d'} Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.287562 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.292355 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.292355 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.292355 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.292355 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:16.292355 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:16.292355 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. Oct 25 03:16:16.292355 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.298384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 3124ad5d-3bef-4651-b4f4-b205d004398d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:16.299572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f177fbb2-77dc-499d-858e-c067330be10d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d" status: 404 len: 111 microversion: 2.1 time: 0.075951 Oct 25 03:16:16.311492 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1768/3341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:16 2022] GET /compute/v2.1/servers/3124ad5d-3bef-4651-b4f4-b205d004398d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:16.333519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:16.334514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.350153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.357359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.358388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.359689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.360396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.361086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.390824 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 HTTP/1.1 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '40f89739-25c6-4c83-91c6-f723d7ae0d75'} Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:16.392632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.396946 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.398433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:16.400049 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f65ba0f-5826-4166-b927-099e3c6e6c13 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 404 len: 111 microversion: 2.1 time: 0.084250 Oct 25 03:16:16.406267 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1769/3342] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:16 2022] DELETE /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:16.415523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:16.416370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.424245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.425367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.426234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.427179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.427879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.428542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.821476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Updating instance_info_cache with network_info: [{"id": "dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1", "address": "fa:16:3e:ac:08:e1", "network": {"id": "6427d142-9820-4b57-8069-4f18bec800ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1957352803-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "06f909703b14420996925ac2850f536a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdd3bb9bb-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120563) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:16:16.844412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Releasing lock "refresh_cache-b005fb5c-ecfe-44f8-a41e-624bf0dc7043" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:16:16.845668 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-301cb454-5bbf-4e0f-9008-77aaafcd6caf tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043/action" status: 202 len: 0 microversion: 2.1 time: 14.043713 Oct 25 03:16:16.847023 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1574/3343] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:02 2022] POST /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043/action => generated 0 bytes in 14046 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 25 03:16:16.854417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:16.855722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 40f89739-25c6-4c83-91c6-f723d7ae0d75] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.872664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.873665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.874439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.875589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.876334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.883877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.919071 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.924871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 HTTP/1.1 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '40f89739-25c6-4c83-91c6-f723d7ae0d75'} Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:16.930493 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.938983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:16.938983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:16.938983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:16.938983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:16.938983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:16.938983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. Oct 25 03:16:16.938983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:16.940432 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f33226d2-d61b-4c82-821a-300440f689be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.524341 Oct 25 03:16:16.941714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 40f89739-25c6-4c83-91c6-f723d7ae0d75 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:16.942875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b56da7a-1a7d-424d-9adb-8cfc6f760ab3 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75" status: 404 len: 111 microversion: 2.1 time: 0.094555 Oct 25 03:16:16.943716 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1575/3344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:16 2022] GET /compute/v2.1/servers/40f89739-25c6-4c83-91c6-f723d7ae0d75 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:16.953634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:16.954558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:16.954824 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1770/3345] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:16 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:16.960009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.180"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:16.962725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.963509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.964216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:16.965771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:16.966483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:16.967155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:17.140433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:17.160612 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86900928-d857-452d-bb7d-e1a3ebc8c90b tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1274 microversion: 2.1 time: 0.211504 Oct 25 03:16:17.163192 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1576/3346] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:16 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:17.179026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8d1d153-79fd-4346-b765-7d78eab58595 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:17.179926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8d1d153-79fd-4346-b765-7d78eab58595 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 55f23582-0bbc-4b8d-9b73-549566f8048d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:17.191195 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-d8d1d153-79fd-4346-b765-7d78eab58595 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8d1d153-79fd-4346-b765-7d78eab58595 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d HTTP/1.1 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '55f23582-0bbc-4b8d-9b73-549566f8048d'} Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.193257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.198874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8d1d153-79fd-4346-b765-7d78eab58595 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:17.206410 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8d1d153-79fd-4346-b765-7d78eab58595 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d" status: 404 len: 111 microversion: 2.1 time: 0.034659 Oct 25 03:16:17.206410 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1577/3347] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:17 2022] DELETE /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:17.226264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9bdd435-5ee0-4499-aa1c-6bd21b5f7cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:17.226938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9bdd435-5ee0-4499-aa1c-6bd21b5f7cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 55f23582-0bbc-4b8d-9b73-549566f8048d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:17.237547 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c9bdd435-5ee0-4499-aa1c-6bd21b5f7cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9bdd435-5ee0-4499-aa1c-6bd21b5f7cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d HTTP/1.1 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '55f23582-0bbc-4b8d-9b73-549566f8048d'} Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:17.239131 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:17.245618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:17.245618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:17.245618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:17.245618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. Oct 25 03:16:17.245618 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:17.266165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9bdd435-5ee0-4499-aa1c-6bd21b5f7cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 55f23582-0bbc-4b8d-9b73-549566f8048d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:17.267474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9bdd435-5ee0-4499-aa1c-6bd21b5f7cfa tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d" status: 404 len: 111 microversion: 2.1 time: 0.060021 Oct 25 03:16:17.267820 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1578/3348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:17 2022] GET /compute/v2.1/servers/55f23582-0bbc-4b8d-9b73-549566f8048d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:17.746223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:17.753920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:17.754590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:17.755151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:17.756019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:17.757286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:17.759454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:17.987727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:17.989412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:18.000571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:18.001378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:18.004572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:18.005592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:18.006324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:18.006977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:18.430766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:18.439888 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e5bb343-97a6-4177-9060-83810e4b9c53 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.481352 Oct 25 03:16:18.459921 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1579/3349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:17 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:18.470967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:18.482581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:18.489590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:18.490364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:18.491252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:18.492151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:18.493026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:18.493629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:18.494110 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] HTTP exception thrown: Floating IP 172.25.3.180 is not associated with instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4. Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Request method failure captured: Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action HTTP/1.1 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 49 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1S2IUnswOiu8Pc7d0DNK-oU7vIg3B6hk3ecleWf6dw-5C0kT12MmgrlKencZNFx4xU8vk2AkNQRQHJqbSM6Crq-R00UOVzr7yvHGxySC1OKQsfT-Qu16tpDrqY1pDHdD6o8_OYjzQyfeIPl35qu60NMXo6QCYt1a2u5uo974mHfTJc Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_06f909703b14420996925ac2850f536a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/06f909703b14420996925ac2850f536a"}]}] Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 35575a22b7ce49b3b390e4578a00dfd5 Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: {"removeFloatingIp": {"address": "172.25.3.180"}} Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: exception: Floating IP 172.25.3.180 is not associated with instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4. Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5b29de76-21f4-4f1e-9888-48fa586ee4d4', 'body': {'removeFloatingIp': {'address': '172.25.3.180'}}} Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.180 is not associated with instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4. Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.180 is not associated with instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4. Oct 25 03:16:18.495684 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:18.500473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Returning 409 to user: Floating IP 172.25.3.180 is not associated with instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:18.500473 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c84b3540-3f04-4c99-8a6c-3a667e396058 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action" status: 409 len: 146 microversion: 2.1 time: 1.542220 Oct 25 03:16:18.500473 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1771/3350] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:16 2022] POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action => generated 146 bytes in 1544 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:16:18.545219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.180"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:18.750596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:18.760141 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5c81e7e4-d45e-4958-90e1-2f3ec6ecc291 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1280 microversion: 2.1 time: 0.298623 Oct 25 03:16:18.774685 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1580/3351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:18 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1280 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:19.475569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:19.476410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:19.497199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:19.498688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:19.500797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:19.507183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:19.510079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:19.511835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:19.516286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:19.523572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:19.524076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:19.527171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:19.528552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:19.529238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:19.532053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:20.169646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:20.181123 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc953047-232d-44ad-9d1b-72ef7c6fad08 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.707677 Oct 25 03:16:20.186690 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1581/3352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:19 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:20.195292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:20.196104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:20.211758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:20.212577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:20.213206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:20.215566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:20.216383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:20.217033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:20.224959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:20.375576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:20.386922 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5f44a32e-687f-4918-9162-71b7bb253a34 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1280 microversion: 2.1 time: 0.198737 Oct 25 03:16:20.407739 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1582/3353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:20 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:20.528126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "refresh_cache-b005fb5c-ecfe-44f8-a41e-624bf0dc7043" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:16:20.530702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquired lock "refresh_cache-b005fb5c-ecfe-44f8-a41e-624bf0dc7043" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:16:21.214526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:21.218593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:21.228742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:21.229389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:21.229922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:21.231669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:21.232308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:21.232816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:22.151201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:22.161120 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c47d16a9-6e49-440e-80ce-59d34d12f8fa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1681 microversion: 2.1 time: 0.950582 Oct 25 03:16:22.167072 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1583/3354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:21 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1681 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:22.177146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:22.180313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:22.198904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:22.201972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:22.202681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:22.205566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:22.206925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:22.207703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:22.674729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:22.690913 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-562b44d5-26e2-435a-ae6a-9a3ff98dabdf tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 0.522385 Oct 25 03:16:22.725770 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1584/3355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:22 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:23.194886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:23.196049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:23.215124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:23.218016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:23.219474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:23.220499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:23.222237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:23.223999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:23.676333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:23.688924 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-76dcdf3e-0455-4145-b32a-3ce6760499b3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.498095 Oct 25 03:16:23.706137 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1585/3356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:23 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:23.718949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:23.721315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:23.737910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:23.740073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:23.741453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:23.743413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:23.747139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:23.747604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:23.813439 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c HTTP/1.1 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '227a8049-3445-4a56-8f6c-26d85d588b7c'} Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:23.821438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:23.828255 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:23.832247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:23.837270 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da9f0539-368a-45d1-ae10-19794fe2f11b tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 404 len: 111 microversion: 2.1 time: 0.128871 Oct 25 03:16:23.840649 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1586/3357] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:23 2022] DELETE /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:23.852524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:23.855387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:23.878826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:23.879699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:23.882087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:23.886281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:23.888648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:23.889974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:24.348993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Building network info cache for instance {{(pid=120562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:16:24.547115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:24.570648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:24.584601 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9be7cec7-3d88-4ebc-bc8d-4f10a7fab9b1 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 0.741929 Oct 25 03:16:24.590115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1587/3358] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:23 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:24.602118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:24.612483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: 227a8049-3445-4a56-8f6c-26d85d588b7c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:24.636264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:24.639386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:24.639860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:24.645584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:24.646128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:24.646584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:24.685608 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c HTTP/1.1 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '227a8049-3445-4a56-8f6c-26d85d588b7c'} Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:24.694604 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:24.699906 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:24.699906 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:24.699906 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:24.699906 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:24.699906 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:24.699906 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. Oct 25 03:16:24.699906 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:24.707126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance 227a8049-3445-4a56-8f6c-26d85d588b7c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:24.709198 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a3b1adfd-7b13-458a-9d3b-487175fc0023 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c" status: 404 len: 111 microversion: 2.1 time: 0.117785 Oct 25 03:16:24.713898 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1588/3359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:24 2022] GET /compute/v2.1/servers/227a8049-3445-4a56-8f6c-26d85d588b7c => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:24.726697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:24.727594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:24.736578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:24.737313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:24.737965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:24.738839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:24.739469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:24.740255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:25.017592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:25.031968 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc6a4a0c-b78d-4d27-8fb8-5b9ddfe279b2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.316100 Oct 25 03:16:25.032841 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1589/3360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:24 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:25.041632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7403876c-a4f4-4093-8e92-ed7de7c08e3e req-73ecc558-a72c-424f-8f7e-0cfdc46bfd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b005fb5c-ecfe-44f8-a41e-624bf0dc7043", "tag": "dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:25.068739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7403876c-a4f4-4093-8e92-ed7de7c08e3e req-73ecc558-a72c-424f-8f7e-0cfdc46bfd40 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:25.069851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7403876c-a4f4-4093-8e92-ed7de7c08e3e req-73ecc558-a72c-424f-8f7e-0cfdc46bfd40 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:25.072930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7403876c-a4f4-4093-8e92-ed7de7c08e3e req-73ecc558-a72c-424f-8f7e-0cfdc46bfd40 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:25.106058 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7403876c-a4f4-4093-8e92-ed7de7c08e3e req-73ecc558-a72c-424f-8f7e-0cfdc46bfd40 service nova] Creating event network-changed:dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1 for instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 on n-h1-862355-1 Oct 25 03:16:25.118662 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7403876c-a4f4-4093-8e92-ed7de7c08e3e req-73ecc558-a72c-424f-8f7e-0cfdc46bfd40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083297 Oct 25 03:16:25.121343 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1590/3361] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:25.134371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:25.135346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:25.161447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:25.164357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:25.165391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:25.167076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:25.168867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:25.169625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:25.207020 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 HTTP/1.1 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'ff95e7f4-4239-4203-ae0b-70a238e45398'} Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:25.210401 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.217877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.219144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:25.220753 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c1901a9-72a6-4af8-b29e-7d4c44be076d tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 404 len: 111 microversion: 2.1 time: 0.096490 Oct 25 03:16:25.227028 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1591/3362] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:25 2022] DELETE /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:25.239454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:25.241767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] [instance: ff95e7f4-4239-4203-ae0b-70a238e45398] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:25.255915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:25.258990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:25.259714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:25.261228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:25.263520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:25.264106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:25.321358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] HTTP exception thrown: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Request method failure captured: Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 HTTP/1.1 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1OomjplGqRhgC2_VL6GnEO7foQAWe5TjR0lhkiX1Awa8c9fkWJMepOwPeDvXJcD4MBL6PI86F_QzZ9EUQaofMstRCTJ61XX6NOraVMx-odKTna1N_nPlpd75m1vuXwzwwhTHwT5aD7xK0fLqJgSteoKxkz6arQH59qB1QaSUgQxYP4 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec96fdcf66774081b73265ebef1577c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec96fdcf66774081b73265ebef1577c9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec96fdcf66774081b73265ebef1577c9"}]}] Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ec96fdcf66774081b73265ebef1577c9 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1827909893 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256827a36f464fe1b535d91f95e48681 Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1827909893-project Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'ff95e7f4-4239-4203-ae0b-70a238e45398'} Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:25.328865 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.334896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:25.334896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:25.334896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:25.334896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:25.334896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:25.334896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. Oct 25 03:16:25.334896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:25.342994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] Returning 404 to user: Instance ff95e7f4-4239-4203-ae0b-70a238e45398 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:25.344483 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-54ac08dd-2b7f-46ae-9402-3cb73079b890 tempest-DeleteServersTestJSON-1827909893 tempest-DeleteServersTestJSON-1827909893-project] 10.222.0.36 "GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398" status: 404 len: 111 microversion: 2.1 time: 0.115941 Oct 25 03:16:25.346339 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1592/3363] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:25 2022] GET /compute/v2.1/servers/ff95e7f4-4239-4203-ae0b-70a238e45398 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:25.568780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:25.617184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:25.618062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:25.635669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:25.638946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:25.639571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:25.640740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:25.642125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:25.644500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:26.756129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:26.790163 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35cbd047-64df-44dc-bd4f-f4fa179299e6 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 1.177115 Oct 25 03:16:26.794565 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1593/3364] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:25 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:27.094652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-aed5d1e4-24e1-4278-aae2-47a8cbbca58b req-c9062d39-2109-4ab8-84e6-5a0a5a68ee5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "name": "network-vif-unplugged", "status": "completed", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:27.116572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aed5d1e4-24e1-4278-aae2-47a8cbbca58b req-c9062d39-2109-4ab8-84e6-5a0a5a68ee5c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:27.117296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aed5d1e4-24e1-4278-aae2-47a8cbbca58b req-c9062d39-2109-4ab8-84e6-5a0a5a68ee5c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:27.117860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aed5d1e4-24e1-4278-aae2-47a8cbbca58b req-c9062d39-2109-4ab8-84e6-5a0a5a68ee5c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:27.133762 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-aed5d1e4-24e1-4278-aae2-47a8cbbca58b req-c9062d39-2109-4ab8-84e6-5a0a5a68ee5c service nova] Creating event network-vif-unplugged:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:16:27.141001 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-aed5d1e4-24e1-4278-aae2-47a8cbbca58b req-c9062d39-2109-4ab8-84e6-5a0a5a68ee5c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.341692 Oct 25 03:16:27.142415 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1594/3365] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:27.309900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:27.311114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:27.338133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:27.340028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:27.340522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:27.341277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:27.341801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:27.348104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:27.968322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Updating instance_info_cache with network_info: [{"id": "dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1", "address": "fa:16:3e:ac:08:e1", "network": {"id": "6427d142-9820-4b57-8069-4f18bec800ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1957352803-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "06f909703b14420996925ac2850f536a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdd3bb9bb-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:16:27.984966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Releasing lock "refresh_cache-b005fb5c-ecfe-44f8-a41e-624bf0dc7043" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:16:27.986035 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d74c9c45-6bd4-4a6d-bc4c-49d997bfeb7c tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043/action" status: 202 len: 0 microversion: 2.1 time: 9.481709 Oct 25 03:16:27.986698 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1772/3366] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:18 2022] POST /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043/action => generated 0 bytes in 9483 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 25 03:16:28.006976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:28.010371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:28.025977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.026564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.027983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.030220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.030737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.031181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.550271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:28.560643 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca94f8f6-776c-4860-920b-69ca9013f75a tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 0.572844 Oct 25 03:16:28.566806 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1773/3367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:27 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:28.571926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:28.572440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:28.593534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.595084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.596597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.597822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.599190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.599911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.617364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:28.627987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ef48b79-a9ca-41aa-991e-9e427aad0d24 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 1.324401 Oct 25 03:16:28.633099 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1595/3368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:27 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:28.644081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-bb730a0e-8767-46c3-8fb6-8463038829bd req-a4d6cea2-c99c-4d10-93b4-3aea50f905f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c83511b-5d9f-4b76-aaad-265cc3e612f2", "tag": "ac52f17b-33aa-4eae-b7f3-bac66e204686"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:28.659023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:16:28.667233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bb730a0e-8767-46c3-8fb6-8463038829bd req-a4d6cea2-c99c-4d10-93b4-3aea50f905f6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.668558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bb730a0e-8767-46c3-8fb6-8463038829bd req-a4d6cea2-c99c-4d10-93b4-3aea50f905f6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.669196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bb730a0e-8767-46c3-8fb6-8463038829bd req-a4d6cea2-c99c-4d10-93b4-3aea50f905f6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.691887 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-bb730a0e-8767-46c3-8fb6-8463038829bd req-a4d6cea2-c99c-4d10-93b4-3aea50f905f6 service nova] Creating event network-changed:ac52f17b-33aa-4eae-b7f3-bac66e204686 for instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 on n-h2-862355-1 Oct 25 03:16:28.707573 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-bb730a0e-8767-46c3-8fb6-8463038829bd req-a4d6cea2-c99c-4d10-93b4-3aea50f905f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073071 Oct 25 03:16:28.713204 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1596/3369] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:28.725592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:28.736280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:28.744315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.755125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.755603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.756562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.757227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.757964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.775414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c11708dd-82d5-4a42-b13c-b258755f293a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 204 len: 0 microversion: 2.1 time: 0.206819 Oct 25 03:16:28.778438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1774/3370] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:28 2022] DELETE /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:16:28.797922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.180"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:28.801082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:28.816267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.826604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.827412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.828662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:28.829301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:28.829975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:28.834685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:28.866114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:16:28.866762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquired lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:16:29.889016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:29.901223 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13a27565-3120-4f1d-81bb-c7300c5fc74d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 1.185354 Oct 25 03:16:29.910048 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1597/3371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:28 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:29.916651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:29.918168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:29.940366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:29.951074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:29.951609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:29.952383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:29.954768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:29.955208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:30.644364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:30.656014 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cad388d5-d230-4b82-8ef2-b558e3024bf7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 0.744222 Oct 25 03:16:30.657338 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1598/3372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:29 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:30.663618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:30.665365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:30.674258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:30.675356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:30.676161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:30.682128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:30.684276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:30.685346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:31.213973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:31.224211 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-814fa81d-4c9e-452e-b793-1fe75ccd9bab tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.565329 Oct 25 03:16:31.224820 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1599/3373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:30 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:31.252181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:31.254501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:31.269377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:31.269913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:31.270547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:31.271434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:31.272062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:31.272660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:31.386571 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a83a1437-c796-46f0-ae58-01027815148a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.137425 Oct 25 03:16:31.393070 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1600/3374] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:31 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:16:31.400060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:31.401429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:31.417053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:31.421320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:31.422020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:31.423324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:31.424012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:31.425780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:32.058456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:32.069654 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-49f72095-ba27-4a60-b5fc-f55aad5a5f62 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1670 microversion: 2.1 time: 0.674512 Oct 25 03:16:32.070634 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1601/3375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:31 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1670 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:32.076266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:32.085061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:32.092566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:32.098323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:32.098786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:32.099535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:32.100004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:32.100443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:32.159658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:32.675086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Building network info cache for instance {{(pid=120562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:16:33.750244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:33.765115 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a82dfe14-3fa6-4491-8b95-295c12b22b43 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 1.692958 Oct 25 03:16:33.784914 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1602/3376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:32 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:33.792326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b9e4d76a-0f1c-4e41-99fa-b632d50f1c9d req-5ad40556-19a9-4846-a62c-85cd89b89a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b005fb5c-ecfe-44f8-a41e-624bf0dc7043", "name": "network-vif-deleted", "tag": "dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:33.808535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b9e4d76a-0f1c-4e41-99fa-b632d50f1c9d req-5ad40556-19a9-4846-a62c-85cd89b89a5f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:33.809581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b9e4d76a-0f1c-4e41-99fa-b632d50f1c9d req-5ad40556-19a9-4846-a62c-85cd89b89a5f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:33.810307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b9e4d76a-0f1c-4e41-99fa-b632d50f1c9d req-5ad40556-19a9-4846-a62c-85cd89b89a5f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:33.825552 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b9e4d76a-0f1c-4e41-99fa-b632d50f1c9d req-5ad40556-19a9-4846-a62c-85cd89b89a5f service nova] Creating event network-vif-deleted:dd3bb9bb-6bf4-4971-9d24-4ae8b333e2b1 for instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 on n-h1-862355-1 Oct 25 03:16:33.831740 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b9e4d76a-0f1c-4e41-99fa-b632d50f1c9d req-5ad40556-19a9-4846-a62c-85cd89b89a5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044520 Oct 25 03:16:33.836889 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1603/3377] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:33.843908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:33.845019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:33.855745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:33.857084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:33.857816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:33.858837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:33.859536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:33.860214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:34.377850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:34.405964 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-485e07d0-bd5b-49bc-88da-f5a49aaca482 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1670 microversion: 2.1 time: 0.566705 Oct 25 03:16:34.408721 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1604/3378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:33 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1670 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:34.420024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Updating instance_info_cache with network_info: [{"id": "c5ee39e9-f93c-425d-ac84-30fba25672de", "address": "fa:16:3e:d9:9d:e3", "network": {"id": "6427d142-9820-4b57-8069-4f18bec800ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1957352803-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "06f909703b14420996925ac2850f536a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5ee39e9-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:16:34.434866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Releasing lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:16:34.436047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd9f34ba-5a56-4789-859d-f1947caf934d tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action" status: 202 len: 0 microversion: 2.1 time: 5.649160 Oct 25 03:16:34.440611 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1775/3379] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:28 2022] POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action => generated 0 bytes in 5654 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 25 03:16:34.446834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e632423-0c89-4641-8f38-08b51748e6c5 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '.version_select at 0x7efd335a9670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:34.793643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:34.794395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:34.810456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:34.811273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:34.811910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:34.816622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:34.817391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:34.818211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:35.278782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e632423-0c89-4641-8f38-08b51748e6c5 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/e77c4f46-9b95-4967-95a5-13a8268a2905" status: 200 len: 184 microversion: 2.1 time: 0.834997 Oct 25 03:16:35.283816 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1605/3380] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:16:34 2022] GET /compute/v2.1/os-floating-ips/e77c4f46-9b95-4967-95a5-13a8268a2905 => generated 184 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:35.295651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.180"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:35.438228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:35.447663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f3cd551c-ed16-42e8-af04-34f51f935439 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 0.658800 Oct 25 03:16:35.456026 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1776/3381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:34 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:35.467470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:35.468784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:35.474794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:35.479381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:35.481536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:35.483066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:35.494808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:35.496462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:35.497116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:35.859185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:35.869489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:35.870323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:35.871179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:35.872553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:35.873479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:35.874110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:36.212315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:36.222984 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d441b98-b96d-452b-8921-61a2d6feb7b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1675 microversion: 2.1 time: 0.765489 Oct 25 03:16:36.223588 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1777/3382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:35 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1675 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:36.242713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b83d1d8b-bce5-49be-9a8e-8b8eff328731 req-05171316-7164-4fe7-bfdc-71d48f140fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b29de76-21f4-4f1e-9888-48fa586ee4d4", "tag": "c5ee39e9-f93c-425d-ac84-30fba25672de"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:36.264006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b83d1d8b-bce5-49be-9a8e-8b8eff328731 req-05171316-7164-4fe7-bfdc-71d48f140fd6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:36.265060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b83d1d8b-bce5-49be-9a8e-8b8eff328731 req-05171316-7164-4fe7-bfdc-71d48f140fd6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:36.265421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b83d1d8b-bce5-49be-9a8e-8b8eff328731 req-05171316-7164-4fe7-bfdc-71d48f140fd6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:36.292367 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b83d1d8b-bce5-49be-9a8e-8b8eff328731 req-05171316-7164-4fe7-bfdc-71d48f140fd6 service nova] Creating event network-changed:c5ee39e9-f93c-425d-ac84-30fba25672de for instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 on n-h1-862355-1 Oct 25 03:16:36.305481 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b83d1d8b-bce5-49be-9a8e-8b8eff328731 req-05171316-7164-4fe7-bfdc-71d48f140fd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077802 Oct 25 03:16:36.306143 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1778/3383] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:36.493608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:36.495055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:36.515390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:36.517250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:36.535711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:36.536761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:36.538250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:36.539048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:36.993019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:16:36.993669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquired lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:16:37.282493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:37.302795 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81ea574d-b419-42ab-9d8a-47389f96b6d7 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 0.813768 Oct 25 03:16:37.312734 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1779/3384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:36 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:37.325960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:37.326602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:37.340573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:37.340984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:37.345997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:37.347257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:37.348018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:37.348642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:37.774093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:37.788219 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f82a1f69-0974-4894-9597-6292d6fb9f7b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.474190 Oct 25 03:16:37.789332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1780/3385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:37 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:37.798114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a475c505-468b-4d16-9ff2-2be475b4228d req-5ca1edf8-2ba6-49da-8ae8-7a8695723ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c83511b-5d9f-4b76-aaad-265cc3e612f2", "name": "network-vif-plugged", "status": "completed", "tag": "ac52f17b-33aa-4eae-b7f3-bac66e204686"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:37.823817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a475c505-468b-4d16-9ff2-2be475b4228d req-5ca1edf8-2ba6-49da-8ae8-7a8695723ed7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:37.825971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a475c505-468b-4d16-9ff2-2be475b4228d req-5ca1edf8-2ba6-49da-8ae8-7a8695723ed7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:37.826535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a475c505-468b-4d16-9ff2-2be475b4228d req-5ca1edf8-2ba6-49da-8ae8-7a8695723ed7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:37.854152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a475c505-468b-4d16-9ff2-2be475b4228d req-5ca1edf8-2ba6-49da-8ae8-7a8695723ed7 service nova] Creating event network-vif-plugged:ac52f17b-33aa-4eae-b7f3-bac66e204686 for instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 on n-h2-862355-1 Oct 25 03:16:37.861238 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a475c505-468b-4d16-9ff2-2be475b4228d req-5ca1edf8-2ba6-49da-8ae8-7a8695723ed7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066611 Oct 25 03:16:37.862286 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1781/3386] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:37.867901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:37.871403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:37.878326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:37.879205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:37.879869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:37.880813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:37.881483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:37.882156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:37.950383 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5aedb3c2-9ae5-45b2-a8ca-0eb16b380bd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 200 len: 322 microversion: 2.1 time: 0.085909 Oct 25 03:16:37.951759 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1782/3387] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:37 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 322 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:37.962771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:37.963603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:37.974961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:37.975857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:37.976640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:37.978240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:37.982015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:37.982995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:38.324692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:38.357660 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e84f297-6426-4197-9b8f-e0082eaa7962 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.400194 Oct 25 03:16:38.362658 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1783/3388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:37 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:38.373143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:38.373897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:38.394061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:38.394553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:38.394998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:38.395725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:38.396178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:38.396616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:38.869509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:38.895553 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d980574-b624-4fe1-bb72-d989531f9b16 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1322 microversion: 2.1 time: 0.530629 Oct 25 03:16:38.899031 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1784/3389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:38 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:38.914183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:38.916659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:38.933796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:38.934448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:38.936835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:38.944068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:38.944923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:38.946315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:39.881406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:39.893965 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3ae4363-71fc-4102-8f44-be02c7943410 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.992757 Oct 25 03:16:39.894906 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1785/3390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:38 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:39.923669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Building network info cache for instance {{(pid=120563) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:16:39.925463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:39.926275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:39.938840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:39.939381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:39.944022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:39.944873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:39.945377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:39.945860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:40.377207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:40.392511 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a939b49-0514-414d-89e2-85a828278b09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.471394 Oct 25 03:16:40.396030 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1786/3391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:39 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:40.407514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:40.408404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:40.429103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:40.430967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:40.432151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:40.433642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:40.436685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:40.437483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.112441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:41.122618 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9e9a2d1e-ee76-46aa-bcbb-7a1afb456870 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1471 microversion: 2.1 time: 0.725106 Oct 25 03:16:41.142396 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1787/3392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:40 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1471 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:41.156809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0e56c469-4dbd-4455-9b3a-6ea864728b08 req-dc7e64d8-9c07-498c-b113-04e6fc0177f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b29de76-21f4-4f1e-9888-48fa586ee4d4", "tag": "c5ee39e9-f93c-425d-ac84-30fba25672de"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:41.175210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0e56c469-4dbd-4455-9b3a-6ea864728b08 req-dc7e64d8-9c07-498c-b113-04e6fc0177f9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:41.178572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0e56c469-4dbd-4455-9b3a-6ea864728b08 req-dc7e64d8-9c07-498c-b113-04e6fc0177f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:41.179125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0e56c469-4dbd-4455-9b3a-6ea864728b08 req-dc7e64d8-9c07-498c-b113-04e6fc0177f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.206243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0e56c469-4dbd-4455-9b3a-6ea864728b08 req-dc7e64d8-9c07-498c-b113-04e6fc0177f9 service nova] Creating event network-changed:c5ee39e9-f93c-425d-ac84-30fba25672de for instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 on n-h1-862355-1 Oct 25 03:16:41.212123 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0e56c469-4dbd-4455-9b3a-6ea864728b08 req-dc7e64d8-9c07-498c-b113-04e6fc0177f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068328 Oct 25 03:16:41.213528 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1788/3393] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:41.220430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:41.221230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:41.241613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:41.242796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:41.243436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.244554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:41.245885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:41.246823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.670416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:41.685666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:41.693338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:41.694465 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b67bb2c-75f6-4d11-8474-93ee400fe3f1 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2952 microversion: 2.42 time: 0.479457 Oct 25 03:16:41.717204 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1789/3394] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:16:41 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2952 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:16:41.722293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:41.722913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:41.738225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:41.738732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:41.739178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.739894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:41.747993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:41.748460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.784409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Updating instance_info_cache with network_info: [{"id": "c5ee39e9-f93c-425d-ac84-30fba25672de", "address": "fa:16:3e:d9:9d:e3", "network": {"id": "6427d142-9820-4b57-8069-4f18bec800ed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1957352803-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "06f909703b14420996925ac2850f536a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5ee39e9-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120563) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:16:41.821466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Releasing lock "refresh_cache-5b29de76-21f4-4f1e-9888-48fa586ee4d4" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:16:41.826208 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cf5e144-008c-4358-a820-f245349e8048 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action" status: 202 len: 0 microversion: 2.1 time: 6.534901 Oct 25 03:16:41.827703 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1606/3395] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:35 2022] POST /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4/action => generated 0 bytes in 6537 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 25 03:16:41.835991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:41.837130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:41.846650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:41.847522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:41.848487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.849889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:41.850598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:41.851412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:41.909518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lazy-loading 'flavor' on Instance uuid 7c83511b-5d9f-4b76-aaad-265cc3e612f2 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:16:42.090069 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87b6eca2-23fa-407b-8969-676b00e5ce63 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2/action" status: 202 len: 0 microversion: 2.1 time: 0.255087 Oct 25 03:16:42.093725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1607/3396] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:41 2022] POST /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:16:42.107983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:42.111389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:42.144587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.145408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.147534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.148432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.152580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.153168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.209627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:42.219320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f63e65e-053f-4aac-bce5-3eed50583f39 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.500834 Oct 25 03:16:42.246119 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1790/3397] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:41 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:42.280548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:42.286224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:42.303318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.304745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.305283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.306715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.308587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.310055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.337735 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] HTTP exception thrown: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Request method failure captured: Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 HTTP/1.1 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1S2IUnswOiu8Pc7d0DNK-oU7vIg3B6hk3ecleWf6dw-5C0kT12MmgrlKencZNFx4xU8vk2AkNQRQHJqbSM6Crq-R00UOVzr7yvHGxySC1OKQsfT-Qu16tpDrqY1pDHdD6o8_OYjzQyfeIPl35qu60NMXo6QCYt1a2u5uo974mHfTJc Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_06f909703b14420996925ac2850f536a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/06f909703b14420996925ac2850f536a"}]}] Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 35575a22b7ce49b3b390e4578a00dfd5 Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'b005fb5c-ecfe-44f8-a41e-624bf0dc7043'} Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:42.346390 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.351635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.361299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Returning 404 to user: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:42.362459 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2999abd9-0147-48d2-a9f2-41aea15021a3 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 404 len: 111 microversion: 2.1 time: 0.115017 Oct 25 03:16:42.363247 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1791/3398] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:42 2022] DELETE /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:42.383958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:42.384605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:42.404517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.405025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.405701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.408106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.411182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.411852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.496407 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6dc97838-5846-4fc6-b9d8-a561fd5a87a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.400373 Oct 25 03:16:42.498985 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1608/3399] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 25 03:16:42 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b/os-interface => generated 1830 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:16:42.504587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:42.505589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: b005fb5c-ecfe-44f8-a41e-624bf0dc7043] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:42.514185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.515186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.515940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.517074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:42.518072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:42.518807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:42.545112 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] HTTP exception thrown: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Request method failure captured: Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 HTTP/1.1 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1S2IUnswOiu8Pc7d0DNK-oU7vIg3B6hk3ecleWf6dw-5C0kT12MmgrlKencZNFx4xU8vk2AkNQRQHJqbSM6Crq-R00UOVzr7yvHGxySC1OKQsfT-Qu16tpDrqY1pDHdD6o8_OYjzQyfeIPl35qu60NMXo6QCYt1a2u5uo974mHfTJc Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_06f909703b14420996925ac2850f536a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/06f909703b14420996925ac2850f536a"}]}] Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 35575a22b7ce49b3b390e4578a00dfd5 Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'b005fb5c-ecfe-44f8-a41e-624bf0dc7043'} Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.548194 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. Oct 25 03:16:42.555409 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:42.558748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Returning 404 to user: Instance b005fb5c-ecfe-44f8-a41e-624bf0dc7043 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:42.560193 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1b76cfd-272a-4196-8eaa-ea2921772060 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043" status: 404 len: 111 microversion: 2.1 time: 0.059949 Oct 25 03:16:42.561384 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1609/3400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:42 2022] GET /compute/v2.1/servers/b005fb5c-ecfe-44f8-a41e-624bf0dc7043 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:42.567849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-107934784", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:42.664375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] validate_networks() for [('0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:16:43.270275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:16:43.271407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:16:43.272366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:16:43.272834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:16:43.273259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:16:43.278558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=71 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:43.285950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:43.286447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:43.286942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:43.288118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:43.288573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:43.291056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:43.317081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:16:43.322717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for user 41342d3f5062457aaee26cf5d836e441 and project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:16:43.339444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:16:43.341850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:16:43.399367 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad6425d8-7e17-4684-befe-27148d20081e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835958 Oct 25 03:16:43.400377 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1610/3401] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:16:43.412905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-035a34a3-7594-4bbf-8669-f6798ce44bd1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '.version_select at 0x7efd3330d820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:43.747685 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf3a0b42-ec18-4c41-be46-12084a551a78 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1630 microversion: 2.1 time: 1.380866 Oct 25 03:16:43.748490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1792/3402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:42 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1630 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:43.782478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6b5a7d6-d28a-4725-90d2-131d078915e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:43.783105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6b5a7d6-d28a-4725-90d2-131d078915e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:44.023354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a6b5a7d6-d28a-4725-90d2-131d078915e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:44.033987 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6b5a7d6-d28a-4725-90d2-131d078915e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1214 microversion: 2.1 time: 0.284460 Oct 25 03:16:44.035758 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1793/3403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:43 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:44.777167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:44.779958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:44.801969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:44.803261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:44.804239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:44.806524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:44.808889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:44.810517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.204210 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-035a34a3-7594-4bbf-8669-f6798ce44bd1 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/e77c4f46-9b95-4967-95a5-13a8268a2905" status: 202 len: 0 microversion: 2.1 time: 1.795573 Oct 25 03:16:45.205274 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1611/3404] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:16:43 2022] DELETE /compute/v2.1/os-floating-ips/e77c4f46-9b95-4967-95a5-13a8268a2905 => generated 0 bytes in 1797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:16:45.211361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:45.212096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:45.221497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.222134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.222650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.223448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.223983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.224486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.392331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:45.431872 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-49ed3be6-e8b8-4210-9227-b9cb0dee8611 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1266 microversion: 2.1 time: 0.221223 Oct 25 03:16:45.435210 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1612/3405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:45 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:45.455829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:45.456453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:45.481339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.482280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.482730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.488715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.489515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.490213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.553078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:16:45.691307 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc81d87d-47ba-422c-b4ac-ebabcc46879e tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 204 len: 0 microversion: 2.1 time: 0.253917 Oct 25 03:16:45.692189 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1613/3406] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:45 2022] DELETE /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:16:45.702793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:45.703752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:45.712565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.713340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.714866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.716194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.717143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.718567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.782732 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1829849b-4193-4a5c-9173-dfc0f41a5791 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1613 microversion: 2.1 time: 1.013343 Oct 25 03:16:45.800550 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1794/3407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:44 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1613 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:45.816559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:45.817141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:45.839320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.840938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.841668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.844645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:45.845360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:45.847060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:45.858069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:45.888613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] HTTP exception thrown: Cannot 'migrate' instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 while it is in vm_state suspended Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Request method failure captured: Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2/action HTTP/1.1 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1TlYENugsk8OtFyROPk-y0w2QgjDXE_jHz6ni8jfwLxJA8kVxE5N9Q04f0MSXszNLB0UvsGihsevqU-sBxDMMHp2OBjc7yxlxzaifkWfZAhaWOCz57kT1bRRxebrqRIGWjsXkKnI3azXJ2mKOr6IlAFNRy7F9UD8elyqFo5NfJ1OP8 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1c1f5a775814b5391863c3e2d1ac037", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1c1f5a775814b5391863c3e2d1ac037"}]}] Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d061a5be306c4a698bec0eb1c1cdb4ad Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: {"migrate": {}} Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'migrate' instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 while it is in vm_state suspended Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '7c83511b-5d9f-4b76-aaad-265cc3e612f2', 'body': {'migrate': {}}} Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 in vm_state suspended. Cannot resize while the instance is in this state. Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:16:45.903503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 while it is in vm_state suspended Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 while it is in vm_state suspended Oct 25 03:16:45.908165 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.913212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Returning 409 to user: Cannot 'migrate' instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 while it is in vm_state suspended {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:45.914261 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e8bbe8d-9c15-42ed-bfb7-eff32e1dc7d0 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2/action" status: 409 len: 148 microversion: 2.1 time: 0.101726 Oct 25 03:16:45.929108 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1795/3408] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:45 2022] POST /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2/action => generated 148 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:16:45.938541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44662272-a4b1-44a3-bf46-242b50b3bfdc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44662272-a4b1-44a3-bf46-242b50b3bfdc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Request method failure captured: Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169/action HTTP/1.1 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 39 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1TlYENugsk8OtFyROPk-y0w2QgjDXE_jHz6ni8jfwLxJA8kVxE5N9Q04f0MSXszNLB0UvsGihsevqU-sBxDMMHp2OBjc7yxlxzaifkWfZAhaWOCz57kT1bRRxebrqRIGWjsXkKnI3azXJ2mKOr6IlAFNRy7F9UD8elyqFo5NfJ1OP8 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1c1f5a775814b5391863c3e2d1ac037", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1c1f5a775814b5391863c3e2d1ac037"}]}] Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d061a5be306c4a698bec0eb1c1cdb4ad Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: {"os-resetState": {"state": "invalid"}} Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'd1755534-5ca4-47f2-ba94-a464160b6169', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'invalid' Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:16:45.947596 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44662272-a4b1-44a3-bf46-242b50b3bfdc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44662272-a4b1-44a3-bf46-242b50b3bfdc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169/action" status: 400 len: 144 microversion: 2.1 time: 0.024060 Oct 25 03:16:45.958780 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1796/3409] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:45 2022] POST /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169/action => generated 144 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:16:45.967247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c69c638-9922-47ad-8e45-83a9894569f6 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c69c638-9922-47ad-8e45-83a9894569f6 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Request method failure captured: Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169/action HTTP/1.1 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 31 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1TlYENugsk8OtFyROPk-y0w2QgjDXE_jHz6ni8jfwLxJA8kVxE5N9Q04f0MSXszNLB0UvsGihsevqU-sBxDMMHp2OBjc7yxlxzaifkWfZAhaWOCz57kT1bRRxebrqRIGWjsXkKnI3azXJ2mKOr6IlAFNRy7F9UD8elyqFo5NfJ1OP8 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1c1f5a775814b5391863c3e2d1ac037", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1c1f5a775814b5391863c3e2d1ac037"}]}] Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d061a5be306c4a698bec0eb1c1cdb4ad Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: {"os-resetState": {"state": 1}} Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'd1755534-5ca4-47f2-ba94-a464160b6169', 'body': {'os-resetState': {'state': 1}}} Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 1 Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 25 03:16:45.971069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c69c638-9922-47ad-8e45-83a9894569f6 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:45.978164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c69c638-9922-47ad-8e45-83a9894569f6 tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169/action" status: 400 len: 120 microversion: 2.1 time: 0.010231 Oct 25 03:16:45.981159 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1797/3410] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:16:45 2022] POST /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:16:46.004465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ca27899-724e-4d41-84cc-01eaf26b85bc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:46.009230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5ca27899-724e-4d41-84cc-01eaf26b85bc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Failed to fetch instance by id 999 {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 25 03:16:46.012754 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5ca27899-724e-4d41-84cc-01eaf26b85bc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ca27899-724e-4d41-84cc-01eaf26b85bc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Request method failure captured: Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 37 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1TlYENugsk8OtFyROPk-y0w2QgjDXE_jHz6ni8jfwLxJA8kVxE5N9Q04f0MSXszNLB0UvsGihsevqU-sBxDMMHp2OBjc7yxlxzaifkWfZAhaWOCz57kT1bRRxebrqRIGWjsXkKnI3azXJ2mKOr6IlAFNRy7F9UD8elyqFo5NfJ1OP8 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b1c1f5a775814b5391863c3e2d1ac037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b1c1f5a775814b5391863c3e2d1ac037", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b1c1f5a775814b5391863c3e2d1ac037"}]}] Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b1c1f5a775814b5391863c3e2d1ac037 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-638091619 Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d061a5be306c4a698bec0eb1c1cdb4ad Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-638091619-project-admin Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: {"os-resetState": {"state": "error"}} Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 999 could not be found. Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:46.023368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:46.030604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:46.030604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 25 03:16:46.030604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:46.030604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ca27899-724e-4d41-84cc-01eaf26b85bc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:46.030604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5ca27899-724e-4d41-84cc-01eaf26b85bc tempest-ServersAdminNegativeTestJSON-638091619 tempest-ServersAdminNegativeTestJSON-638091619-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.042004 Oct 25 03:16:46.030604 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1798/3411] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Oct 25 03:16:45 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:16:46.038438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:46.038943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:46.044313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:46.056925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed82d353-c78a-4ca3-bbd2-67899cd6c6b8 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1526 microversion: 2.1 time: 0.359488 Oct 25 03:16:46.060712 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1614/3412] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:45 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1526 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:46.064364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:46.065102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:46.065765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:46.066644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:46.067298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:46.067904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:46.103267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:16:46.232348 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9702f0e9-134f-46d1-99e3-0cffb1dc235e tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 204 len: 0 microversion: 2.1 time: 0.200492 Oct 25 03:16:46.236724 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1799/3413] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:46 2022] DELETE /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:16:46.241696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:46.242366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:46.253113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:46.253624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:46.254114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:46.254817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:46.255288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:46.255865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:46.463128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:46.464478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:46.473589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:46.474119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:46.474562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:46.475369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:46.476243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:46.476925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:46.488789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:46.507335 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b29ac551-39af-485d-8eb5-e4ce6f33b790 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1468 microversion: 2.1 time: 0.268213 Oct 25 03:16:46.522889 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1615/3414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:46 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:46.696142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:46.707818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f228e348-4165-43af-9814-2ab1c1219736 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1272 microversion: 2.1 time: 0.249121 Oct 25 03:16:46.718066 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1800/3415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:46 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:47.087437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:47.088056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:47.099858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:47.100357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:47.102986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:47.103734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:47.106711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:47.107183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:47.532743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:47.533320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:47.540731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:47.541551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:47.542286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:47.543213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:47.543834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:47.544497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:47.588086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:47.598368 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2e389313-3b98-433f-8654-8b6855b7c889 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1526 microversion: 2.1 time: 0.515430 Oct 25 03:16:47.599659 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1616/3416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:47 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1526 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:47.735316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:47.736196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:47.754366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:47.754979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:47.757652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:47.758473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:47.759005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:47.761289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:47.988526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:48.005799 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d67aaa9-27eb-4c12-8cfb-d486e0a85475 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1272 microversion: 2.1 time: 0.277971 Oct 25 03:16:48.009260 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1617/3417] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:47 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:48.769180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:48.787484 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2d17028-717a-482d-b7d0-6afad29a1f72 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1468 microversion: 2.1 time: 1.258449 Oct 25 03:16:48.788402 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1801/3418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:47 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1468 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:16:48.793563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:48.803036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:48.810689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:48.811903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:48.824757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:48.825533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:48.826038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:48.826474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:48.908136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:48.912696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:48.914311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:48.919372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lazy-loading 'fault' on Instance uuid 5b29de76-21f4-4f1e-9888-48fa586ee4d4 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:16:49.281562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-041c5565-87c3-4327-a810-5af7be30a16a req-87e685ef-9374-4af0-b16c-9972b7c7a0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b29de76-21f4-4f1e-9888-48fa586ee4d4", "name": "network-vif-deleted", "tag": "c5ee39e9-f93c-425d-ac84-30fba25672de"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:49.300457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-041c5565-87c3-4327-a810-5af7be30a16a req-87e685ef-9374-4af0-b16c-9972b7c7a0d2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:49.300955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-041c5565-87c3-4327-a810-5af7be30a16a req-87e685ef-9374-4af0-b16c-9972b7c7a0d2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:49.301392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-041c5565-87c3-4327-a810-5af7be30a16a req-87e685ef-9374-4af0-b16c-9972b7c7a0d2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:49.359404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-041c5565-87c3-4327-a810-5af7be30a16a req-87e685ef-9374-4af0-b16c-9972b7c7a0d2 service nova] Creating event network-vif-deleted:c5ee39e9-f93c-425d-ac84-30fba25672de for instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 on n-h1-862355-1 Oct 25 03:16:49.370645 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-041c5565-87c3-4327-a810-5af7be30a16a req-87e685ef-9374-4af0-b16c-9972b7c7a0d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.762645 Oct 25 03:16:49.373486 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1618/3419] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:16:49.381277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:49.382573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:49.393103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:49.405824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:49.407614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:49.409325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:49.410276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:49.411023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:49.458680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35575a22b7ce49b3b390e4578a00dfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f909703b14420996925ac2850f536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:49.467984 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d0bcbf4-a7ce-42d2-b2f9-aea07e640a98 tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 200 len: 1314 microversion: 2.1 time: 0.678346 Oct 25 03:16:49.468572 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1802/3420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:48 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:49.570610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:49.579416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:49.590133 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bcd4adf9-2a9f-4d40-b68d-7f2a0344a900 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1272 microversion: 2.1 time: 0.212976 Oct 25 03:16:49.591523 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1619/3421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:49 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:49.817764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:49.818491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:49.830617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:49.833963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:49.835998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:49.836984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:49.837553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:49.838029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:50.493627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:50.495264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] [instance: 5b29de76-21f4-4f1e-9888-48fa586ee4d4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:50.508376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:50.517251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:50.519654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:50.525574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:50.527145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:50.527614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:50.566078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] HTTP exception thrown: Instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 could not be found. Oct 25 03:16:50.581602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:50.599796 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-939c5b7f-30c2-4b4b-99d4-bb61eea05031 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1468 microversion: 2.1 time: 0.786951 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Request method failure captured: Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 HTTP/1.1 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1S2IUnswOiu8Pc7d0DNK-oU7vIg3B6hk3ecleWf6dw-5C0kT12MmgrlKencZNFx4xU8vk2AkNQRQHJqbSM6Crq-R00UOVzr7yvHGxySC1OKQsfT-Qu16tpDrqY1pDHdD6o8_OYjzQyfeIPl35qu60NMXo6QCYt1a2u5uo974mHfTJc Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/06f909703b14420996925ac2850f536a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_06f909703b14420996925ac2850f536a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/06f909703b14420996925ac2850f536a"}]}] Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 06f909703b14420996925ac2850f536a Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1030533659 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 35575a22b7ce49b3b390e4578a00dfd5 Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1030533659-project Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 could not be found. Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '5b29de76-21f4-4f1e-9888-48fa586ee4d4'} Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 could not be found. Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 could not be found. Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:50.600366 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 could not be found. Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] Returning 404 to user: Instance 5b29de76-21f4-4f1e-9888-48fa586ee4d4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:50.609161 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-917da7e7-18e2-48e6-bd86-d7962fa9d94a tempest-FloatingIPsAssociationTestJSON-1030533659 tempest-FloatingIPsAssociationTestJSON-1030533659-project] 10.222.0.36 "GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4" status: 404 len: 111 microversion: 2.1 time: 0.118653 Oct 25 03:16:50.615478 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1803/3422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:49 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1468 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:50.616241 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1620/3423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:50 2022] GET /compute/v2.1/servers/5b29de76-21f4-4f1e-9888-48fa586ee4d4 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:50.619771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:50.620420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:50.638571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:50.639083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:50.639521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:50.640236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:50.640681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:50.641109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:51.639581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:51.640200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:51.656942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:51.657436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:51.657909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:51.658633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:51.659084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:51.659510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:51.780730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:51.809634 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b3f809c-c677-4765-8b11-e6f946b3791d tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1426 microversion: 2.1 time: 0.173886 Oct 25 03:16:51.818608 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1621/3424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:51 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1426 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:51.894316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:51.909767 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-419177f0-36ef-4261-beba-41906aa1e3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 1.294228 Oct 25 03:16:51.923848 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1804/3425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:50 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:52.092321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3abb0d58-8e3a-4179-969c-9726687a7949 req-2701e9aa-70af-474f-8df7-43f4b246ae70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c83511b-5d9f-4b76-aaad-265cc3e612f2", "name": "network-vif-deleted", "tag": "ac52f17b-33aa-4eae-b7f3-bac66e204686"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:52.114875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3abb0d58-8e3a-4179-969c-9726687a7949 req-2701e9aa-70af-474f-8df7-43f4b246ae70 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:52.115491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3abb0d58-8e3a-4179-969c-9726687a7949 req-2701e9aa-70af-474f-8df7-43f4b246ae70 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:52.116059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3abb0d58-8e3a-4179-969c-9726687a7949 req-2701e9aa-70af-474f-8df7-43f4b246ae70 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:52.147983 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3abb0d58-8e3a-4179-969c-9726687a7949 req-2701e9aa-70af-474f-8df7-43f4b246ae70 service nova] Creating event network-vif-deleted:ac52f17b-33aa-4eae-b7f3-bac66e204686 for instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 on n-h2-862355-1 Oct 25 03:16:52.174904 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3abb0d58-8e3a-4179-969c-9726687a7949 req-2701e9aa-70af-474f-8df7-43f4b246ae70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081725 Oct 25 03:16:52.177601 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1622/3426] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:16:52.847861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:52.848545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:52.865862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:52.868902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:52.872224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:52.873489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:52.877546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:52.879274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:52.994672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:52.997408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:53.028830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:53.029995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:53.031047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:53.032250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lazy-loading 'fault' on Instance uuid 7c83511b-5d9f-4b76-aaad-265cc3e612f2 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:16:53.033465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:53.040623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:53.041887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:53.045239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:53.045774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:53.046227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:53.263377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:53.271031 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-993e0479-5677-4a41-acda-1d593e48d88c tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 200 len: 1312 microversion: 2.1 time: 0.427235 Oct 25 03:16:53.272215 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1805/3427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:52 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 1312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:53.299073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:53.330599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:53.417313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:53.428152 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58f582bc-f2ed-4aeb-af16-3363b6f3385e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.480374 Oct 25 03:16:53.429387 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1623/3428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:52 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:54.297274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:54.297917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: 7c83511b-5d9f-4b76-aaad-265cc3e612f2] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:54.300694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:16:54.315066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.316127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.317304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.318486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.320595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.325668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.358390 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] HTTP exception thrown: Instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 could not be found. Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Request method failure captured: Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 HTTP/1.1 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Tju0RcLi4bpgGOh61kkedL6hM1YQqWUJ4sozdGF9DSEBhVk_g1ONhY5HELSXd2oNm6yAhf5rO5I7jyq5UhI0TUtaX1Ml58tA5Uo5TCVoaJHmzE_PUzMd4i2n9wxGVD4UYaVcxuCE_YYe08a_kFPniH2r82Xzs-0FUxxeIygAm72HM Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 08fac472c3ce42adbece8aed49aa9073 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1381537931 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/08fac472c3ce42adbece8aed49aa9073"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/08fac472c3ce42adbece8aed49aa9073"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_08fac472c3ce42adbece8aed49aa9073", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/08fac472c3ce42adbece8aed49aa9073"}]}] Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1381537931 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 08fac472c3ce42adbece8aed49aa9073 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1381537931 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminNegativeTestJSON-1381537931-project Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 86f1785d7d4a476ea54a4c2f0ceb3609 Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1381537931-project Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 could not be found. Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '7c83511b-5d9f-4b76-aaad-265cc3e612f2'} Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 could not be found. Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 could not be found. Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:54.360235 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 could not be found. Oct 25 03:16:54.367172 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:16:54.371041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Returning 404 to user: Instance 7c83511b-5d9f-4b76-aaad-265cc3e612f2 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:16:54.372817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec916593-78f2-453b-8fbd-7d11d38d106f tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2" status: 404 len: 111 microversion: 2.1 time: 0.079704 Oct 25 03:16:54.374444 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1806/3429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:54 2022] GET /compute/v2.1/servers/7c83511b-5d9f-4b76-aaad-265cc3e612f2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:16:54.382000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:54.382541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:54.389441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.394328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.398028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.398885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.399375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.399824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.445294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:16:54.455891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:54.456944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:54.482647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.485052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.486839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.487702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.490592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.495264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.661642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39fc1fe3-fba1-4976-9ba6-088fe29f6604 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 204 len: 0 microversion: 2.1 time: 0.282970 Oct 25 03:16:54.665857 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1624/3430] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:16:54 2022] DELETE /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:16:54.673937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:54.675334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:54.687189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.687905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.688806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.689947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:54.690768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:54.691430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:54.957370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:54.968192 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-266956b4-1030-4be0-a0b6-518c972bb921 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1478 microversion: 2.1 time: 0.300141 Oct 25 03:16:54.985666 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1625/3431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:54 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1478 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:55.590807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:55.599788 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f0d4c6c9-8260-4c69-b11d-6f270bba0230 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 1.149054 Oct 25 03:16:55.600357 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1807/3432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:54 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:55.999478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:56.000241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:56.016057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:56.021198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:56.021918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:56.022931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:56.023563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:56.025497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:56.528480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:56.542300 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-df80e9c4-b568-429d-a6f5-2750abf463ac tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1478 microversion: 2.1 time: 0.546906 Oct 25 03:16:56.544977 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1626/3433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:55 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1478 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:56.623825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:56.625504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:56.634454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:56.636355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:56.637044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:56.640913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:56.641622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:56.642360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:56.817174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e8549fe3-aeae-4125-9026-6eea107f2432 req-b5657274-06a2-45b0-aa24-fbb31fb46caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86f3ce87-196d-4bc1-a602-1ba5ae950975", "tag": "3f94364d-3677-4e47-a271-ffd5ad0ae912"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:56.843056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e8549fe3-aeae-4125-9026-6eea107f2432 req-b5657274-06a2-45b0-aa24-fbb31fb46caf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:56.845354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e8549fe3-aeae-4125-9026-6eea107f2432 req-b5657274-06a2-45b0-aa24-fbb31fb46caf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:56.846935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e8549fe3-aeae-4125-9026-6eea107f2432 req-b5657274-06a2-45b0-aa24-fbb31fb46caf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:56.889706 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e8549fe3-aeae-4125-9026-6eea107f2432 req-b5657274-06a2-45b0-aa24-fbb31fb46caf service nova] Creating event network-changed:3f94364d-3677-4e47-a271-ffd5ad0ae912 for instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 on n-h2-862355-1 Oct 25 03:16:56.910744 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e8549fe3-aeae-4125-9026-6eea107f2432 req-b5657274-06a2-45b0-aa24-fbb31fb46caf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095905 Oct 25 03:16:56.913775 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1627/3434] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:16:57.380520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:57.411428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79bdedd7-68b7-4321-8385-de2b0a3cf8f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.784249 Oct 25 03:16:57.412311 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1808/3435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:56 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:57.572882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:57.573610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:57.593628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:57.594495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:57.595173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:57.596137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:57.596823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:57.597489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:58.107716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:58.118658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87775c1e-e73d-4984-b485-4fd3d016a9df tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1478 microversion: 2.1 time: 0.553612 Oct 25 03:16:58.121276 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1628/3436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:57 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1478 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:58.442902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:58.443664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:58.475783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:58.476315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:58.476815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:58.480046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:58.480535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:58.480977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:58.709786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-13a8b271-e98f-4c18-a64d-aeb115ac79e4 req-8f1ef514-192e-4c81-89ce-51e7a6f1e2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1755534-5ca4-47f2-ba94-a464160b6169", "name": "network-vif-deleted", "tag": "fd861e0a-467e-4b26-9e99-a3e9a6449962"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:16:58.735360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-13a8b271-e98f-4c18-a64d-aeb115ac79e4 req-8f1ef514-192e-4c81-89ce-51e7a6f1e2e5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:58.735846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-13a8b271-e98f-4c18-a64d-aeb115ac79e4 req-8f1ef514-192e-4c81-89ce-51e7a6f1e2e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:58.736277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-13a8b271-e98f-4c18-a64d-aeb115ac79e4 req-8f1ef514-192e-4c81-89ce-51e7a6f1e2e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:58.798452 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-13a8b271-e98f-4c18-a64d-aeb115ac79e4 req-8f1ef514-192e-4c81-89ce-51e7a6f1e2e5 service nova] Creating event network-vif-deleted:fd861e0a-467e-4b26-9e99-a3e9a6449962 for instance d1755534-5ca4-47f2-ba94-a464160b6169 on n-h1-862355-1 Oct 25 03:16:58.826860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-13a8b271-e98f-4c18-a64d-aeb115ac79e4 req-8f1ef514-192e-4c81-89ce-51e7a6f1e2e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102977 Oct 25 03:16:58.828678 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1629/3437] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 25 03:16:59.143035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:16:59.143927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:16:59.158800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:59.159301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:59.159757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:59.160468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:59.163375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:59.164598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:59.172910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:59.185232 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9bbd2d5-c8b4-4fe4-8b5b-321bfd446375 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.748521 Oct 25 03:16:59.189251 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1809/3438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:58 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:16:59.223855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:16:59.224775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:16:59.225568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:16:59.226245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lazy-loading 'fault' on Instance uuid d1755534-5ca4-47f2-ba94-a464160b6169 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:16:59.339986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1785d7d4a476ea54a4c2f0ceb3609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fac472c3ce42adbece8aed49aa9073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:16:59.360191 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97cc76a8-4c71-411a-a60a-7f7a39f03693 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 200 len: 1312 microversion: 2.1 time: 0.221723 Oct 25 03:16:59.369773 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1630/3439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:16:59 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:00.212301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:00.214006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:00.235142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:00.235764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:00.239054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:00.239985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:00.240476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:00.242219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:00.388978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:00.389494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] [instance: d1755534-5ca4-47f2-ba94-a464160b6169] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:00.402731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:00.403254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:00.403723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:00.404446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:00.415160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:00.416514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:00.449337 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] HTTP exception thrown: Instance d1755534-5ca4-47f2-ba94-a464160b6169 could not be found. Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Request method failure captured: Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 HTTP/1.1 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Tju0RcLi4bpgGOh61kkedL6hM1YQqWUJ4sozdGF9DSEBhVk_g1ONhY5HELSXd2oNm6yAhf5rO5I7jyq5UhI0TUtaX1Ml58tA5Uo5TCVoaJHmzE_PUzMd4i2n9wxGVD4UYaVcxuCE_YYe08a_kFPniH2r82Xzs-0FUxxeIygAm72HM Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 08fac472c3ce42adbece8aed49aa9073 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1381537931 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/08fac472c3ce42adbece8aed49aa9073"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/08fac472c3ce42adbece8aed49aa9073"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_08fac472c3ce42adbece8aed49aa9073", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/08fac472c3ce42adbece8aed49aa9073"}]}] Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1381537931 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 08fac472c3ce42adbece8aed49aa9073 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1381537931 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersAdminNegativeTestJSON-1381537931-project Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 86f1785d7d4a476ea54a4c2f0ceb3609 Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1381537931-project Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance d1755534-5ca4-47f2-ba94-a464160b6169 could not be found. Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'd1755534-5ca4-47f2-ba94-a464160b6169'} Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1755534-5ca4-47f2-ba94-a464160b6169 could not be found. Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1755534-5ca4-47f2-ba94-a464160b6169 could not be found. Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:17:00.452718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1755534-5ca4-47f2-ba94-a464160b6169 could not be found. Oct 25 03:17:00.458680 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:17:00.460546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] Returning 404 to user: Instance d1755534-5ca4-47f2-ba94-a464160b6169 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:17:00.461626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-edc228e6-1c66-4d8c-a907-3539423773a9 tempest-ServersAdminNegativeTestJSON-1381537931 tempest-ServersAdminNegativeTestJSON-1381537931-project] 10.222.0.36 "GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169" status: 404 len: 111 microversion: 2.1 time: 0.077468 Oct 25 03:17:00.463158 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1631/3440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:00 2022] GET /compute/v2.1/servers/d1755534-5ca4-47f2-ba94-a464160b6169 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:17:00.778308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:00.795712 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9e23ef1-1db2-40af-8334-88f23cc9d0f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.586308 Oct 25 03:17:00.797653 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1810/3441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:00 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:01.825008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:01.827900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:01.849373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:01.850028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:01.850743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:01.851641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:01.852270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:01.854415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:02.870385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:02.890797 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-05847e09-6584-482a-ade4-1b0230042fc5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 1.071870 Oct 25 03:17:02.906368 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1632/3442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:01 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:03.923062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:03.924477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:03.945722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:03.948231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:03.948916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:03.949948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:03.952828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:03.953618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:04.619055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:04.629205 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cecb9da4-ee85-4020-816e-ffc7bf8be532 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.713418 Oct 25 03:17:04.633545 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1811/3443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:03 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:05.660543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:05.662578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:05.678995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:05.679684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:05.680384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:05.683137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:05.685767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:05.688270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:06.357260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:06.388857 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84cf47d4-13f4-4bc7-8e42-0d42153b1078 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.731055 Oct 25 03:17:06.424101 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1633/3444] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:05 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:07.250794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-159624f8-b8bc-4daa-b859-fa0c8a5dd438 req-7c93a338-4103-4352-8a37-0b131c52cabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f3ce87-196d-4bc1-a602-1ba5ae950975", "name": "network-vif-plugged", "status": "completed", "tag": "3f94364d-3677-4e47-a271-ffd5ad0ae912"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:07.278511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:07.283220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-159624f8-b8bc-4daa-b859-fa0c8a5dd438 req-7c93a338-4103-4352-8a37-0b131c52cabf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:07.286185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-159624f8-b8bc-4daa-b859-fa0c8a5dd438 req-7c93a338-4103-4352-8a37-0b131c52cabf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:07.287235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-159624f8-b8bc-4daa-b859-fa0c8a5dd438 req-7c93a338-4103-4352-8a37-0b131c52cabf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:07.332663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-159624f8-b8bc-4daa-b859-fa0c8a5dd438 req-7c93a338-4103-4352-8a37-0b131c52cabf service nova] Creating event network-vif-plugged:3f94364d-3677-4e47-a271-ffd5ad0ae912 for instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 on n-h2-862355-1 Oct 25 03:17:07.352356 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-159624f8-b8bc-4daa-b859-fa0c8a5dd438 req-7c93a338-4103-4352-8a37-0b131c52cabf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100362 Oct 25 03:17:07.354664 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1812/3445] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:07.428692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:07.429393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:07.445270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:07.450325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:07.454117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:07.455164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:07.456067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:07.462244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:07.665531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1013449853", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:07.739376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:17:07.934445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:07.945733 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a2c16b6-da82-4bae-a3aa-8c912374bbac tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.521747 Oct 25 03:17:07.950550 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1813/3446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:07 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:08.975649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:08.977628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:08.988156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:08.998157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:08.999081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:09.000008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:09.000642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:09.001285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:09.004760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:09.266474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:17:09.267835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:17:09.270996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:17:09.272284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:17:09.272955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:17:09.283821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:09.284722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:09.285483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:09.286685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:09.287339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:09.287944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:09.327796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:09.333621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:09.336533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:09.352051 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fc68f271-8027-4595-9960-3ea75e6a0655 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1314 microversion: 2.1 time: 0.379788 Oct 25 03:17:09.356558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:17:09.360639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:17:09.384715 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1814/3447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:08 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:09.445332 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aab7f6a5-6d93-44e4-9db4-1b43bc1b8d4f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050810 Oct 25 03:17:09.448537 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1634/3448] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:17:09.458397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e321e92f-c7ce-4133-9e57-c45469ec8762 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:09.459133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e321e92f-c7ce-4133-9e57-c45469ec8762 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:09.618897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e321e92f-c7ce-4133-9e57-c45469ec8762 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:09.636522 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e321e92f-c7ce-4133-9e57-c45469ec8762 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1217 microversion: 2.1 time: 0.177603 Oct 25 03:17:09.637503 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1815/3449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:09 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:10.402613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:10.403314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:10.425895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:10.426981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:10.427968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:10.430108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:10.430880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:10.438842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:10.662866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:10.663710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:10.680032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:10.680774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:10.681990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:10.683065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:10.684334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:10.684960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:10.912001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:10.925551 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87158e9d-a06b-4eaa-9e07-cd4647bd03d9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1221 microversion: 2.1 time: 0.267606 Oct 25 03:17:10.948440 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1816/3450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:10 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:11.128131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:11.142244 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-71e7a273-a616-4a27-9fbe-11d7adc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1500 microversion: 2.1 time: 0.748973 Oct 25 03:17:11.169000 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1635/3451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:10 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1500 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:11.171745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-60e5368c-aed6-432b-b14e-9a49de2efe4d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:11.181107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60e5368c-aed6-432b-b14e-9a49de2efe4d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:11.181605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60e5368c-aed6-432b-b14e-9a49de2efe4d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:11.182224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60e5368c-aed6-432b-b14e-9a49de2efe4d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:11.199686 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 03:17:11.199872 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 03:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975/action (ip 10.222.0.36) !!! Oct 25 03:17:11.309263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-60e5368c-aed6-432b-b14e-9a49de2efe4d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:17:11.436707 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-60e5368c-aed6-432b-b14e-9a49de2efe4d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975/action" status: 202 len: 0 microversion: 2.1 time: 0.265739 Oct 25 03:17:11.438053 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1817/3452] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:17:11 2022] POST /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:17:11.448562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:11.449269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:11.464817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:11.467385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:11.469779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:11.472006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:11.474045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:11.475120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:11.860509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:11.874969 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7483b342-111c-44af-8ea6-55b8b6e08d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.432571 Oct 25 03:17:11.875799 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1636/3453] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:11 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:11.970961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:11.973481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:12.024999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:12.031663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:12.035306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:12.039585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:12.045287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:12.048389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:12.338200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:12.352112 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-98ad8aef-1569-4cd2-aa8f-1b6f23a3d2a4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1287 microversion: 2.1 time: 0.398277 Oct 25 03:17:12.355825 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1818/3454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:11 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1287 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:12.908399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:12.911860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:13.007908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:13.010004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:13.012052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:13.012999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:13.014488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:13.016067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:13.383521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:13.385088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:13.398971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:13.406380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:13.408645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:13.410570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:13.412441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:13.413880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:13.921518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:13.950637 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8efbd3df-14a4-4043-94da-a70dc5a6106a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 1.054096 Oct 25 03:17:13.953984 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1637/3455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:12 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:14.183187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:14.203014 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c816e3b1-60d3-405f-8d81-093a6a216eac tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1275 microversion: 2.1 time: 0.823798 Oct 25 03:17:14.208237 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1819/3456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:13 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1275 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:14.984306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:14.985550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:14.999789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:15.007856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:15.009555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:15.010054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:15.013098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:15.016236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:15.017788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:15.080393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:15.229893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:15.232540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:15.242890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:15.245124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:15.245895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:15.246866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:15.247563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:15.248274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:16.078042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:16.092233 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d9df495-fcf5-4eec-952a-2951516eccd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 1.114412 Oct 25 03:17:16.107367 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1638/3457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:14 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:16.298595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:16.317790 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1e3a4ac-994a-40df-9390-a58de471295e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 1.091609 Oct 25 03:17:16.318437 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1820/3458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:15 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:17.122073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:17.123291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:17.140316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:17.142146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:17.142736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:17.144358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:17.146248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:17.146768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:17.341362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:17.342777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:17.356184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:17.362364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:17.362959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:17.363980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:17.364999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:17.365764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:17.535488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:17.556405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9137bf6-cc3e-4b7d-8c3f-3fcfa0c7d23c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.439400 Oct 25 03:17:17.563881 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1639/3459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:17 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:18.464295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:18.478423 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8fe3eea1-8734-4410-930d-d5649d02c0c2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 1.137110 Oct 25 03:17:18.489729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1821/3460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:17 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:18.580903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:18.581543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:18.600595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:18.601368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:18.609824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:18.610952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:18.611601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:18.612215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:18.964804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:18.974441 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-223a6a90-5f1e-462c-a1bd-c17665761265 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.397817 Oct 25 03:17:18.980940 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1640/3461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:18 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:19.506947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:19.508589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:19.520667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:19.532409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:19.534058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:19.537061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:19.539631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:19.541194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:19.644996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:19.746395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ce0bce54-bef0-4b5e-95fb-5f5fc0a0f957 req-cd51dca6-716c-4d96-9a3d-7c49948a1e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a", "tag": "b239ffd4-1930-4901-bc34-2c5918c886dd"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:19.751969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:19.752642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:19.794383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ce0bce54-bef0-4b5e-95fb-5f5fc0a0f957 req-cd51dca6-716c-4d96-9a3d-7c49948a1e6e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:19.795628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ce0bce54-bef0-4b5e-95fb-5f5fc0a0f957 req-cd51dca6-716c-4d96-9a3d-7c49948a1e6e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:19.796079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ce0bce54-bef0-4b5e-95fb-5f5fc0a0f957 req-cd51dca6-716c-4d96-9a3d-7c49948a1e6e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:19.832183 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ce0bce54-bef0-4b5e-95fb-5f5fc0a0f957 req-cd51dca6-716c-4d96-9a3d-7c49948a1e6e service nova] Creating event network-changed:b239ffd4-1930-4901-bc34-2c5918c886dd for instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a on n-h1-862355-1 Oct 25 03:17:19.857722 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ce0bce54-bef0-4b5e-95fb-5f5fc0a0f957 req-cd51dca6-716c-4d96-9a3d-7c49948a1e6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109717 Oct 25 03:17:19.870738 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1641/3462] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:20.015695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:20.016327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:20.039475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:20.041058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:20.042302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:20.045590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:20.046583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:20.047478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:20.317201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:20.329490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e39e9041-74b5-4f18-b4a0-1835aa909f81 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 0.828147 Oct 25 03:17:20.358886 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1822/3463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:19 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:21.359596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:21.360438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:21.369994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:21.387292 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c79f9a6-d845-4962-af31-7f8f46fddeca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 1.383365 Oct 25 03:17:21.387909 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1642/3464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:20 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:21.408071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:21.409419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:21.413304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:21.414630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:21.415895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:21.417781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:22.018906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:22.046755 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4187fd0a-29b5-4dc3-b0d6-e5d15f9d13bb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 0.691432 Oct 25 03:17:22.052658 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1823/3465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:21 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:22.417586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:22.418567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:22.441306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:22.441306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:22.444938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:22.450510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:22.452453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:22.453760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:22.945447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:22.974860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a83e4c4-0e98-4738-b240-2ee55b065fc9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.562151 Oct 25 03:17:22.976656 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1643/3466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:22 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:23.084543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:23.085174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:23.099634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:23.100330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:23.102670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:23.105150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:23.105632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:23.106100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:23.785822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:23.802527 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d4774c6f-46ec-4661-8ca8-b603b62cf39b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 0.721791 Oct 25 03:17:23.803328 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1824/3467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:23 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:24.004964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:24.005753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:24.020031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:24.020541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:24.020989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:24.021762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:24.023167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:24.028191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:24.561150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:24.591446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e86643c1-0405-4348-9fbb-99e31495cc8f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.587868 Oct 25 03:17:24.594603 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1644/3468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:23 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:24.828597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:24.829392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:24.849044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:24.849821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:24.850966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:24.855663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:24.859168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:24.863092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:25.626418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:25.627927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:25.638673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:25.640996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:25.641705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:25.642721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:25.643522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:25.646917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:25.915847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:25.937101 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92a2e4d1-bd71-4fdf-862e-747a225a9864 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 1.112316 Oct 25 03:17:25.937762 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1825/3469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:24 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:25.975881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:25.987219 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c2cf948-9ed1-440d-bb63-a163a97b9ecd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.366482 Oct 25 03:17:25.988124 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1645/3470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:25 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:26.729798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-52f44bd4-392b-4e8b-ac8b-47831c0b5d93 req-d53b5587-1c3b-4eca-8f8c-572c999ffd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a", "name": "network-vif-plugged", "status": "completed", "tag": "b239ffd4-1930-4901-bc34-2c5918c886dd"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:26.754342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52f44bd4-392b-4e8b-ac8b-47831c0b5d93 req-d53b5587-1c3b-4eca-8f8c-572c999ffd71 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:26.754826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52f44bd4-392b-4e8b-ac8b-47831c0b5d93 req-d53b5587-1c3b-4eca-8f8c-572c999ffd71 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:26.755257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52f44bd4-392b-4e8b-ac8b-47831c0b5d93 req-d53b5587-1c3b-4eca-8f8c-572c999ffd71 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:26.780604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-52f44bd4-392b-4e8b-ac8b-47831c0b5d93 req-d53b5587-1c3b-4eca-8f8c-572c999ffd71 service nova] Creating event network-vif-plugged:b239ffd4-1930-4901-bc34-2c5918c886dd for instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a on n-h1-862355-1 Oct 25 03:17:26.798531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-52f44bd4-392b-4e8b-ac8b-47831c0b5d93 req-d53b5587-1c3b-4eca-8f8c-572c999ffd71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069993 Oct 25 03:17:26.799703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1826/3471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:26.965656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:26.966326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:26.985463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:26.986009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:26.987278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:26.988811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:26.991350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:26.994202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:27.021327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:27.023238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:27.057812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:27.058404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:27.058743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:27.062439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:27.071377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:27.072520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:27.693489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:27.712038 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6ce33eb7-e9ce-4efd-832c-0c708241245f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 0.750891 Oct 25 03:17:27.713346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:27.721354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1646/3472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:26 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:27.726326 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ec7325d-89ae-4df0-b400-2a9a57ae64d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.710670 Oct 25 03:17:27.739562 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1827/3473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:27 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:27.994893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a1a94b8-9fb2-40c3-ae0c-0294091a5497 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Action: 'create', calling method: .version_select at 0x7efd3330d4c0>, body: {"pool": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:28.742619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:28.746674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:28.761143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:28.761950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:28.762570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:28.763519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:28.763985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:28.764419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:29.106856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:29.114320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd1b4a73-f649-4e94-9bda-84c7808b29d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1317 microversion: 2.1 time: 0.379790 Oct 25 03:17:29.114963 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1828/3474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:28 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:29.123807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:29.135237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:29.155742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:29.156265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:29.156705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:29.157448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:29.157944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:29.158422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:29.373320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:29.386823 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df57aad7-75c9-42e6-8ba3-03d81e2042bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.270747 Oct 25 03:17:29.399637 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1829/3475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:29 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:30.139871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:30.140657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:30.150149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:30.150469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:30.150935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:30.151670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:30.152151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:30.152570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:30.423548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:30.433472 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3754537b-1337-424c-af98-872ad6ffae01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1466 microversion: 2.1 time: 0.297510 Oct 25 03:17:30.434735 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1830/3476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:30 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1466 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:30.443311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:30.448532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:30.471356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:30.474177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:30.474844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:30.476568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:30.477951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:30.478593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:30.508630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:30.825362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:30.833296 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-04109af4-0bd7-487a-89a2-4284202425aa tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.397114 Oct 25 03:17:30.849935 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1831/3477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:30 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:31.038961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:31.040874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:31.049775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:31.051018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:31.052004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:31.053169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:31.053881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:31.054494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:31.711905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-598d1033-37eb-4c75-9c9e-7da715ccac23 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1617 microversion: 2.1 time: 0.859434 Oct 25 03:17:31.714763 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1832/3478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:30 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1617 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:31.739251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6fd6638e-3c6d-4f96-a33f-d68ba9340cbf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: .version_select at 0x7efd3284b310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1601062055", "policies": ["affinity"]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:31.762404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6fd6638e-3c6d-4f96-a33f-d68ba9340cbf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:31.777368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6fd6638e-3c6d-4f96-a33f-d68ba9340cbf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:31.861283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6fd6638e-3c6d-4f96-a33f-d68ba9340cbf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:31.872386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6fd6638e-3c6d-4f96-a33f-d68ba9340cbf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:31.890116 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6fd6638e-3c6d-4f96-a33f-d68ba9340cbf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.154476 Oct 25 03:17:31.894993 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1833/3479] 10.222.0.36 () {60 vars in 1174 bytes} [Tue Oct 25 03:17:31 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:17:31.904947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:31.905671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:31.913324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:31.913968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:31.915321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:31.916793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:31.917771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:31.918461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:32.271683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:32.284174 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff257d62-3bd7-4a99-8c92-4d2d8204a896 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.387791 Oct 25 03:17:32.287255 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1834/3480] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:31 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:32.306692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1688374548", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6e0d3758-87cf-4904-853a-2ead1e491030"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:32.443329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:17:32.970567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:17:32.971197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:17:32.971751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:17:32.972352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:17:32.972861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:17:32.993015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:32.993753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:32.997390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:32.998750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:33.000033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:33.003549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:33.028923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:33.034856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:33.052467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Going to run 2 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:17:33.057079 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a1a94b8-9fb2-40c3-ae0c-0294091a5497 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.334415 Oct 25 03:17:33.058095 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1647/3481] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:17:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:33.059089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:17:33.070341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d085c9e5-7fef-4e9d-8f74-8c3c89a4164e tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Calling method '.version_select at 0x7efd32f14af0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:33.111982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120562) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 25 03:17:33.146423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:33.155004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:33.159258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:33.224608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:33.230825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:33.253912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=85aa6e51-d017-47ad-a622-dcaa21838be8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:17:33.332076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:33.341355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:33.369068 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d085c9e5-7fef-4e9d-8f74-8c3c89a4164e tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/e9663cf6-271a-4eac-ac80-8cb97fa1c52a" status: 200 len: 142 microversion: 2.1 time: 0.302467 Oct 25 03:17:33.370248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1648/3482] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:17:33 2022] GET /compute/v2.1/os-floating-ips/e9663cf6-271a-4eac-ac80-8cb97fa1c52a => generated 142 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:33.376604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:33.377736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:33.399862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:33.403257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:33.404636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:33.408009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:33.408699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:33.412633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:33.420787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:33.427421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:33.495091 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-036e411b-5523-421b-a988-94bd4c1dca78 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.203872 Oct 25 03:17:33.495954 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1835/3483] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:17:32 2022] POST /compute/v2.1/servers => generated 32 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 25 03:17:33.501201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd3917c7-d54d-4136-9564-cda4e1d48afe tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Calling method '.version_select at 0x7efd328b18b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:33.976427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:33.997616 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9af31b3e-ed34-4f69-9879-bbfdc72bf15a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.625551 Oct 25 03:17:33.998873 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1649/3484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:33 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:34.004784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:34.015622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:34.016935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Searching by: {'deleted': False, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:17:34.058003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:34.058735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:34.070929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:34.072306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:34.073080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:34.073807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:34.140410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:17:34.208436 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6afb7896-2ca8-41e8-a8ba-a41c39870ea6 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.207238 Oct 25 03:17:34.209847 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1650/3485] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:17:33 2022] GET /compute/v2.1/servers => generated 1004 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:34.227488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-353ff721-0c3f-4fee-8ae1-26bce36f96ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:34.228389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-353ff721-0c3f-4fee-8ae1-26bce36f96ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:34.437311 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd3917c7-d54d-4136-9564-cda4e1d48afe tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.940383 Oct 25 03:17:34.445847 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1836/3486] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:17:33 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:34.450540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c5ef4c1-c2af-4459-b7f8-bacfd017cc74 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Calling method '.version_select at 0x7efd3280d1f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:34.476474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-353ff721-0c3f-4fee-8ae1-26bce36f96ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:34.488997 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-353ff721-0c3f-4fee-8ae1-26bce36f96ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1219 microversion: 2.1 time: 0.270131 Oct 25 03:17:34.489859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1651/3487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:34 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1219 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:35.025071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:35.029039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:35.043668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:35.056781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:35.058175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:35.063808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:35.065276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:35.066937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:35.658338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:35.674924 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99b1f391-9c94-445b-ae72-210674f84f2c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.653920 Oct 25 03:17:35.677624 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1652/3488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:35 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:35.694852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:35.697175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:35.718743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:35.720524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:35.724916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:35.727584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:35.728625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:35.729531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:35.840169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:35.862525 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-383ef77f-5944-4fdd-b8df-6f7f4d1dc948 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1215 microversion: 2.1 time: 0.181070 Oct 25 03:17:35.864796 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1653/3489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:35 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:36.642156 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c5ef4c1-c2af-4459-b7f8-bacfd017cc74 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/e9663cf6-271a-4eac-ac80-8cb97fa1c52a" status: 202 len: 0 microversion: 2.1 time: 2.194449 Oct 25 03:17:36.643485 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1837/3490] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:17:34 2022] DELETE /compute/v2.1/os-floating-ips/e9663cf6-271a-4eac-ac80-8cb97fa1c52a => generated 0 bytes in 2197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:17:36.653352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5a24cbc-80d8-4ca8-a790-24cc41945916 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Action: 'create', calling method: .version_select at 0x7efd33064670>, body: {"pool": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:36.707176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:36.707901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:36.718834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:36.720095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:36.721614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:36.723592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:36.725262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:36.726827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:37.065496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:37.090315 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94643a77-3405-4706-bfa6-ede114b95fd9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1510 microversion: 2.1 time: 0.387314 Oct 25 03:17:37.091551 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1838/3491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:36 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:37.097408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:37.098409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:37.110571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:37.111331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:37.112016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:37.113092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:37.113945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:37.114586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:37.205272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:37.218954 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b11a4b71-07b1-47f8-837e-d7629c154ed5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1277 microversion: 2.1 time: 0.125763 Oct 25 03:17:37.220931 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1839/3492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:37 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:38.115274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:38.116730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:38.132553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.137251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.138848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:38.141384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.143029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.144173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:38.446809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:38.460017 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-522585e6-db7a-4531-93f3-a02e62c80887 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1487 microversion: 2.1 time: 0.349250 Oct 25 03:17:38.464107 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1840/3493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:38 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:38.473806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:38.475915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:38.489538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.490066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.490503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:38.491281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.496967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.499751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:38.714194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:38.727583 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-25163723-6653-4a99-850a-5f70ef43c94b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1277 microversion: 2.1 time: 0.262107 Oct 25 03:17:38.731013 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1841/3494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:38 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:38.759468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:38.761486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:38.777159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.778732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.779723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:38.783816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.784529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.785191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:38.879437 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7abd837c-5bab-42f3-9f64-5a4138a1d1ed tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 200 len: 128 microversion: 2.1 time: 0.129530 Oct 25 03:17:38.880525 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1842/3495] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:17:38 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 128 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:38.891630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:38.892865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:38.913143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.917948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.918864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:38.920035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:38.922730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:38.923418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:39.364843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:39.381441 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c06f2c8-3b9b-4844-afaf-d538bd9c1a12 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.494283 Oct 25 03:17:39.398851 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1843/3496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:38 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:39.432990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:39.433282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:39.443823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:39.444420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:39.444865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:39.446423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:39.447548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:39.448223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:40.540532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:40.549785 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b1b98811-f6b5-4461-9e10-4b8eb175f13b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 1.123588 Oct 25 03:17:40.572175 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1844/3497] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:39 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:40.594760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:40.595393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:40.622898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:40.623323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:40.628006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:40.629476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:40.631521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:40.634908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:41.098153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:41.114641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22e5aade-ca5e-4ff1-97ea-bc307fa6fb51 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.538991 Oct 25 03:17:41.115240 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1845/3498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:40 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:41.423990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b5fea8a8-527b-4768-bc4e-2556ed83f676 req-090933f3-a244-45f3-8fc1-7fa8bb642597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85aa6e51-d017-47ad-a622-dcaa21838be8", "tag": "09ba7e54-9ba1-445c-af39-0a741a3c39bd"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:41.444268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b5fea8a8-527b-4768-bc4e-2556ed83f676 req-090933f3-a244-45f3-8fc1-7fa8bb642597 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:41.447705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b5fea8a8-527b-4768-bc4e-2556ed83f676 req-090933f3-a244-45f3-8fc1-7fa8bb642597 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:41.448427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b5fea8a8-527b-4768-bc4e-2556ed83f676 req-090933f3-a244-45f3-8fc1-7fa8bb642597 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:41.480177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b5fea8a8-527b-4768-bc4e-2556ed83f676 req-090933f3-a244-45f3-8fc1-7fa8bb642597 service nova] Creating event network-changed:09ba7e54-9ba1-445c-af39-0a741a3c39bd for instance 85aa6e51-d017-47ad-a622-dcaa21838be8 on n-h1-862355-1 Oct 25 03:17:41.488420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b5fea8a8-527b-4768-bc4e-2556ed83f676 req-090933f3-a244-45f3-8fc1-7fa8bb642597 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371782 Oct 25 03:17:41.493717 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1846/3499] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:41.510602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:41.511996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:41.521440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:41.524297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:41.524984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:41.525821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:41.527995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:41.529930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:41.999292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:42.010146 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ac4d063e-874f-46b3-9936-683817e67197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.514794 Oct 25 03:17:42.021529 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1847/3500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:41 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:42.033788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:42.034418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:42.040988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:42.041480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:42.042156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:42.042898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:42.043365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:42.043799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:42.340780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:42.356318 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f7f5195-222d-4136-bd73-1afcd9688a42 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.326406 Oct 25 03:17:42.372153 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1848/3501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:42 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:42.379076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:42.381484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:42.393870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:42.394700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:42.395152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:42.396181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:42.396876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:42.398566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:42.502592 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5a24cbc-80d8-4ca8-a790-24cc41945916 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.853740 Oct 25 03:17:42.511161 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1654/3502] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:17:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:42.511161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1970829978", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:42.577155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] validate_networks() for [('0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:17:42.754867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:42.764603 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47038948-24c0-41db-88bb-f8e4fe0b7dcc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.391233 Oct 25 03:17:42.765607 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1849/3503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:42 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:42.770462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-607c6899-efa5-462c-8da0-d1db01e4572e tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Calling method '.version_select at 0x7efd328980d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:43.014609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:43.437518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=30 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:44.083963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:44.422884 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-607c6899-efa5-462c-8da0-d1db01e4572e tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc" status: 202 len: 0 microversion: 2.1 time: 1.656010 Oct 25 03:17:44.424349 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1850/3504] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:17:42 2022] DELETE /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc => generated 0 bytes in 1658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:17:44.431751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:44.437745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:44.447018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:44.447790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:44.448343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:44.449900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:44.450203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:44.450672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:44.484051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:44.772462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:44.840004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:17:44.840551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:17:44.841716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:17:44.843257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:17:44.844026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:17:44.857416 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16835bb8-6381-4047-99e0-e0b84173965b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.431680 Oct 25 03:17:44.861542 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1851/3505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:44 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:44.875265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:44.879631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f17c7723-ba8d-409e-bd3a-8103387d6665 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Calling method '.version_select at 0x7efd33bcfd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:44.881115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:44.881791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:44.890872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:44.891502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:44.891772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:44.962161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:17:44.982269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for user 41342d3f5062457aaee26cf5d836e441 and project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:17:45.022157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-f17c7723-ba8d-409e-bd3a-8103387d6665 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6818dff4-cf63-46e1-9196-9f424fcc6ddc could not be found", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:17:45.023741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f17c7723-ba8d-409e-bd3a-8103387d6665 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] HTTP exception thrown: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f17c7723-ba8d-409e-bd3a-8103387d6665 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Request method failure captured: Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc HTTP/1.1 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1VHdl0UV8Innwpuc0UU2iWQlhlE3H75Hhtf8f6b40KPUS8gaYwfyThAY7C8Y9_JzeGNzOa2uWDNcnmu8gpGyFX4yuhWic51srzvPDaoip9ZeJVn5qf3s5GEwjDHdZw69HGSicftTmCxfhU3Vm3iu7CwwtUhCH39J0vbE-q11F5X2HI Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8fe9811be6cf4accabf3b57fc40ff6e9 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsTestJSON-251666263 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8fe9811be6cf4accabf3b57fc40ff6e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8fe9811be6cf4accabf3b57fc40ff6e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8fe9811be6cf4accabf3b57fc40ff6e9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8fe9811be6cf4accabf3b57fc40ff6e9"}]}] Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsTestJSON-251666263 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8fe9811be6cf4accabf3b57fc40ff6e9 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsTestJSON-251666263 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsTestJSON-251666263-project Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 7e2b5759996a45e081b93f09961545e2 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsTestJSON-251666263-project Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: exception: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6818dff4-cf63-46e1-9196-9f424fcc6ddc'} Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6818dff4-cf63-46e1-9196-9f424fcc6ddc could not be found Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9210de1a-1d80-4c76-b64b-2aa693833553'] Oct 25 03:17:45.025722 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc. Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f17c7723-ba8d-409e-bd3a-8103387d6665 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Returning 404 to user: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:17:45.030703 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f17c7723-ba8d-409e-bd3a-8103387d6665 tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc" status: 404 len: 111 microversion: 2.1 time: 0.162990 Oct 25 03:17:45.033645 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1852/3506] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:17:44 2022] GET /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:17:45.036819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:17:45.037585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bde776d8-7599-4f04-9604-f62c1ea4a990 req-43a66162-7fc9-4145-bb0a-a56e6b0093b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74288f30-f899-45b0-858f-74469b93d003", "tag": "11fe32a1-2b7c-4219-afee-c12a39c98357"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:45.039983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:17:45.049426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bde776d8-7599-4f04-9604-f62c1ea4a990 req-43a66162-7fc9-4145-bb0a-a56e6b0093b2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:45.050455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bde776d8-7599-4f04-9604-f62c1ea4a990 req-43a66162-7fc9-4145-bb0a-a56e6b0093b2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:45.051291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bde776d8-7599-4f04-9604-f62c1ea4a990 req-43a66162-7fc9-4145-bb0a-a56e6b0093b2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:45.074544 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bde776d8-7599-4f04-9604-f62c1ea4a990 req-43a66162-7fc9-4145-bb0a-a56e6b0093b2 service nova] Creating event network-changed:11fe32a1-2b7c-4219-afee-c12a39c98357 for instance 74288f30-f899-45b0-858f-74469b93d003 on n-h1-862355-1 Oct 25 03:17:45.092175 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bde776d8-7599-4f04-9604-f62c1ea4a990 req-43a66162-7fc9-4145-bb0a-a56e6b0093b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057897 Oct 25 03:17:45.096374 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1853/3507] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:45.102745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=42 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:45.111411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6463878b-5189-4a86-a61d-536be8e38d5c tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Calling method '.version_select at 0x7efd33624ca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:45.195376 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa23d8f0-0611-45b1-933b-9849bd14ae9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.688191 Oct 25 03:17:45.198990 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1655/3508] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:17:45.216966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1158bc79-3ea3-41a0-9099-470ef3af17c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:45.219259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1158bc79-3ea3-41a0-9099-470ef3af17c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:45.285562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-6463878b-5189-4a86-a61d-536be8e38d5c tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6818dff4-cf63-46e1-9196-9f424fcc6ddc could not be found", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:17:45.286630 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6463878b-5189-4a86-a61d-536be8e38d5c tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] HTTP exception thrown: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6463878b-5189-4a86-a61d-536be8e38d5c tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Request method failure captured: Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc HTTP/1.1 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1VHdl0UV8Innwpuc0UU2iWQlhlE3H75Hhtf8f6b40KPUS8gaYwfyThAY7C8Y9_JzeGNzOa2uWDNcnmu8gpGyFX4yuhWic51srzvPDaoip9ZeJVn5qf3s5GEwjDHdZw69HGSicftTmCxfhU3Vm3iu7CwwtUhCH39J0vbE-q11F5X2HI Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8fe9811be6cf4accabf3b57fc40ff6e9 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-FloatingIPsTestJSON-251666263 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8fe9811be6cf4accabf3b57fc40ff6e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8fe9811be6cf4accabf3b57fc40ff6e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8fe9811be6cf4accabf3b57fc40ff6e9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8fe9811be6cf4accabf3b57fc40ff6e9"}]}] Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-FloatingIPsTestJSON-251666263 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8fe9811be6cf4accabf3b57fc40ff6e9 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-FloatingIPsTestJSON-251666263 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-FloatingIPsTestJSON-251666263-project Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 7e2b5759996a45e081b93f09961545e2 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-FloatingIPsTestJSON-251666263-project Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: exception: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6818dff4-cf63-46e1-9196-9f424fcc6ddc'} Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6818dff4-cf63-46e1-9196-9f424fcc6ddc could not be found Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13ae4399-8321-4035-89a7-1dac408d2ec6'] Oct 25 03:17:45.288908 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc. Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6463878b-5189-4a86-a61d-536be8e38d5c tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] Returning 404 to user: Floating IP not found for ID 6818dff4-cf63-46e1-9196-9f424fcc6ddc {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:17:45.294907 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6463878b-5189-4a86-a61d-536be8e38d5c tempest-FloatingIPsTestJSON-251666263 tempest-FloatingIPsTestJSON-251666263-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc" status: 404 len: 111 microversion: 2.1 time: 0.191365 Oct 25 03:17:45.297557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1854/3509] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:17:45 2022] DELETE /compute/v2.1/os-floating-ips/6818dff4-cf63-46e1-9196-9f424fcc6ddc => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:17:45.408835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1158bc79-3ea3-41a0-9099-470ef3af17c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:45.419222 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1158bc79-3ea3-41a0-9099-470ef3af17c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1215 microversion: 2.1 time: 0.207144 Oct 25 03:17:45.422376 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1656/3510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:45 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:45.890303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:45.891337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:45.900061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:45.900713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:45.901519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:45.902484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:45.903173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:45.903915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:46.448207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:46.448939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:46.471812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:46.479868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:46.480635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:46.484628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:46.485631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:46.487355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:46.493756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:46.496679 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5eb5e6a9-3f6d-48b1-9e5b-5eb8490d34d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.611765 Oct 25 03:17:46.500903 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1855/3511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:45 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:46.569452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=75 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:47.112949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dd63ca94-c771-4cf4-950a-a1496155a592 req-a09494dd-6c76-410d-8c58-b07c2d353511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aa6e51-d017-47ad-a622-dcaa21838be8", "name": "network-vif-plugged", "status": "completed", "tag": "09ba7e54-9ba1-445c-af39-0a741a3c39bd"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:47.135658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dd63ca94-c771-4cf4-950a-a1496155a592 req-a09494dd-6c76-410d-8c58-b07c2d353511 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:47.136155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dd63ca94-c771-4cf4-950a-a1496155a592 req-a09494dd-6c76-410d-8c58-b07c2d353511 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:47.136595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dd63ca94-c771-4cf4-950a-a1496155a592 req-a09494dd-6c76-410d-8c58-b07c2d353511 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:47.189374 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dd63ca94-c771-4cf4-950a-a1496155a592 req-a09494dd-6c76-410d-8c58-b07c2d353511 service nova] Creating event network-vif-plugged:09ba7e54-9ba1-445c-af39-0a741a3c39bd for instance 85aa6e51-d017-47ad-a622-dcaa21838be8 on n-h1-862355-1 Oct 25 03:17:47.211778 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dd63ca94-c771-4cf4-950a-a1496155a592 req-a09494dd-6c76-410d-8c58-b07c2d353511 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101665 Oct 25 03:17:47.225882 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1856/3512] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:17:47.437241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:47.450148 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-79232aa6-9a05-43b2-82fa-b2d94cb503e6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1211 microversion: 2.1 time: 1.006618 Oct 25 03:17:47.466565 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1657/3513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:46 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1211 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:47.528292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:47.529115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:47.548432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:47.554710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:47.555298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:47.556062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:47.556538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:47.556971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:47.561583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:48.159361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:48.174900 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ef84448-42c1-4e04-9fb0-5e8a37380490 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.651816 Oct 25 03:17:48.175635 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1857/3514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:47 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:48.480122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:48.481816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:48.492581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:48.493404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:48.497011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:48.498211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:48.509743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:48.511583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:48.715744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:48.728208 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3b2aa632-0c0b-452a-ab61-ef229dbd119a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1273 microversion: 2.1 time: 0.248829 Oct 25 03:17:48.742180 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1658/3515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:48 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:49.205766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:49.206576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:49.222317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:49.222974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:49.223637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:49.224601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:49.225293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:49.227969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:49.675527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:49.688652 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fb1077ae-a960-41a8-95c8-71f706c512cf tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.487204 Oct 25 03:17:49.689187 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1858/3516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:49 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:49.760860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:49.762005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:49.783498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:49.784019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:49.786643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:49.787386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:49.787848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:49.788279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:50.713825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:50.715379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:50.737511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:50.738042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:50.738858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:50.747484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:50.748261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:50.748909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:51.157148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:51.171947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7acde682-8071-48ac-b5b3-e977e6b2e038 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.463358 Oct 25 03:17:51.174044 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1859/3517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:50 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:51.176039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:51.186998 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a8c6a9e-c911-43dc-a8f2-8168f5af73af tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 1.428629 Oct 25 03:17:51.189389 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1659/3518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:49 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:51.608156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4ddad338-a4c7-4e0d-b58a-de7c99e9465f req-05ea2996-e392-42ef-9bf6-fd3bf0c6fc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4cdf5f-9bbe-405c-b0c6-506517c14415", "tag": "eb885822-86a8-481f-b965-cbb4ff96f05b"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:51.641484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4ddad338-a4c7-4e0d-b58a-de7c99e9465f req-05ea2996-e392-42ef-9bf6-fd3bf0c6fc7e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:51.642010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4ddad338-a4c7-4e0d-b58a-de7c99e9465f req-05ea2996-e392-42ef-9bf6-fd3bf0c6fc7e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:51.642609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4ddad338-a4c7-4e0d-b58a-de7c99e9465f req-05ea2996-e392-42ef-9bf6-fd3bf0c6fc7e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:51.679989 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4ddad338-a4c7-4e0d-b58a-de7c99e9465f req-05ea2996-e392-42ef-9bf6-fd3bf0c6fc7e service nova] Creating event network-changed:eb885822-86a8-481f-b965-cbb4ff96f05b for instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 on n-h2-862355-1 Oct 25 03:17:51.694869 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4ddad338-a4c7-4e0d-b58a-de7c99e9465f req-05ea2996-e392-42ef-9bf6-fd3bf0c6fc7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090570 Oct 25 03:17:51.695518 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1860/3519] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:52.205123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:52.217382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:52.224430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:52.225244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:52.236550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:52.240362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:52.242401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:52.242602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:52.243067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:52.243549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:52.243818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:52.244283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:52.244716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:52.245082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:52.245980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:52.246618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:52.855395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:52.870329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21cc87d0-4b08-4a82-ab92-3ef3d57d27a2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.672082 Oct 25 03:17:52.876955 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1660/3520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:52 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:53.256643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:53.269351 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0dca61c1-8293-40f2-815a-e4f67a66b706 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 1.051254 Oct 25 03:17:53.272305 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1861/3521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:52 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:53.901882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:53.902511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:53.925359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:53.925902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:53.931735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:53.938666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:53.939358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:53.942940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:54.299273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:54.301182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:54.321781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:54.325254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:54.327568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:54.344527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:54.345286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:54.350165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:54.539068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:54.586925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d60f3873-367f-4154-ad53-071b54f948d8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 0.679256 Oct 25 03:17:54.590744 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1661/3522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:53 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:54.818534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:54.828752 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d91602c-33ae-4565-b90b-8fbe9d4d3c1b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 0.533694 Oct 25 03:17:54.839533 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1862/3523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:54 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:55.087577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-bcc8c30f-0dd8-4d64-a97e-b374fbde80a3 req-a0eb5b1a-410d-4952-989e-b41468c2321d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74288f30-f899-45b0-858f-74469b93d003", "name": "network-vif-plugged", "status": "completed", "tag": "11fe32a1-2b7c-4219-afee-c12a39c98357"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:17:55.111317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:55.113318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bcc8c30f-0dd8-4d64-a97e-b374fbde80a3 req-a0eb5b1a-410d-4952-989e-b41468c2321d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:55.118145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bcc8c30f-0dd8-4d64-a97e-b374fbde80a3 req-a0eb5b1a-410d-4952-989e-b41468c2321d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:55.121756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bcc8c30f-0dd8-4d64-a97e-b374fbde80a3 req-a0eb5b1a-410d-4952-989e-b41468c2321d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:55.147484 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-bcc8c30f-0dd8-4d64-a97e-b374fbde80a3 req-a0eb5b1a-410d-4952-989e-b41468c2321d service nova] Creating event network-vif-plugged:11fe32a1-2b7c-4219-afee-c12a39c98357 for instance 74288f30-f899-45b0-858f-74469b93d003 on n-h1-862355-1 Oct 25 03:17:55.164320 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-bcc8c30f-0dd8-4d64-a97e-b374fbde80a3 req-a0eb5b1a-410d-4952-989e-b41468c2321d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081990 Oct 25 03:17:55.166231 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1662/3524] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:55.615966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:55.617048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:55.631588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:55.634741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:55.635536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:55.636745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:55.638426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:55.639749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:55.864478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:55.870601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:55.871416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:55.888129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:55.888710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:55.890376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:55.892649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:55.893188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:55.894832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:56.602430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:56.643226 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-580ed92a-be84-4035-9126-a1684765d953 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1319 microversion: 2.1 time: 1.025723 Oct 25 03:17:56.645077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1863/3525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:55 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1319 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:56.818187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:56.845747 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa2967b4-67c2-447c-8021-900239115caf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 0.977566 Oct 25 03:17:56.856640 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1663/3526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:55 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:57.672243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:57.672756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:57.690331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:57.691123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:57.694983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:57.696430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:57.697065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:57.697643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:57.877432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:57.879227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:57.898641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:57.909844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:57.910871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:57.911670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:57.912159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:57.912597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:58.164482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:58.181491 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0c5584e1-b6a8-4de2-9a03-7251e5e26ae5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1469 microversion: 2.1 time: 0.513231 Oct 25 03:17:58.186562 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1864/3527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:57 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1469 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:58.217497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:58.218332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:58.230880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:58.233929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:58.237106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:58.240871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:58.245043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:58.245800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:58.732947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:58.749340 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f2a61ecc-7aa9-4fe2-9272-1c6218f6f4e7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8" status: 200 len: 1468 microversion: 2.1 time: 0.536635 Oct 25 03:17:58.749999 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1865/3528] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:58 2022] GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 => generated 1468 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:58.777346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:58.783496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:58.791537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Searching by: {'reservation_id': 'r-ver64ps0', 'deleted': False, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:17:58.811266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:58.816483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:58.817143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:58.818528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:58.820794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:58.823697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:59.101119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:17:59.171401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:59.189544 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fda3e2d2-4a4a-43c0-b5bb-dd7076fdafb5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 1.310897 Oct 25 03:17:59.195600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1664/3529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:57 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:17:59.213284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:17:59.222261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:59.223130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:59.223803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:59.489909 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b6a3c78-6906-496b-899c-139cdd14f474 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-ver64ps0" status: 200 len: 2930 microversion: 2.1 time: 0.717108 Oct 25 03:17:59.490983 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1866/3530] 10.222.0.36 () {58 vars in 1197 bytes} [Tue Oct 25 03:17:58 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ver64ps0 => generated 2930 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:17:59.515415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0abc1ec6-6ca3-4b2c-878f-b6be19baf315 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:59.589399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.server_groups [None req-0abc1ec6-6ca3-4b2c-878f-b6be19baf315 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Querying cell 10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) for 2 instances {{(pid=120563) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 25 03:17:59.591195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0abc1ec6-6ca3-4b2c-878f-b6be19baf315 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:59.591938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0abc1ec6-6ca3-4b2c-878f-b6be19baf315 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:59.592615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0abc1ec6-6ca3-4b2c-878f-b6be19baf315 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:59.681946 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0abc1ec6-6ca3-4b2c-878f-b6be19baf315 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/6e0d3758-87cf-4904-853a-2ead1e491030" status: 200 len: 266 microversion: 2.1 time: 0.170120 Oct 25 03:17:59.685041 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1665/3531] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:17:59 2022] GET /compute/v2.1/os-server-groups/6e0d3758-87cf-4904-853a-2ead1e491030 => generated 266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:17:59.702909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:17:59.705420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:17:59.715020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:17:59.717803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:59.720018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:59.722367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:17:59.726825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:17:59.727626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:17:59.728368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:00.396869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-276821099", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:00.518425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:18:00.737602 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfe2ac23-f36a-437e-8473-767696f4e7de tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1620 microversion: 2.1 time: 1.045740 Oct 25 03:18:00.738770 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1867/3532] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:17:59 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1620 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:00.745143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:00.746086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:00.756629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:00.757518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:00.758163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:00.759046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:00.759645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:00.760216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:00.971248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:00.983793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-967da8c2-e342-4cea-bc3b-4eb468f3226b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 0.242430 Oct 25 03:18:00.984725 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1868/3533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:00 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:01.003418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:01.005001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:01.019388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:01.024129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:01.024877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:01.026699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:01.028608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:01.030855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:01.198211 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d8fbbb30-9eb3-470b-bae4-cee33b2df229 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8" status: 200 len: 1619 microversion: 2.1 time: 0.209060 Oct 25 03:18:01.198796 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1869/3534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:00 2022] GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 => generated 1619 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:01.231798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-343b0a55-7e06-4f19-bb12-e5263056c70f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: .version_select at 0x7efd32875550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1590106495", "policies": ["anti-affinity"]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:01.256611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-343b0a55-7e06-4f19-bb12-e5263056c70f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:01.262797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-343b0a55-7e06-4f19-bb12-e5263056c70f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:01.313471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-343b0a55-7e06-4f19-bb12-e5263056c70f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:01.319959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-343b0a55-7e06-4f19-bb12-e5263056c70f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:01.341265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-343b0a55-7e06-4f19-bb12-e5263056c70f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.114147 Oct 25 03:18:01.349846 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1870/3535] 10.222.0.36 () {60 vars in 1174 bytes} [Tue Oct 25 03:18:01 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:18:01.420619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:18:01.421627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:18:01.422340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:18:01.423539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:18:01.424654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:18:01.436390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:01.437179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:01.438418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:01.439392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:01.440061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:01.440714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:01.464045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Getting quotas for project ee89c033477d449ab24dbb865dd9eb19. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:01.478833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Getting quotas for user 1160aef6e662446eb3066ec8f3bcc110 and project ee89c033477d449ab24dbb865dd9eb19. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:01.518723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1163733877", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2a685065-1cb6-427f-b0b1-5cded83a76f8"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:01.526883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:18:01.530349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:18:01.596622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:18:01.613248 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-40387de6-533b-4858-b5d1-dfdf02c92b5d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490896 Oct 25 03:18:01.614572 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1666/3536] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:18:01.635500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-511f15c3-738d-46c7-87aa-416e95f501e7 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:01.639282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-511f15c3-738d-46c7-87aa-416e95f501e7 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:01.937174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-511f15c3-738d-46c7-87aa-416e95f501e7 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:01.951656 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-511f15c3-738d-46c7-87aa-416e95f501e7 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1216 microversion: 2.1 time: 0.325621 Oct 25 03:18:01.954168 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1667/3537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:01 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1216 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:02.019795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:02.020532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:02.036307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:02.036817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:02.037262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:02.038238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:02.039192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:02.039795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:02.140927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:18:02.141450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:18:02.141783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:18:02.142200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:18:02.142990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:18:02.165285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:02.166044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:02.174530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:02.175775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:02.176567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:02.177152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:02.216117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:02.235689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:02.264658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Going to run 2 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:18:02.267569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:18:02.412751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:02.425626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:02.514937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:02.534012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:02.569375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=367cb225-52e8-4d74-814d-6c88e43e1222,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:18:02.645911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:02.658567 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-274db11d-f371-42c5-a1cb-3f90a64a59c1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 0.649557 Oct 25 03:18:02.668391 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1668/3538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:02 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:02.676470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d817030c-6e56-4929-89ce-9b9a5c1904fc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Action: 'create', calling method: .version_select at 0x7efd3b881430>, body: {"keypair": {"name": "tempest-keypair-324442429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFef2kkn0kucm1aaTazRrpsh6XfiELDCgDbVrq5Cw9rAS7ufTmzmE6c+w+x/TixwF3znCjvFxwpGr/Fi+zTTzM9rKL5R/hECRb91fkFp+xnkYX0a54ABnzzQUor6rNs7A=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:02.689387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:02.703561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:02.729331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d817030c-6e56-4929-89ce-9b9a5c1904fc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Getting quotas for project 7924cd765bf44932b656980b0ef6435c. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:02.747040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d817030c-6e56-4929-89ce-9b9a5c1904fc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Getting quotas for user 58d4600cedf84763bcf5671f5c54627d and project 7924cd765bf44932b656980b0ef6435c. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:02.807579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:02.818404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d817030c-6e56-4929-89ce-9b9a5c1904fc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.147202 Oct 25 03:18:02.825878 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1669/3539] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:18:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 25 03:18:02.826312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'server_group_members'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:02.834475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:02.875808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67d1cc48-afe4-4ea5-855d-d46af6aa0d2d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.362597 Oct 25 03:18:02.880784 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1871/3540] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:18:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 1369 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 25 03:18:02.885090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:02.889892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:02.890663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Searching by: {'deleted': False, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:18:02.939835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:02.941267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:02.942292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:02.946027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:02.947579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:02.949498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:02.980713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:02.981533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:03.002201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:03.002583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:03.003177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:03.004521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:03.005166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:03.005713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:03.050402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:18:03.126390 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc201662-0e02-47ab-8ec8-101afbd2bd11 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.240531 Oct 25 03:18:03.130197 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1670/3541] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:18:02 2022] GET /compute/v2.1/servers => generated 1666 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:03.143952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e728b841-24a7-40d9-bc82-9328096f35d2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:03.144208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e728b841-24a7-40d9-bc82-9328096f35d2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:03.281897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:03.296625 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63e7fbe1-fa10-4836-88d4-ca954a983288 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1268 microversion: 2.1 time: 0.323092 Oct 25 03:18:03.299976 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1872/3542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:02 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1268 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:03.326751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c1ea06e4-092b-4f77-9818-5da4674b03b1 req-ca8caa1c-36cd-485c-9be1-d2cfe31909a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4cdf5f-9bbe-405c-b0c6-506517c14415", "name": "network-vif-plugged", "status": "completed", "tag": "eb885822-86a8-481f-b965-cbb4ff96f05b"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:03.346509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e728b841-24a7-40d9-bc82-9328096f35d2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:03.355595 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e728b841-24a7-40d9-bc82-9328096f35d2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1219 microversion: 2.1 time: 0.218119 Oct 25 03:18:03.356783 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1671/3543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:03 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:03.358669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1ea06e4-092b-4f77-9818-5da4674b03b1 req-ca8caa1c-36cd-485c-9be1-d2cfe31909a9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:03.359180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1ea06e4-092b-4f77-9818-5da4674b03b1 req-ca8caa1c-36cd-485c-9be1-d2cfe31909a9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:03.359621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c1ea06e4-092b-4f77-9818-5da4674b03b1 req-ca8caa1c-36cd-485c-9be1-d2cfe31909a9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:03.380283 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c1ea06e4-092b-4f77-9818-5da4674b03b1 req-ca8caa1c-36cd-485c-9be1-d2cfe31909a9 service nova] Creating event network-vif-plugged:eb885822-86a8-481f-b965-cbb4ff96f05b for instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 on n-h2-862355-1 Oct 25 03:18:03.390789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c1ea06e4-092b-4f77-9818-5da4674b03b1 req-ca8caa1c-36cd-485c-9be1-d2cfe31909a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070393 Oct 25 03:18:03.392370 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1873/3544] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 25 03:18:03.693585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:03.694536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:03.708049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:03.708560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:03.709045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:03.713254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:03.714052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:03.714794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:04.331975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:04.333321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:04.352953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:04.356280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:04.356878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:04.357967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:04.359512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:04.359952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:04.487632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:04.503054 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0dcd8f40-ec8c-4486-88d2-ff4353663f8e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1274 microversion: 2.1 time: 0.178656 Oct 25 03:18:04.504534 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1874/3545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:04 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:04.514830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:04.515759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:04.534663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:04.535468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:04.536335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:04.537645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:04.539732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:04.540514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:04.677377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:04.693910 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e753cc0-1f8b-43d0-b7d4-733652f66b66 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1315 microversion: 2.1 time: 0.997398 Oct 25 03:18:04.696413 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1672/3546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:03 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:04.714736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:04.763424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9179dbc9-1915-43ec-8f14-0087b6b20a8e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1271 microversion: 2.1 time: 0.255389 Oct 25 03:18:04.768897 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1875/3547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:04 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:05.531618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:05.532246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:05.544843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:05.545263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:05.545725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:05.546450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:05.549295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:05.549919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:05.720492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:05.721993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:05.734610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:05.735439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:05.735893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:05.736613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:05.737072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:05.737781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:05.747958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:05.954956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:05.971614 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb26c69c-bf58-43fd-a4f1-11381570fb46 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.443987 Oct 25 03:18:05.975910 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1673/3548] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:05 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:05.986822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:05.988827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:05.997489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:05.998466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:05.999121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:06.000083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:06.000763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:06.002786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:06.150223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:06.168216 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e3f4911-76b6-41cf-9804-cc2d8c7267c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1277 microversion: 2.1 time: 0.190740 Oct 25 03:18:06.169101 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1674/3549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:05 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:06.546449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:06.555247 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4fa0685a-5c7f-42a7-8510-59cb8c55644b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1502 microversion: 2.1 time: 0.839477 Oct 25 03:18:06.555819 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1876/3550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:05 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1502 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:06.580280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:06.584192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:06.593789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:06.594767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:06.595422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:06.596343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:06.597012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:06.597647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:06.655899 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f820bbd-29bd-4625-a8eb-d66258cf44cd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action" status: 200 len: 14 microversion: 2.1 time: 0.079614 Oct 25 03:18:06.656738 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1675/3551] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:06 2022] POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:18:07.007665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:07.008978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:07.028354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:07.029528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:07.031777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:07.032623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:07.033618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:07.035741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:07.196227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:07.199037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:07.217383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:07.218339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:07.219050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:07.220666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:07.221351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:07.223673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:07.425741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:07.433621 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da9aacb2-554e-49c2-906e-a6881f9939f0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.434738 Oct 25 03:18:07.437250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:07.450683 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a67c4ddf-f077-420a-a3d3-b55baf924824 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1277 microversion: 2.1 time: 0.261975 Oct 25 03:18:07.451751 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1877/3552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:06 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:07.452025 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1676/3553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:07 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:07.668955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:07.671535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:07.681187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:07.687008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:07.687679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:07.688648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:07.689227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:07.693439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:07.761072 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a86ae849-2e3e-4059-9833-fab87c3e36cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action" status: 200 len: 14 microversion: 2.1 time: 0.096447 Oct 25 03:18:07.762885 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1878/3554] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:07 2022] POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:18:08.456703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:08.457924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:08.472243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:08.473001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:08.473516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:08.474491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:08.475883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:08.476096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:08.476777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:08.477083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:08.502430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:08.503336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:08.505380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:08.507911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:08.510452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:08.512402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:08.832875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:08.844315 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6b94c093-8650-4099-a755-2bc91383c343 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1319 microversion: 2.1 time: 0.373497 Oct 25 03:18:08.860070 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1879/3555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:08 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:08.873051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1988204406", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "69918774-d927-4207-a18a-5f650e5593c4"}, {"port": "83a5d23b-851d-4581-997e-80f2fdabf0df", "tag": "port-1"}, {"port": "3c70718a-f41c-4237-b525-125333cb3a7d", "tag": "port-2"}, {"uuid": "2d99abc1-f518-4683-a4af-795b395c0deb", "tag": "net-1"}, {"uuid": "2d99abc1-f518-4683-a4af-795b395c0deb"}, {"uuid": "a8792ce6-799e-4b5c-8a7d-c496a88fe347", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a8792ce6-799e-4b5c-8a7d-c496a88fe347", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "dd766f22-2e09-4882-b131-3c6de376fedc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4c1d2ba0-b305-41e2-8ea3-9a7991e27708", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "292036f6-3ae2-483d-9c2a-52b71f7c1a04", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--672116558"}], "key_name": "tempest-keypair-324442429", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:09.125187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] validate_networks() for [('69918774-d927-4207-a18a-5f650e5593c4', None, None, None, None, None), (None, None, '83a5d23b-851d-4581-997e-80f2fdabf0df', None, None, None), (None, None, '3c70718a-f41c-4237-b525-125333cb3a7d', None, None, None), ('2d99abc1-f518-4683-a4af-795b395c0deb', None, None, None, None, None), ('2d99abc1-f518-4683-a4af-795b395c0deb', None, None, None, None, None), ('a8792ce6-799e-4b5c-8a7d-c496a88fe347', '10.2.2.100', None, None, None, None), ('a8792ce6-799e-4b5c-8a7d-c496a88fe347', '10.2.2.200', None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:18:09.168152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:09.182658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8878cd1-3391-4693-9d26-d8a3327e35f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.729733 Oct 25 03:18:09.183494 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1677/3556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:08 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:09.200541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:09.202965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:09.216192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:09.216694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:09.217138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:09.217887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:09.219790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:09.220393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:09.244351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:09.290306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9119f6af-3203-4f18-b436-f92082563e23 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action" status: 200 len: 14 microversion: 2.1 time: 0.105336 Oct 25 03:18:09.291525 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1678/3557] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:09 2022] POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:18:09.699399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-06bea3b4-5b8b-4f2c-85ce-b7ebb50b7fd7 req-708d05a1-3216-4d5a-ad98-1baf87733428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b32ae59-c085-47d9-be50-3c0eb0350c01", "tag": "985c5405-7c62-48ed-87fe-3cc4bb482730"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:09.760712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06bea3b4-5b8b-4f2c-85ce-b7ebb50b7fd7 req-708d05a1-3216-4d5a-ad98-1baf87733428 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:09.762969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06bea3b4-5b8b-4f2c-85ce-b7ebb50b7fd7 req-708d05a1-3216-4d5a-ad98-1baf87733428 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:09.764714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06bea3b4-5b8b-4f2c-85ce-b7ebb50b7fd7 req-708d05a1-3216-4d5a-ad98-1baf87733428 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:09.814487 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-06bea3b4-5b8b-4f2c-85ce-b7ebb50b7fd7 req-708d05a1-3216-4d5a-ad98-1baf87733428 service nova] Creating event network-changed:985c5405-7c62-48ed-87fe-3cc4bb482730 for instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 on n-h2-862355-1 Oct 25 03:18:09.823847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-06bea3b4-5b8b-4f2c-85ce-b7ebb50b7fd7 req-708d05a1-3216-4d5a-ad98-1baf87733428 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132952 Oct 25 03:18:09.829797 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1679/3558] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:18:09.874512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:09.875823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:09.891532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:09.892031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:09.892477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:09.896672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:09.898764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:09.900623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:10.907306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:10.927266 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b22b1ef-8b92-4ee4-9179-e0d8f3878e8d tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1319 microversion: 2.1 time: 1.057196 Oct 25 03:18:10.948502 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1680/3559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:09 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1319 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:10.964164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:10.968232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:11.003889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:11.005945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:11.007000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:11.009402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:11.010091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:11.011588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:11.502987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:11.519475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-83a61c0c-009b-45b0-acd1-48732cc165cb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.568227 Oct 25 03:18:11.520397 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1681/3560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:10 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:11.527711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:11.530669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:11.538566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:11.539340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:11.539927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:11.540818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:11.541463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:11.542157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:12.198536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:12.831814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=32 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:12.965839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:13.351516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=14 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:13.507929 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1416b5bc-d939-4f51-a342-52ea855f64e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action" status: 200 len: 14 microversion: 2.1 time: 1.982971 Oct 25 03:18:13.510342 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1682/3561] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:11 2022] POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action => generated 14 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:18:13.525399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-9c4a6a24-f890-4eab-b3b4-fef31dcf39ec req-93ae29c0-e992-49a6-bfac-6d9d28176a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40220c5f-5ed6-4610-bcd1-ed9928ade692", "tag": "8dcbee47-86c7-4c73-b11b-8b43a0da25d4"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:13.567119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9c4a6a24-f890-4eab-b3b4-fef31dcf39ec req-93ae29c0-e992-49a6-bfac-6d9d28176a54 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:13.567758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9c4a6a24-f890-4eab-b3b4-fef31dcf39ec req-93ae29c0-e992-49a6-bfac-6d9d28176a54 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:13.568342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9c4a6a24-f890-4eab-b3b4-fef31dcf39ec req-93ae29c0-e992-49a6-bfac-6d9d28176a54 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:13.606613 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-9c4a6a24-f890-4eab-b3b4-fef31dcf39ec req-93ae29c0-e992-49a6-bfac-6d9d28176a54 service nova] Creating event network-changed:8dcbee47-86c7-4c73-b11b-8b43a0da25d4 for instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 on n-h1-862355-1 Oct 25 03:18:13.612600 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-9c4a6a24-f890-4eab-b3b4-fef31dcf39ec req-93ae29c0-e992-49a6-bfac-6d9d28176a54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099384 Oct 25 03:18:13.613852 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1683/3562] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:13.621235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:13.622318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:13.630434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:13.632255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:13.633151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:13.634036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:13.634643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:13.635998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:14.257234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:14.281433 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-68fb9117-46c7-4767-b5da-6bfd2a37f7ec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1319 microversion: 2.1 time: 0.659949 Oct 25 03:18:14.290170 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1684/3563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:13 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1319 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:14.306966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3186d927-f56f-47cd-8f6b-c00639f6143f req-c652fefd-cc6a-4a7b-88d9-0b0b6120dc19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367cb225-52e8-4d74-814d-6c88e43e1222", "tag": "e5423839-4236-4902-9553-c1d2103b7fd1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:14.330867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3186d927-f56f-47cd-8f6b-c00639f6143f req-c652fefd-cc6a-4a7b-88d9-0b0b6120dc19 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:14.332788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3186d927-f56f-47cd-8f6b-c00639f6143f req-c652fefd-cc6a-4a7b-88d9-0b0b6120dc19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:14.337784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3186d927-f56f-47cd-8f6b-c00639f6143f req-c652fefd-cc6a-4a7b-88d9-0b0b6120dc19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:14.360690 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3186d927-f56f-47cd-8f6b-c00639f6143f req-c652fefd-cc6a-4a7b-88d9-0b0b6120dc19 service nova] Creating event network-changed:e5423839-4236-4902-9553-c1d2103b7fd1 for instance 367cb225-52e8-4d74-814d-6c88e43e1222 on n-h2-862355-1 Oct 25 03:18:14.373176 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3186d927-f56f-47cd-8f6b-c00639f6143f req-c652fefd-cc6a-4a7b-88d9-0b0b6120dc19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081336 Oct 25 03:18:14.374107 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1685/3564] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:14.380796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:14.381868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:14.388227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:14.388814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:14.389330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:14.390162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:14.390820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:14.391440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:15.052875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:15.061960 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-79ba6b7c-a01d-4132-b3d2-deda16cdc9d2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.686353 Oct 25 03:18:15.075554 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1686/3565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:14 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:15.097208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:15.099759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:15.113060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:15.116345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:15.117069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:15.118099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:15.118716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:15.120266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:15.321744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:18:15.322821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:18:15.323522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:18:15.324516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:18:15.325621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:18:15.338373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:15.339199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:15.339846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:15.341736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:15.342553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:15.343312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:15.368166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Getting quotas for project 7924cd765bf44932b656980b0ef6435c. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:15.376296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Getting quotas for user 58d4600cedf84763bcf5671f5c54627d and project 7924cd765bf44932b656980b0ef6435c. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:15.662897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:18:15.671950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='dd766f22-2e09-4882-b131-3c6de376fedc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4c1d2ba0-b305-41e2-8ea3-9a7991e27708',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='292036f6-3ae2-483d-9c2a-52b71f7c1a04',volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:18:16.264593 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ade31193-63df-45ed-b7d3-f5e552ffae09 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.397529 Oct 25 03:18:16.265464 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1880/3566] 10.222.0.36 () {62 vars in 1189 bytes} [Tue Oct 25 03:18:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 7405 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:18:16.279855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:16.281357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:16.292404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:16.293952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:16.295484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:16.296385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:16.297046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:16.297652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:16.981926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:16.989596 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6751afb3-3a8e-4b0c-9b35-8f9abbc03892 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1319 microversion: 2.1 time: 0.714700 Oct 25 03:18:16.990206 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1881/3567] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:16 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:16.995578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:16.996192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:17.026989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:17.027508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:17.038268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:17.041124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:17.050940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:17.051877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:17.342204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4506bbc8-834d-4001-97bd-02b5d8170be1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action" status: 200 len: 14 microversion: 2.1 time: 2.265065 Oct 25 03:18:17.346320 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1687/3568] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:15 2022] POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action => generated 14 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:18:17.352569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b08277c-9188-4731-8fa2-18de0811ad79 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:17.354578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9b08277c-9188-4731-8fa2-18de0811ad79 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:17.370323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:17.503698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:17.521641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-49b21d19-dc55-4c8a-8247-8677ab32a3eb tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.529582 Oct 25 03:18:17.542014 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1882/3569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:16 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:17.573472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b08277c-9188-4731-8fa2-18de0811ad79 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:17.591899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b08277c-9188-4731-8fa2-18de0811ad79 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:17.596145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b08277c-9188-4731-8fa2-18de0811ad79 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:17.603067 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b08277c-9188-4731-8fa2-18de0811ad79 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1285 microversion: 2.32 time: 0.250536 Oct 25 03:18:17.603724 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1688/3570] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:17 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:18.016516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:18.017040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:18.033851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.034436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.034900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.046887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.047402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.062279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.357447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:18.360589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:18.390917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.399884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.402186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.403153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.404788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.406929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:18.407644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.423120 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-556bf764-00d6-439d-940e-6cd00a039622 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1319 microversion: 2.1 time: 0.411285 Oct 25 03:18:18.424515 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1883/3571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:18 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:18.533723 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3556b19d-8dfa-4bdc-b0a2-fb9337df8a1e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action" status: 200 len: 8207 microversion: 2.1 time: 0.179862 Oct 25 03:18:18.536066 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1689/3572] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:18 2022] POST /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415/action => generated 8207 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:18.550664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:18.551826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:18.555264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:18.558210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:18.569173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.569698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.570159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.570892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.577429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.577985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.581738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.582242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.582687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.583712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:18.583867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:18.592509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:18.958812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:18.970591 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42509007-7f8e-484b-9cf8-ef6c0165f9a8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.425067 Oct 25 03:18:18.973322 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1690/3573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:18 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:18.989633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:18.990591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:19.004997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.008186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.009877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.012733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.018127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.018873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.028425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:19.056895 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-72f3d093-d1c8-472a-a5d4-f928689958a5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.515428 Oct 25 03:18:19.060324 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1884/3574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:18 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:19.082585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9e72a458-401e-4d1f-a3a5-5396d295eeac req-ab728d3a-54de-4999-98de-32f7e63732f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40220c5f-5ed6-4610-bcd1-ed9928ade692", "name": "network-vif-plugged", "status": "completed", "tag": "8dcbee47-86c7-4c73-b11b-8b43a0da25d4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:19.131700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e72a458-401e-4d1f-a3a5-5396d295eeac req-ab728d3a-54de-4999-98de-32f7e63732f8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.133298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e72a458-401e-4d1f-a3a5-5396d295eeac req-ab728d3a-54de-4999-98de-32f7e63732f8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.135976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e72a458-401e-4d1f-a3a5-5396d295eeac req-ab728d3a-54de-4999-98de-32f7e63732f8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.189972 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9e72a458-401e-4d1f-a3a5-5396d295eeac req-ab728d3a-54de-4999-98de-32f7e63732f8 service nova] Creating event network-vif-plugged:8dcbee47-86c7-4c73-b11b-8b43a0da25d4 for instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 on n-h1-862355-1 Oct 25 03:18:19.197558 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9e72a458-401e-4d1f-a3a5-5396d295eeac req-ab728d3a-54de-4999-98de-32f7e63732f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134459 Oct 25 03:18:19.198370 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1885/3575] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:19.219452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:19.220597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:19.231179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.234131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.235574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.236537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.237698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.239914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.312788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:19.333646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:19.340941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:19.344364 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2b62943-f0ae-45c9-8658-04a551f09813 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1583 microversion: 2.32 time: 0.366019 Oct 25 03:18:19.346307 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1691/3576] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:18 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1583 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:19.452693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:19.454398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:19.471352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.471961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.472409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.473110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.473564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.478132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.750802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:19.764514 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d45e5730-4816-41f8-a339-f557b88adbd7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.562356 Oct 25 03:18:19.783045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1886/3577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:19 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:19.796030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:19.796906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:19.807960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.808476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.808978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.813927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:19.814431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:19.815050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:19.864118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:19.880970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56537006-fb20-4ef8-b504-ccbe27df8974 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1319 microversion: 2.1 time: 0.429360 Oct 25 03:18:19.882884 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1692/3578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:19 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:20.005382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:20.006039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:20.018946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.020340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.020805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:20.021632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.022153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.022760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:20.272613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:20.285027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b1c602b-3687-4079-9106-7259ad9e3d52 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.492719 Oct 25 03:18:20.302957 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1887/3579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:19 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:20.314500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:20.315810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:20.328552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.329062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.329514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:20.333241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.335910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.336559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:20.461581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:20.481182 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cea4f356-10a8-4300-a9e7-a931c586468c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.478820 Oct 25 03:18:20.498563 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1693/3580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:20 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:20.506294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:20.507757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:20.515760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.516482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.517057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:20.518485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.519104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.519778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:20.666722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:20.686344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:20.687956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:20.689161 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-019e3da7-cab8-4a8b-ac04-ae61b0bf70b1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1593 microversion: 2.32 time: 0.188442 Oct 25 03:18:20.689757 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1694/3581] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:20 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1593 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:20.906521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:20.907265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:20.919536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.921316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.923503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:20.923620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:20.925598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:20.926444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:21.194109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:21.212689 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4610a152-dfb1-4c5d-b05a-fd81397635ec tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.902225 Oct 25 03:18:21.214790 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1888/3582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:20 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:21.239367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:21.241058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:21.255205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:21.258757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:21.259520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:21.262311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:21.263231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:21.263891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:21.383447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Locking {{(pid=120562) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 25 03:18:21.503292 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2dfddede-521d-4f14-ada7-bf2290b9aff5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.268063 Oct 25 03:18:21.504755 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1889/3583] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:21 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:18:21.513330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3a27bbc5-0c29-4e7c-8e55-1d0c2c9de581 req-89269941-9676-4756-9437-5de121534048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b32ae59-c085-47d9-be50-3c0eb0350c01", "name": "network-vif-plugged", "status": "completed", "tag": "985c5405-7c62-48ed-87fe-3cc4bb482730"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:21.527204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3a27bbc5-0c29-4e7c-8e55-1d0c2c9de581 req-89269941-9676-4756-9437-5de121534048 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:21.527846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3a27bbc5-0c29-4e7c-8e55-1d0c2c9de581 req-89269941-9676-4756-9437-5de121534048 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:21.528448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3a27bbc5-0c29-4e7c-8e55-1d0c2c9de581 req-89269941-9676-4756-9437-5de121534048 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:21.546513 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3a27bbc5-0c29-4e7c-8e55-1d0c2c9de581 req-89269941-9676-4756-9437-5de121534048 service nova] Creating event network-vif-plugged:985c5405-7c62-48ed-87fe-3cc4bb482730 for instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 on n-h2-862355-1 Oct 25 03:18:21.555181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3a27bbc5-0c29-4e7c-8e55-1d0c2c9de581 req-89269941-9676-4756-9437-5de121534048 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048857 Oct 25 03:18:21.557582 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1890/3584] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:21.575215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:21.612262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:21.631869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:21.632745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:21.633621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:21.636373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:21.639778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:21.640368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:21.911561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:21.921088 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b8398ac-1864-4031-bd9d-7533b9f6cc60 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1319 microversion: 2.1 time: 1.018344 Oct 25 03:18:21.921088 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1695/3585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:20 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1319 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:21.935700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:21.949165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:21.972240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:21.972985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:21.973608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:21.975062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:21.977406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:21.978141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:22.376192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:22.392351 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2e109534-f7dc-4e18-92db-9ee6c47db92e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 0.826027 Oct 25 03:18:22.394772 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1891/3586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:21 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:22.403323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:22.404623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:22.432267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:22.434000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:22.434416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:22.435524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:22.436262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:22.437648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:22.488378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:22.748074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:22.784722 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b026315-aefa-4e08-bc19-fdf4276c2531 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.848849 Oct 25 03:18:22.791664 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1696/3587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:21 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:22.845448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:22.858342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:22.861026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:22.862175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:22.917648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:22.920194 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] HTTP exception thrown: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e is locked Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Request method failure captured: Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action HTTP/1.1 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 15 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1RWjlVE2sQh_gERIgsA6GFJ3mlQMKfGGB6JBmHqeKExER_q2xBsEZ41YuIa5yFsRyjj2ai1oDRcYnd-HPHQrK6KI6riL_Nk0ppae_wtcOI1d_0NXpHXkGs1EeZ-fmDCgTq_dyffPyZt5hZfUTcGbN6DMaz6TKjC-PKJdQQ8wD1ZMpw Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_587d3b710c1843279c9ffb9d78d6975b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/587d3b710c1843279c9ffb9d78d6975b"}]}] Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 41342d3f5062457aaee26cf5d836e441 Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: {"os-stop": {}} Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e is locked Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fafc972b-b66f-427e-beec-c11ecd2a2d8e', 'body': {'os-stop': {}}} Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e is locked Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e is locked Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e is locked Oct 25 03:18:22.926129 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:18:22.936403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Returning 409 to user: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e is locked {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:18:22.940847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d9c6ec3-b0a8-4a09-853a-8ba81eafd994 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 409 len: 107 microversion: 2.1 time: 0.106857 Oct 25 03:18:22.949071 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1697/3588] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:22 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 107 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:18:22.960051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:22.962031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:22.974715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:22.976026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:22.977167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:22.978820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:22.980096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:22.981163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:22.992135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:23.000597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:23.016508 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9de5624e-7504-42ec-a30a-32b1f721a998 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1660 microversion: 2.32 time: 0.616131 Oct 25 03:18:23.035684 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1892/3589] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:22 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1660 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:23.069510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:23.070637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:23.097040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:23.097942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:23.102155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:23.108350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:23.109198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:23.110126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:23.215274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Unlocking {{(pid=120562) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 25 03:18:23.320354 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-523ead98-1094-4f52-a70a-9dc5599394d3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.281352 Oct 25 03:18:23.326679 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1893/3590] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:23 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:18:23.338009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1245c9ed-e0c6-4fab-847d-7338ce055267 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:23.345447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1245c9ed-e0c6-4fab-847d-7338ce055267 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:23.346106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1245c9ed-e0c6-4fab-847d-7338ce055267 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:23.346639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1245c9ed-e0c6-4fab-847d-7338ce055267 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:23.416896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1245c9ed-e0c6-4fab-847d-7338ce055267 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:18:23.556641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1245c9ed-e0c6-4fab-847d-7338ce055267 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.223087 Oct 25 03:18:23.567661 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1894/3591] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:23 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:18:23.579481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:23.580196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:23.609963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:23.610470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:23.610992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:23.611835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:23.612304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:23.612807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:23.648132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:23.669719 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e5e8319-3c51-4b7c-8a9a-630f7563c26e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1469 microversion: 2.1 time: 0.718762 Oct 25 03:18:23.670805 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1698/3592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:22 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1469 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:23.685629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:23.686286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:23.720513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:23.723317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:23.724137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:23.725232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:23.725960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:23.728619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:24.694768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:24.705774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:24.717376 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbde6319-2334-4528-ae73-7c76251f6382 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 1.043006 Oct 25 03:18:24.732811 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1699/3593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:23 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:24.761240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:24.763049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:24.773424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:24.774318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:24.774978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:24.776056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:24.776748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:24.778483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:25.015913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:25.032141 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-95173d97-b747-4d99-8a4e-c14669efda9e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1316 microversion: 2.1 time: 1.458028 Oct 25 03:18:25.051459 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1895/3594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:23 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1316 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:25.059377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:25.060305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:25.067170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:25.068031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:25.069263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:25.070493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:25.071218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:25.071847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:25.144535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:25.155339 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-093f52f8-ca0b-4743-a04f-d107b26aa7bd tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1319 microversion: 2.1 time: 0.415084 Oct 25 03:18:25.157865 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1700/3595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:24 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:25.165123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-fbf30a44-a02d-4d19-84af-849dc7641c0a req-3c509498-f1cd-4809-852c-77e538da8b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367cb225-52e8-4d74-814d-6c88e43e1222", "name": "network-vif-plugged", "status": "completed", "tag": "e5423839-4236-4902-9553-c1d2103b7fd1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:25.186646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fbf30a44-a02d-4d19-84af-849dc7641c0a req-3c509498-f1cd-4809-852c-77e538da8b4e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:25.189642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fbf30a44-a02d-4d19-84af-849dc7641c0a req-3c509498-f1cd-4809-852c-77e538da8b4e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:25.192452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fbf30a44-a02d-4d19-84af-849dc7641c0a req-3c509498-f1cd-4809-852c-77e538da8b4e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:25.221773 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-fbf30a44-a02d-4d19-84af-849dc7641c0a req-3c509498-f1cd-4809-852c-77e538da8b4e service nova] Creating event network-vif-plugged:e5423839-4236-4902-9553-c1d2103b7fd1 for instance 367cb225-52e8-4d74-814d-6c88e43e1222 on n-h2-862355-1 Oct 25 03:18:25.233992 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-fbf30a44-a02d-4d19-84af-849dc7641c0a req-3c509498-f1cd-4809-852c-77e538da8b4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074431 Oct 25 03:18:25.248200 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1701/3596] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:25.358463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:25.385961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:25.663980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:25.675597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:25.677350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:25.678978 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a34b15c-a23a-4306-bdd3-8fa5725c4912 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1706 microversion: 2.32 time: 0.625517 Oct 25 03:18:25.693897 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1896/3597] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:25 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1706 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:25.747486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:25.748280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:25.762052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:25.762775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:25.764480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:25.767383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:25.769254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:25.769949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.057104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:26.058014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:26.065044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.078894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:26.094700 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f3a63dc6-fab0-4f7d-8469-c4f29a30fbd1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.351656 Oct 25 03:18:26.096057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1702/3598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:25 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:26.103130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.103975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.105537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.106385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.107073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.184972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:26.185593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:26.192700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.193281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.194020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.194740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.195204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.195648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.576166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:26.591468 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e430bd4-0349-4394-b235-e2f6316f2c71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1319 microversion: 2.1 time: 0.410216 Oct 25 03:18:26.594705 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1703/3599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:26 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:26.631625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:26.647422 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22619421-84d3-47e6-a785-2bf2c4b23dd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1465 microversion: 2.1 time: 0.592245 Oct 25 03:18:26.658029 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1897/3600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:26 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1465 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:26.673944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1566704212", "metadata": {"image_type": "test"}}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:26.676336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:26.687134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.687630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.688064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.688774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.694811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.695266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.710641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:26.711273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:26.727172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.727928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.728528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.729406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:26.733917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:26.735384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:26.786362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Getting quotas for project ee89c033477d449ab24dbb865dd9eb19. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:26.803573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Getting quotas for user 1160aef6e662446eb3066ec8f3bcc110 and project ee89c033477d449ab24dbb865dd9eb19. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:27.255221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a005e09-1729-4265-ac39-c8d313f2fc9c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "POST /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01/action" status: 202 len: 0 microversion: 2.1 time: 0.585235 Oct 25 03:18:27.256676 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1704/3601] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:26 2022] POST /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:18:27.265384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:27.272264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:27.292364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:27.293752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:27.294354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:27.295239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:27.295961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:27.296541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:27.312074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:27.334696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:27.343311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:27.348877 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53062ce5-ec97-430a-abf4-16258429c2c2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1752 microversion: 2.32 time: 0.641283 Oct 25 03:18:27.353931 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1898/3602] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:26 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1752 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:27.367568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f163f9e6-e86d-40e7-a002-ac2d9470c4ea tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32875f70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:27.470887 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f163f9e6-e86d-40e7-a002-ac2d9470c4ea tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.114422 Oct 25 03:18:27.471490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1899/3603] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:27 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:27.583474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:27.618066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:27.618971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:27.635447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:27.638146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:27.638851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:27.639744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:27.642005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:27.642829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:28.108230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:28.116734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34d46e97-4edf-428b-a572-c697fee14f29 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.858862 Oct 25 03:18:28.120289 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1705/3604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:27 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:28.363403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:28.374295 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b56bc260-237a-4f6d-9347-f596b02e6efb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1469 microversion: 2.1 time: 0.762014 Oct 25 03:18:28.378399 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1900/3605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:27 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1469 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:28.383062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:28.384064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:28.396963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:28.397475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:28.397962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:28.400039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:28.403120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:28.404241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:28.406547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:28.412844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:28.420393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Searching by: {'reservation_id': 'r-cg48cy4r', 'deleted': False, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:18:28.431543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:28.442358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:28.443467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:28.444498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:28.445648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:28.446421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:28.665333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:18:28.778553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:28.797277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:28.797818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:28.798276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:28.879647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:28.897818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:28.899466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:28.900680 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a869f9a2-7748-4268-ac33-542cdf82d75c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1752 microversion: 2.32 time: 0.525740 Oct 25 03:18:28.901463 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1706/3606] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:28 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1752 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:28.927489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d70a2ac1-92b1-4921-aa80-cc3be7c46f42 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32941c10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:29.012741 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d70a2ac1-92b1-4921-aa80-cc3be7c46f42 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.096610 Oct 25 03:18:29.018587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1707/3607] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:28 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:29.152031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:29.153723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:29.175471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.176156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.177436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.180875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.181609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.182430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.267837 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61593783-416a-4055-9db4-9e2c889b0a6f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-cg48cy4r" status: 200 len: 2931 microversion: 2.1 time: 0.865519 Oct 25 03:18:29.284911 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1901/3608] 10.222.0.36 () {58 vars in 1197 bytes} [Tue Oct 25 03:18:28 2022] GET /compute/v2.1/servers/detail?reservation_id=r-cg48cy4r => generated 2931 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:29.297650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc271480-2ccc-46a2-924d-0c2afdb2d8fa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:29.327355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_groups [None req-bc271480-2ccc-46a2-924d-0c2afdb2d8fa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Querying cell 10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) for 2 instances {{(pid=120562) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 25 03:18:29.328161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc271480-2ccc-46a2-924d-0c2afdb2d8fa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.328743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc271480-2ccc-46a2-924d-0c2afdb2d8fa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.329603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc271480-2ccc-46a2-924d-0c2afdb2d8fa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.383651 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc271480-2ccc-46a2-924d-0c2afdb2d8fa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/2a685065-1cb6-427f-b0b1-5cded83a76f8" status: 200 len: 271 microversion: 2.1 time: 0.091737 Oct 25 03:18:29.384424 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1902/3609] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:18:29 2022] GET /compute/v2.1/os-server-groups/2a685065-1cb6-427f-b0b1-5cded83a76f8 => generated 271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:29.397660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:29.400204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:29.411355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.412331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.412968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.415348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.415997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.416579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.453939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:29.471689 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-be68294f-aa62-4510-8999-a2e64198eb1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.329025 Oct 25 03:18:29.472295 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1708/3610] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:29 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:29.832256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc21bbd5-6af0-4a67-ac4b-65f318be7b25 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1620 microversion: 2.1 time: 0.440172 Oct 25 03:18:29.832858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1903/3611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:29 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1620 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:29.860074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:29.862444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:29.874395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.874897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.875341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.879829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.880405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.881275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.933384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:29.934668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:29.946475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.947376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.949716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:29.953371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:29.955292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:29.957139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:30.113090 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3be8851c-8c86-4693-9dd2-6d73ff7b7910 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1620 microversion: 2.1 time: 0.256021 Oct 25 03:18:30.114545 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1709/3612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:29 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1620 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:30.135429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-04a5b801-e69c-4d3d-b19d-faceb163b075 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd33ace1f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:30.228851 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-04a5b801-e69c-4d3d-b19d-faceb163b075 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.111582 Oct 25 03:18:30.238969 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1710/3613] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:30 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:30.351936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1085237169", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:30.418096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:18:30.794870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:18:30.795221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:18:30.795704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:18:30.796477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:18:30.797107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:18:30.812186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:30.812682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:30.813122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:30.814073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:30.814714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:30.815304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:30.838708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:18:30.847686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:18:30.870336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:18:30.872901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:18:30.969865 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d1ee7cc0-e845-4aaf-bb83-38c862e5c093 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626289 Oct 25 03:18:30.973869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1711/3614] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:18:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:18:30.985687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:30.987452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:31.016466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:31.019150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:31.019646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:31.020391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:31.020844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:31.024885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:31.066059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:31.088837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:31.093579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:31.101941 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c8cba598-e79b-4d37-b43f-df4d9fd5611e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1798 microversion: 2.32 time: 1.172234 Oct 25 03:18:31.117375 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1904/3615] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:29 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1798 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:31.135037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-beffeaee-5975-4ecb-b4e4-3554c922beec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:31.140974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-beffeaee-5975-4ecb-b4e4-3554c922beec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:31.395315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-beffeaee-5975-4ecb-b4e4-3554c922beec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:31.403598 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-beffeaee-5975-4ecb-b4e4-3554c922beec tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1217 microversion: 2.1 time: 0.284797 Oct 25 03:18:31.414468 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1905/3616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:31 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:31.434351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17a9184f-ce5f-4dc4-99ed-2799a6af9fbe tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7c0040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:31.534462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17a9184f-ce5f-4dc4-99ed-2799a6af9fbe tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.118596 Oct 25 03:18:31.535765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1906/3617] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:31 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:32.154264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:32.156058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:32.168165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:32.181746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:32.181746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:32.182828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:32.185613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:32.186363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:32.428827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:32.460864 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91730d00-d0f9-450f-b363-00a712be7ced tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 1.485286 Oct 25 03:18:32.467459 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1712/3618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:30 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:32.506575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:32.508948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:32.533610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:32.541138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:32.542826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:32.545322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:32.547249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:32.549426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:32.745168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:32.772767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-529d1a54-fdc5-4d8f-af51-39ab59a38a14 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1213 microversion: 2.1 time: 0.302655 Oct 25 03:18:32.780361 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1713/3619] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:32 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1213 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:32.800485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51ef9cbf-7460-469d-819d-0570c6d15a6e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32f29dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:32.884978 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51ef9cbf-7460-469d-819d-0570c6d15a6e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.101569 Oct 25 03:18:32.888038 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1714/3620] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:32 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:33.140220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:33.155099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:33.157851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:33.159644 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8b205fa-ac9d-43df-a27a-fbb6195862fd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1844 microversion: 2.32 time: 1.012053 Oct 25 03:18:33.161939 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1907/3621] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:32 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1844 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:33.494060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:33.494672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:33.511125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:33.511623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:33.512057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:33.512761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:33.513215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:33.513639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:33.799469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:33.800397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:33.803768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:33.814180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:33.814767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:33.815111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:33.815837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:33.816297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:33.821478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:33.869413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:34.031133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:34.054936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:34.059114 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f303d4ac-2933-4604-bf2b-88a110966f14 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.564821 Oct 25 03:18:34.060186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1715/3622] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:33 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:34.074825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-72913968-7b9d-4bc6-a4a9-b65ae7d0c22e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3363e160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:34.084356 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c35d4c20-be17-4fb7-a69d-78855b50f00b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1269 microversion: 2.1 time: 0.288125 Oct 25 03:18:34.107441 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1908/3623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:33 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1269 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:34.120924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dff828ac-087d-4dad-9107-6249efce03b7 req-362bb917-4450-48fb-b676-0155e84caa29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b32ae59-c085-47d9-be50-3c0eb0350c01", "name": "network-vif-plugged", "status": "completed", "tag": "985c5405-7c62-48ed-87fe-3cc4bb482730"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:34.151081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dff828ac-087d-4dad-9107-6249efce03b7 req-362bb917-4450-48fb-b676-0155e84caa29 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:34.154051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dff828ac-087d-4dad-9107-6249efce03b7 req-362bb917-4450-48fb-b676-0155e84caa29 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:34.155470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dff828ac-087d-4dad-9107-6249efce03b7 req-362bb917-4450-48fb-b676-0155e84caa29 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:34.186204 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dff828ac-087d-4dad-9107-6249efce03b7 req-362bb917-4450-48fb-b676-0155e84caa29 service nova] Creating event network-vif-plugged:985c5405-7c62-48ed-87fe-3cc4bb482730 for instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 on n-h2-862355-1 Oct 25 03:18:34.190405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-72913968-7b9d-4bc6-a4a9-b65ae7d0c22e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.124505 Oct 25 03:18:34.204461 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1716/3624] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:34 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:34.209129 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dff828ac-087d-4dad-9107-6249efce03b7 req-362bb917-4450-48fb-b676-0155e84caa29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098906 Oct 25 03:18:34.210524 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1909/3625] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:34.218835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:34.225085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:34.246938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:34.248159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:34.249022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:34.249986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:34.257101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:34.263583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:34.797150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:34.810755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:34.820143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:34.829970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b78f3eb-b0b2-47b3-b2a7-a318590d2407 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1844 microversion: 2.32 time: 0.629058 Oct 25 03:18:34.830580 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1717/3626] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:34 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1844 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:35.084407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:35.085713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:35.094295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:35.095177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:35.095971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:35.097058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:35.098142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:35.099020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:35.115767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:35.117081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:35.131145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:35.132032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:35.132696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:35.135798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:35.137824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:35.138788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:35.350969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:35.366949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-538553c8-f982-46c8-af40-132f075a3ea9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1275 microversion: 2.1 time: 0.255669 Oct 25 03:18:35.390195 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1718/3627] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:35 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:35.414574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7ca1920-7bbb-430f-9de8-8bfd40eeddc6 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b881dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:35.555565 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7ca1920-7bbb-430f-9de8-8bfd40eeddc6 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.160907 Oct 25 03:18:35.557591 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1719/3628] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:35 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:35.861059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:35.861760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:35.881841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:35.884254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:35.896813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:35.897979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:35.906633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:35.907244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:36.555217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:36.582247 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9be92bdb-b855-4cd5-afb8-38aa544675fe tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1655 microversion: 2.1 time: 1.502039 Oct 25 03:18:36.587932 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1910/3629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:35 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1655 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:36.618590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:36.621494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:36.649556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:36.654123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:36.658969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:36.659905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:36.664029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:36.666514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:36.784717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:36.787634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:36.807825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:36.810713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:36.815944 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-afdce159-1ee5-4b0b-99c3-ac299915dfbe tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1844 microversion: 2.32 time: 0.959144 Oct 25 03:18:36.822066 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1720/3630] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:35 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1844 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:18:36.835787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bd183a71-ceb3-4d38-8ab3-4f7cf649623a tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7445e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:36.941552 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bd183a71-ceb3-4d38-8ab3-4f7cf649623a tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.117666 Oct 25 03:18:36.943688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1721/3631] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:36 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:36.960551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e0e44d0-3f59-4dca-95fa-ee408a12843f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:36.982813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e0e44d0-3f59-4dca-95fa-ee408a12843f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:36.990724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e0e44d0-3f59-4dca-95fa-ee408a12843f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:36.991963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e0e44d0-3f59-4dca-95fa-ee408a12843f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:37.093496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9e0e44d0-3f59-4dca-95fa-ee408a12843f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Going to try to start instance {{(pid=120563) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 25 03:18:37.260173 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e0e44d0-3f59-4dca-95fa-ee408a12843f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.313871 Oct 25 03:18:37.268599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1722/3632] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:36 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:18:37.304637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:37.305397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:37.347176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:37.357053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:37.357911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:37.359200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:37.360030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:37.360612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:38.077357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:38.095084 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb0633a3-58ca-44eb-8b98-a11d997c3999 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 1.503053 Oct 25 03:18:38.103568 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1911/3633] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:36 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:38.113443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:38.114740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:38.132225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:38.132961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:38.133556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:38.134465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:38.135079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:38.135771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:38.516486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:38.537712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:38.551727 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-74ac176f-14f6-4c93-8743-b1bd6334fc75 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1664 microversion: 2.1 time: 1.280861 Oct 25 03:18:38.565178 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1723/3634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:37 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1664 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:38.576793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e647c98-53db-4127-b6dc-91a276c04cf4 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3363e160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:38.673389 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e647c98-53db-4127-b6dc-91a276c04cf4 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.104348 Oct 25 03:18:38.674334 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1724/3635] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:38 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:38.910643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ec520657-1b05-4490-9298-919616fd1df6 req-489961cc-a6a3-4889-9271-efaf935902df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "1a0e64be-54b2-4f1d-b5a8-f846755d9c1b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:38.967519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec520657-1b05-4490-9298-919616fd1df6 req-489961cc-a6a3-4889-9271-efaf935902df service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:38.968033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec520657-1b05-4490-9298-919616fd1df6 req-489961cc-a6a3-4889-9271-efaf935902df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:38.968475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec520657-1b05-4490-9298-919616fd1df6 req-489961cc-a6a3-4889-9271-efaf935902df service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:39.029755 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ec520657-1b05-4490-9298-919616fd1df6 req-489961cc-a6a3-4889-9271-efaf935902df service nova] Creating event network-changed:1a0e64be-54b2-4f1d-b5a8-f846755d9c1b for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:18:39.035864 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ec520657-1b05-4490-9298-919616fd1df6 req-489961cc-a6a3-4889-9271-efaf935902df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135832 Oct 25 03:18:39.036862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1725/3636] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:39.129834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:39.131393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:39.152274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:39.152789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:39.153237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:39.153992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:39.154449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:39.154875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:39.326835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:39.342117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:39.350712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:39.359201 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-afe349a2-0283-446e-b3e2-901cab22cf75 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1844 microversion: 2.32 time: 1.252437 Oct 25 03:18:39.362403 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1912/3637] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:38 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1844 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:39.594381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:39.595372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:39.611984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:39.614289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:39.616092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:39.618559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:39.619477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:39.620097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:39.882357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:39.898813 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6f8225b-5d1b-4c83-b503-f28661c69fe5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.773320 Oct 25 03:18:39.903274 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1726/3638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:39 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:39.918837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aacd2ed1-b13d-4c7a-979a-846060e6eeb0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7c75e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:40.037721 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aacd2ed1-b13d-4c7a-979a-846060e6eeb0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.130629 Oct 25 03:18:40.042103 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1727/3639] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:39 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:40.331599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:40.355860 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f3580bf-d5a5-4117-b158-61f82622d06b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1664 microversion: 2.1 time: 0.765570 Oct 25 03:18:40.362322 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1913/3640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:39 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1664 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:40.391588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:40.392476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:40.407885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:40.416038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:40.416890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:40.418617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:40.422284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:40.423314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:40.827435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:40.858981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:40.925454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:40.926128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:40.946094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:40.949965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:40.950884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:40.953819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:40.956129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:40.962646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:41.403829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:41.651519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:41.675049 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12dc2a43-ca77-43a1-966e-0e07d15a11e0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.749974 Oct 25 03:18:41.678524 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1914/3641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:40 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:41.700546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-194a5dae-600e-4fbe-aa17-cc2768883cc0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd33a41a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:41.817026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-194a5dae-600e-4fbe-aa17-cc2768883cc0 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.137070 Oct 25 03:18:41.818770 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1915/3642] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:41 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:41.833821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:41.835722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:41.849451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:41.853239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:41.853920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:41.856045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:41.857763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:41.859364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:42.197294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:42.227003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:42.232973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:42.234262 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da5c8eb1-999f-40e8-bd0e-5f4e7e94b613 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1865 microversion: 2.32 time: 1.848756 Oct 25 03:18:42.234847 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1728/3643] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:40 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1865 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:42.699195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:42.700069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:42.724499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:42.730898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:42.731374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:42.732144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:42.740425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:42.740891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:43.241394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:43.250688 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c98c4a76-b3f3-4cf9-b846-e969a05f5db0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1664 microversion: 2.1 time: 1.425617 Oct 25 03:18:43.270386 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1916/3644] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:41 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1664 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:43.281601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da9d5b0e-5a43-4d72-992d-63845a88ce8b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b82c430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:43.364100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:43.369200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da9d5b0e-5a43-4d72-992d-63845a88ce8b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.098858 Oct 25 03:18:43.370274 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1917/3645] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:43 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:43.380730 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d884b4e-9365-46c3-8dd9-3db48f4912ab tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.686715 Oct 25 03:18:43.383007 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1729/3646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:42 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:43.403486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:43.406965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:43.433199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:43.434894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:43.436319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:43.443164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:43.443861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:43.444621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:43.579995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-fa427569-7591-430e-ba28-5f4978496d85 req-1cfe5281-d588-4f14-b6bc-09e77f8bf040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02", "tag": "62ac361c-72c5-4eff-adce-8b7444d8bf61"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:43.639854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fa427569-7591-430e-ba28-5f4978496d85 req-1cfe5281-d588-4f14-b6bc-09e77f8bf040 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:43.643034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fa427569-7591-430e-ba28-5f4978496d85 req-1cfe5281-d588-4f14-b6bc-09e77f8bf040 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:43.643941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fa427569-7591-430e-ba28-5f4978496d85 req-1cfe5281-d588-4f14-b6bc-09e77f8bf040 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:43.702913 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-fa427569-7591-430e-ba28-5f4978496d85 req-1cfe5281-d588-4f14-b6bc-09e77f8bf040 service nova] Creating event network-changed:62ac361c-72c5-4eff-adce-8b7444d8bf61 for instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 on n-h2-862355-1 Oct 25 03:18:43.743911 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-fa427569-7591-430e-ba28-5f4978496d85 req-1cfe5281-d588-4f14-b6bc-09e77f8bf040 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161317 Oct 25 03:18:43.744860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1730/3647] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:18:43.767038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-240efcd9-d2f5-4a37-8627-9221b563ce48 req-3007d280-5e99-4495-8bca-b3bb40869858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "83a5d23b-851d-4581-997e-80f2fdabf0df"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:43.797839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-240efcd9-d2f5-4a37-8627-9221b563ce48 req-3007d280-5e99-4495-8bca-b3bb40869858 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:43.798700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-240efcd9-d2f5-4a37-8627-9221b563ce48 req-3007d280-5e99-4495-8bca-b3bb40869858 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:43.802068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-240efcd9-d2f5-4a37-8627-9221b563ce48 req-3007d280-5e99-4495-8bca-b3bb40869858 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:43.823580 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-240efcd9-d2f5-4a37-8627-9221b563ce48 req-3007d280-5e99-4495-8bca-b3bb40869858 service nova] Creating event network-changed:83a5d23b-851d-4581-997e-80f2fdabf0df for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:18:43.830336 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-240efcd9-d2f5-4a37-8627-9221b563ce48 req-3007d280-5e99-4495-8bca-b3bb40869858 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083360 Oct 25 03:18:43.831772 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1731/3648] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:44.282451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:44.283149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:44.305846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:44.306714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:44.307184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:44.307940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:44.308455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:44.308886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:44.587607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:44.609852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:44.619824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:44.621056 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-032a69f6-d5a3-4d6c-86fe-31ddb228934c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1865 microversion: 2.32 time: 1.249532 Oct 25 03:18:44.645313 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1918/3649] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:43 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1865 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:44.655528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf2a1101-a01a-4e78-b97b-332a94b1ef80 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b872940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:44.753304 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf2a1101-a01a-4e78-b97b-332a94b1ef80 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.103863 Oct 25 03:18:44.756921 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1919/3650] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:44 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:44.774097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:44.791433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:44.829342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:44.837067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:44.843511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:44.845207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:44.852562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:44.853319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:44.855252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:44.861725 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f8980a8b-cbd8-4d44-90bc-7ecdc9811e09 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.583254 Oct 25 03:18:44.865946 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1732/3651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:44 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:44.891937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:44.892553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:44.907059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:44.907558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:44.907997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:44.908709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:44.909158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:44.909592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:45.232443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:45.242749 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb7613af-d945-4495-9b76-9281391c3bf3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.354988 Oct 25 03:18:45.243660 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1733/3652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:44 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:45.272839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:45.273383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:45.289128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:45.290734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:45.291329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:45.291762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:45.292473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:45.292981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:45.293406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:45.373798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:45.384876 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-166a3706-c152-4823-b3a4-79aedf32d370 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.621892 Oct 25 03:18:45.387396 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1920/3653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:44 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:45.388953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Unlocking {{(pid=120563) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 25 03:18:45.545100 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ea24118-ac92-43d1-a5ea-f02d8ef9b86a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.277421 Oct 25 03:18:45.551667 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1734/3654] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:45 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:18:45.567499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:45.568143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:45.577969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:45.583997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:45.584738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:45.587154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:45.587792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:45.588847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:45.666836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:45.667861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:45.714265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:45.715080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:45.716449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:45.720209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:45.721039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:45.724809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:46.141561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:46.141561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:46.141561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:46.141561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d273be8e-7196-41f4-b4ca-4a18dd99a56e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1865 microversion: 2.32 time: 0.478163 Oct 25 03:18:46.141561 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1735/3655] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:45 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1865 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:46.173577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7455478c-c154-49ab-9c40-fe1ffc687136 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7c7430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:46.189365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:46.205191 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d19c0de-e4f3-4ff5-9a56-77e0df1ed8d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.640670 Oct 25 03:18:46.225808 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1921/3656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:45 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:46.241253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:46.256151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:46.267475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7455478c-c154-49ab-9c40-fe1ffc687136 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.127712 Oct 25 03:18:46.268371 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1736/3657] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:46 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:46.294206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:46.294727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:46.295185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:46.299756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:46.301155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:46.302385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:46.414219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:46.414849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:46.437344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:46.437894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:46.438343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:46.439063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:46.443729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:46.444216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:46.716536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:46.725526 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9468b850-0530-4abc-925b-7560cc92efc1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.490194 Oct 25 03:18:46.729183 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1922/3658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:46 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:46.750863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:46.751496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:46.761125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:46.761713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:46.762183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:46.765077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:46.765614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:46.766099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:46.807754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:46.834256 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bad7b98b-3b5f-46fb-8bbf-73dc2510ef5f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.423884 Oct 25 03:18:46.854022 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1737/3659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:46 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:47.365382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:47.380807 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9e54534c-f6eb-44b4-baca-d418f0b66088 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.633715 Oct 25 03:18:47.382915 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1923/3660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:46 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:47.388051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:47.391682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:47.405181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:47.406855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:47.410314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:47.419540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:47.420617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:47.425692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:47.427072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:47.430770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:47.431516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:47.439515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:47.440687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:47.445665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:47.448636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:47.450729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:47.562625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:18:47.639339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:47.778450 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e7ad85ba-5c53-40a8-b287-e84eb4af0541 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 204 len: 0 microversion: 2.42 time: 0.816832 Oct 25 03:18:47.779456 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1738/3661] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:18:46 2022] DELETE /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:18:47.790195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eefb950b-4e0d-4e44-ade1-55de6ccde335 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32f09160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:47.917299 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eefb950b-4e0d-4e44-ade1-55de6ccde335 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.134847 Oct 25 03:18:47.920325 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1739/3662] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:47 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:47.936389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:47.939983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:47.960643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:47.963076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:47.963849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:47.969233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:47.970064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:47.970724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:48.144275 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3c4046c-663b-451e-9b87-d19c2db99362 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.219864 Oct 25 03:18:48.146663 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1740/3663] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:47 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:18:48.161552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:48.164939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:48.183325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:48.184713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:48.188242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:48.191556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:48.193290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:48.193955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:48.346331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:48.365618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:48.368086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:48.370762 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd0e945c-5c9a-4163-8fd2-8422cf2f788e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1886 microversion: 2.32 time: 0.986459 Oct 25 03:18:48.378578 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1924/3664] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:47 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1886 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:48.385636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e2b25a01-7a95-4b50-869a-fbf5f0aea6cb req-070758d1-c676-4d2e-af60-6d8ebb996834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "3c70718a-f41c-4237-b525-125333cb3a7d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:48.398834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e2b25a01-7a95-4b50-869a-fbf5f0aea6cb req-070758d1-c676-4d2e-af60-6d8ebb996834 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:48.399388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e2b25a01-7a95-4b50-869a-fbf5f0aea6cb req-070758d1-c676-4d2e-af60-6d8ebb996834 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:48.400115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e2b25a01-7a95-4b50-869a-fbf5f0aea6cb req-070758d1-c676-4d2e-af60-6d8ebb996834 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:48.418198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e2b25a01-7a95-4b50-869a-fbf5f0aea6cb req-070758d1-c676-4d2e-af60-6d8ebb996834 service nova] Creating event network-changed:3c70718a-f41c-4237-b525-125333cb3a7d for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:18:48.427633 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e2b25a01-7a95-4b50-869a-fbf5f0aea6cb req-070758d1-c676-4d2e-af60-6d8ebb996834 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046873 Oct 25 03:18:48.428730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1925/3665] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:48.435883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:48.436612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:48.446611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:48.447361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:48.448091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:48.449080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:48.450237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:48.451168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:48.915295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:48.934755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:48.937217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:48.946801 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-373e421b-c961-41b7-a112-e762dd5b297d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2958 microversion: 2.42 time: 0.795347 Oct 25 03:18:48.948851 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1741/3666] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:48 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2958 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:48.957970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:48.962327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:48.965018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:48.967777 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-659d534c-f3e9-4d32-b19f-c453472aded3 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.537601 Oct 25 03:18:48.971050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1926/3667] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:48 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:48.976932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:48.986198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:48.989951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:49.022574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:49.027838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5244f68-2d7f-45c0-9d38-1ff7e3693da8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b8721f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:49.028781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:49.038961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:49.120640 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5244f68-2d7f-45c0-9d38-1ff7e3693da8 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.138377 Oct 25 03:18:49.122491 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1927/3668] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:48 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:49.408626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:49.409314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:49.419253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:49.423615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:49.424309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:49.424894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:49.427342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:49.428114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:49.430851 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87c29b7f-9c69-443b-b185-87c609ca7288 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1653 microversion: 2.1 time: 0.479794 Oct 25 03:18:49.431514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:49.433960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1742/3669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:48 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1653 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:49.463152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:49.464174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:49.490822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:49.498467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:49.499298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:49.500206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:49.500818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:49.503453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:49.659264 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e8f144b-4625-422b-b744-ae75958ec566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.202484 Oct 25 03:18:49.663911 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1743/3670] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:18:49 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:18:49.677017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:49.678188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:49.691042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:49.691551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:49.692008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:49.696367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:49.696854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:49.698114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:50.752261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:50.772351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:50.779988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:50.783626 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bb179664-e0e3-44eb-97ae-14749028991f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1886 microversion: 2.32 time: 1.380874 Oct 25 03:18:50.806702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1928/3671] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:49 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1886 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:18:50.812083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:50.819040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:50.838851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:50.840530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:50.842496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:50.850734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:50.851387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:50.851919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:51.548530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:51.558547 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-776768b6-dd53-4f5e-8ab0-6812b9e8c35c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1660 microversion: 2.1 time: 1.893214 Oct 25 03:18:51.570469 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1744/3672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:49 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1660 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:51.586459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:51.587294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:51.603337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:51.604109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:51.604687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:51.605614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:51.606189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:51.606636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:51.771043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:51.795862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:51.804990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:51.816118 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-99d038e3-2f7e-4c41-9ae7-e11bd6323f80 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2958 microversion: 2.42 time: 1.006883 Oct 25 03:18:51.830908 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1929/3673] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:50 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2958 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:51.850535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c036e581-1675-4700-a8aa-7dbc00744328 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd327e4c10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:51.965489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c036e581-1675-4700-a8aa-7dbc00744328 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.132871 Oct 25 03:18:51.967786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1930/3674] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:51 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:51.978919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:51.979607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:51.983071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:51.992290 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c38651e-6bbe-4bc9-9ea5-d2b68b10df6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.420448 Oct 25 03:18:52.000710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:52.001446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:52.002098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:52.002971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:52.006110 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1745/3675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:51 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:52.007438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:52.008098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:52.052959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:52.598442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:52.599652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:52.607746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:52.609990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:52.610454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:52.611183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:52.611651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:52.612120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:52.788142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:52.803076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:52.804548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:52.810790 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c36cc95-b270-424f-bdfb-bddf264b74b3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.841561 Oct 25 03:18:52.830883 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1931/3676] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:51 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:52.837663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-be26012e-903a-4462-840e-e586b8bd986d req-85625310-d7c7-4d35-baa1-dea358627d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02", "name": "network-vif-plugged", "status": "completed", "tag": "62ac361c-72c5-4eff-adce-8b7444d8bf61"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:52.854605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-be26012e-903a-4462-840e-e586b8bd986d req-85625310-d7c7-4d35-baa1-dea358627d8d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:52.857835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-be26012e-903a-4462-840e-e586b8bd986d req-85625310-d7c7-4d35-baa1-dea358627d8d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:52.858531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-be26012e-903a-4462-840e-e586b8bd986d req-85625310-d7c7-4d35-baa1-dea358627d8d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:52.893967 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-be26012e-903a-4462-840e-e586b8bd986d req-85625310-d7c7-4d35-baa1-dea358627d8d service nova] Creating event network-vif-plugged:62ac361c-72c5-4eff-adce-8b7444d8bf61 for instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 on n-h2-862355-1 Oct 25 03:18:52.907547 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-be26012e-903a-4462-840e-e586b8bd986d req-85625310-d7c7-4d35-baa1-dea358627d8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092003 Oct 25 03:18:52.908179 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1932/3677] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:52.917995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:52.924022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:52.945008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:52.945903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:52.947953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:52.948916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:52.950869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:52.951707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:53.281966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:53.297789 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bfa7e4f7-8c05-4d90-af09-cf5fb4b0abe8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.703417 Oct 25 03:18:53.308585 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1746/3678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:52 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:18:53.337927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b99c41c3-6b1a-4428-8115-0a7f242ad949 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7b3700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:53.459687 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b99c41c3-6b1a-4428-8115-0a7f242ad949 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.149329 Oct 25 03:18:53.463663 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1747/3679] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:53 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:53.480789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:53.481418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:53.489799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:53.490480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:53.490924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:53.491640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:53.492104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:53.492541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:54.060284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:54.082685 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-baec941c-0897-4088-8f42-fb906cccf1da tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 0.611799 Oct 25 03:18:54.099824 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1748/3680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:53 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:54.107300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2198eced-a1a5-4d42-a510-a12f10079b87 req-df3be549-aac8-4a24-af9c-138ab383a365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "f262a55a-b193-4212-8269-aba78af92fa8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:54.118880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2198eced-a1a5-4d42-a510-a12f10079b87 req-df3be549-aac8-4a24-af9c-138ab383a365 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:54.119973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2198eced-a1a5-4d42-a510-a12f10079b87 req-df3be549-aac8-4a24-af9c-138ab383a365 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:54.119973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2198eced-a1a5-4d42-a510-a12f10079b87 req-df3be549-aac8-4a24-af9c-138ab383a365 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:54.133095 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2198eced-a1a5-4d42-a510-a12f10079b87 req-df3be549-aac8-4a24-af9c-138ab383a365 service nova] Creating event network-changed:f262a55a-b193-4212-8269-aba78af92fa8 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:18:54.139402 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2198eced-a1a5-4d42-a510-a12f10079b87 req-df3be549-aac8-4a24-af9c-138ab383a365 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041472 Oct 25 03:18:54.140840 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1749/3681] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:54.147987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:54.149227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:54.158224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:54.158965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:54.160493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:54.161570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:54.162889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:54.163501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:54.284095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:54.327772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:54.330815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:54.332867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab6ae9ea-f99f-4142-b1af-461b27d131d7 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2958 microversion: 2.42 time: 1.423530 Oct 25 03:18:54.335778 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1933/3682] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:52 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2958 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:54.353863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:54.355256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:54.366936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:54.367734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:54.368177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:54.370042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:54.370754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:54.371561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:54.563407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:54.573368 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4ee14dcc-5233-407f-8ba4-f6e3d7ffee70 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.431071 Oct 25 03:18:54.576771 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1750/3683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:54 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:54.582033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-92cc6b78-fe38-4213-b8a4-29281fc9993b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32995430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:54.672405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-92cc6b78-fe38-4213-b8a4-29281fc9993b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.094124 Oct 25 03:18:54.682481 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1751/3684] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:54 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:54.690890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:54.703898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:54.735077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:54.743886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:54.744691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:54.746828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:54.748761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:54.751875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:55.089366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:55.135208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:55.136695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:55.146039 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5462449-ff8d-461e-bf35-8f98fc3a50cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.808233 Oct 25 03:18:55.146652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1934/3685] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:54 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:55.179168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:55.179799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:55.210922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:55.211948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:55.213134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:55.214287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:55.214965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:55.215695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:55.344782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:55.364915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-add6cacc-0301-42e8-a4ae-da54283d26c7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.676094 Oct 25 03:18:55.365658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1752/3686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:54 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:55.401592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:55.402273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:55.422258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:55.422744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:55.424735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:55.427113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:55.427540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:55.427985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:56.274683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:56.289879 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b699c42-d991-4f01-8666-5cfb7871600b tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1317 microversion: 2.1 time: 1.124384 Oct 25 03:18:56.292806 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1935/3687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:55 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1317 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:56.307598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:56.312095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:56.329550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:56.332409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:56.334329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:56.340848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:56.342056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:56.342960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:56.659388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:56.682351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:56.684060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:56.685634 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d3a12b84-b412-40f7-b0a4-e770a10da21f tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2937 microversion: 2.42 time: 1.305863 Oct 25 03:18:56.686513 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1753/3688] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:55 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2937 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:56.691606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86fa485d-a5a5-4cbd-86df-359b75cc949d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32995430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:56.716691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:56.740786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-efa0ded9-8e69-41dc-8aca-39b8fd448804 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.446410 Oct 25 03:18:56.742423 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1936/3689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:56 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:56.753938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:56.765988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:56.798114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:56.798630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:56.807528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:56.808406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:56.808910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:56.809357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:56.850629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86fa485d-a5a5-4cbd-86df-359b75cc949d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.162525 Oct 25 03:18:56.851376 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1754/3690] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:56 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:56.862690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:56.863481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:56.879466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:56.883995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:56.884724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:56.885780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:56.886543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:56.895529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:57.439841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:57.452687 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1171ba1c-b917-4d71-bcb0-a9afbdf3a3e2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.598338 Oct 25 03:18:57.456802 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1755/3691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:56 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:57.467711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:57.471721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:57.488157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:57.489120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:57.492696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:57.494394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:57.495095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:57.497037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:57.577279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:57.592660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:57.598794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:57.600373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66a743a4-bac2-4ed2-a980-90ab99b2bd24 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.856505 Oct 25 03:18:57.600978 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1937/3692] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:56 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:18:57.605778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b4f64349-614d-481a-ae15-7c900df25905 req-a59f4b78-d5a4-4b06-ab5c-c5398665b8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "4080e02e-5d05-4b9c-8e35-fe42cbed4c96"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:57.630309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b4f64349-614d-481a-ae15-7c900df25905 req-a59f4b78-d5a4-4b06-ab5c-c5398665b8e0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:57.636233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b4f64349-614d-481a-ae15-7c900df25905 req-a59f4b78-d5a4-4b06-ab5c-c5398665b8e0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:57.636951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b4f64349-614d-481a-ae15-7c900df25905 req-a59f4b78-d5a4-4b06-ab5c-c5398665b8e0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:57.660166 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b4f64349-614d-481a-ae15-7c900df25905 req-a59f4b78-d5a4-4b06-ab5c-c5398665b8e0 service nova] Creating event network-changed:4080e02e-5d05-4b9c-8e35-fe42cbed4c96 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:18:57.672152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b4f64349-614d-481a-ae15-7c900df25905 req-a59f4b78-d5a4-4b06-ab5c-c5398665b8e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069683 Oct 25 03:18:57.672980 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1938/3693] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:57.683868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:57.689865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:57.698431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:57.701620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:57.702304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:57.704981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:57.706087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:57.709759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:58.282571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:58.294552 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3c57ae1-e8b1-4406-92d8-52de6361c3f5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1467 microversion: 2.1 time: 0.834563 Oct 25 03:18:58.315073 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1756/3694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:57 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1467 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:58.339359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:58.340084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:58.359463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:58.360124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:58.360793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:58.364614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:58.366276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:58.366995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:58.389344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:18:58.398883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-58a3b19a-36f4-4bd6-a514-e80ff1121005 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.723796 Oct 25 03:18:58.405628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1939/3695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:57 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:58.422163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:18:58.427221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-58d2a0ec-e384-41f9-968c-ecd7f184843b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b803a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:58.534003 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-58d2a0ec-e384-41f9-968c-ecd7f184843b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.111033 Oct 25 03:18:58.534616 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1940/3696] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:18:58 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:58.566329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-76fd54ab-4010-4c63-987e-c131d1739d4f req-126b9ab2-7606-46d9-be7f-a8b2f5b712d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-unplugged", "status": "completed", "tag": "4e479d1c-2ec3-4733-93c5-74f7e16c3d8e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:18:58.595699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76fd54ab-4010-4c63-987e-c131d1739d4f req-126b9ab2-7606-46d9-be7f-a8b2f5b712d7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:58.596467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76fd54ab-4010-4c63-987e-c131d1739d4f req-126b9ab2-7606-46d9-be7f-a8b2f5b712d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:58.597067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76fd54ab-4010-4c63-987e-c131d1739d4f req-126b9ab2-7606-46d9-be7f-a8b2f5b712d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:58.631547 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-76fd54ab-4010-4c63-987e-c131d1739d4f req-126b9ab2-7606-46d9-be7f-a8b2f5b712d7 service nova] Creating event network-vif-unplugged:4e479d1c-2ec3-4733-93c5-74f7e16c3d8e for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:18:58.640569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-76fd54ab-4010-4c63-987e-c131d1739d4f req-126b9ab2-7606-46d9-be7f-a8b2f5b712d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091742 Oct 25 03:18:58.642381 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1941/3697] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:18:58.652401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:58.662943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:58.683263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:58.683948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:58.685966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:58.686886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:58.689129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:58.694376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:59.259787 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b5dc80f-a5cc-4f8b-a1cc-7ab4bcfd3a2f tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1618 microversion: 2.1 time: 0.611488 Oct 25 03:18:59.261185 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1942/3698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:18:58 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1618 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:18:59.266492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:18:59.267303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:18:59.274665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:59.275330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:59.275928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:18:59.276813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:18:59.277445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:18:59.280130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:00.128813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:00.155335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:00.160200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:00.164757 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a08b9b5-5a2a-4634-95cf-bcb345a875fd tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2869 microversion: 2.42 time: 1.848405 Oct 25 03:19:00.167569 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1757/3699] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:58 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2869 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:00.178558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-902907271", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a"]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:00.298059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:19:00.321090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:00.330633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:00.332087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:00.348744 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc7ab790-e100-45fd-a907-f20a0a6fb4cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.085042 Oct 25 03:19:00.349746 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1943/3700] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:18:59 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:00.358023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4b5ece1-e37a-4f7c-a4d0-95f92dda665a tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b8baca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:00.422344 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4b5ece1-e37a-4f7c-a4d0-95f92dda665a tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.071339 Oct 25 03:19:00.422944 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1944/3701] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:00 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:00.446899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a2aeca35-3a89-43d1-9da9-081239573a7f req-8f9ade0e-c9dd-4f45-81f1-fca1d9331e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-deleted", "tag": "42f8ac95-4a46-470d-9f6c-1d1045fbf922"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:00.482202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a2aeca35-3a89-43d1-9da9-081239573a7f req-8f9ade0e-c9dd-4f45-81f1-fca1d9331e8e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:00.482703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a2aeca35-3a89-43d1-9da9-081239573a7f req-8f9ade0e-c9dd-4f45-81f1-fca1d9331e8e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:00.483149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a2aeca35-3a89-43d1-9da9-081239573a7f req-8f9ade0e-c9dd-4f45-81f1-fca1d9331e8e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:00.529251 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a2aeca35-3a89-43d1-9da9-081239573a7f req-8f9ade0e-c9dd-4f45-81f1-fca1d9331e8e service nova] Creating event network-vif-deleted:42f8ac95-4a46-470d-9f6c-1d1045fbf922 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:00.548616 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a2aeca35-3a89-43d1-9da9-081239573a7f req-8f9ade0e-c9dd-4f45-81f1-fca1d9331e8e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116992 Oct 25 03:19:00.550319 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1945/3702] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:00.721831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-unplugged", "status": "completed", "tag": "5328eb15-eb4f-4c5d-a324-41e317e5b958"}, {"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-unplugged", "status": "completed", "tag": "49f692b2-342c-4715-a3bf-8de914655333"}, {"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-unplugged", "status": "completed", "tag": "b72ec6e2-76b3-491d-b4dc-5e311cf014e2"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:00.743444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:00.744207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:00.744799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:00.765040 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] Creating event network-vif-unplugged:5328eb15-eb4f-4c5d-a324-41e317e5b958 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:00.777109 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] Creating event network-vif-unplugged:49f692b2-342c-4715-a3bf-8de914655333 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:00.777633 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] Creating event network-vif-unplugged:b72ec6e2-76b3-491d-b4dc-5e311cf014e2 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:00.787178 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ac8312b3-5733-45ff-8289-9e0712e79213 req-ccaa43ed-4f17-49d8-8bc9-f394a1742ecf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.069540 Oct 25 03:19:00.788324 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1946/3703] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:19:01.204222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:01.204851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:01.223814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:01.225737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:01.226377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:01.227298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:01.227948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:01.228585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:01.576086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:19:01.576540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:19:01.576973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:19:01.577560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:19:01.578201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:19:01.595177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:01.598864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:01.599494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:01.600458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:01.602075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:01.605875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:01.638235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:01.661451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:01.663232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:01.664653 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8712fa90-5d72-44bc-be76-05f558b0c878 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2661 microversion: 2.42 time: 0.465114 Oct 25 03:19:01.668310 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1947/3704] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:01 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2661 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:01.670473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:19:01.677609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:01.682868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:19:01.683740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:01.699890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:01.700400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:01.700920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:01.701637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:01.702157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:01.703106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:01.705057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:19:01.710600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:19:01.789087 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e85c45ee-8c60-4ae5-91dd-bf4b68bb0bf5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619608 Oct 25 03:19:01.790626 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1758/3705] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:19:01.797438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e7728d4-61c5-45ae-aaba-2e91925c0150 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b731430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:01.860195 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e7728d4-61c5-45ae-aaba-2e91925c0150 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.068251 Oct 25 03:19:01.861926 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1759/3706] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:01 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:01.868563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a1205d84-4f3e-4dea-a1cf-26d1e2a681ff tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:01.869538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a1205d84-4f3e-4dea-a1cf-26d1e2a681ff tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:02.160733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a1205d84-4f3e-4dea-a1cf-26d1e2a681ff tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:02.231958 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a1205d84-4f3e-4dea-a1cf-26d1e2a681ff tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1216 microversion: 2.1 time: 0.368483 Oct 25 03:19:02.234681 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1760/3707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:01 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1216 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:02.659602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-deleted", "tag": "49f692b2-342c-4715-a3bf-8de914655333"}, {"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-deleted", "tag": "5328eb15-eb4f-4c5d-a324-41e317e5b958"}, {"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "c0254f2d-b694-462b-8660-c868db54fe1d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:02.676735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:02.677246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:02.677925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:02.698226 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] Creating event network-vif-deleted:49f692b2-342c-4715-a3bf-8de914655333 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:02.705950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] Creating event network-vif-deleted:5328eb15-eb4f-4c5d-a324-41e317e5b958 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:02.706992 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] Creating event network-changed:c0254f2d-b694-462b-8660-c868db54fe1d for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:19:02.716444 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-eed3e604-448e-4023-99ec-ada2e67abb18 req-95e267ba-233a-4ae7-9874-470dc89b35e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.061351 Oct 25 03:19:02.717772 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1761/3708] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:02.726569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:02.736836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:02.752711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:02.755154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:02.760785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:02.762004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:02.762801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:02.763779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:03.030350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:03.066377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:03.070796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:03.073640 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3eceb6fd-4f26-4d3c-bed7-cbcef0754fed tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.402901 Oct 25 03:19:03.087977 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1948/3709] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:01 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:03.087977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-954e707c-1039-4336-b2c7-498b97708ced tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b82ce50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:03.141228 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-954e707c-1039-4336-b2c7-498b97708ced tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1424 microversion: 2.1 time: 0.065453 Oct 25 03:19:03.142851 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1949/3710] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:03 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:03.257544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:03.258590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:03.273106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:03.273923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:03.274573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:03.281853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:03.282549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:03.283181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:03.466873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:03.486371 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-75f543bf-1e39-4ff5-b24d-640193a50f77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1268 microversion: 2.1 time: 0.233653 Oct 25 03:19:03.487238 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1950/3711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:03 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:03.755285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:03.774705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:03.776420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:03.778012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41883c3a-58a0-4158-adc6-d8d3aeea81e6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2547 microversion: 2.42 time: 1.058915 Oct 25 03:19:03.781405 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1762/3712] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:02 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2547 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:04.105026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:04.106385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:04.112570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=70 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:04.115212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:04.116043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:04.116698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:04.117645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:04.118461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:04.119091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:04.165421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a4803fb-fdf8-4f08-bbfc-8bdf1163c54b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b731c10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:04.248747 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a4803fb-fdf8-4f08-bbfc-8bdf1163c54b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1433 microversion: 2.1 time: 0.094085 Oct 25 03:19:04.250144 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1763/3713] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:04 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1433 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:04.269580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e028b7f7-c5ab-41b2-b2b6-4381f03601e1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd334f3ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:04.368251 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e028b7f7-c5ab-41b2-b2b6-4381f03601e1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 200 len: 1433 microversion: 2.1 time: 0.104139 Oct 25 03:19:04.368867 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1764/3714] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:04 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 1433 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:04.383177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:04.383803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:04.394342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:04.395370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:04.395558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:04.396687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:04.397126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:04.397516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:04.731491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:04.744428 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e68ea16-36fd-4894-94d4-93642986ccba tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1465 microversion: 2.1 time: 0.365013 Oct 25 03:19:04.747795 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1765/3715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:04 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1465 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:04.752547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:04.770917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:04.787258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:04.787755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:04.788639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:04.790496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:04.792168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:04.792612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:04.950153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:04.963600 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b610befc-5771-452b-974a-406e98257796 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1274 microversion: 2.1 time: 0.214668 Oct 25 03:19:04.968315 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1766/3716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:04 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:04.979118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e56be0f-8957-4f60-b3d0-e3ea064c2550 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd33809670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:04.989478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:05.012290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:05.015058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:05.016271 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d00fb8cb-5da6-46b4-a110-0a23c5fc3f7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.915224 Oct 25 03:19:05.016850 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1951/3717] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:04 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:05.037469 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e56be0f-8957-4f60-b3d0-e3ea064c2550 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/aaf4b9eb-e26e-4d56-8bee-d6f868921bec" status: 200 len: 784 microversion: 2.1 time: 0.067846 Oct 25 03:19:05.038094 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1767/3718] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:04 2022] GET /compute/v2.1/images/aaf4b9eb-e26e-4d56-8bee-d6f868921bec => generated 784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:05.044467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8367f622-0a9a-4c51-af61-7d948c482780 req-ba655c74-eb4c-4244-88ca-74cf1b42649b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-deleted", "tag": "4e479d1c-2ec3-4733-93c5-74f7e16c3d8e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:05.060976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:05.062537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:05.064224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8367f622-0a9a-4c51-af61-7d948c482780 req-ba655c74-eb4c-4244-88ca-74cf1b42649b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:05.065272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8367f622-0a9a-4c51-af61-7d948c482780 req-ba655c74-eb4c-4244-88ca-74cf1b42649b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:05.065953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8367f622-0a9a-4c51-af61-7d948c482780 req-ba655c74-eb4c-4244-88ca-74cf1b42649b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:05.077769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:05.078268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:05.078706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:05.079630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:05.079858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:05.080284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:05.085595 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8367f622-0a9a-4c51-af61-7d948c482780 req-ba655c74-eb4c-4244-88ca-74cf1b42649b service nova] Creating event network-vif-deleted:4e479d1c-2ec3-4733-93c5-74f7e16c3d8e for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:05.092620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8367f622-0a9a-4c51-af61-7d948c482780 req-ba655c74-eb4c-4244-88ca-74cf1b42649b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065451 Oct 25 03:19:05.094144 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1952/3719] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:05.100314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4e6f6a3-09b2-4e19-9a4e-3a446bf85aa6 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:05.112303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4e6f6a3-09b2-4e19-9a4e-3a446bf85aa6 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016663 Oct 25 03:19:05.122715 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1953/3720] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:19:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:05.130164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd5fc1cb-402d-4343-8a79-1e2efa52bc59 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7c0430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:05.486918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:05.517450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:05.521968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:05.526460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a90a8f7c-0447-4e56-bcfb-812ba7f909e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2386 microversion: 2.42 time: 0.474994 Oct 25 03:19:05.544503 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1768/3721] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:05 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2386 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:05.996219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:05.997575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:06.004978 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd5fc1cb-402d-4343-8a79-1e2efa52bc59 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "DELETE /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 204 len: 0 microversion: 2.1 time: 0.880224 Oct 25 03:19:06.005645 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1954/3722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:05 2022] DELETE /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 0 bytes in 882 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:19:06.009053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.009553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.010020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:06.010734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.011186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.013651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:06.019487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-acc0efdb-cff9-47a3-b06b-7e3c57a2c621 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b8bad30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:06.058086 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-acc0efdb-cff9-47a3-b06b-7e3c57a2c621 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] HTTP exception thrown: Image not found. Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-acc0efdb-cff9-47a3-b06b-7e3c57a2c621 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Request method failure captured: Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be HTTP/1.1 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Vnaj-oV1pwZ4B6YNk5w7aYJAKRQwCqhNMK0bLurItzKUL3mp_o8WMAAd7LoFSo4FvyiRzqTS4Jle7d-pUomxlllneTrGN-KjjKJZUBkMz3Ahn9ZvV-Ec7PfCwPeEz3fNOxJ_0oBEmSnD06tewbJgJ6QxtvVSOA9mz0uLmtVnft0yI Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ee89c033477d449ab24dbb865dd9eb19 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee89c033477d449ab24dbb865dd9eb19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee89c033477d449ab24dbb865dd9eb19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee89c033477d449ab24dbb865dd9eb19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee89c033477d449ab24dbb865dd9eb19"}]}] Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ee89c033477d449ab24dbb865dd9eb19 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesOneServerTestJSON-1376236292-project Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 1160aef6e662446eb3066ec8f3bcc110 Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesOneServerTestJSON-1376236292-project Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'b85e146d-bdbf-4cc6-847c-856d0276b5be'} Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b85e146d-bdbf-4cc6-847c-856d0276b5be Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:19:06.060417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b85e146d-bdbf-4cc6-847c-856d0276b5be could not be found. Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:19:06.064705 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:06.070806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-acc0efdb-cff9-47a3-b06b-7e3c57a2c621 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:19:06.070806 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-acc0efdb-cff9-47a3-b06b-7e3c57a2c621 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 404 len: 62 microversion: 2.1 time: 0.054002 Oct 25 03:19:06.070806 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1955/3723] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:06 2022] GET /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:19:06.085625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:06.086656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:06.093867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.094598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.095194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:06.096060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.096701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.097285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:06.115661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:06.127212 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d3e29081-fe31-40dc-b041-43356c7f2765 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1274 microversion: 2.1 time: 0.136447 Oct 25 03:19:06.143333 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1769/3724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:05 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:06.150654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1291550494"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:06.153249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:06.170615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.171118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.171562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:06.172270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.172721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.174548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:06.604678 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3f18074b-a977-4304-b332-a7f5569e5700 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "POST /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01/action" status: 202 len: 0 microversion: 2.1 time: 0.456755 Oct 25 03:19:06.609236 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1770/3725] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:19:06 2022] POST /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:19:06.634924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:06.637355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:06.656917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.657751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.658390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:06.659325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:06.660244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:06.666472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:07.179689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:07.201037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:07.205413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:07.208979 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-692e125b-a772-4bca-95f6-5e4d7bbc3ca9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2228 microversion: 2.42 time: 0.596595 Oct 25 03:19:07.210273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1771/3726] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:06 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2228 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:07.211718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:07.217322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c78250cb-af81-4331-b392-13e5f817c390 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd329b5670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:07.241506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:07.251223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:07.252464 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c673f1c-827a-4f44-98cd-69dfd962bb05 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.181463 Oct 25 03:19:07.253047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1956/3727] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:06 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:07.297017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-354cc0b2-7641-4363-90f4-042aa36f5fac req-43536813-9843-4c46-bb8e-fef32bc35cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b32ae59-c085-47d9-be50-3c0eb0350c01", "name": "network-vif-unplugged", "status": "completed", "tag": "985c5405-7c62-48ed-87fe-3cc4bb482730"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:07.297888 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c78250cb-af81-4331-b392-13e5f817c390 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.085458 Oct 25 03:19:07.298850 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1772/3728] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:07 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:07.312708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-0cbd3d40-414a-4942-a30a-7154f545019d req-f8bb22ff-02d5-44a7-844b-cd15cf380c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "4d408fc1-c38d-41df-b975-f734805dd002"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:07.313843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-354cc0b2-7641-4363-90f4-042aa36f5fac req-43536813-9843-4c46-bb8e-fef32bc35cb9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:07.314878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-354cc0b2-7641-4363-90f4-042aa36f5fac req-43536813-9843-4c46-bb8e-fef32bc35cb9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:07.315480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-354cc0b2-7641-4363-90f4-042aa36f5fac req-43536813-9843-4c46-bb8e-fef32bc35cb9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:07.340148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-354cc0b2-7641-4363-90f4-042aa36f5fac req-43536813-9843-4c46-bb8e-fef32bc35cb9 service nova] Creating event network-vif-unplugged:985c5405-7c62-48ed-87fe-3cc4bb482730 for instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 on n-h2-862355-1 Oct 25 03:19:07.349880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0cbd3d40-414a-4942-a30a-7154f545019d req-f8bb22ff-02d5-44a7-844b-cd15cf380c25 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:07.350672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0cbd3d40-414a-4942-a30a-7154f545019d req-f8bb22ff-02d5-44a7-844b-cd15cf380c25 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:07.351824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0cbd3d40-414a-4942-a30a-7154f545019d req-f8bb22ff-02d5-44a7-844b-cd15cf380c25 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:07.372164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-354cc0b2-7641-4363-90f4-042aa36f5fac req-43536813-9843-4c46-bb8e-fef32bc35cb9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091310 Oct 25 03:19:07.382458 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1957/3729] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:07.382683 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-0cbd3d40-414a-4942-a30a-7154f545019d req-f8bb22ff-02d5-44a7-844b-cd15cf380c25 service nova] Creating event network-changed:4d408fc1-c38d-41df-b975-f734805dd002 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:19:07.388179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:07.391034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:07.394926 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-0cbd3d40-414a-4942-a30a-7154f545019d req-f8bb22ff-02d5-44a7-844b-cd15cf380c25 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094136 Oct 25 03:19:07.399476 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1773/3730] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:07.416719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:07.417147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:07.417652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:07.418578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:07.419643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:07.420091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:07.767604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:07.776204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:07.782981 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef1ae7c2-7e39-4e98-bb1a-7c9033ab48a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1274 microversion: 2.1 time: 0.398863 Oct 25 03:19:07.784688 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1958/3731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:07 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1274 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:08.252349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:08.255846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:08.288073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:08.288887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:08.297243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:08.299503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:08.300796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:08.305841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:08.306538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:08.309757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:08.321449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:08.321449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:08.321449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:08.321449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:08.321449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:08.321900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:08.504289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:08.525293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:08.528898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:08.530430 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a872e101-dff6-4c0d-8431-5cc612c1e151 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2160 microversion: 2.42 time: 0.293919 Oct 25 03:19:08.531526 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1774/3732] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:08 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2160 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:08.543051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-05a177aa-082a-4b41-9e80-2c399e81ea3c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7244c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:08.617578 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-05a177aa-082a-4b41-9e80-2c399e81ea3c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.079939 Oct 25 03:19:08.619166 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1775/3733] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:08 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:08.809586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:08.810264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:08.823778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:08.824297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:08.824812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:08.829539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:08.830094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:08.830541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:09.105909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:09.122261 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aec31e02-2b40-416e-83ad-ec1a815f9bb5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 0.314535 Oct 25 03:19:09.124574 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1776/3734] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:08 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:09.419044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:09.436774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:09.438601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:09.446277 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57aa2676-90f4-4e4a-a8c8-45aedc0a9ee8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.165201 Oct 25 03:19:09.459512 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1959/3735] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:08 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:09.561394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:09.562638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:09.589108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:09.594719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:09.596738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:09.599581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:09.599685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:09.603971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:09.638851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bdf43fe9-19b2-4b6f-a0eb-8a60d62463a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3825ad30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:09.749105 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bdf43fe9-19b2-4b6f-a0eb-8a60d62463a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.118169 Oct 25 03:19:09.749725 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1960/3736] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:09 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:09.838258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:09.858720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:09.864182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:09.868579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-caf8ab32-d1b0-4d9f-8b3a-efa98d2e1cfe tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 2160 microversion: 2.42 time: 0.309639 Oct 25 03:19:09.869449 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1777/3737] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:09 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 2160 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:09.905756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e7bdf540-d9c5-4155-a938-51b44f91e5c2 req-efe889cf-2b6f-468e-ac63-a05b7976db91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36018ca-4be0-4f59-afde-c7c983ccb70b", "name": "network-vif-deleted", "tag": "b72ec6e2-76b3-491d-b4dc-5e311cf014e2"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:09.954012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7bdf540-d9c5-4155-a938-51b44f91e5c2 req-efe889cf-2b6f-468e-ac63-a05b7976db91 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:09.954587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7bdf540-d9c5-4155-a938-51b44f91e5c2 req-efe889cf-2b6f-468e-ac63-a05b7976db91 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:09.955037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7bdf540-d9c5-4155-a938-51b44f91e5c2 req-efe889cf-2b6f-468e-ac63-a05b7976db91 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:10.019779 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e7bdf540-d9c5-4155-a938-51b44f91e5c2 req-efe889cf-2b6f-468e-ac63-a05b7976db91 service nova] Creating event network-vif-deleted:b72ec6e2-76b3-491d-b4dc-5e311cf014e2 for instance f36018ca-4be0-4f59-afde-c7c983ccb70b on n-h2-862355-1 Oct 25 03:19:10.048935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e7bdf540-d9c5-4155-a938-51b44f91e5c2 req-efe889cf-2b6f-468e-ac63-a05b7976db91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147435 Oct 25 03:19:10.049213 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1961/3738] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:10.151491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:10.152307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:10.167450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:10.168158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:10.169332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:10.173848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:10.174384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:10.174840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:10.479367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:10.480868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:10.493861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:10.496141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:10.496798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:10.499318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:10.499999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:10.501296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:11.139969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:11.151884 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eeb0e297-0432-451b-a115-ff39624e3b77 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 1.008340 Oct 25 03:19:11.153888 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1778/3739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:10 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:11.171575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a14f4c8a-0d3b-4959-ad5e-64e50b13e14b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b787c10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:11.270328 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a14f4c8a-0d3b-4959-ad5e-64e50b13e14b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.109097 Oct 25 03:19:11.271387 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1779/3740] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:11 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:11.282805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:11.286392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:11.310090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:11.310930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:11.311517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:11.312569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:11.317703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:11.318408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:11.509928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:11.524789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:11.533347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:11.536930 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-632ef7c4-f355-41bb-8bf6-124358a5087b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.262088 Oct 25 03:19:11.543423 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1780/3741] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:11 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:11.619163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:11.634696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:11.650810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:11.655851 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47734eee-cbc4-41e4-a00c-cadee83e0e7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.182857 Oct 25 03:19:11.657466 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1962/3742] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:10 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:12.177389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:12.178082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:12.188520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:12.195556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:12.196508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:12.197188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:12.198401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:12.199887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:12.200548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:12.230425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:12.288002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5a4bf64-1488-4b40-b6ad-ede928c8628b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b803670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:12.353537 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b5a4bf64-1488-4b40-b6ad-ede928c8628b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.071013 Oct 25 03:19:12.354185 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1963/3743] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:12 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:12.574439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:12.575087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:12.590838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:12.591655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:12.592347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:12.593257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:12.594836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:12.596962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:12.834828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:12.850533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:12.852298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:12.853793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1709d46d-eed5-4f2e-b2b0-8bc494a98433 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.284992 Oct 25 03:19:12.854936 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1964/3744] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:12 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:12.860876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:12.861760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:12.869312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:12.870566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:12.871162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:12.872046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:12.872659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:12.873288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:13.184438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:13.202659 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a32d68c3-31ac-4bd0-93ba-c7a0bac67b1c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 1.028594 Oct 25 03:19:13.205019 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1781/3745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:12 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:13.373010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1816820d-7a0f-430b-b52e-c529f221913e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7caa60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:13.458495 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1816820d-7a0f-430b-b52e-c529f221913e tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.089791 Oct 25 03:19:13.462465 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1782/3746] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:13 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:13.619614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:13.632286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:13.634081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:13.635516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21f6b391-9580-46d6-acf2-d9a0493e071d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.779386 Oct 25 03:19:13.636322 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1965/3747] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:12 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:13.886207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:13.886841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:13.893829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:13.894365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:13.906167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:13.906981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:13.907479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:13.911019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:14.064257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e7783fbe-d527-4398-9a36-5feb16f49bd1 req-3c0a8120-d3c8-48d9-aefc-1b925248abac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c39196-d2dd-4001-932d-743919ffdbe8", "tag": "2726d2ec-ed90-4e4d-abab-fda8f4798647"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:14.086029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7783fbe-d527-4398-9a36-5feb16f49bd1 req-3c0a8120-d3c8-48d9-aefc-1b925248abac service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:14.086757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7783fbe-d527-4398-9a36-5feb16f49bd1 req-3c0a8120-d3c8-48d9-aefc-1b925248abac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:14.087924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7783fbe-d527-4398-9a36-5feb16f49bd1 req-3c0a8120-d3c8-48d9-aefc-1b925248abac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:14.119678 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e7783fbe-d527-4398-9a36-5feb16f49bd1 req-3c0a8120-d3c8-48d9-aefc-1b925248abac service nova] Creating event network-changed:2726d2ec-ed90-4e4d-abab-fda8f4798647 for instance 15c39196-d2dd-4001-932d-743919ffdbe8 on n-h2-862355-1 Oct 25 03:19:14.126518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:14.131072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:14.135855 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e7783fbe-d527-4398-9a36-5feb16f49bd1 req-3c0a8120-d3c8-48d9-aefc-1b925248abac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076197 Oct 25 03:19:14.139170 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1966/3748] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:19:14.147328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:14.156574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:14.161609 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9669fca0-82ec-4ee3-b23d-2e5fbab3687e tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.276621 Oct 25 03:19:14.184168 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1783/3749] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:13 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:14.234048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:14.234992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:14.254735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:14.255632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:14.256600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:14.257607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:14.259030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:14.259713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:14.486118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-535a8f2d-069d-4901-98f9-c19a38620ad2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7ca4c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:14.603252 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-535a8f2d-069d-4901-98f9-c19a38620ad2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.131673 Oct 25 03:19:14.606591 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1784/3750] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:14 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:14.668265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:14.669078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:14.706322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:14.711286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:14.712064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:14.716394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:14.717228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:14.718544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:15.011236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:15.026013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-06208437-30de-4038-baa2-06d5c5dbca68 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 0.799267 Oct 25 03:19:15.027957 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1967/3751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:14 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:15.105951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:15.126164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:15.131385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:15.134149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46917cc7-1752-4877-b297-20b7c70df51d tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.470433 Oct 25 03:19:15.138425 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1785/3752] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:14 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:15.192854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:15.193577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:15.202223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:15.203731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:15.204383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:15.206145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:15.206851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:15.207604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:15.423661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:15.453780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:15.466796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:15.468121 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e226f1cd-67f2-45e5-be1f-555413c4d392 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.281125 Oct 25 03:19:15.468735 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1968/3753] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:15 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:15.625178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c0c1946-044b-44c2-8c8a-d35d598c948f tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b731940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:15.723985 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c0c1946-044b-44c2-8c8a-d35d598c948f tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.105949 Oct 25 03:19:15.724990 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1786/3754] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:15 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:16.062201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:16.063210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:16.080685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:16.082655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:16.084241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:16.085803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:16.086638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:16.087503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:16.169548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:16.170597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:16.172763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:16.186006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:16.199502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:16.199999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:16.200776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:16.201256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:16.201720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:16.734736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:16.750295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:16.753300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:16.755521 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-916ac947-5c44-428e-8647-e088f742d617 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.590798 Oct 25 03:19:16.785581 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1787/3755] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:16 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:16.806125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:16.808507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:16.823475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:16.824441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:16.825044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:16.835326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:16.838889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:16.839575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:17.022134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:17.050053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:17.053524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:17.063871 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-24cb4809-33bb-4c23-8974-ddc792fcb8a5 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.275231 Oct 25 03:19:17.079507 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1788/3756] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:16 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:17.096634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3f7653b9-9608-42e6-9a3e-865105d466ad tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd329984c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:17.166316 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3f7653b9-9608-42e6-9a3e-865105d466ad tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.085031 Oct 25 03:19:17.166914 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1789/3757] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:17 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:17.228853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d7eadad0-45ef-4096-854d-314cadad55fe req-a02b429b-4d38-4adb-9688-4ffb2f451e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b32ae59-c085-47d9-be50-3c0eb0350c01", "name": "network-vif-plugged", "status": "completed", "tag": "985c5405-7c62-48ed-87fe-3cc4bb482730"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:17.241348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d7eadad0-45ef-4096-854d-314cadad55fe req-a02b429b-4d38-4adb-9688-4ffb2f451e16 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:17.244427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d7eadad0-45ef-4096-854d-314cadad55fe req-a02b429b-4d38-4adb-9688-4ffb2f451e16 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:17.248706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d7eadad0-45ef-4096-854d-314cadad55fe req-a02b429b-4d38-4adb-9688-4ffb2f451e16 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:17.280160 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d7eadad0-45ef-4096-854d-314cadad55fe req-a02b429b-4d38-4adb-9688-4ffb2f451e16 service nova] Creating event network-vif-plugged:985c5405-7c62-48ed-87fe-3cc4bb482730 for instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 on n-h2-862355-1 Oct 25 03:19:17.289620 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d7eadad0-45ef-4096-854d-314cadad55fe req-a02b429b-4d38-4adb-9688-4ffb2f451e16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065246 Oct 25 03:19:17.289620 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1790/3758] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:17.364542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:17.377538 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6568efbb-ee85-45d2-a395-fde9ea0057f9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 1.327633 Oct 25 03:19:17.383397 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1969/3759] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:16 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:17.795191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:17.796479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:17.809147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:17.809659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:17.812506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:17.816971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:17.817692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:17.818292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:18.100652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:18.101316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:18.109267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:18.110566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:18.111303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:18.112729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:18.114752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:18.115345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:18.162317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:18.180706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:18.182188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:18.183372 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fecc9025-3d14-4c10-ac2b-03ccf5e80916 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.396670 Oct 25 03:19:18.183936 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1791/3760] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:17 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:18.194439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ebfffdb-af9e-48bf-b395-736d249bfc21 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32998310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:18.266221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ebfffdb-af9e-48bf-b395-736d249bfc21 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.077828 Oct 25 03:19:18.275719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1792/3761] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:18 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:18.284297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:18.298599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:18.300897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:18.302440 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-360054ab-1019-4a21-9189-9ab823db89ca tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.205987 Oct 25 03:19:18.304059 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1970/3762] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:18 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:18.402171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:18.402989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:18.409600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:18.411469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:18.412085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:18.413117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:18.413740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:18.415524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:18.809395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:18.828825 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18374717-b46e-4aa2-9158-9cdc970809c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 0.431806 Oct 25 03:19:18.834095 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1793/3763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:18 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:19.214886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:19.215508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:19.229968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:19.231599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:19.233016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:19.234938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:19.235574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:19.236971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:19.282744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-de536bfa-fd09-4bf8-a190-d54765d2678d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b724310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:19.341992 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-de536bfa-fd09-4bf8-a190-d54765d2678d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.063157 Oct 25 03:19:19.343312 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1794/3764] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:19 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:19.348352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:19.349150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:19.384626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:19.385740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:19.386537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:19.388974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:19.390370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:19.393368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:19.693251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:19.701272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:19.714656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:19.716605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:19.721668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:19.722780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:19.725735 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff1072be-807d-4699-bd08-d3ea24e4a4d3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.513966 Oct 25 03:19:19.726889 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f66928a6-dc0a-4506-a561-fbdd262efc7b tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.379523 Oct 25 03:19:19.728793 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1971/3765] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:19 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:19.730891 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1795/3766] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:19 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:19.859363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:19.860207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:19.880639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:19.883398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:19.883969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:19.887301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:19.888780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:19.890816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:20.359952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b2f83a6-9ea1-4f45-a3bd-a125058d1c2a tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b734c10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:20.444839 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b2f83a6-9ea1-4f45-a3bd-a125058d1c2a tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.089173 Oct 25 03:19:20.445924 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1796/3767] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:20 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:20.757835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:20.758548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:20.776356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:20.776888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:20.779980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:20.780960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:20.781608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:20.784503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:21.437201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:21.456177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bbbc036d-cf48-4818-a850-dbebb1958aba tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 1.601290 Oct 25 03:19:21.480914 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1972/3768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:19 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:21.510690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:21.514296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:21.545969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:21.549431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:21.552602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:21.554040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:21.558393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:21.560368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:21.673011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:21.703682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:21.721421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:21.723806 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84490810-a27a-4ed3-8876-454a31d9047f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.972178 Oct 25 03:19:21.727630 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1797/3769] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:20 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:21.737485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:21.744665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:21.784186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:21.787313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:21.788213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:21.789844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:21.790526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:21.791188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:22.030323 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aaf70c32-4cb2-4e61-8853-56ea5cbb94f7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.299559 Oct 25 03:19:22.048278 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1798/3770] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:19:21 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:19:22.069474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f56ff9f3-082e-46f1-9320-8bbc51440006 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b734550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:22.103276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:22.122819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:22.134180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:22.137116 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2144a1d4-4dc3-43ad-b10d-40e7855e0123 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.654779 Oct 25 03:19:22.160467 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1973/3771] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:21 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:22.171833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:22.172352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:22.186731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:22.189363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:22.190060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:22.193290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:22.193995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:22.194599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:22.226155 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f56ff9f3-082e-46f1-9320-8bbc51440006 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.170969 Oct 25 03:19:22.226756 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1799/3772] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:22 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:22.482065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:22.482807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:22.505468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:22.505973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:22.506414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:22.507136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:22.507587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:22.508011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:23.673029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:23.692438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51447247-5ee5-49e8-bffa-536b27a9e2b9 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 1.214720 Oct 25 03:19:23.692438 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1800/3773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:22 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:23.717018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:23.718375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:23.745160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:23.745943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:23.746627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:23.748859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:23.749737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:23.750343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:23.989559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:24.000807 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fc911b48-06a3-4acf-87d7-340e4e607e40 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1670 microversion: 2.1 time: 1.837866 Oct 25 03:19:24.001422 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1974/3774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:22 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1670 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:24.034134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:24.041991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:24.056043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:24.065034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:24.070511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:24.071895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:24.074530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:24.075432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:24.511433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:24.529300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:24.535189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:24.539260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-85afdf1e-4ffd-4da7-b357-af78a3cbf0e9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.523156 Oct 25 03:19:24.555434 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1975/3775] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:24 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:24.579345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67a6e248-aedb-4e76-9586-db49d39bdda4 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3363b8b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:24.672637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67a6e248-aedb-4e76-9586-db49d39bdda4 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.115651 Oct 25 03:19:24.673273 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1976/3776] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:24 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:24.723519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:24.724159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:24.771627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:24.772154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:24.777221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:24.781576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:24.786588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:24.787418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:25.381585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:25.400140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:25.406826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:25.410649 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-679c0128-6c16-4036-97ea-47f430dd8e38 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.714995 Oct 25 03:19:25.411740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1801/3777] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:23 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:25.427216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:25.428101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:25.446664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:25.447192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:25.448773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:25.450768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:25.451293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:25.453034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:25.470947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:25.496241 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fb57e4d3-d784-41df-9634-357980e2a69e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 0.777658 Oct 25 03:19:25.508225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1977/3778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:24 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:25.538566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-200e0204-7765-4fa6-98cb-d9dceb3d8691 req-bd140ab2-909d-4722-aca9-a5084097296d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c39196-d2dd-4001-932d-743919ffdbe8", "name": "network-vif-plugged", "status": "completed", "tag": "2726d2ec-ed90-4e4d-abab-fda8f4798647"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:25.563967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-200e0204-7765-4fa6-98cb-d9dceb3d8691 req-bd140ab2-909d-4722-aca9-a5084097296d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:25.571608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-200e0204-7765-4fa6-98cb-d9dceb3d8691 req-bd140ab2-909d-4722-aca9-a5084097296d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:25.584340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-200e0204-7765-4fa6-98cb-d9dceb3d8691 req-bd140ab2-909d-4722-aca9-a5084097296d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:25.607978 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-200e0204-7765-4fa6-98cb-d9dceb3d8691 req-bd140ab2-909d-4722-aca9-a5084097296d service nova] Creating event network-vif-plugged:2726d2ec-ed90-4e4d-abab-fda8f4798647 for instance 15c39196-d2dd-4001-932d-743919ffdbe8 on n-h2-862355-1 Oct 25 03:19:25.626537 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-200e0204-7765-4fa6-98cb-d9dceb3d8691 req-bd140ab2-909d-4722-aca9-a5084097296d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114429 Oct 25 03:19:25.627746 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1978/3779] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:25.656985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:25.658059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:25.671874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:25.674280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:25.694410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:25.695481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:25.699752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:25.713163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:25.970026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:25.982786 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3bbf540c-6d06-4736-a3f8-cbdef62a61e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1670 microversion: 2.1 time: 0.569340 Oct 25 03:19:25.983799 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1802/3780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:25 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1670 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:25.996452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-29f25e69-f35c-4bba-865c-64b5ba5d0fd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b8819d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:26.082338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:26.093311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:26.095790 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-29f25e69-f35c-4bba-865c-64b5ba5d0fd2 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.109961 Oct 25 03:19:26.096531 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1803/3781] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:25 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:26.114703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:26.116252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ae51df5-70b0-4945-800a-37fab0b49b2c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.487293 Oct 25 03:19:26.116841 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1979/3782] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:25 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:26.444454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:26.446033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:26.460520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:26.474473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:26.476189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:26.477112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:26.478006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:26.478607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:26.532481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:26.533127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:26.556140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:26.556652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:26.564832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:26.565405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:26.566098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:26.566667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:26.624260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:27.009398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.028420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.030481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.031987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f6ab7371-616e-4660-92a1-92cc6d92db74 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.595182 Oct 25 03:19:27.037092 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1804/3783] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:26 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:27.045523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:27.051724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:27.072128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:27.073046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:27.074040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:27.075075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:27.075677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:27.076252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:27.080532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.089594 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91699f9f-2c26-4189-905b-5ea32f1ce6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1316 microversion: 2.1 time: 0.561905 Oct 25 03:19:27.095781 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1980/3784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:26 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:27.120250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-020b8993-4bc6-4449-8e7b-0cb07f9abfc1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd33835160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:27.242698 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-020b8993-4bc6-4449-8e7b-0cb07f9abfc1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.131211 Oct 25 03:19:27.251010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1981/3785] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:27 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:27.254133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:27.254485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:27.286884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:27.289985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:27.290511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:27.297795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:27.299766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:27.305770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:27.486577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.504013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.507368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.513582 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aaeeb9b1-80dd-4c2b-9468-762d89704d92 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.266287 Oct 25 03:19:27.514388 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1982/3786] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:27 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:27.666482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:27.676186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a0f1fe8-3a60-407f-8b45-8b1fb9093341 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.637072 Oct 25 03:19:27.677054 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1805/3787] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:27 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:28.068880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:28.069496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:28.088889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:28.089416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:28.089894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:28.090614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:28.093964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:28.094450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:28.560349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78a45841-00e7-481e-a3d0-437008fa5868 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Action: 'create', calling method: .version_select at 0x7efd3b8031f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-588161485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJn07SJywyH/aDVjPTqugvZyDD/B/gNBcuo7SbkzWMqJGypqGkYYng5eSpc+nopw9UYa0rcZ4/K0u3KlBxtIvj8FK+YPaJDWCMtuIm2nZjtFRkJMTYisFbVacEHSuH4Ig=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:28.653812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-78a45841-00e7-481e-a3d0-437008fa5868 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Getting quotas for project f9caf679fdf54cadbae34f5894064dd7. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:19:28.686955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-78a45841-00e7-481e-a3d0-437008fa5868 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Getting quotas for user 45cd7d8599c84a989dc3e74541eba7b0 and project f9caf679fdf54cadbae34f5894064dd7. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:19:28.825704 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-78a45841-00e7-481e-a3d0-437008fa5868 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.132561 Oct 25 03:19:28.826356 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1983/3788] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:19:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:19:28.850330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:28.865076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:28.889651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:28.901219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:28.903274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:28.906513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:28.909204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:28.910542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:29.760860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:29.800495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:29.811389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:29.825364 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d3c34ff-d03c-4cda-8dcc-a87e4b992be3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.759500 Oct 25 03:19:29.828913 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1806/3789] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:28 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:29.856014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e17f1300-9a09-45a5-a831-c517f171b093 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd32998040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:29.995018 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e17f1300-9a09-45a5-a831-c517f171b093 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.164650 Oct 25 03:19:29.998598 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1807/3790] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:29 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:30.016100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:30.018674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:30.048740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:30.051277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:30.053220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:30.054121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:30.054666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:30.055107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:30.070765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:30.086525 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44881b22-ef96-413d-b898-95b44295e360 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1466 microversion: 2.1 time: 1.254438 Oct 25 03:19:30.087131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1984/3791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:28 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1466 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:30.118822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:30.119700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:30.142783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:30.143463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:30.149027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:30.153339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:30.154496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:30.155096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:30.920226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:30.939929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:30.942150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:30.960403 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23d4abe6-771f-454f-82ec-a5a3fb0195a6 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.959774 Oct 25 03:19:30.961231 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1808/3792] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:29 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:30.976463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:30.977850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:31.001146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:31.004850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:31.005863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:31.006995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:31.010819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:31.011588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:31.077362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:31.467961 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-de03e77f-019a-49f1-b73b-99ee0b9db6e9 tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1617 microversion: 2.1 time: 1.353305 Oct 25 03:19:31.477316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1985/3793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:30 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1617 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:31.489773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-560a4995-d975-43cb-9654-fd2c71a45f42 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3367ad30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:31.701299 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-560a4995-d975-43cb-9654-fd2c71a45f42 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.221504 Oct 25 03:19:31.715709 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1986/3794] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:31 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:31.948597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-10623930", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:32.086025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:19:32.505320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:32.533000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:32.541102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:32.548617 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1def93b-602a-4748-9201-c9c81f50255f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.584380 Oct 25 03:19:32.573218 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1809/3795] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:30 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:32.586637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:32.595066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:32.631379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:32.632030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:32.632492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:32.642546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:32.645855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:32.648489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:32.922249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:32.947189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:32.953667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:32.966524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e3e62b7-c015-4166-b5ba-83ec8a441e24 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.389044 Oct 25 03:19:32.973281 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1810/3796] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:32 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:32.994845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f878e9fa-72f5-4d6d-8f45-3fcbb52f7c6b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7345e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:33.131820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f878e9fa-72f5-4d6d-8f45-3fcbb52f7c6b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.157361 Oct 25 03:19:33.139414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1811/3797] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:32 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:33.437145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:19:33.438327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:19:33.438957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:19:33.439513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:19:33.440073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:19:33.473172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:33.473766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:33.474276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:33.474905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:33.475367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:33.475793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:33.564725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:19:33.581722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:33.588212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:33.602585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Getting quotas for user 3d263ce619e3478ba32340edc8d6d092 and project ece51f6d19a343f58f60658b9aacdf3f. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:19:33.650734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:33.656199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:33.661039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:33.663525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:33.668585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:33.668883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:19:33.672030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:33.686655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:19:33.834800 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b066ab34-70a5-4d2a-94ee-a7620878ebbe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894804 Oct 25 03:19:33.843937 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1987/3798] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:19:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:19:33.875118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90e133ad-54b4-4258-b395-77138b4c4ece tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:33.875781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-90e133ad-54b4-4258-b395-77138b4c4ece tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:34.229046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90e133ad-54b4-4258-b395-77138b4c4ece tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:34.253922 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90e133ad-54b4-4258-b395-77138b4c4ece tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1215 microversion: 2.1 time: 0.406963 Oct 25 03:19:34.255063 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1988/3799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:33 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1215 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:34.268172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:34.271819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:34.275024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:34.291659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:34.291907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:34.292704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:34.293623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:34.304895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:34.305611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:34.550944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:34.564349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:34.578102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:34.582270 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d22b88b-86c6-4c93-a33a-2049f04b4188 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.325041 Oct 25 03:19:34.593237 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1989/3800] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:34 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:34.620649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7fb211e0-a3d6-4fb7-af1b-346451c97d43 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3363bf70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:34.777179 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7fb211e0-a3d6-4fb7-af1b-346451c97d43 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.182454 Oct 25 03:19:34.777808 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1990/3801] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:34 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:35.026278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:35.053067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:35.060737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:35.065331 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c810bc88-676d-4b0c-a2ac-4ffa7a595846 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.489071 Oct 25 03:19:35.067262 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1812/3802] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:33 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:35.158131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-492126985", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-588161485", "security_groups": [{"name": "tempest-secgroup-smoke-426953677"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c7fc7fc8-87f5-420e-8607-ae630654a293"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:35.282519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:35.283142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:35.302520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:35.303039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:35.303490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:35.304214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:35.310357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:35.310819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:35.673326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] validate_networks() for [('c7fc7fc8-87f5-420e-8607-ae630654a293', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:19:35.973126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:35.985744 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4bbd078d-49d1-48a3-9aa7-b22537c853ca tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1211 microversion: 2.1 time: 0.710126 Oct 25 03:19:35.992056 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1813/3803] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:35 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1211 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:36.023804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:36.025017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:36.038047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:36.045898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:36.046698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:36.054590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:36.055538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:36.056204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:36.254669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:36.272032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:36.276083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:36.282953 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-652208ee-7860-45d2-b3c8-171d8f27d53a tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.285325 Oct 25 03:19:36.284901 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1814/3804] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:35 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:36.297611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f8a36ab0-def6-41cb-95e3-7af68a3b0a5b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b726550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:36.407160 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f8a36ab0-def6-41cb-95e3-7af68a3b0a5b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.120971 Oct 25 03:19:36.418886 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1815/3805] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:36 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:36.432626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:36.436089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:36.453092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:36.456993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:36.457859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:36.460230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:36.461397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:36.462076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:36.941803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Getting quotas for project f9caf679fdf54cadbae34f5894064dd7. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:19:36.953565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Getting quotas for user 45cd7d8599c84a989dc3e74541eba7b0 and project f9caf679fdf54cadbae34f5894064dd7. Resources: dict_keys(['metadata_items']) {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:19:37.021448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:19:37.022286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:19:37.023001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:19:37.023633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:19:37.024999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:19:37.037213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:37.038096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:37.038845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:37.040840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:37.041712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:37.042517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:37.072950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Getting quotas for project f9caf679fdf54cadbae34f5894064dd7. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:19:37.079932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Getting quotas for user 45cd7d8599c84a989dc3e74541eba7b0 and project f9caf679fdf54cadbae34f5894064dd7. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:19:37.097865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:19:37.100710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:19:37.156254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:37.179735 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e39b056b-96c4-418d-816b-b48bf8b6e2b2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.026545 Oct 25 03:19:37.189383 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1991/3806] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:19:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:19:37.196739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:37.197763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:37.207712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:37.208492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:37.209668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:37.210911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:37.211046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:37.211794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:37.212481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:37.212759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:37.213712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21375430-52d2-49af-acdf-395ac4e35a99 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.793382 Oct 25 03:19:37.258011 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1816/3807] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:36 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:37.279850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8f21957-95f2-41a7-81f7-03e5f4ea3d28 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:37.280506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e8f21957-95f2-41a7-81f7-03e5f4ea3d28 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:37.411079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:37.431602 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4de5d291-071e-4d7f-8119-a6936063d749 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1273 microversion: 2.1 time: 0.239365 Oct 25 03:19:37.433063 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1992/3808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:37 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:37.450887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8f21957-95f2-41a7-81f7-03e5f4ea3d28 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:37.464281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:37.464971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:37.470311 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8f21957-95f2-41a7-81f7-03e5f4ea3d28 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1301 microversion: 2.1 time: 0.204023 Oct 25 03:19:37.471011 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1817/3809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:37 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1301 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:37.485461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4cb639c4-226c-4b86-812d-62eac7ca341b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b744b80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:37.493981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:37.494510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:37.494950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:37.495665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:37.496144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:37.496580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:37.630964 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4cb639c4-226c-4b86-812d-62eac7ca341b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.156758 Oct 25 03:19:37.631587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1818/3810] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:37 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:38.265100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:38.266492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:38.291852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:38.295187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:38.300090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:38.303076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:38.307478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:38.310982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:38.436931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:38.479960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:38.485351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:38.490362 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ce9f9170-2d4e-45fa-b35b-da3c0e881cb2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 1.053564 Oct 25 03:19:38.495534 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1993/3811] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:37 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:38.508527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:38.509416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:38.527054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:38.529022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:38.531308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:38.532268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:38.535494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:38.536887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:38.917423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:38.928065 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2fead163-a78e-4738-a5ca-4131f1a8ac82 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1273 microversion: 2.1 time: 0.430857 Oct 25 03:19:38.928931 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1994/3812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:38 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1273 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:38.953229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:38.954138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:38.979614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:38.980097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:38.980544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:38.981273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:38.981756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:38.982194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:39.178669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:39.192317 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b1b9269-c5ee-433c-a51e-fe0473cfb092 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1297 microversion: 2.1 time: 0.260350 Oct 25 03:19:39.192904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:39.193224 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1995/3813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:38 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1297 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:39.202216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44196244-74e5-4c34-b521-8c39a657cfa9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd338baa60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:39.210576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:39.212139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:39.222593 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b9518fe-29ed-4bff-9ab1-32eeaf11905f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.962657 Oct 25 03:19:39.246293 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1819/3814] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:38 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:39.311590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44196244-74e5-4c34-b521-8c39a657cfa9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.117236 Oct 25 03:19:39.312743 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1996/3815] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:39 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:39.520261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:39.520849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:39.531290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:39.531777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:39.541062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:39.545519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:39.546343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:39.547249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:39.954855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:39.956086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:39.983393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:39.986375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:39.987012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:39.988700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:39.990983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:39.992278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:40.156503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:40.167066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:40.188684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:40.190034 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7ef23cf8-0e3d-4c25-9e6c-e28b3e0295a9 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.673786 Oct 25 03:19:40.198498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1820/3816] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:39 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:40.221374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:40.222880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:40.235261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:40.236032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:40.236801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:40.252634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:40.254118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:40.255006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:40.457129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:40.472714 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b331c5e9-3eb9-4625-8c9a-50286ca893a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1371 microversion: 2.1 time: 0.248255 Oct 25 03:19:40.474093 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1821/3817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:40 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:40.479303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:40.482403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:40.499231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:40.499983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:40.500564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:40.501439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:40.507184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:40.508414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:41.006565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.017053 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-501f26f2-defa-4d0a-b131-5632715438b0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 1.066181 Oct 25 03:19:41.020690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1997/3818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:39 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:41.038939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a145387-c4d4-42a1-95f4-503eabf00add tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b8721f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:41.138475 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a145387-c4d4-42a1-95f4-503eabf00add tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.116464 Oct 25 03:19:41.139549 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1998/3819] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:41 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:41.225879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:41.226622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:41.234717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:41.235755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:41.236414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:41.237916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:41.238667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:41.239311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:41.338457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.353531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.368300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.373470 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc0a2473-14ef-42ab-aa01-f2821ae694d6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.898113 Oct 25 03:19:41.381255 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1822/3820] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:40 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:41.502350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:41.503135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:41.510896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:41.518165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:41.524490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:41.526896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:41.527506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:41.528507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:41.627875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.654523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.657496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.665428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-364229c2-3332-4ded-acf8-36d08b33cf7c tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.445725 Oct 25 03:19:41.671554 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 1999/3821] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:41 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:41.733383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:41.751482 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-605a4d97-749b-4321-9289-d29d4229540f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1359 microversion: 2.1 time: 0.246843 Oct 25 03:19:41.756450 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1823/3822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:41 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:42.054848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:42.055508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:42.082734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:42.083243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:42.083689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:42.084430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:42.095575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:42.096026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:42.156196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ecc7e3cf-0213-4489-907d-a66d919fce88 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7449d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:42.259551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ecc7e3cf-0213-4489-907d-a66d919fce88 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.106680 Oct 25 03:19:42.266169 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1824/3823] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:42 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:42.413432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:42.414807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:42.425389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:42.427321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:42.429578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:42.431474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:42.433469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:42.434131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:42.910885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:42.929146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:42.941800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:42.944763 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-206fe419-66dd-4e96-bedd-d919af9de49b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.539708 Oct 25 03:19:42.945958 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1825/3824] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:42 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:42.951357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:42.966886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:42.989326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:42.997878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:42.999226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:43.000143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:43.001265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:43.002673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:43.351256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:43.372987 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6029478-dff2-4118-bbd0-6d33d11dc1a5 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 1.332668 Oct 25 03:19:43.377103 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2000/3825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:42 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:43.398091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:43.398847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:43.413117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:43.417968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:43.418987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:43.419965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:43.420738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:43.422493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:43.438899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:43.500370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:43.506883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:43.519099 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d5e71b9-85e0-4e83-aa02-2c355ec4f91d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1603 microversion: 2.42 time: 0.563483 Oct 25 03:19:43.519099 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1826/3826] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:42 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1603 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:43.534798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48566987-57a5-4dc1-b07a-b6091c378702 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd329981f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:43.671773 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48566987-57a5-4dc1-b07a-b6091c378702 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.153455 Oct 25 03:19:43.675904 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1827/3827] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:43 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:43.687353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-db85187e-7cf9-4a35-a890-421dc44b4b6b req-b96d9f4d-08b7-476c-8626-db4e4c256e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b8298f-ec78-4a23-90c3-bd7e9fd9a36f", "tag": "f8896851-b6ce-41b2-b30f-aebf16defd05"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:43.716160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-db85187e-7cf9-4a35-a890-421dc44b4b6b req-b96d9f4d-08b7-476c-8626-db4e4c256e10 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:43.718378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-db85187e-7cf9-4a35-a890-421dc44b4b6b req-b96d9f4d-08b7-476c-8626-db4e4c256e10 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:43.721229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-db85187e-7cf9-4a35-a890-421dc44b4b6b req-b96d9f4d-08b7-476c-8626-db4e4c256e10 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:43.748094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-db85187e-7cf9-4a35-a890-421dc44b4b6b req-b96d9f4d-08b7-476c-8626-db4e4c256e10 service nova] Creating event network-changed:f8896851-b6ce-41b2-b30f-aebf16defd05 for instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f on n-h1-862355-1 Oct 25 03:19:43.755011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-db85187e-7cf9-4a35-a890-421dc44b4b6b req-b96d9f4d-08b7-476c-8626-db4e4c256e10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076966 Oct 25 03:19:43.755809 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1828/3828] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:43.975896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:43.982343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:43.983156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:44.023157 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46432aa5-0f79-4764-8877-28f702d1ff18 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1359 microversion: 2.1 time: 0.643661 Oct 25 03:19:44.028842 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2001/3829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:43 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1359 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:44.046255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:44.046917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:44.047535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:44.051429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:44.052164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:44.053487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:44.404253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:44.405786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:44.426785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:44.427531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:44.428284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:44.429198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:44.429899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:44.430483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:44.480208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:44.492072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:44.497700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:44.500670 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e7a86fa-d5a3-4a07-b939-e0619ff6fd06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.531530 Oct 25 03:19:44.505722 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1829/3830] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:43 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:44.545401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:44.546492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:44.557720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:44.560118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:44.560695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:44.561464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:44.561967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:44.562532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:44.627045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:44.628116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:44.628819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:44.629287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lazy-loading 'fault' on Instance uuid f36018ca-4be0-4f59-afde-c7c983ccb70b {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:19:44.776681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:44.798447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:44.803256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'adb6b1dd7a634ce4be57353d3fcdeb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70fc8d491ccb43629333e60609380230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:44.808094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ac759bd-f079-46f9-a2ca-8abaf1fd96b2 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 200 len: 1608 microversion: 2.42 time: 0.266690 Oct 25 03:19:44.809895 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1830/3831] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:44 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 1608 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:44.815908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4d59e56e-a1f1-4990-83a4-b14c0f1de1f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b734280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:44.945805 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4d59e56e-a1f1-4990-83a4-b14c0f1de1f9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.133384 Oct 25 03:19:44.947301 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1831/3832] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:44 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:45.052670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:45.053294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:45.070196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:45.079882 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bf4bd55b-8773-4f68-b02d-ef0e69f527e4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 0.683178 Oct 25 03:19:45.082231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:45.082924 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2002/3833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:44 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:45.084084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:45.084712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:45.085608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:45.086268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:45.086862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:45.533419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:45.535188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:45.552915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:45.553488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:45.561687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:45.562604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:45.563101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:45.563666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:45.640159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:45.653050 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57e2235a-f93a-4e7b-8f50-227171055757 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 0.605198 Oct 25 03:19:45.654696 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1832/3834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:45 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:45.841799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:45.844760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:45.857726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:45.858312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:45.858762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:45.859495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:45.859957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:45.860389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:45.882747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:45.909888 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] HTTP exception thrown: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Request method failure captured: Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b HTTP/1.1 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1QTd3chQhrzKT8BBd69SrZijf7n1TWm6S8YQs4BAlS3CCd_qODmrZUL4tzYzKTlHgEOaTppW7o7dD270oYNuNwZGRpGDaYekv0lSXJT-IU4WjSJYR9qaJwINAeRUerJth_4ThL47wQnKeurMfkG5gfjR7j-i7GB8FC5PZOUUm5slVI Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.42 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 70fc8d491ccb43629333e60609380230 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70fc8d491ccb43629333e60609380230"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70fc8d491ccb43629333e60609380230"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_70fc8d491ccb43629333e60609380230", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/70fc8d491ccb43629333e60609380230"}]}] Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 70fc8d491ccb43629333e60609380230 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TaggedBootDevicesTest_v242-1580552712-project Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: adb6b1dd7a634ce4be57353d3fcdeb5f Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1580552712-project Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f36018ca-4be0-4f59-afde-c7c983ccb70b'} Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:45.914766 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:45.918721 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:45.920866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Returning 404 to user: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:19:45.921985 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2978ccac-16be-4be2-85e9-fe0f454394d0 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 404 len: 111 microversion: 2.42 time: 0.088627 Oct 25 03:19:45.925428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1833/3835] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:45 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:19:45.932415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb0e06a6-74f1-4a13-8ae4-00bf91f26231 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '.version_select at 0x7efd3b726670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:45.977570 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb0e06a6-74f1-4a13-8ae4-00bf91f26231 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887684521" status: 204 len: 0 microversion: 2.42 time: 0.047913 Oct 25 03:19:45.978357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1834/3836] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Oct 25 03:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887684521 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:19:45.988809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-433ab9fb-bd9d-436f-a779-d8693d097afa tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b79e160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:46.071482 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-433ab9fb-bd9d-436f-a779-d8693d097afa tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.091246 Oct 25 03:19:46.073647 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1835/3837] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:45 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:46.106604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:46.107295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:46.118766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:46.121691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:46.125849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:46.126744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:46.127324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:46.127902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:46.541531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:46.555917 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e3b413b-0c16-47a2-ac89-dfc8aaaa2521 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 0.454075 Oct 25 03:19:46.558658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1836/3838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:46 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:46.677012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:46.677639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:46.686850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:46.690961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:46.691733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:46.692988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:46.696426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:46.697107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:46.697551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:46.789381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:46.800893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:46.802388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:46.811877 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db620c8c-03e1-4e88-9d25-b21d181c2cf1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.283282 Oct 25 03:19:46.830389 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2003/3839] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:45 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:47.005218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:47.026708 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a16da4bf-422d-4172-8349-ad4e4b0dbef1 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 0.353976 Oct 25 03:19:47.041379 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1837/3840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:46 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:47.088223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f39aa859-d29d-4f57-b80c-fa1a6de00905 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3367af70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:47.095129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:47.095929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=22 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:47.181162 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f39aa859-d29d-4f57-b80c-fa1a6de00905 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.096833 Oct 25 03:19:47.181812 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2004/3841] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:47 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:47.589981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:47.590876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:47.592972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:47.599776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:47.600509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:47.601115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:47.602023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:47.602624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:47.603188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:47.775734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:47.786629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dcb61532-03b1-4c79-b85f-350cfc5a151f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 0.203538 Oct 25 03:19:47.787678 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1838/3842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:47 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:47.842629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:47.843928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:47.855415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:47.859132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:47.861051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:47.862664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:47.863450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:47.864061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:48.068835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:48.069495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:48.096086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:48.097145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:48.097433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:48.113344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:48.113882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:48.122018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:48.241009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:48.257127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:48.259322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:48.260909 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dfe11e2d-6bbb-456e-9a16-f12af54de562 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.424523 Oct 25 03:19:48.262038 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2005/3843] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:47 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:48.279704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cfa8ec85-02e6-44bc-9511-32c696c659fd tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3367aca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:48.411498 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cfa8ec85-02e6-44bc-9511-32c696c659fd tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.148058 Oct 25 03:19:48.412981 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2006/3844] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:48 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:48.517023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-57622299-568e-43e6-918c-2cfe382c117c req-c2e61162-a9aa-4844-81e4-638e2dd44719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c947299d-7286-442e-9a54-ead975874d85", "tag": "10eb2301-32cd-4542-b87b-00d7a3c775be"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:48.528729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-57622299-568e-43e6-918c-2cfe382c117c req-c2e61162-a9aa-4844-81e4-638e2dd44719 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:48.529626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-57622299-568e-43e6-918c-2cfe382c117c req-c2e61162-a9aa-4844-81e4-638e2dd44719 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:48.530331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-57622299-568e-43e6-918c-2cfe382c117c req-c2e61162-a9aa-4844-81e4-638e2dd44719 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:48.545416 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-57622299-568e-43e6-918c-2cfe382c117c req-c2e61162-a9aa-4844-81e4-638e2dd44719 service nova] Creating event network-changed:10eb2301-32cd-4542-b87b-00d7a3c775be for instance c947299d-7286-442e-9a54-ead975874d85 on n-h1-862355-1 Oct 25 03:19:48.554901 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-57622299-568e-43e6-918c-2cfe382c117c req-c2e61162-a9aa-4844-81e4-638e2dd44719 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042726 Oct 25 03:19:48.556217 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2007/3845] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:48.815034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:48.817000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:48.830328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:48.833053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:48.834373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:48.837291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:48.838083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:48.838704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:48.906784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:49.129159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:49.146516 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-10c51aa3-4878-41b1-9276-5b5a66eee35d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 1.094679 Oct 25 03:19:49.167187 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1839/3846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:48 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:49.294699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:49.295316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:49.316481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:49.319968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:49.322373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:49.323165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:49.323645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:49.324082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:49.770163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:49.787104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:49.790675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:49.791906 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91adb5fb-64eb-42a3-9772-7ec9df52b83a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.503037 Oct 25 03:19:49.796919 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1840/3847] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:49 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:49.800476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:49.807663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ecba879e-2236-4832-9b9d-d678fe25a9f3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b731700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:49.820708 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f3734123-4856-4841-934a-c7e6d214e34c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 1.011727 Oct 25 03:19:49.821438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2008/3848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:48 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:49.902045 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ecba879e-2236-4832-9b9d-d678fe25a9f3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.103590 Oct 25 03:19:49.902962 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1841/3849] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:49 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:50.172995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:50.175024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:50.188969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:50.192354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:50.193450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:50.195111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:50.198023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:50.198724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:50.825170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:50.825864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:50.863907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:50.884252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:50.893888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:50.910763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:50.912727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:50.914394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:51.274675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:51.313706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:51.315573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:51.317460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8da7d13d-1135-4915-adf5-95b20d0db15b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.498714 Oct 25 03:19:51.354491 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1842/3850] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:50 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:51.384276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:51.384796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:51.385278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:51.394456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:51.395566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:51.397080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:51.400975 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b96af4c-51d2-4ba2-97bf-ab5ab992c24f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 1.226456 Oct 25 03:19:51.401372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:51.402059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:51.402649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:51.428623 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2009/3851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:50 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:51.446071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f00ae7ca-2520-4dbf-a3f1-d23c0aff6942 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd38148700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:51.561630 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f00ae7ca-2520-4dbf-a3f1-d23c0aff6942 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1429 microversion: 2.1 time: 0.131824 Oct 25 03:19:51.572025 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2010/3852] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:51 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:51.792760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:51.801660 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4e108bb-8408-4e56-8e05-598b7b559ef2 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 0.445552 Oct 25 03:19:51.802303 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1843/3853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:51 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:52.017302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-42c37229-581a-41b3-b6c5-b8f7b039f081 req-c1fb493b-f446-461e-8aa2-d9999829b30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b8298f-ec78-4a23-90c3-bd7e9fd9a36f", "name": "network-vif-plugged", "status": "completed", "tag": "f8896851-b6ce-41b2-b30f-aebf16defd05"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:52.070323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42c37229-581a-41b3-b6c5-b8f7b039f081 req-c1fb493b-f446-461e-8aa2-d9999829b30f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:52.077720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42c37229-581a-41b3-b6c5-b8f7b039f081 req-c1fb493b-f446-461e-8aa2-d9999829b30f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:52.081964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42c37229-581a-41b3-b6c5-b8f7b039f081 req-c1fb493b-f446-461e-8aa2-d9999829b30f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:52.163748 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-42c37229-581a-41b3-b6c5-b8f7b039f081 req-c1fb493b-f446-461e-8aa2-d9999829b30f service nova] Creating event network-vif-plugged:f8896851-b6ce-41b2-b30f-aebf16defd05 for instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f on n-h1-862355-1 Oct 25 03:19:52.193135 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-42c37229-581a-41b3-b6c5-b8f7b039f081 req-c1fb493b-f446-461e-8aa2-d9999829b30f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190326 Oct 25 03:19:52.196852 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2011/3854] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:52.376298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:52.377826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:52.397362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:52.398275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:52.398949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:52.400207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:52.400889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:52.401541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:52.430715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:52.432141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:52.447009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:52.454966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:52.457329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:52.458367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:52.460853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:52.467534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:53.829174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:53.852540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:53.858792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:53.863915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d34cb74-7ef9-4671-bd8a-5b73c6232262 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 1.489993 Oct 25 03:19:53.864835 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1844/3855] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:52 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:53.875237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcdef07a-50da-430c-b906-67099a9fc698 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3291f700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:53.956503 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dcdef07a-50da-430c-b906-67099a9fc698 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1438 microversion: 2.1 time: 0.089673 Oct 25 03:19:53.958980 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1845/3856] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:53 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:53.970901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:53.973601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:53.995519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:53.996370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:53.997068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:53.999731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:54.000584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:54.002090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:54.244791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:54.253725 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0001b3cc-0173-4a49-8c59-b962055ffcc6 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 1.827410 Oct 25 03:19:54.258540 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2012/3857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:52 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:54.263674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-115bd619-2d23-43b3-9462-75de5b264a2c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd335a0b80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:54.360245 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-115bd619-2d23-43b3-9462-75de5b264a2c tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 200 len: 1438 microversion: 2.1 time: 0.100204 Oct 25 03:19:54.360965 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2013/3858] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:19:54 2022] GET /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:54.376672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:54.378150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:54.389281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:54.390710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:54.391409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:54.392557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:54.393814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:54.394471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:54.394936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:54.410787 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41f1809f-004f-4843-b002-bdf92efd1ace tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1315 microversion: 2.1 time: 0.449857 Oct 25 03:19:54.411800 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1846/3859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:53 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:54.825485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:54.837656 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1803d2d6-60fb-4f43-9f76-901cd44c85a3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1465 microversion: 2.1 time: 0.466328 Oct 25 03:19:54.844935 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2014/3860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:54 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1465 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:19:54.880971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-688ca42d-6d3a-4e30-ac83-ab53b52aa19f tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd3b7ca8b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:54.900317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:54.905425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:54.922970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:54.927228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:54.927965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:54.929462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:54.930133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:54.931218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:55.740545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:55.751113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:55.763571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:55.766836 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9664ff56-8dcb-4edc-8b09-e7710347c67c tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.874749 Oct 25 03:19:55.785790 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2015/3861] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:54 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:55.790991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:55.791955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:55.799174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:55.802628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:55.803540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:55.811839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:55.813866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:55.816819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.021976 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-688ca42d-6d3a-4e30-ac83-ab53b52aa19f tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "DELETE /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905" status: 204 len: 0 microversion: 2.1 time: 1.146894 Oct 25 03:19:56.026257 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1847/3862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:54 2022] DELETE /compute/v2.1/images/b03fe34b-3011-4e3b-8276-2e13f70f3905 => generated 0 bytes in 1149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:19:56.035106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:56.035744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:56.061480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.062015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.067932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.069516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.070036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.075815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.186067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:56.199700 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f06a4a2f-ea61-4c73-b19b-5a0ed0ec2f79 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 0.425972 Oct 25 03:19:56.201580 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2016/3863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:55 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:56.210551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-026d7f34-f7db-4272-b018-3fd2f8a89ca9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '.version_select at 0x7efd328be5e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:56.238274 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-026d7f34-f7db-4272-b018-3fd2f8a89ca9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] HTTP exception thrown: Image not found. Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-026d7f34-f7db-4272-b018-3fd2f8a89ca9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Request method failure captured: Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be HTTP/1.1 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Vnaj-oV1pwZ4B6YNk5w7aYJAKRQwCqhNMK0bLurItzKUL3mp_o8WMAAd7LoFSo4FvyiRzqTS4Jle7d-pUomxlllneTrGN-KjjKJZUBkMz3Ahn9ZvV-Ec7PfCwPeEz3fNOxJ_0oBEmSnD06tewbJgJ6QxtvVSOA9mz0uLmtVnft0yI Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ee89c033477d449ab24dbb865dd9eb19 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee89c033477d449ab24dbb865dd9eb19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee89c033477d449ab24dbb865dd9eb19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee89c033477d449ab24dbb865dd9eb19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee89c033477d449ab24dbb865dd9eb19"}]}] Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ee89c033477d449ab24dbb865dd9eb19 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesOneServerTestJSON-1376236292-project Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 1160aef6e662446eb3066ec8f3bcc110 Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesOneServerTestJSON-1376236292-project Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: exception: Image not found. Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'b85e146d-bdbf-4cc6-847c-856d0276b5be'} Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b85e146d-bdbf-4cc6-847c-856d0276b5be to delete Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b85e146d-bdbf-4cc6-847c-856d0276b5be could not be found. Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:56.240486 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:19:56.244186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:19:56.253256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-026d7f34-f7db-4272-b018-3fd2f8a89ca9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Returning 404 to user: Image not found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:19:56.255050 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-026d7f34-f7db-4272-b018-3fd2f8a89ca9 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "DELETE /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be" status: 404 len: 62 microversion: 2.1 time: 0.047911 Oct 25 03:19:56.258985 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2017/3864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:56 2022] DELETE /compute/v2.1/images/b85e146d-bdbf-4cc6-847c-856d0276b5be => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:19:56.270155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:56.276799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:56.285925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.289250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.291401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.292356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.301647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.302418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.339996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:56.352203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:19:56.352462 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-29a52941-805e-4360-962d-31ad4d0354c8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1465 microversion: 2.1 time: 0.323673 Oct 25 03:19:56.354262 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1848/3865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:56 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1465 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:56.377877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:56.379126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:56.390237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.392485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.393865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.396043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.397343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.399771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.545977 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4809c1f1-273c-4ac5-9fde-914f61a40bf1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 204 len: 0 microversion: 2.1 time: 0.285202 Oct 25 03:19:56.546486 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2018/3866] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:19:56 2022] DELETE /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:19:56.555178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:56.558087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:56.579110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.579905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.581111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.583937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.585117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.587274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.838794 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-78a3b16f-0750-47c3-beaf-f9fd665a12fe tempest-ServersOnMultiNodesTest-395585927 tempest-ServersOnMultiNodesTest-395585927-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1616 microversion: 2.1 time: 0.466170 Oct 25 03:19:56.843866 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1849/3867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:56 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1616 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:56.849618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:56.852094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:56.872340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.873089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.873540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.874311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:56.874931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:56.880585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:56.965233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:56.983857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6247b9f-272b-4bf3-808c-82205ffdf8d1 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1471 microversion: 2.1 time: 0.432515 Oct 25 03:19:56.985714 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2019/3868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:56 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:57.024677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:57.026455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:57.033529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:57.038498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:57.039863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:57.040877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:57.041563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:57.042781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:57.093491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:19:57.262425 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-976f54e4-f9c5-4cad-9b5c-3b6bfe147f01 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 204 len: 0 microversion: 2.1 time: 0.274517 Oct 25 03:19:57.266124 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2020/3869] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:19:56 2022] DELETE /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:19:57.279242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:57.280183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:57.295327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:57.296033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:57.296696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:57.297588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:57.299850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:57.301640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:57.362669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:57.378455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:57.379928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:57.387352 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c410af15-c173-4d56-83dc-24dc318001dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.542141 Oct 25 03:19:57.388563 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1850/3870] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:56 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:19:57.393984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:57.396653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:57.412670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:57.415894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:57.416511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:57.417396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:57.421477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:57.422154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:57.650179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:57.666751 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93c817de-ff1c-401c-bc9e-a58dc426ae27 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 0.402446 Oct 25 03:19:57.667412 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2021/3871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:57 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:57.901744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:57.915037 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7258cfd4-afd2-4f1a-a499-c52b9705ae9a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1471 microversion: 2.1 time: 0.525141 Oct 25 03:19:57.922649 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1851/3872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:57 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1471 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:58.012601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:58.013234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:58.026121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.027138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.027815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.028720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.029419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.035312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.111259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:58.112074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:58.131379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.131889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.132343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.133094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.133547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.134033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.149569 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] HTTP exception thrown: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Request method failure captured: Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b HTTP/1.1 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1QTd3chQhrzKT8BBd69SrZijf7n1TWm6S8YQs4BAlS3CCd_qODmrZUL4tzYzKTlHgEOaTppW7o7dD270oYNuNwZGRpGDaYekv0lSXJT-IU4WjSJYR9qaJwINAeRUerJth_4ThL47wQnKeurMfkG5gfjR7j-i7GB8FC5PZOUUm5slVI Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.42 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 70fc8d491ccb43629333e60609380230 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70fc8d491ccb43629333e60609380230"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70fc8d491ccb43629333e60609380230"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_70fc8d491ccb43629333e60609380230", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/70fc8d491ccb43629333e60609380230"}]}] Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 70fc8d491ccb43629333e60609380230 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TaggedBootDevicesTest_v242-1580552712-project Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: adb6b1dd7a634ce4be57353d3fcdeb5f Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1580552712-project Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f36018ca-4be0-4f59-afde-c7c983ccb70b'} Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:19:58.151236 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.155587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.157235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Returning 404 to user: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:19:58.158320 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-be3604d8-9de9-47a8-8871-364b1c5d7606 tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 404 len: 111 microversion: 2.42 time: 0.051094 Oct 25 03:19:58.160293 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1852/3873] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:19:58 2022] DELETE /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:19:58.174355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:58.175332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] [instance: f36018ca-4be0-4f59-afde-c7c983ccb70b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:58.181971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.184211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.184894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.185921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.186556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.187146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.204002 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] HTTP exception thrown: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Request method failure captured: Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b HTTP/1.1 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1QTd3chQhrzKT8BBd69SrZijf7n1TWm6S8YQs4BAlS3CCd_qODmrZUL4tzYzKTlHgEOaTppW7o7dD270oYNuNwZGRpGDaYekv0lSXJT-IU4WjSJYR9qaJwINAeRUerJth_4ThL47wQnKeurMfkG5gfjR7j-i7GB8FC5PZOUUm5slVI Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.42 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 70fc8d491ccb43629333e60609380230 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70fc8d491ccb43629333e60609380230"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70fc8d491ccb43629333e60609380230"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_70fc8d491ccb43629333e60609380230", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/70fc8d491ccb43629333e60609380230"}]}] Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 70fc8d491ccb43629333e60609380230 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1580552712 Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TaggedBootDevicesTest_v242-1580552712-project Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: adb6b1dd7a634ce4be57353d3fcdeb5f Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1580552712-project Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f36018ca-4be0-4f59-afde-c7c983ccb70b'} Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.206265 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. Oct 25 03:19:58.210523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:19:58.212109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] Returning 404 to user: Instance f36018ca-4be0-4f59-afde-c7c983ccb70b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:19:58.213423 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce5bd7f9-d9fd-47b4-9820-5247bbc8714d tempest-TaggedBootDevicesTest_v242-1580552712 tempest-TaggedBootDevicesTest_v242-1580552712-project] 10.222.0.36 "GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b" status: 404 len: 111 microversion: 2.42 time: 0.044865 Oct 25 03:19:58.217517 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1853/3874] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:58 2022] GET /compute/v2.1/servers/f36018ca-4be0-4f59-afde-c7c983ccb70b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:19:58.303226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:58.314856 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0841a65f-4aab-4f82-8447-6e473758f41d tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1471 microversion: 2.1 time: 0.304915 Oct 25 03:19:58.316131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2022/3875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:58 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:58.419545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:58.422742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:58.433609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.434141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.434590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.435422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.435889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.436322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.694777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:58.695707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:58.710027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.710546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.710991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.711721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.712176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.712601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.729572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:58.742946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:58.744797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:58.746419 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc926554-abe5-4d07-aa68-68a870f8ca50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.330764 Oct 25 03:19:58.747215 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1854/3876] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:58 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:19:58.952870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:58.954184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:58.962470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.963327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.964068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:58.965011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:58.965739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:58.966537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:59.246340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:59.262404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-67423543-a3f6-4656-a54e-1f346fab2f74 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1471 microversion: 2.1 time: 0.313373 Oct 25 03:19:59.280857 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1855/3877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:58 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:59.294476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e4037be5-661f-47ee-b7cf-7a6371e0178f req-c35a9718-5c5b-4cd4-a6ea-72560c83ad39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b32ae59-c085-47d9-be50-3c0eb0350c01", "name": "network-vif-unplugged", "status": "completed", "tag": "985c5405-7c62-48ed-87fe-3cc4bb482730"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:19:59.321345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e4037be5-661f-47ee-b7cf-7a6371e0178f req-c35a9718-5c5b-4cd4-a6ea-72560c83ad39 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:59.323626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e4037be5-661f-47ee-b7cf-7a6371e0178f req-c35a9718-5c5b-4cd4-a6ea-72560c83ad39 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:59.325210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e4037be5-661f-47ee-b7cf-7a6371e0178f req-c35a9718-5c5b-4cd4-a6ea-72560c83ad39 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:59.353286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e4037be5-661f-47ee-b7cf-7a6371e0178f req-c35a9718-5c5b-4cd4-a6ea-72560c83ad39 service nova] Creating event network-vif-unplugged:985c5405-7c62-48ed-87fe-3cc4bb482730 for instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 on n-h2-862355-1 Oct 25 03:19:59.359932 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e4037be5-661f-47ee-b7cf-7a6371e0178f req-c35a9718-5c5b-4cd4-a6ea-72560c83ad39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072593 Oct 25 03:19:59.361102 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1856/3878] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:19:59.367251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:59.368294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:59.380898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:59.381523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:59.382209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:59.382872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:59.383410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:59.383915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:59.418946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:19:59.602661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:59.613240 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-80843dfb-48f1-4e29-b6ff-7a51b8757df3 tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1471 microversion: 2.1 time: 0.250452 Oct 25 03:19:59.614309 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1857/3879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:59 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:19:59.775879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:19:59.776736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:19:59.790204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:59.790958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:59.791534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:59.792901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:19:59.793381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:19:59.796919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:19:59.906284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:19:59.920950 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-84bf7917-9ab6-4716-acd1-05a26fe296a3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 1.228973 Oct 25 03:19:59.921583 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2023/3880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:19:58 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:00.154097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:00.169280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:00.170870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:00.172648 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99923313-66ac-4936-8d3d-ced3ed82c4c4 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.401228 Oct 25 03:20:00.173552 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1858/3881] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:19:59 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:20:00.288398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:00.289211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:00.295724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.296222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.296665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.297527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.298034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.298467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.474839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:00.475470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:00.484459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.484951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.494378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.495392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.496023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.496610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.776772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:00.789255 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36f90de0-301a-4a4c-8c43-1d7e1283e5c1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1471 microversion: 2.1 time: 0.506256 Oct 25 03:20:00.790244 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2024/3882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:00 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1471 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:00.809708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:00.818077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:00.821170 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b90e26af-a1dc-4fad-97a6-7f36d45ee635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.352191 Oct 25 03:20:00.821785 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1859/3883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:00 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:00.821934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:00.831297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.832033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.832627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.833492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.834139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.836493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.852111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:00.854444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:00.873968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.876563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.877208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.878247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:00.879196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:00.881392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:00.891981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:01.092132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:01.103947 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89f37cbb-425f-4539-ba1b-c4580f46c359 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.255657 Oct 25 03:20:01.104329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1860/3884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:00 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:01.121292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:01.122339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:01.130297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:01.141314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:01.142055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:01.143581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:01.144253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:01.144938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:01.292795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1160aef6e662446eb3066ec8f3bcc110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89c033477d449ab24dbb865dd9eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:01.325986 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05b5938f-537f-4f56-97d1-1b1b4e4d7a0b tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 200 len: 1471 microversion: 2.1 time: 0.534541 Oct 25 03:20:01.331201 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2025/3885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:00 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 1471 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:01.353151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:01.363141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:01.375097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:01.375821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:01.377445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:01.378462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:01.379495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:01.380124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:01.967736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:01.980234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a14386da-102e-4b93-a9ce-0cf32ab0f534 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.647616 Oct 25 03:20:01.980844 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2026/3886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:01 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:02.022434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:02.029021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:02.042651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.043152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.043581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.045725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.046667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.047242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.098969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:02.113149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a05a6b1b-1005-43ca-9c4c-f28a77e32bd3 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 1.007051 Oct 25 03:20:02.118895 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1861/3887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:01 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:02.132549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c625d8e3-8960-4c82-aeaf-daf14f7a8b1f req-a8daefe6-d7ab-4500-96e8-285e8a7d145c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b32ae59-c085-47d9-be50-3c0eb0350c01", "name": "network-vif-deleted", "tag": "985c5405-7c62-48ed-87fe-3cc4bb482730"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:02.190120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c625d8e3-8960-4c82-aeaf-daf14f7a8b1f req-a8daefe6-d7ab-4500-96e8-285e8a7d145c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.190738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c625d8e3-8960-4c82-aeaf-daf14f7a8b1f req-a8daefe6-d7ab-4500-96e8-285e8a7d145c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.191067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c625d8e3-8960-4c82-aeaf-daf14f7a8b1f req-a8daefe6-d7ab-4500-96e8-285e8a7d145c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.219051 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c625d8e3-8960-4c82-aeaf-daf14f7a8b1f req-a8daefe6-d7ab-4500-96e8-285e8a7d145c service nova] Creating event network-vif-deleted:985c5405-7c62-48ed-87fe-3cc4bb482730 for instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 on n-h2-862355-1 Oct 25 03:20:02.234357 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c625d8e3-8960-4c82-aeaf-daf14f7a8b1f req-a8daefe6-d7ab-4500-96e8-285e8a7d145c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113562 Oct 25 03:20:02.237714 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1862/3888] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:02.249234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-25057ea4-35c0-48d0-9faa-122418e19d2e req-fae04011-aaac-4917-ac10-a0ce1c5f4a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c947299d-7286-442e-9a54-ead975874d85", "name": "network-vif-plugged", "status": "completed", "tag": "10eb2301-32cd-4542-b87b-00d7a3c775be"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:02.273204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-25057ea4-35c0-48d0-9faa-122418e19d2e req-fae04011-aaac-4917-ac10-a0ce1c5f4a01 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.277892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-25057ea4-35c0-48d0-9faa-122418e19d2e req-fae04011-aaac-4917-ac10-a0ce1c5f4a01 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.279708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-25057ea4-35c0-48d0-9faa-122418e19d2e req-fae04011-aaac-4917-ac10-a0ce1c5f4a01 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.307213 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-25057ea4-35c0-48d0-9faa-122418e19d2e req-fae04011-aaac-4917-ac10-a0ce1c5f4a01 service nova] Creating event network-vif-plugged:10eb2301-32cd-4542-b87b-00d7a3c775be for instance c947299d-7286-442e-9a54-ead975874d85 on n-h1-862355-1 Oct 25 03:20:02.322003 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-25057ea4-35c0-48d0-9faa-122418e19d2e req-fae04011-aaac-4917-ac10-a0ce1c5f4a01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078589 Oct 25 03:20:02.322953 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1863/3889] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:02.333517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:02.336433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:02.364845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.366893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.368867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.369618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.370119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.370547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.473975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.474475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.474919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.475374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lazy-loading 'fault' on Instance uuid 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:20:02.589247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:02.608333 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8813eba8-b089-4109-8515-91667a694eef tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 200 len: 1305 microversion: 2.1 time: 0.284134 Oct 25 03:20:02.613259 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1864/3890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:02 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 1305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:02.635677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:02.636501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:02.656506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.656996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.665717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.670407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.686077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.686614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.718784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:02.734303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:02.742445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:02.743930 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb1a5996-cf76-47c9-ac05-7c37346cc778 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.738737 Oct 25 03:20:02.745081 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2027/3891] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:01 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:02.751370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:02.752834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] [instance: 4b32ae59-c085-47d9-be50-3c0eb0350c01] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:02.772904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.794000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.794712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.797404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:02.798281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:02.800580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:02.831965 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] HTTP exception thrown: Instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 could not be found. Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Request method failure captured: Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 HTTP/1.1 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Vnaj-oV1pwZ4B6YNk5w7aYJAKRQwCqhNMK0bLurItzKUL3mp_o8WMAAd7LoFSo4FvyiRzqTS4Jle7d-pUomxlllneTrGN-KjjKJZUBkMz3Ahn9ZvV-Ec7PfCwPeEz3fNOxJ_0oBEmSnD06tewbJgJ6QxtvVSOA9mz0uLmtVnft0yI Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ee89c033477d449ab24dbb865dd9eb19 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee89c033477d449ab24dbb865dd9eb19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ee89c033477d449ab24dbb865dd9eb19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ee89c033477d449ab24dbb865dd9eb19", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ee89c033477d449ab24dbb865dd9eb19"}]}] Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ee89c033477d449ab24dbb865dd9eb19 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1376236292 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ImagesOneServerTestJSON-1376236292-project Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 1160aef6e662446eb3066ec8f3bcc110 Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ImagesOneServerTestJSON-1376236292-project Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 could not be found. Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '4b32ae59-c085-47d9-be50-3c0eb0350c01'} Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 could not be found. Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 could not be found. Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:02.835606 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 could not be found. Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] Returning 404 to user: Instance 4b32ae59-c085-47d9-be50-3c0eb0350c01 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6140a5f6-ef75-48a8-93d5-f8014135c9ec tempest-ImagesOneServerTestJSON-1376236292 tempest-ImagesOneServerTestJSON-1376236292-project] 10.222.0.36 "GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01" status: 404 len: 111 microversion: 2.1 time: 0.090823 Oct 25 03:20:02.839455 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2028/3892] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:02 2022] GET /compute/v2.1/servers/4b32ae59-c085-47d9-be50-3c0eb0350c01 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:20:03.156533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:03.158209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:03.180903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:03.193971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:03.195527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:03.198182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:03.200305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:03.202472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:03.203278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:03.258940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:03.270079 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a589298-0277-4c1d-9f97-8b1b74e1817d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.655492 Oct 25 03:20:03.271642 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1865/3893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:02 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:03.504597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-298767448", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:03.510330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:03.523114 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92794b82-1611-4b12-aed2-67108a5ecf9f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1426 microversion: 2.1 time: 0.379254 Oct 25 03:20:03.541173 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2029/3894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:03 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1426 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:03.614360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] validate_networks() for [('0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:20:03.652176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:03.653181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:03.664838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:03.667686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:03.669250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:03.670249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:03.670921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:03.671527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:03.703548 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f could not be found. Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f HTTP/1.1 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f could not be found. Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '95b8298f-ec78-4a23-90c3-bd7e9fd9a36f'} Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f could not be found. Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f could not be found. Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:03.736858 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:03.741513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:03.741513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:03.741513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:03.741513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:03.741513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:03.741513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f could not be found. Oct 25 03:20:03.741513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:03.745630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:03.749217 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1ceeef02-6f0e-48a0-b3bd-f9e4fc3b44ad tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f" status: 404 len: 111 microversion: 2.1 time: 0.120153 Oct 25 03:20:03.757753 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2030/3895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:03 2022] GET /compute/v2.1/servers/95b8298f-ec78-4a23-90c3-bd7e9fd9a36f => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:20:03.766458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:03.769473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:03.776823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:03.777512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:03.778139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:03.778999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:03.779785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:03.780392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:03.855636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:20:04.087824 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dac58652-8e22-46ca-a5f7-c3067f45c0f7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 204 len: 0 microversion: 2.1 time: 0.325113 Oct 25 03:20:04.088963 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2031/3896] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:20:03 2022] DELETE /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:04.098343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:04.108508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:04.121321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:04.122016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:04.123157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:04.124037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:04.124649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:04.125385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:04.604068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:04.621046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:04.624208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:04.629561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-663ce88b-39df-4141-a741-30e70375a126 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.538646 Oct 25 03:20:04.631089 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2032/3897] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:04 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:04.638103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:04.638943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:04.649150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:04.650087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:04.663083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:04.665882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:04.668698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:04.669320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:04.984004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:05.019087 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b90e15b-9379-4c2e-a08c-d6f722d9e3e8 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1472 microversion: 2.1 time: 0.386375 Oct 25 03:20:05.019924 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2033/3898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:04 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:05.025392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ab695abb-5364-4ee3-95db-48736a6a5431 req-c55192db-efa4-4718-8baa-5238c7bd4b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b8298f-ec78-4a23-90c3-bd7e9fd9a36f", "name": "network-vif-deleted", "tag": "f8896851-b6ce-41b2-b30f-aebf16defd05"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:05.047730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab695abb-5364-4ee3-95db-48736a6a5431 req-c55192db-efa4-4718-8baa-5238c7bd4b3b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:05.049776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab695abb-5364-4ee3-95db-48736a6a5431 req-c55192db-efa4-4718-8baa-5238c7bd4b3b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:05.050408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ab695abb-5364-4ee3-95db-48736a6a5431 req-c55192db-efa4-4718-8baa-5238c7bd4b3b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:05.078780 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ab695abb-5364-4ee3-95db-48736a6a5431 req-c55192db-efa4-4718-8baa-5238c7bd4b3b service nova] Creating event network-vif-deleted:f8896851-b6ce-41b2-b30f-aebf16defd05 for instance 95b8298f-ec78-4a23-90c3-bd7e9fd9a36f on n-h1-862355-1 Oct 25 03:20:05.085029 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ab695abb-5364-4ee3-95db-48736a6a5431 req-c55192db-efa4-4718-8baa-5238c7bd4b3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063670 Oct 25 03:20:05.086865 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2034/3899] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:05.093385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-be39ab1e-533e-4be4-b988-10ad888e436f req-1fbdeb54-8a50-4cc2-b5d2-0035b99586f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-plugged", "status": "completed", "tag": "f262a55a-b193-4212-8269-aba78af92fa8"}, {"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-plugged", "status": "completed", "tag": "4080e02e-5d05-4b9c-8e35-fe42cbed4c96"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:05.118084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-be39ab1e-533e-4be4-b988-10ad888e436f req-1fbdeb54-8a50-4cc2-b5d2-0035b99586f6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:05.119032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-be39ab1e-533e-4be4-b988-10ad888e436f req-1fbdeb54-8a50-4cc2-b5d2-0035b99586f6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:05.120247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-be39ab1e-533e-4be4-b988-10ad888e436f req-1fbdeb54-8a50-4cc2-b5d2-0035b99586f6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:05.138669 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-be39ab1e-533e-4be4-b988-10ad888e436f req-1fbdeb54-8a50-4cc2-b5d2-0035b99586f6 service nova] Creating event network-vif-plugged:f262a55a-b193-4212-8269-aba78af92fa8 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:05.139614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-be39ab1e-533e-4be4-b988-10ad888e436f req-1fbdeb54-8a50-4cc2-b5d2-0035b99586f6 service nova] Creating event network-vif-plugged:4080e02e-5d05-4b9c-8e35-fe42cbed4c96 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:05.157578 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-be39ab1e-533e-4be4-b988-10ad888e436f req-1fbdeb54-8a50-4cc2-b5d2-0035b99586f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065997 Oct 25 03:20:05.162274 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2035/3900] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:05.172006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:05.173188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:05.189394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:05.191894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:05.192856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:05.194039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:05.194776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:05.195488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:05.530990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:05.549410 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a5c691cd-8745-4022-abf2-1b062095c653 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1605 microversion: 2.1 time: 0.384507 Oct 25 03:20:05.561747 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2036/3901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:05 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1605 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:05.577580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:05.580577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:05.599821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:05.602558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:05.603041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:05.603815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:05.604287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:05.604739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:06.318903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:20:06.319368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:20:06.319799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:20:06.320218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:20:06.320634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:20:06.351825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:06.352325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:06.352775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:06.357877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:06.358516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:06.358984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:06.451312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:20:06.463763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for user 41342d3f5062457aaee26cf5d836e441 and project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:20:06.494024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:20:06.502432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:20:06.663681 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-214ff8ae-6b50-4dc3-9f1e-48088ea50aa0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.163973 Oct 25 03:20:06.667859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1866/3902] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:20:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:20:06.680187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:06.681100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:06.716530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:06.717316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:06.717971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:06.718873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:06.719944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:06.725359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:06.726225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:06.730232 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a744e7e3-35ed-4148-8339-90daa2196796 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1605 microversion: 2.1 time: 1.157842 Oct 25 03:20:06.750944 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2037/3903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:05 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1605 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:06.762901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:06.774791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:06.811603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:06.812111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:06.812554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:06.813274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:06.833834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:06.834507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:07.448543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:07.482900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:07.498758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:07.504847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e520a138-bdac-4689-acd4-a83d2dabdeb5 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.834459 Oct 25 03:20:07.517024 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1867/3904] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:06 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:07.543857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:07.560961 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff437a38-32d5-48ee-8749-8f6402d30e5a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1472 microversion: 2.1 time: 0.807764 Oct 25 03:20:07.561640 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2038/3905] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:06 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1472 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:07.586882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-245c36df-ce24-4418-9fd4-d66187072c3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:07.587575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-245c36df-ce24-4418-9fd4-d66187072c3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:07.803525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Calling method '.version_select at 0x7efd32912790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:07.833057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:07.833916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:07.834511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:07.835496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:07.836144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:07.836743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:07.846336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-245c36df-ce24-4418-9fd4-d66187072c3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:07.857902 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-245c36df-ce24-4418-9fd4-d66187072c3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1214 microversion: 2.1 time: 0.291215 Oct 25 03:20:07.878390 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2039/3906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:07 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:07.890023 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a25d247-0976-4337-9add-c0c94b805c2a tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.368201 Oct 25 03:20:07.893999 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1868/3907] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Oct 25 03:20:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:07.899241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:07.900215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:07.915699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ab9b6f94-01bb-473a-a512-4a371ac98545 req-6744c9f7-0559-4159-a535-ad3b0e2d3cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-plugged", "status": "completed", "tag": "83a5d23b-851d-4581-997e-80f2fdabf0df"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:07.919176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:07.920250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:07.926597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:07.928543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:07.937957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:07.938640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:07.946377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ab9b6f94-01bb-473a-a512-4a371ac98545 req-6744c9f7-0559-4159-a535-ad3b0e2d3cc3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:07.948299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ab9b6f94-01bb-473a-a512-4a371ac98545 req-6744c9f7-0559-4159-a535-ad3b0e2d3cc3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:07.948912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ab9b6f94-01bb-473a-a512-4a371ac98545 req-6744c9f7-0559-4159-a535-ad3b0e2d3cc3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:07.982652 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ab9b6f94-01bb-473a-a512-4a371ac98545 req-6744c9f7-0559-4159-a535-ad3b0e2d3cc3 service nova] Creating event network-vif-plugged:83a5d23b-851d-4581-997e-80f2fdabf0df for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:08.000800 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ab9b6f94-01bb-473a-a512-4a371ac98545 req-6744c9f7-0559-4159-a535-ad3b0e2d3cc3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104814 Oct 25 03:20:08.003117 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1869/3908] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:08.076617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-879322108", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:08.219338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:20:08.650063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Getting quotas for project 68ce2f791f43444b91fb2313c7a8480f. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:20:08.662910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Getting quotas for user f966b93af1454d9ea7cf30eebcb40a4d and project 68ce2f791f43444b91fb2313c7a8480f. Resources: dict_keys(['metadata_items']) {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:20:08.718019 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Request method failure captured: Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 1751 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Xm2q_jRJO4QeOf2aLJyTey_ImRdSwA-Z1vprrYZFm0bjkmwFkMWY7gMEgX9pKDTH8Rn8aWWRH-jZ46hAxQkFxaesYaFnfA1Yuoc6sWyfZPy1fujw1FwoKJrmGGk_dCqlAcbYLHD8Kl_Mb1GgcUPHo_Fgck9q-jse4jJyutGVFtz0E Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 68ce2f791f43444b91fb2313c7a8480f Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1530945880 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/68ce2f791f43444b91fb2313c7a8480f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/68ce2f791f43444b91fb2313c7a8480f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_68ce2f791f43444b91fb2313c7a8480f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/68ce2f791f43444b91fb2313c7a8480f"}]}] Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1530945880 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 68ce2f791f43444b91fb2313c7a8480f Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1530945880 Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: f966b93af1454d9ea7cf30eebcb40a4d Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-879322108", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:20:08.724331 n-d-862355-1 devstack@n-api.service[120563]: exception: Maximum number of metadata items exceeds 128 Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-879322108', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:20:08.726610 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 25 03:20:08.729645 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:08.733217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:08.735753 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-27b1247f-7a37-4a96-89de-1057664744d9 tempest-AbsoluteLimitsNegativeTestJSON-1530945880 tempest-AbsoluteLimitsNegativeTestJSON-1530945880-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.667523 Oct 25 03:20:08.748163 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1870/3909] 10.222.0.36 () {60 vars in 1148 bytes} [Tue Oct 25 03:20:08 2022] POST /compute/v2.1/servers => generated 87 bytes in 673 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:20:08.773946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:08.775627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:08.809168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:08.809699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:08.810147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:08.816960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:08.817456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:08.826808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:08.897651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:08.915188 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-906c1db3-5227-4238-b368-d2f23b3d5754 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1605 microversion: 2.1 time: 1.035224 Oct 25 03:20:08.916320 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2040/3910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:07 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1605 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:08.921949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:08.940069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:08.955838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:08.958307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:08.962938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:08.964000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:08.965221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:08.965932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:09.043338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:09.044259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:09.045128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:09.045925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lazy-loading 'fault' on Instance uuid 15c39196-d2dd-4001-932d-743919ffdbe8 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:20:09.210305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:09.234400 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aaee9b71-9e88-4544-91b0-4af48a2a4075 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 200 len: 1306 microversion: 2.1 time: 0.316152 Oct 25 03:20:09.272714 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2041/3911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:08 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 1306 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:09.294022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4d898b90-ece3-4369-9b10-247398454088 req-23aa2fb8-598a-4892-8792-0616ec17b88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c39196-d2dd-4001-932d-743919ffdbe8", "name": "network-vif-deleted", "tag": "2726d2ec-ed90-4e4d-abab-fda8f4798647"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:09.323345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4d898b90-ece3-4369-9b10-247398454088 req-23aa2fb8-598a-4892-8792-0616ec17b88e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:09.324197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4d898b90-ece3-4369-9b10-247398454088 req-23aa2fb8-598a-4892-8792-0616ec17b88e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:09.325091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4d898b90-ece3-4369-9b10-247398454088 req-23aa2fb8-598a-4892-8792-0616ec17b88e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:09.380951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4d898b90-ece3-4369-9b10-247398454088 req-23aa2fb8-598a-4892-8792-0616ec17b88e service nova] Creating event network-vif-deleted:2726d2ec-ed90-4e4d-abab-fda8f4798647 for instance 15c39196-d2dd-4001-932d-743919ffdbe8 on n-h2-862355-1 Oct 25 03:20:09.391773 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4d898b90-ece3-4369-9b10-247398454088 req-23aa2fb8-598a-4892-8792-0616ec17b88e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116232 Oct 25 03:20:09.394503 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2042/3912] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:09.403168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:09.405433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:09.417988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:09.420931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:09.422366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:09.427137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:09.429324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:09.430817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:09.550628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:09.572804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:09.583820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:09.586608 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a4c055b-fc8f-458d-b046-f20d5d42b4a8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.832907 Oct 25 03:20:09.594592 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1871/3913] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:08 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:09.765049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:09.778481 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-986d282f-feed-4010-be2d-5cb94d1eb5d6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1274 microversion: 2.1 time: 0.382457 Oct 25 03:20:09.794702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2043/3914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:09 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1274 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:10.219074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-0143407d-dd92-4894-b73f-a9a3305f418c req-dc04daf6-da63-4f93-a348-3b9c39886b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-plugged", "status": "completed", "tag": "4d408fc1-c38d-41df-b975-f734805dd002"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:10.240956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0143407d-dd92-4894-b73f-a9a3305f418c req-dc04daf6-da63-4f93-a348-3b9c39886b48 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.242316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0143407d-dd92-4894-b73f-a9a3305f418c req-dc04daf6-da63-4f93-a348-3b9c39886b48 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.245892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0143407d-dd92-4894-b73f-a9a3305f418c req-dc04daf6-da63-4f93-a348-3b9c39886b48 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.263911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:10.265167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 15c39196-d2dd-4001-932d-743919ffdbe8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:10.276788 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-0143407d-dd92-4894-b73f-a9a3305f418c req-dc04daf6-da63-4f93-a348-3b9c39886b48 service nova] Creating event network-vif-plugged:4d408fc1-c38d-41df-b975-f734805dd002 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:10.281704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.282533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.283665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.284990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.285612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.286240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.291046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:10.293406 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-0143407d-dd92-4894-b73f-a9a3305f418c req-dc04daf6-da63-4f93-a348-3b9c39886b48 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077954 Oct 25 03:20:10.298109 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1872/3915] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:10.343271 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance 15c39196-d2dd-4001-932d-743919ffdbe8 could not be found. Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 HTTP/1.1 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 15c39196-d2dd-4001-932d-743919ffdbe8 could not be found. Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '15c39196-d2dd-4001-932d-743919ffdbe8'} Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c39196-d2dd-4001-932d-743919ffdbe8 could not be found. Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c39196-d2dd-4001-932d-743919ffdbe8 could not be found. Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:10.344913 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:10.351554 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:10.351554 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:10.351554 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:10.351554 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:10.351554 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:10.351554 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c39196-d2dd-4001-932d-743919ffdbe8 could not be found. Oct 25 03:20:10.351554 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:10.378359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance 15c39196-d2dd-4001-932d-743919ffdbe8 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:10.379680 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50070d62-ae64-47cc-91ef-827e66b5847e tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8" status: 404 len: 111 microversion: 2.1 time: 0.119874 Oct 25 03:20:10.380841 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2044/3916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:10 2022] GET /compute/v2.1/servers/15c39196-d2dd-4001-932d-743919ffdbe8 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:20:10.400809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:10.401446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:10.424101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.424775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.427050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.430016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.430570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.431204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.504119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:20:10.621671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:10.622395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:10.641799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.643348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.643893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.646253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.650941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.651401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.719348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:10.730871 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b39a5b2-5b1e-4feb-9568-af6af71bf813 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 204 len: 0 microversion: 2.1 time: 0.344219 Oct 25 03:20:10.737707 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1873/3917] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:20:10 2022] DELETE /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:10.753073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:10.756386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:10.771343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.773190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.789447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:10.790542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:10.791182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:10.791767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:11.205415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:11.246321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:11.254827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:11.259838 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd5a314d-fd69-4d35-8653-fe87b0d344a1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.643225 Oct 25 03:20:11.261949 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2045/3918] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:10 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:20:11.284709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:11.285381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:11.311139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:11.312042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:11.312734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:11.313731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:11.315389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:11.317081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:11.527015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:11.545204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c94bbd7b-ffa4-4187-9cbe-57d7b401fbbb tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1473 microversion: 2.1 time: 0.805976 Oct 25 03:20:11.548871 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1874/3919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:10 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1473 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:11.647201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:11.663604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d76477b4-611a-4161-aa5a-890b719c8ee2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1272 microversion: 2.1 time: 0.398992 Oct 25 03:20:11.666952 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2046/3920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:11 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1272 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:12.295139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:12.295867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:12.313141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:12.317441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:12.327711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:12.328509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:12.329006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:12.329442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:12.395304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a8733fb3-a8d2-43eb-8e3a-3a4b61151430 req-c8e094ef-4c80-44de-8b8c-8bbe680db823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-plugged", "status": "completed", "tag": "3c70718a-f41c-4237-b525-125333cb3a7d"}, {"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-plugged", "status": "completed", "tag": "1a0e64be-54b2-4f1d-b5a8-f846755d9c1b"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:12.422081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a8733fb3-a8d2-43eb-8e3a-3a4b61151430 req-c8e094ef-4c80-44de-8b8c-8bbe680db823 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:12.423990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a8733fb3-a8d2-43eb-8e3a-3a4b61151430 req-c8e094ef-4c80-44de-8b8c-8bbe680db823 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:12.425736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a8733fb3-a8d2-43eb-8e3a-3a4b61151430 req-c8e094ef-4c80-44de-8b8c-8bbe680db823 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:12.460745 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a8733fb3-a8d2-43eb-8e3a-3a4b61151430 req-c8e094ef-4c80-44de-8b8c-8bbe680db823 service nova] Creating event network-vif-plugged:3c70718a-f41c-4237-b525-125333cb3a7d for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:12.466775 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a8733fb3-a8d2-43eb-8e3a-3a4b61151430 req-c8e094ef-4c80-44de-8b8c-8bbe680db823 service nova] Creating event network-vif-plugged:1a0e64be-54b2-4f1d-b5a8-f846755d9c1b for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:12.492476 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a8733fb3-a8d2-43eb-8e3a-3a4b61151430 req-c8e094ef-4c80-44de-8b8c-8bbe680db823 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102773 Oct 25 03:20:12.504442 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2047/3921] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:12.572734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:12.573858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:12.603631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:12.605789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:12.609721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:12.626860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:12.629058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:12.631497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:13.936649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:13.954280 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e36f81c5-103f-436a-b492-acdce4094d64 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1473 microversion: 2.1 time: 1.384587 Oct 25 03:20:13.958636 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2048/3922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:12 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1473 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:13.969488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:13.970659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:13.989642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:13.990717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:13.992166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:14.004082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:14.004737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:14.005327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:14.349952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:14.365544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:14.367067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:14.368266 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-556abd1b-764d-4873-9854-c29198823f50 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 2.079617 Oct 25 03:20:14.368840 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1875/3923] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:12 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:14.546298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-899886dc-848d-4a01-9697-c0bdf43939dd req-5e2e54f9-dc64-495a-8658-2adfb57ad71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-plugged", "status": "completed", "tag": "c0254f2d-b694-462b-8660-c868db54fe1d"}, {"server_uuid": "2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02", "name": "network-vif-unplugged", "status": "completed", "tag": "62ac361c-72c5-4eff-adce-8b7444d8bf61"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:14.571287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-899886dc-848d-4a01-9697-c0bdf43939dd req-5e2e54f9-dc64-495a-8658-2adfb57ad71e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:14.571891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-899886dc-848d-4a01-9697-c0bdf43939dd req-5e2e54f9-dc64-495a-8658-2adfb57ad71e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:14.572794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-899886dc-848d-4a01-9697-c0bdf43939dd req-5e2e54f9-dc64-495a-8658-2adfb57ad71e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:14.619529 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-899886dc-848d-4a01-9697-c0bdf43939dd req-5e2e54f9-dc64-495a-8658-2adfb57ad71e service nova] Creating event network-vif-plugged:c0254f2d-b694-462b-8660-c868db54fe1d for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:14.620408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-899886dc-848d-4a01-9697-c0bdf43939dd req-5e2e54f9-dc64-495a-8658-2adfb57ad71e service nova] Creating event network-vif-unplugged:62ac361c-72c5-4eff-adce-8b7444d8bf61 for instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 on n-h2-862355-1 Oct 25 03:20:14.628546 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-899886dc-848d-4a01-9697-c0bdf43939dd req-5e2e54f9-dc64-495a-8658-2adfb57ad71e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.085737 Oct 25 03:20:14.632725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1876/3924] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:20:14.715690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:14.730789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ce6015f-f9d9-4abc-bfd5-ab55c5505035 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.765336 Oct 25 03:20:14.732263 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2049/3925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:13 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:14.983459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:14.984495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:14.997503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:15.003742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:15.004243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:15.005008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:15.005491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:15.005955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:15.305822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dcda10f5-4067-41e5-9b11-03132300aa14 req-b034741b-74de-431c-a88c-09e6391d6396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02", "name": "network-vif-deleted", "tag": "62ac361c-72c5-4eff-adce-8b7444d8bf61"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:15.321751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcda10f5-4067-41e5-9b11-03132300aa14 req-b034741b-74de-431c-a88c-09e6391d6396 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:15.322511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcda10f5-4067-41e5-9b11-03132300aa14 req-b034741b-74de-431c-a88c-09e6391d6396 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:15.323192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcda10f5-4067-41e5-9b11-03132300aa14 req-b034741b-74de-431c-a88c-09e6391d6396 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:15.346211 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dcda10f5-4067-41e5-9b11-03132300aa14 req-b034741b-74de-431c-a88c-09e6391d6396 service nova] Creating event network-vif-deleted:62ac361c-72c5-4eff-adce-8b7444d8bf61 for instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 on n-h2-862355-1 Oct 25 03:20:15.357874 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dcda10f5-4067-41e5-9b11-03132300aa14 req-b034741b-74de-431c-a88c-09e6391d6396 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055751 Oct 25 03:20:15.359833 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2050/3926] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:15.370660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:15.384655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:15.395002 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c361b06-e55e-43aa-b5a1-99e34808e580 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 200 len: 1431 microversion: 2.1 time: 0.415659 Oct 25 03:20:15.396179 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1877/3927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:14 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 1431 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:15.410108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:15.412615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:15.419735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:15.421156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:15.422177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:15.423104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:15.427490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:15.428714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:15.761570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:15.762284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:15.776112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:15.776606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:15.777300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:15.778050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:15.780112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:15.780559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.234180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:16.244452 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6287d1b9-60b5-4b98-8d8f-7a58a2a63da8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.487201 Oct 25 03:20:16.248093 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1878/3928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:15 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:16.337077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:16.349813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-aebcc580-78f0-4450-ab86-df4c590dfc2e req-9185f0d9-b11a-4480-9e95-6477c7e89217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c947299d-7286-442e-9a54-ead975874d85", "tag": "10eb2301-32cd-4542-b87b-00d7a3c775be"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:16.362910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:16.364745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:16.366234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d6a1317b-1f3a-4e3b-ac3d-fe744d881509 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.967719 Oct 25 03:20:16.368412 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2051/3929] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:15 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:16.371079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aebcc580-78f0-4450-ab86-df4c590dfc2e req-9185f0d9-b11a-4480-9e95-6477c7e89217 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:16.371579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aebcc580-78f0-4450-ab86-df4c590dfc2e req-9185f0d9-b11a-4480-9e95-6477c7e89217 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:16.372006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aebcc580-78f0-4450-ab86-df4c590dfc2e req-9185f0d9-b11a-4480-9e95-6477c7e89217 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.408571 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-aebcc580-78f0-4450-ab86-df4c590dfc2e req-9185f0d9-b11a-4480-9e95-6477c7e89217 service nova] Creating event network-changed:10eb2301-32cd-4542-b87b-00d7a3c775be for instance c947299d-7286-442e-9a54-ead975874d85 on n-h1-862355-1 Oct 25 03:20:16.422078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:16.422932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:16.437551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-aebcc580-78f0-4450-ab86-df4c590dfc2e req-9185f0d9-b11a-4480-9e95-6477c7e89217 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092910 Oct 25 03:20:16.441202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:16.441737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:16.442183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.442629 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1879/3930] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:16.443573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:16.444216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:16.444820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.476292 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 could not be found. Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 HTTP/1.1 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 could not be found. Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02'} Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 could not be found. Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 could not be found. Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:16.479539 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:16.484248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:16.484248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:16.484248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:16.484248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:16.484248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:16.484248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 could not be found. Oct 25 03:20:16.484248 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:16.489653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance 2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:16.492048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-699d017a-3568-46c9-8542-683d05dfe550 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02" status: 404 len: 111 microversion: 2.1 time: 0.073916 Oct 25 03:20:16.501888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:16.502532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:16.507437 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2052/3931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:16 2022] GET /compute/v2.1/servers/2f2c0aa5-b4c7-45b6-b374-a4ccbf2e3c02 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:20:16.514012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:16.514523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:16.514967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.515695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:16.516157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:16.516589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.580215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:20:16.763067 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d813f0a-595a-4f7d-bb87-3a3db52651a1 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 204 len: 0 microversion: 2.1 time: 0.265491 Oct 25 03:20:16.765649 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1880/3932] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:20:16 2022] DELETE /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:16.773530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:16.774388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:16.793147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:16.793712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:16.794159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.802301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:16.802791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:16.803247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:16.871562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:20:17.109203 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-454c9478-f0c6-4dce-9e57-5fd1469b5456 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 204 len: 0 microversion: 2.1 time: 0.339585 Oct 25 03:20:17.109910 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2053/3933] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:20:16 2022] DELETE /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:17.119138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:17.119855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:17.135131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:17.139540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:17.140422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:17.143290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:17.143786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:17.144229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:17.275866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:17.276902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:17.288122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:17.288657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:17.289083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:17.292347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:17.292868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:17.293322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:17.420482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:17.434263 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2dcc2846-c632-47d5-8047-8c3cbdf00611 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1475 microversion: 2.1 time: 0.316013 Oct 25 03:20:17.445712 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1881/3934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:17 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1475 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:17.448909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:17.449748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:17.467516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:17.469466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:17.472442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:17.474546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:17.475338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:17.477172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:17.585632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:17.597071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67dc1df1-7d7a-4b13-9f6e-64252ee917c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.323439 Oct 25 03:20:17.614313 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2054/3935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:17 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:17.620581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0a4bda68-b426-4faa-bf72-70ba2a27e69a req-90a2ecc0-7932-4e21-b9f6-a4a5cf80917c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6e293f-a76f-4c33-a5a6-c31ffab08c32", "tag": "d89e12cc-6465-436a-936e-a46ab8964407"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:17.633745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0a4bda68-b426-4faa-bf72-70ba2a27e69a req-90a2ecc0-7932-4e21-b9f6-a4a5cf80917c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:17.635299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0a4bda68-b426-4faa-bf72-70ba2a27e69a req-90a2ecc0-7932-4e21-b9f6-a4a5cf80917c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:17.635911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0a4bda68-b426-4faa-bf72-70ba2a27e69a req-90a2ecc0-7932-4e21-b9f6-a4a5cf80917c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:17.651842 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0a4bda68-b426-4faa-bf72-70ba2a27e69a req-90a2ecc0-7932-4e21-b9f6-a4a5cf80917c service nova] Creating event network-changed:d89e12cc-6465-436a-936e-a46ab8964407 for instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 on n-h1-862355-1 Oct 25 03:20:17.664428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0a4bda68-b426-4faa-bf72-70ba2a27e69a req-90a2ecc0-7932-4e21-b9f6-a4a5cf80917c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048510 Oct 25 03:20:17.665297 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2055/3936] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:17.850661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:18.268434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:18.292967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:18.294452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:18.295686 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9ec6a665-997d-4174-90dd-3cb837a1e402 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1874 microversion: 2.32 time: 0.857202 Oct 25 03:20:18.296312 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1882/3937] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:17 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1874 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:18.462530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:18.463597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:18.475922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:18.480192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:18.484936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:18.486456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:18.487758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:18.490777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:18.491419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:18.620711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:18.621329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:18.647904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:18.672315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:18.673110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:18.675537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:18.676220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:18.679230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:18.719834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:19.291243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:19.306055 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea92dc27-8f90-462a-8298-ac7b8b6d2d71 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1475 microversion: 2.1 time: 0.848293 Oct 25 03:20:19.328451 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2056/3938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:18 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1475 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:19.338826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:19.339456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:19.364219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:19.364784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:19.365244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:19.365989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:19.366457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:19.366891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:20.304209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:20.318240 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06244103-0311-462d-93f6-f3719776b0b0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 1.697184 Oct 25 03:20:20.319694 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1883/3939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:18 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:20.335762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:20.336673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:20.344188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:20.349390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:20.350171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:20.351256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:20.353869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:20.354545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:20.740290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:20.754303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:20.758288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:20.759894 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-370b4d35-99d7-4320-b585-12dcb8edfc8e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2825 microversion: 2.32 time: 1.430267 Oct 25 03:20:20.762893 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2057/3940] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:20:19 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2825 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:20.795526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:20.795869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:20.810869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:20.842902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:20.846132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:20.848652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:20.866375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:20.867874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:21.126061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:21.154736 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2c4f460-9e07-4039-b422-e45aeba03213 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1475 microversion: 2.1 time: 0.822865 Oct 25 03:20:21.162159 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1884/3941] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:20 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1475 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:21.313596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1432f554-3cdc-47f2-bf03-36fbd2c3fcfe req-c25b9f30-c710-457d-9cbb-f38d6c62db9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367cb225-52e8-4d74-814d-6c88e43e1222", "name": "network-vif-unplugged", "status": "completed", "tag": "e5423839-4236-4902-9553-c1d2103b7fd1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:21.336219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1432f554-3cdc-47f2-bf03-36fbd2c3fcfe req-c25b9f30-c710-457d-9cbb-f38d6c62db9c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:21.338791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1432f554-3cdc-47f2-bf03-36fbd2c3fcfe req-c25b9f30-c710-457d-9cbb-f38d6c62db9c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:21.341158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1432f554-3cdc-47f2-bf03-36fbd2c3fcfe req-c25b9f30-c710-457d-9cbb-f38d6c62db9c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:21.382511 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1432f554-3cdc-47f2-bf03-36fbd2c3fcfe req-c25b9f30-c710-457d-9cbb-f38d6c62db9c service nova] Creating event network-vif-unplugged:e5423839-4236-4902-9553-c1d2103b7fd1 for instance 367cb225-52e8-4d74-814d-6c88e43e1222 on n-h2-862355-1 Oct 25 03:20:21.397594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1432f554-3cdc-47f2-bf03-36fbd2c3fcfe req-c25b9f30-c710-457d-9cbb-f38d6c62db9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087036 Oct 25 03:20:21.398344 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1885/3942] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:20:21.416219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:21.419044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:21.436551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:21.437865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:21.441901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:21.443593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:21.444373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:21.445267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:21.650601 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd389428-d215-4eb7-b80e-e7790ab3e705 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.859531 Oct 25 03:20:21.663368 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2058/3943] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 25 03:20:20 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977/os-interface => generated 1830 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:20:22.192445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:22.193170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:22.210559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:22.211198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:22.211751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:22.212577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:22.214177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:22.215870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:22.233784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:22.247808 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-353c5615-a03a-4239-8896-4a52a3e9a11d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.848021 Oct 25 03:20:22.248555 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1886/3944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:21 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:22.310218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-12979ba0-0519-457b-800a-cff762930483 req-a7302f7f-cf88-4072-b89d-408c4be8f503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367cb225-52e8-4d74-814d-6c88e43e1222", "name": "network-vif-deleted", "tag": "e5423839-4236-4902-9553-c1d2103b7fd1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:22.358756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-12979ba0-0519-457b-800a-cff762930483 req-a7302f7f-cf88-4072-b89d-408c4be8f503 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:22.360741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-12979ba0-0519-457b-800a-cff762930483 req-a7302f7f-cf88-4072-b89d-408c4be8f503 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:22.364553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-12979ba0-0519-457b-800a-cff762930483 req-a7302f7f-cf88-4072-b89d-408c4be8f503 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:22.419174 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-12979ba0-0519-457b-800a-cff762930483 req-a7302f7f-cf88-4072-b89d-408c4be8f503 service nova] Creating event network-vif-deleted:e5423839-4236-4902-9553-c1d2103b7fd1 for instance 367cb225-52e8-4d74-814d-6c88e43e1222 on n-h2-862355-1 Oct 25 03:20:22.431123 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-12979ba0-0519-457b-800a-cff762930483 req-a7302f7f-cf88-4072-b89d-408c4be8f503 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158106 Oct 25 03:20:22.432324 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1887/3945] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:22.447410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:22.472995 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c53e03d6-c133-474d-9288-7f5a4483bc06 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 200 len: 1433 microversion: 2.1 time: 0.284563 Oct 25 03:20:22.481774 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2059/3946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:22 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 1433 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:22.569235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7a479510-6ce6-4e65-be3f-9862bc01cd73 req-40fff8ff-e173-47e2-a1c3-5e15907b146d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40220c5f-5ed6-4610-bcd1-ed9928ade692", "name": "network-vif-deleted", "tag": "8dcbee47-86c7-4c73-b11b-8b43a0da25d4"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:22.589074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a479510-6ce6-4e65-be3f-9862bc01cd73 req-40fff8ff-e173-47e2-a1c3-5e15907b146d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:22.590936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a479510-6ce6-4e65-be3f-9862bc01cd73 req-40fff8ff-e173-47e2-a1c3-5e15907b146d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:22.593089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a479510-6ce6-4e65-be3f-9862bc01cd73 req-40fff8ff-e173-47e2-a1c3-5e15907b146d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:22.630864 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7a479510-6ce6-4e65-be3f-9862bc01cd73 req-40fff8ff-e173-47e2-a1c3-5e15907b146d service nova] Creating event network-vif-deleted:8dcbee47-86c7-4c73-b11b-8b43a0da25d4 for instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 on n-h1-862355-1 Oct 25 03:20:22.638760 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7a479510-6ce6-4e65-be3f-9862bc01cd73 req-40fff8ff-e173-47e2-a1c3-5e15907b146d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075652 Oct 25 03:20:22.640115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1888/3947] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:23.278312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:23.279299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:23.293955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:23.295601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:23.296294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:23.300256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:23.300634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:23.301130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:23.499748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:23.500654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 367cb225-52e8-4d74-814d-6c88e43e1222] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:23.533188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:23.534096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:23.536166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:23.537059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:23.542443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:23.543058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:23.587270 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance 367cb225-52e8-4d74-814d-6c88e43e1222 could not be found. Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 HTTP/1.1 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 367cb225-52e8-4d74-814d-6c88e43e1222 could not be found. Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '367cb225-52e8-4d74-814d-6c88e43e1222'} Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367cb225-52e8-4d74-814d-6c88e43e1222 could not be found. Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367cb225-52e8-4d74-814d-6c88e43e1222 could not be found. Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:23.589118 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:23.593712 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:23.593712 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:23.593712 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:23.593712 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:23.593712 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:23.593712 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367cb225-52e8-4d74-814d-6c88e43e1222 could not be found. Oct 25 03:20:23.593712 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:23.602676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance 367cb225-52e8-4d74-814d-6c88e43e1222 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:23.603810 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1249a37e-9572-4f3c-8f07-b314569956c7 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222" status: 404 len: 111 microversion: 2.1 time: 0.109293 Oct 25 03:20:23.610057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1889/3948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:23 2022] GET /compute/v2.1/servers/367cb225-52e8-4d74-814d-6c88e43e1222 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:20:23.615105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:23.615728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:23.632048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:23.632826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:23.633437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:23.634728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:23.635372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:23.636856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:23.701067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:23.711245 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfedc513-4534-40f5-91c3-212aafcb72f9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.439459 Oct 25 03:20:23.715854 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2060/3949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:23 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:23.749460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:23.749460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:23.750093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:23.752321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lazy-loading 'fault' on Instance uuid 40220c5f-5ed6-4610-bcd1-ed9928ade692 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:20:24.021213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:24.031156 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-502ebe72-8173-4290-8780-ed64ab978070 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 200 len: 1309 microversion: 2.1 time: 0.418749 Oct 25 03:20:24.034257 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1890/3950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:23 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:24.744156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:24.744938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:24.759283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:24.762484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:24.764734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:24.766203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:24.769343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:24.769906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.042634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:25.059374 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93664256-7d9d-451b-a40e-207f17421f99 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.317584 Oct 25 03:20:25.059824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:25.061607 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2061/3951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:24 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:25.070410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 40220c5f-5ed6-4610-bcd1-ed9928ade692] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:25.089062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.093824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.094581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.095928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.096610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.097293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.128818 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 could not be found. Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 HTTP/1.1 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 could not be found. Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '40220c5f-5ed6-4610-bcd1-ed9928ade692'} Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 could not be found. Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 could not be found. Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:25.130832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:25.134530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:25.134530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:25.134530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:25.134530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:25.134530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:25.134530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 could not be found. Oct 25 03:20:25.134530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:25.136614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance 40220c5f-5ed6-4610-bcd1-ed9928ade692 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:25.140463 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba2fe22c-4d9b-42c8-84ab-42073981229f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692" status: 404 len: 111 microversion: 2.1 time: 0.084657 Oct 25 03:20:25.146714 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1891/3952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:25 2022] GET /compute/v2.1/servers/40220c5f-5ed6-4610-bcd1-ed9928ade692 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:20:25.152944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3eae8153-1a27-468e-ad29-382cb313c8fe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:25.241216 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3eae8153-1a27-468e-ad29-382cb313c8fe tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/2a685065-1cb6-427f-b0b1-5cded83a76f8" status: 204 len: 0 microversion: 2.1 time: 0.093472 Oct 25 03:20:25.241952 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2062/3953] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:20:25 2022] DELETE /compute/v2.1/os-server-groups/2a685065-1cb6-427f-b0b1-5cded83a76f8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:20:25.252656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:25.253342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:25.261523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.269826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.270310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.271083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.271558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.272007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.352369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:20:25.570630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a16fd17e-8f2e-4718-87b1-cf98bfa8c6b4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8" status: 204 len: 0 microversion: 2.1 time: 0.322205 Oct 25 03:20:25.572592 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1892/3954] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:20:25 2022] DELETE /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:25.585493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:25.588529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:25.608214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.609012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.609661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.611120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.611840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.612512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.665820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:20:25.669548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:25.806719 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aacc1987-8dc4-4f4b-bfcb-7fd4f957b77c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 204 len: 0 microversion: 2.1 time: 0.230064 Oct 25 03:20:25.809259 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2063/3955] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:20:25 2022] DELETE /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:25.820207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:25.821653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:25.838573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.839353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.839974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:25.840867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:25.841643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:25.842683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:26.092726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-94d09f5e-5fd9-4ede-a6e4-033456c4a7d1 req-3ab73301-5012-4a2f-b8b1-dee7ca3d021c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "tag": "1a0e64be-54b2-4f1d-b5a8-f846755d9c1b"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:26.132272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-94d09f5e-5fd9-4ede-a6e4-033456c4a7d1 req-3ab73301-5012-4a2f-b8b1-dee7ca3d021c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:26.132778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-94d09f5e-5fd9-4ede-a6e4-033456c4a7d1 req-3ab73301-5012-4a2f-b8b1-dee7ca3d021c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:26.133221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-94d09f5e-5fd9-4ede-a6e4-033456c4a7d1 req-3ab73301-5012-4a2f-b8b1-dee7ca3d021c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:26.164852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-94d09f5e-5fd9-4ede-a6e4-033456c4a7d1 req-3ab73301-5012-4a2f-b8b1-dee7ca3d021c service nova] Creating event network-changed:1a0e64be-54b2-4f1d-b5a8-f846755d9c1b for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:20:26.177565 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-94d09f5e-5fd9-4ede-a6e4-033456c4a7d1 req-3ab73301-5012-4a2f-b8b1-dee7ca3d021c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091222 Oct 25 03:20:26.182850 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2064/3956] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:20:26.193162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:26.198069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:26.217122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:26.219770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:26.223691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:26.226640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:26.227828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:26.229290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:26.232681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:26.461055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:26.482300 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db840f8e-29d5-44f6-8fe4-c150ddffbd6c tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8" status: 200 len: 1474 microversion: 2.1 time: 0.667679 Oct 25 03:20:26.492155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1893/3957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:25 2022] GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 => generated 1474 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:27.520130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:27.520937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:27.533602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:27.534170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:27.539257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:27.545079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:27.545902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:27.546370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:27.672183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:27.681498 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-76d6a707-8dba-45ac-af7e-fa2a708968d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 1.497105 Oct 25 03:20:27.690054 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2065/3958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:26 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:28.084246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:28.088885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:28.100091 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e93f0221-ab0f-41fe-be8a-da1d68e9d6f4 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8" status: 200 len: 1474 microversion: 2.1 time: 0.584825 Oct 25 03:20:28.119894 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1894/3959] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:27 2022] GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 => generated 1474 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:28.716674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:28.717934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:28.737589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:28.738426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:28.739031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:28.739930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:28.740553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:28.741146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:29.127210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:29.127977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:29.149582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:29.150375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:29.151243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:29.152190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:29.155549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:29.156273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:29.190965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:29.205863 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-304cedf8-7117-49a8-8962-828e53d995dd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.492976 Oct 25 03:20:29.229592 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2066/3960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:28 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:29.238694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-54a24a27-2af8-4ccf-b161-ca6e5614f020 req-ac783c27-a959-4575-8216-13351e2b7734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6e293f-a76f-4c33-a5a6-c31ffab08c32", "name": "network-vif-plugged", "status": "completed", "tag": "d89e12cc-6465-436a-936e-a46ab8964407"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:29.273776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-54a24a27-2af8-4ccf-b161-ca6e5614f020 req-ac783c27-a959-4575-8216-13351e2b7734 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:29.274578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-54a24a27-2af8-4ccf-b161-ca6e5614f020 req-ac783c27-a959-4575-8216-13351e2b7734 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:29.275222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-54a24a27-2af8-4ccf-b161-ca6e5614f020 req-ac783c27-a959-4575-8216-13351e2b7734 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:29.288850 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-54a24a27-2af8-4ccf-b161-ca6e5614f020 req-ac783c27-a959-4575-8216-13351e2b7734 service nova] Creating event network-vif-plugged:d89e12cc-6465-436a-936e-a46ab8964407 for instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 on n-h1-862355-1 Oct 25 03:20:29.298499 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-54a24a27-2af8-4ccf-b161-ca6e5614f020 req-ac783c27-a959-4575-8216-13351e2b7734 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063348 Oct 25 03:20:29.299594 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2067/3961] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:29.649161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-733507aa-66c3-4550-b363-684d1c42e42e req-ef0cd686-40cc-46f3-b0a8-e60250818f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85aa6e51-d017-47ad-a622-dcaa21838be8", "name": "network-vif-deleted", "tag": "09ba7e54-9ba1-445c-af39-0a741a3c39bd"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:29.670689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-733507aa-66c3-4550-b363-684d1c42e42e req-ef0cd686-40cc-46f3-b0a8-e60250818f98 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:29.677734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-733507aa-66c3-4550-b363-684d1c42e42e req-ef0cd686-40cc-46f3-b0a8-e60250818f98 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:29.678202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-733507aa-66c3-4550-b363-684d1c42e42e req-ef0cd686-40cc-46f3-b0a8-e60250818f98 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:29.709137 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-733507aa-66c3-4550-b363-684d1c42e42e req-ef0cd686-40cc-46f3-b0a8-e60250818f98 service nova] Creating event network-vif-deleted:09ba7e54-9ba1-445c-af39-0a741a3c39bd for instance 85aa6e51-d017-47ad-a622-dcaa21838be8 on n-h1-862355-1 Oct 25 03:20:29.730776 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-733507aa-66c3-4550-b363-684d1c42e42e req-ef0cd686-40cc-46f3-b0a8-e60250818f98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086720 Oct 25 03:20:29.731428 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2068/3962] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:20:30.233438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:30.234133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:30.249193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:30.249576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:30.252290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:30.257756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:30.261012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:30.265383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:30.311647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:30.328098 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-557cd3c2-97cc-44c6-9842-2087becba9fc tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8" status: 200 len: 1474 microversion: 2.1 time: 1.204638 Oct 25 03:20:30.338263 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1895/3963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:29 2022] GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 => generated 1474 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:30.571548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:30.581622 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-26e207a4-ca79-44c3-9fec-828cc7263197 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.352458 Oct 25 03:20:30.595678 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2069/3964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:30 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:30.699327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-91eec1a1-8a42-480d-969c-1ffc3a65d547 req-ebed4752-3cbd-45df-91b6-2ed5d1d43d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74288f30-f899-45b0-858f-74469b93d003", "name": "network-vif-deleted", "tag": "11fe32a1-2b7c-4219-afee-c12a39c98357"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:30.717484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91eec1a1-8a42-480d-969c-1ffc3a65d547 req-ebed4752-3cbd-45df-91b6-2ed5d1d43d7a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:30.718013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91eec1a1-8a42-480d-969c-1ffc3a65d547 req-ebed4752-3cbd-45df-91b6-2ed5d1d43d7a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:30.718406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91eec1a1-8a42-480d-969c-1ffc3a65d547 req-ebed4752-3cbd-45df-91b6-2ed5d1d43d7a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:30.771093 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-91eec1a1-8a42-480d-969c-1ffc3a65d547 req-ebed4752-3cbd-45df-91b6-2ed5d1d43d7a service nova] Creating event network-vif-deleted:11fe32a1-2b7c-4219-afee-c12a39c98357 for instance 74288f30-f899-45b0-858f-74469b93d003 on n-h1-862355-1 Oct 25 03:20:30.790652 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-91eec1a1-8a42-480d-969c-1ffc3a65d547 req-ebed4752-3cbd-45df-91b6-2ed5d1d43d7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094983 Oct 25 03:20:30.794567 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1896/3965] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:31.357517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:31.360841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 85aa6e51-d017-47ad-a622-dcaa21838be8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:31.375057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:31.375777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:31.377888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:31.379414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:31.380293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:31.380877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:31.445113 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance 85aa6e51-d017-47ad-a622-dcaa21838be8 could not be found. Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 HTTP/1.1 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 85aa6e51-d017-47ad-a622-dcaa21838be8 could not be found. Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '85aa6e51-d017-47ad-a622-dcaa21838be8'} Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85aa6e51-d017-47ad-a622-dcaa21838be8 could not be found. Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85aa6e51-d017-47ad-a622-dcaa21838be8 could not be found. Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:31.447877 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:31.452371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:31.452371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:31.452371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:31.452371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:31.452371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:31.452371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85aa6e51-d017-47ad-a622-dcaa21838be8 could not be found. Oct 25 03:20:31.452371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:20:31.457958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance 85aa6e51-d017-47ad-a622-dcaa21838be8 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:31.458996 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8edeebc1-6bec-433d-912d-cb9c565fa297 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8" status: 404 len: 111 microversion: 2.1 time: 0.107383 Oct 25 03:20:31.460877 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2070/3966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:31 2022] GET /compute/v2.1/servers/85aa6e51-d017-47ad-a622-dcaa21838be8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:20:31.473467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:31.474807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:31.491884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:31.492774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:31.494914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:31.495848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:31.497541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:31.499615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:31.580987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:31.581813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:31.582432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:31.583046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lazy-loading 'fault' on Instance uuid 74288f30-f899-45b0-858f-74469b93d003 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:20:31.623540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:31.624169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:31.651141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:31.651710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:31.652220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:31.658732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:31.659231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:31.659942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:31.671961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:31.687673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-112d7dff-1115-4e8f-8285-b61b304f813a tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 200 len: 1309 microversion: 2.1 time: 0.219434 Oct 25 03:20:31.691002 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1897/3967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:31 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 1309 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:32.606410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:32.615618 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90981c7b-c5b9-4492-b75f-db8c44d81d3b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1314 microversion: 2.1 time: 0.996358 Oct 25 03:20:32.631483 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2071/3968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:31 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:32.714926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:32.715544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: 74288f30-f899-45b0-858f-74469b93d003] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:32.727605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:32.728101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:32.728660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:32.735108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:32.736531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:32.736989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:32.767546 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance 74288f30-f899-45b0-858f-74469b93d003 could not be found. Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 HTTP/1.1 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 74288f30-f899-45b0-858f-74469b93d003 could not be found. Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '74288f30-f899-45b0-858f-74469b93d003'} Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74288f30-f899-45b0-858f-74469b93d003 could not be found. Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74288f30-f899-45b0-858f-74469b93d003 could not be found. Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:32.769260 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74288f30-f899-45b0-858f-74469b93d003 could not be found. Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance 74288f30-f899-45b0-858f-74469b93d003 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ea4cef7-e647-4fa8-b060-9849df35b55f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003" status: 404 len: 111 microversion: 2.1 time: 0.059944 Oct 25 03:20:32.774460 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1898/3969] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:32 2022] GET /compute/v2.1/servers/74288f30-f899-45b0-858f-74469b93d003 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:20:32.779927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d397ac1-2686-434a-a4f5-f632bcdbf8d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:32.850715 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d397ac1-2686-434a-a4f5-f632bcdbf8d0 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/6e0d3758-87cf-4904-853a-2ead1e491030" status: 204 len: 0 microversion: 2.1 time: 0.075010 Oct 25 03:20:32.851963 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2072/3970] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:20:32 2022] DELETE /compute/v2.1/os-server-groups/6e0d3758-87cf-4904-853a-2ead1e491030 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:32.860280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:32.860994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:32.871982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:32.872860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:32.873454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:32.874362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:32.874836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:32.881249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:32.930268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:20:33.145017 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9fe709f8-5284-477e-859f-0ef5d0fe8e8f tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 204 len: 0 microversion: 2.1 time: 0.288457 Oct 25 03:20:33.146053 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1899/3971] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:20:32 2022] DELETE /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:20:33.157415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:33.159803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:33.171901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:33.173535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:33.174992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:33.176699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:33.177435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:33.181882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:33.535316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6050dc8-dc09-4dc2-93c9-46ac630fab9b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd32912a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1490167272", "description": "tempest-description-647543757"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:33.573820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:33.592492 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-441c6877-5c1d-49ea-ba4c-b8d765c9a742 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1472 microversion: 2.1 time: 0.442310 Oct 25 03:20:33.597526 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2073/3972] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:33 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:33.643231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:33.645025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:33.658424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:33.659860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:33.660590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:33.661502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:33.662823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:33.663415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:34.409788 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e6050dc8-dc09-4dc2-93c9-46ac630fab9b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.146350 Oct 25 03:20:34.428036 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1900/3973] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:20:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:34.434832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b7478f23-7cb6-4485-9d9f-a0c0a8198615 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd32893ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1480265171", "description": "tempest-description-1683264954"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:34.449821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:34.488326 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2cadbf99-d962-457c-8a66-34d928fea7c0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1501 microversion: 2.1 time: 0.850098 Oct 25 03:20:34.491248 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2074/3974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:33 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1501 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:34.519583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:34.520396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:34.532427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:34.533411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:34.533411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:34.534142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:34.543836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:34.545160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:34.944079 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b7478f23-7cb6-4485-9d9f-a0c0a8198615 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.513560 Oct 25 03:20:34.965140 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1901/3975] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:20:34 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:34.974097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:34.976461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:34.998881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:35.000188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:35.002235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:35.003246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:35.004519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:35.005327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:35.681253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d263ce619e3478ba32340edc8d6d092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece51f6d19a343f58f60658b9aacdf3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:35.693010 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e7c1aea-870c-4e74-9383-84a8557e96aa tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 200 len: 1472 microversion: 2.1 time: 0.726053 Oct 25 03:20:35.693801 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1902/3976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:34 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 1472 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:35.701299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2030500561", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "70da3c0a-bd4e-4ac6-982e-dae16a480aa0"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:35.800062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] validate_networks() for [('70da3c0a-bd4e-4ac6-982e-dae16a480aa0', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:20:35.987247 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.network.security_group_api [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Removing security group d40b962a-8455-494c-b74e-a2a990e33818 from port d89e12cc-6465-436a-936e-a46ab8964407 Oct 25 03:20:37.330074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:20:37.331608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:20:37.332303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:20:37.332923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:20:37.333604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:20:37.353323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:37.358560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:37.360463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:37.363747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:37.366252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:37.366969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:37.443125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Getting quotas for project 873bdebcdf0243d4a538c50ee6398fac. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:20:37.477646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Getting quotas for user c36a1bb95e3c4143909870897aef02fc and project 873bdebcdf0243d4a538c50ee6398fac. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:20:37.513696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:20:37.521767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:20:37.613104 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51397d0e-2483-48ba-bee8-45fc774d7505 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917886 Oct 25 03:20:37.616074 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1903/3977] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:20:37.631214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-be69b5e6-9b4b-4aec-abf6-86fca6c2b6b0 req-785cf754-c193-4aac-8352-8f0451b2d5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a", "name": "network-vif-deleted", "tag": "b239ffd4-1930-4901-bc34-2c5918c886dd"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:37.670329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be69b5e6-9b4b-4aec-abf6-86fca6c2b6b0 req-785cf754-c193-4aac-8352-8f0451b2d5c3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:37.671828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be69b5e6-9b4b-4aec-abf6-86fca6c2b6b0 req-785cf754-c193-4aac-8352-8f0451b2d5c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:37.674265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be69b5e6-9b4b-4aec-abf6-86fca6c2b6b0 req-785cf754-c193-4aac-8352-8f0451b2d5c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:37.761591 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-be69b5e6-9b4b-4aec-abf6-86fca6c2b6b0 req-785cf754-c193-4aac-8352-8f0451b2d5c3 service nova] Creating event network-vif-deleted:b239ffd4-1930-4901-bc34-2c5918c886dd for instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a on n-h1-862355-1 Oct 25 03:20:37.781118 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-be69b5e6-9b4b-4aec-abf6-86fca6c2b6b0 req-785cf754-c193-4aac-8352-8f0451b2d5c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161276 Oct 25 03:20:37.781702 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1904/3978] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:37.801456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:37.804925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] [instance: c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:37.828101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:37.828603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:37.838460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:37.839839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:37.840411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:37.840853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:37.876852 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] HTTP exception thrown: Instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a could not be found. Oct 25 03:20:37.881450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-42a671ee-2b92-403c-ab93-fe9d6a7dbb38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32/action" status: 202 len: 0 microversion: 2.1 time: 3.369287 Oct 25 03:20:37.886422 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2075/3979] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:20:34 2022] POST /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32/action => generated 0 bytes in 3375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:20:37.900054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df6a0e9e-1815-4b51-8890-e4b3b3e70f5e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Request method failure captured: Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a HTTP/1.1 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1UxhBBA7FnXIGxtUuxLBfEqa-zyeO54-s0XuvB4oWYpVPdPtgWGf5S7TgeaeM2wR_pmf-Tg7Oex--c1JRO3UK5ScuADg9fF5Vq5QpKVeYfFTIGlrYFbqIKF-8Sk3UvQNDDJykoxADG7hYiPbWnidLQPKuJm_WqodjmvTSqeG5_6DAo Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ece51f6d19a343f58f60658b9aacdf3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ece51f6d19a343f58f60658b9aacdf3f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ece51f6d19a343f58f60658b9aacdf3f"}]}] Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ece51f6d19a343f58f60658b9aacdf3f Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1584681042 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 3d263ce619e3478ba32340edc8d6d092 Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersOnMultiNodesTest-1584681042-project Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a could not be found. Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a'} Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a could not be found. Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a could not be found. Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:20:37.904173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:37.910896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:20:37.910896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:20:37.910896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:20:37.910896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:20:37.910896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:20:37.910896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a could not be found. Oct 25 03:20:37.910896 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:20:37.911360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df6a0e9e-1815-4b51-8890-e4b3b3e70f5e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:37.914718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] Returning 404 to user: Instance c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:20:37.922508 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3468cb6c-b9be-4992-b3c6-016f3ddf9a38 tempest-ServersOnMultiNodesTest-1584681042 tempest-ServersOnMultiNodesTest-1584681042-project] 10.222.0.36 "GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a" status: 404 len: 111 microversion: 2.1 time: 0.133652 Oct 25 03:20:37.931344 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1905/3980] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:37 2022] GET /compute/v2.1/servers/c19c6788-2fd0-44d8-9a23-0a7f3f4d4b2a => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:20:37.936961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:37.937971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:37.949472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:37.951993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:37.953077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:37.955163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:37.956070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:37.956775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:38.177117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-df6a0e9e-1815-4b51-8890-e4b3b3e70f5e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:38.210141 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df6a0e9e-1815-4b51-8890-e4b3b3e70f5e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1216 microversion: 2.1 time: 0.320594 Oct 25 03:20:38.211157 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2076/3981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:37 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1216 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:38.233529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bb9eef1c-288a-4556-a359-61ea2919c10f req-e11238e4-0b11-46b1-81a7-406ecb4f1709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6e293f-a76f-4c33-a5a6-c31ffab08c32", "tag": "d89e12cc-6465-436a-936e-a46ab8964407"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:38.244545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:38.267087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb9eef1c-288a-4556-a359-61ea2919c10f req-e11238e4-0b11-46b1-81a7-406ecb4f1709 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:38.268287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb9eef1c-288a-4556-a359-61ea2919c10f req-e11238e4-0b11-46b1-81a7-406ecb4f1709 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:38.268866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb9eef1c-288a-4556-a359-61ea2919c10f req-e11238e4-0b11-46b1-81a7-406ecb4f1709 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:38.283550 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc9314c3-5548-49c5-ae4c-7ac3b0bbb8fb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1459 microversion: 2.1 time: 0.350631 Oct 25 03:20:38.294658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1906/3982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:37 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1459 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:38.302099 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bb9eef1c-288a-4556-a359-61ea2919c10f req-e11238e4-0b11-46b1-81a7-406ecb4f1709 service nova] Creating event network-changed:d89e12cc-6465-436a-936e-a46ab8964407 for instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 on n-h1-862355-1 Oct 25 03:20:38.311071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bb9eef1c-288a-4556-a359-61ea2919c10f req-e11238e4-0b11-46b1-81a7-406ecb4f1709 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098351 Oct 25 03:20:38.312454 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2077/3983] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:38.313262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:38.314253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:38.337768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:38.365261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:38.365819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:38.373658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:38.374463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:38.379605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:38.380082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:39.141747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:39.153319 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f9ecf64-8ca8-495d-ae22-b85334b3a635 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.843854 Oct 25 03:20:39.154117 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1907/3984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:38 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:39.182275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:39.183522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:39.191882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:39.192793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:39.193484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:39.194566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:39.195185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:39.195770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:39.243192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:39.247441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:39.259917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:39.260753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:39.261464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:39.263143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:39.263761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:39.264343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:39.409522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:39.420367 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d9ee52fd-a192-4f0d-91c2-da299b068655 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1212 microversion: 2.1 time: 0.188431 Oct 25 03:20:39.427393 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1908/3985] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:39 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1212 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:39.908379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:39.933285 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ac412035-ad8a-4447-aee0-5d54fdd4a967 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.745341 Oct 25 03:20:39.944645 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2078/3986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:39 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:39.973948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:39.975031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:39.989004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:39.989617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:39.990099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:39.990893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:39.992292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:39.992898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:40.402870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:40.414990 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e6452e77-0299-4973-b6a6-ccdc66233281 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.447231 Oct 25 03:20:40.416130 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1909/3987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:39 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:40.443582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:40.445128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:40.450659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:40.451674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:40.471765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:40.473915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:40.474736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:40.478012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:40.478980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:40.480005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:40.480675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:40.481363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:40.482377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:40.483060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:40.486522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:40.490143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:40.622082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:40.634757 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01277d98-1f38-4118-88c3-1cc221e423f7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1274 microversion: 2.1 time: 0.187719 Oct 25 03:20:40.635365 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1910/3988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:40 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:41.384980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:41.403125 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b3c59be-6157-44d4-b650-3600f9aec40c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.964563 Oct 25 03:20:41.403738 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2079/3989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:40 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:41.666112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:41.667599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:41.700392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:41.700888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:41.701320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:41.715448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:41.716313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:41.716762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:41.738791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-329719254", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:41.839468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] validate_networks() for [('0a37da4f-d5ff-42e2-9dcf-880fa9b15dc5', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:20:42.321951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:42.331152 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c463dbe-cb49-4c34-b5f2-c23f512ef800 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1316 microversion: 2.1 time: 0.674875 Oct 25 03:20:42.334348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1911/3990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:41 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:43.105756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:20:43.107200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:20:43.107200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:20:43.107200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:20:43.107584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:20:43.120776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:43.121271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:43.121721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:43.122450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:43.122982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:43.123464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:43.186218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:20:43.193919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Getting quotas for user 41342d3f5062457aaee26cf5d836e441 and project 587d3b710c1843279c9ffb9d78d6975b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:20:43.211589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:20:43.214359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:20:43.323450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5633e95c-89f2-4f45-878c-9df35b2cac16 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593701 Oct 25 03:20:43.328024 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2080/3991] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:20:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:20:43.342122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f05c01a1-1a71-4b6b-9033-7a39711d8432 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:43.342952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f05c01a1-1a71-4b6b-9033-7a39711d8432 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:43.361328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:43.362025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:43.372118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:43.373554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:43.374065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:43.376594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:43.378187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:43.378651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:43.673308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f05c01a1-1a71-4b6b-9033-7a39711d8432 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:43.685562 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f05c01a1-1a71-4b6b-9033-7a39711d8432 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1214 microversion: 2.1 time: 0.347750 Oct 25 03:20:43.686807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1912/3992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:43 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1214 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:43.739918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:43.748665 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e9d785cc-86b0-4883-92b7-4b72ef62d57a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1316 microversion: 2.1 time: 0.391994 Oct 25 03:20:43.749278 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2081/3993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:43 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:44.441854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4141a073-ebc3-4c61-9939-1e5bdc2751c2 req-afa271ef-027b-4410-9247-d9ef067460e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88194da6-151a-4ee4-8d15-788a84904e5e", "tag": "664e995d-32d3-44de-82f5-0fd6ff9564b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:44.472293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4141a073-ebc3-4c61-9939-1e5bdc2751c2 req-afa271ef-027b-4410-9247-d9ef067460e5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:44.484801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4141a073-ebc3-4c61-9939-1e5bdc2751c2 req-afa271ef-027b-4410-9247-d9ef067460e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:44.485322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4141a073-ebc3-4c61-9939-1e5bdc2751c2 req-afa271ef-027b-4410-9247-d9ef067460e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:44.507368 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4141a073-ebc3-4c61-9939-1e5bdc2751c2 req-afa271ef-027b-4410-9247-d9ef067460e5 service nova] Creating event network-changed:664e995d-32d3-44de-82f5-0fd6ff9564b9 for instance 88194da6-151a-4ee4-8d15-788a84904e5e on n-h1-862355-1 Oct 25 03:20:44.513853 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4141a073-ebc3-4c61-9939-1e5bdc2751c2 req-afa271ef-027b-4410-9247-d9ef067460e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076350 Oct 25 03:20:44.515358 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1913/3994] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:44.710727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:44.712429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:44.729235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:44.730128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:44.730603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:44.731599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:44.732062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:44.732667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:44.777247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:44.778899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:44.819176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:44.822551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:44.823813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:44.829545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:44.830744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:44.832436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:44.991044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:45.008981 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ecf87ca2-96d4-40a6-afec-07cac5d9ffd2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1266 microversion: 2.1 time: 0.300533 Oct 25 03:20:45.021137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2082/3995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:44 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:45.282485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:45.305750 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c958db76-4a54-4ac5-86bd-dd061b1bab83 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1316 microversion: 2.1 time: 0.533940 Oct 25 03:20:45.312766 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1914/3996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:44 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:45.461325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:45.463232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:45.484959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:45.485518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:45.486873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:45.490252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:45.491315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:45.492042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:45.543132 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9bdc62ff-3118-4444-90a8-614196fb53f2 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.103844 Oct 25 03:20:45.551795 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2083/3997] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 25 03:20:45 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85/os-server-password => generated 116 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:46.042129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:46.042745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:46.058733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:46.059544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:46.060003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:46.061701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:46.062230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:46.062660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:46.241417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:46.252356 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f962ae43-a910-486e-b7df-4d24daf3b64a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1272 microversion: 2.1 time: 0.220556 Oct 25 03:20:46.255598 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1915/3998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:46 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:46.342791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:46.343280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:46.363759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:46.366453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:46.367923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:46.371422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:46.372098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:46.372954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:46.771717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:46.790093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f41d5bcb-67e9-41c2-8176-90a69b021492 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1316 microversion: 2.1 time: 0.454045 Oct 25 03:20:46.793238 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2084/3999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:46 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:47.285405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:47.286183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:47.292863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:47.293336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:47.293856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:47.294561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:47.296557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:47.297253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:47.339907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:47.401091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:47.472286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:47.486821 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b329b8db-df18-47bd-978f-3a64033e34e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1272 microversion: 2.1 time: 0.206085 Oct 25 03:20:47.488859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1916/4000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:47 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:47.819384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:47.820356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:47.841101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:47.841576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:47.842067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:47.842913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:47.843425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:47.843859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:47.895917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:48.512571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:48.513834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:48.528578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:48.530077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:48.533863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:48.539715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:48.540611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:48.541802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:48.544895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:48.557028 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16eff999-f800-47a3-a17f-fbbd018e1b23 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1316 microversion: 2.1 time: 0.740988 Oct 25 03:20:48.559310 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2085/4001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:47 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:48.956608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:48.977524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99c78329-d7f8-4ed2-9e71-f0c93e3a89bb tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.464174 Oct 25 03:20:48.978966 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1917/4002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:48 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:49.583297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:49.583927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:49.601132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:49.603502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:49.604202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:49.606420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:49.609169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:49.612918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:50.026321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:50.030979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:50.050948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:50.053068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:50.053944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:50.056435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:50.057807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:50.058807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:50.549244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:50.563693 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0b63853-db08-4ea6-8cd3-e93912d0ced1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.558960 Oct 25 03:20:50.575322 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1918/4003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:50 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:50.586609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-acf224f2-5e7b-4ef5-8c5b-ae1913c7d1ef req-a9b585e1-901c-4c2b-8266-e9e372c14335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88194da6-151a-4ee4-8d15-788a84904e5e", "name": "network-vif-plugged", "status": "completed", "tag": "664e995d-32d3-44de-82f5-0fd6ff9564b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:50.598746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-acf224f2-5e7b-4ef5-8c5b-ae1913c7d1ef req-a9b585e1-901c-4c2b-8266-e9e372c14335 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:50.600065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-acf224f2-5e7b-4ef5-8c5b-ae1913c7d1ef req-a9b585e1-901c-4c2b-8266-e9e372c14335 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:50.600945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-acf224f2-5e7b-4ef5-8c5b-ae1913c7d1ef req-a9b585e1-901c-4c2b-8266-e9e372c14335 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:50.614099 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-acf224f2-5e7b-4ef5-8c5b-ae1913c7d1ef req-a9b585e1-901c-4c2b-8266-e9e372c14335 service nova] Creating event network-vif-plugged:664e995d-32d3-44de-82f5-0fd6ff9564b9 for instance 88194da6-151a-4ee4-8d15-788a84904e5e on n-h1-862355-1 Oct 25 03:20:50.620201 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-acf224f2-5e7b-4ef5-8c5b-ae1913c7d1ef req-a9b585e1-901c-4c2b-8266-e9e372c14335 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041152 Oct 25 03:20:50.621329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1919/4004] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:50.658860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:50.687117 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e0f0e64e-5c2f-49f3-ac62-6e33e91acaf5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1316 microversion: 2.1 time: 1.110378 Oct 25 03:20:50.693858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2086/4005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:49 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1316 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:51.614389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:51.615942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:51.630691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:51.631186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:51.631605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:51.636478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:51.636960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:51.640493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:51.717239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:51.718208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:51.732186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:51.734265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:51.735419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:51.742277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:51.743149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:51.743701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:52.641983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:52.657490 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed53d239-f2bd-4198-bf66-e075339ce69b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 1.065876 Oct 25 03:20:52.665599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1920/4006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:51 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:52.694448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-953ed7c5-b1ac-49b5-b8da-84a581db24dd req-08454061-01f8-4e27-be67-6db1cc0939a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f00b5417-31ea-4ec1-97b9-a427e4eab36e", "tag": "173ba40e-4c1c-45c7-a711-3afcb55b92d1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:52.726103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-953ed7c5-b1ac-49b5-b8da-84a581db24dd req-08454061-01f8-4e27-be67-6db1cc0939a3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:52.726725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-953ed7c5-b1ac-49b5-b8da-84a581db24dd req-08454061-01f8-4e27-be67-6db1cc0939a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:52.728519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-953ed7c5-b1ac-49b5-b8da-84a581db24dd req-08454061-01f8-4e27-be67-6db1cc0939a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:52.765262 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-953ed7c5-b1ac-49b5-b8da-84a581db24dd req-08454061-01f8-4e27-be67-6db1cc0939a3 service nova] Creating event network-changed:173ba40e-4c1c-45c7-a711-3afcb55b92d1 for instance f00b5417-31ea-4ec1-97b9-a427e4eab36e on n-h2-862355-1 Oct 25 03:20:52.779902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-953ed7c5-b1ac-49b5-b8da-84a581db24dd req-08454061-01f8-4e27-be67-6db1cc0939a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108047 Oct 25 03:20:52.781008 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1921/4007] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:52.810299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:52.822224 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b256ac2-2426-4d5b-9e4c-d458da896ffa tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1316 microversion: 2.1 time: 1.110844 Oct 25 03:20:52.822861 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2087/4008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:51 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:53.692362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:53.693779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:53.716663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:53.726410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:53.729168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:53.729731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:53.733302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:53.736820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:53.737291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:53.850829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:53.851608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:53.863852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:53.865075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:53.867857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:53.869417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:53.870419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:53.871187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:53.874105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:53.874560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:54.222077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:54.240736 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc0736a7-b0f9-45ca-aecf-cd96d32e203e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.553244 Oct 25 03:20:54.259029 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1922/4009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:53 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:54.312550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:54.321495 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5683bc8-b146-4888-b5d6-6f61e85aa3a7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1504 microversion: 2.1 time: 0.474663 Oct 25 03:20:54.324900 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2088/4010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:53 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:54.351864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1490167272"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:54.353188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:54.369472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:54.370152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:54.370977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:54.372044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:54.372846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:54.373611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:54.942312 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.network.security_group_api [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Adding security group 96c178e5-a841-43de-95eb-ee228aaa949b to port 664e995d-32d3-44de-82f5-0fd6ff9564b9 Oct 25 03:20:55.267643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:55.268389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:55.284600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:55.291141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:55.291689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:55.294078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:55.296035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:55.296501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:55.660172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:55.673939 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-855a4900-0342-4fa2-9f1d-600709f9b656 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.410872 Oct 25 03:20:55.676046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2089/4011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:55 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:56.705469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:56.706639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:56.712467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:20:56.727110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:56.728641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:56.729298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:56.732177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:56.733928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:56.735491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:57.444141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:57.458939 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ac1ec2f-d395-495f-86ea-217c1c2e031a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.758122 Oct 25 03:20:57.476632 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2090/4012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:56 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:57.515400 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56fec40d-5b50-47e3-8294-7fbdc9bf894c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e/action" status: 202 len: 0 microversion: 2.1 time: 3.167532 Oct 25 03:20:57.525889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1480265171"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:57.526465 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1923/4013] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:20:54 2022] POST /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e/action => generated 0 bytes in 3179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:20:57.527029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:57.539524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b89f1ae1-0b31-49db-a922-9d371eb0aa86 req-d38e6a6a-417a-4f2f-9e11-70eb5484ce70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88194da6-151a-4ee4-8d15-788a84904e5e", "tag": "664e995d-32d3-44de-82f5-0fd6ff9564b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:57.545462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:57.545992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:57.548992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:57.552165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:57.553633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:57.555280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:57.580504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b89f1ae1-0b31-49db-a922-9d371eb0aa86 req-d38e6a6a-417a-4f2f-9e11-70eb5484ce70 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:57.582214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b89f1ae1-0b31-49db-a922-9d371eb0aa86 req-d38e6a6a-417a-4f2f-9e11-70eb5484ce70 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:57.585694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b89f1ae1-0b31-49db-a922-9d371eb0aa86 req-d38e6a6a-417a-4f2f-9e11-70eb5484ce70 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:57.622952 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b89f1ae1-0b31-49db-a922-9d371eb0aa86 req-d38e6a6a-417a-4f2f-9e11-70eb5484ce70 service nova] Creating event network-changed:664e995d-32d3-44de-82f5-0fd6ff9564b9 for instance 88194da6-151a-4ee4-8d15-788a84904e5e on n-h1-862355-1 Oct 25 03:20:57.634280 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b89f1ae1-0b31-49db-a922-9d371eb0aa86 req-d38e6a6a-417a-4f2f-9e11-70eb5484ce70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098576 Oct 25 03:20:57.634903 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1924/4014] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:20:57.927460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.network.security_group_api [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Adding security group 21c632b4-35b8-4b75-8ffd-4353b5444cfd to port 664e995d-32d3-44de-82f5-0fd6ff9564b9 Oct 25 03:20:58.494572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:58.495293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:58.522299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:58.524487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:58.525109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:58.527885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:58.531320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:58.532516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:59.050685 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8b81e45-3b69-4c4e-8105-7421dac01daf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e/action" status: 202 len: 0 microversion: 2.1 time: 1.529394 Oct 25 03:20:59.056652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2091/4015] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:20:57 2022] POST /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e/action => generated 0 bytes in 1536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:20:59.067120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:20:59.074350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:20:59.101871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:59.102900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:59.104196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:59.108637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:59.110086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:59.110746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:59.410355 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7c6d679-1f35-4fce-9094-e2913bdcbb73 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.351286 Oct 25 03:20:59.411512 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2092/4016] 10.222.0.36 () {58 vars in 1293 bytes} [Tue Oct 25 03:20:59 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e/os-security-groups => generated 1158 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:20:59.431960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5f6568cc-3da2-40b8-a19b-d1d5fc43fe74 req-6aacf008-4287-40bf-9a92-dcf7bffbaf0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88194da6-151a-4ee4-8d15-788a84904e5e", "tag": "664e995d-32d3-44de-82f5-0fd6ff9564b9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:59.448207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5f6568cc-3da2-40b8-a19b-d1d5fc43fe74 req-6aacf008-4287-40bf-9a92-dcf7bffbaf0b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:20:59.448982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5f6568cc-3da2-40b8-a19b-d1d5fc43fe74 req-6aacf008-4287-40bf-9a92-dcf7bffbaf0b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:20:59.449522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5f6568cc-3da2-40b8-a19b-d1d5fc43fe74 req-6aacf008-4287-40bf-9a92-dcf7bffbaf0b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:20:59.472048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5f6568cc-3da2-40b8-a19b-d1d5fc43fe74 req-6aacf008-4287-40bf-9a92-dcf7bffbaf0b service nova] Creating event network-changed:664e995d-32d3-44de-82f5-0fd6ff9564b9 for instance 88194da6-151a-4ee4-8d15-788a84904e5e on n-h1-862355-1 Oct 25 03:20:59.480306 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5f6568cc-3da2-40b8-a19b-d1d5fc43fe74 req-6aacf008-4287-40bf-9a92-dcf7bffbaf0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066909 Oct 25 03:20:59.481260 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2093/4017] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:59.501066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe1aca80-da1e-42e4-8ab9-72be23ff1433 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd33ee7550>, body: {"security_group": {"name": " tempest-securitygroup -1571725082 ", "description": "tempest-description-645055320"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:20:59.519630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:20:59.533861 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90abd3b5-47b9-43b3-93cc-75ace74def1c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 1.046777 Oct 25 03:20:59.538200 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1925/4018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:20:58 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:20:59.715050 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe1aca80-da1e-42e4-8ab9-72be23ff1433 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.226392 Oct 25 03:20:59.715876 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2094/4019] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:20:59 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:20:59.731235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-809ad47c-f513-4d3f-85b9-0d52b2ba2d55 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd328ac3a0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:00.078769 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-809ad47c-f513-4d3f-85b9-0d52b2ba2d55 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894" status: 200 len: 223 microversion: 2.1 time: 0.353082 Oct 25 03:21:00.090568 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1926/4020] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:20:59 2022] GET /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894 => generated 223 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:00.104276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5e94949-47a6-4d62-8f40-9596c97b8262 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd337bff70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:00.456816 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d5e94949-47a6-4d62-8f40-9596c97b8262 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894" status: 202 len: 0 microversion: 2.1 time: 0.366031 Oct 25 03:21:00.457718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2095/4021] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:00 2022] DELETE /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:00.470612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ff71f86-df9a-49df-930e-79a48d56b389 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd328f5670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:00.564368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:00.566290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:00.588107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:00.590327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:00.592245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:00.595344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:00.596810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:00.597751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:00.829023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:00.842371 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e073871c-0df1-4c41-869d-d5fbe321e8cf tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.282848 Oct 25 03:21:00.844899 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2096/4022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:00 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:00.937275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-2ff71f86-df9a-49df-930e-79a48d56b389 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:00.940322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-2ff71f86-df9a-49df-930e-79a48d56b389 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group 36757b25-fbb6-404e-9ec8-c72602e3d894 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:00.941577 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-2ff71f86-df9a-49df-930e-79a48d56b389 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:00.941577 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-02f8bf8d-6438-4d69-b5c3-e4c79bd4d0ed'] Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ff71f86-df9a-49df-930e-79a48d56b389 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894 HTTP/1.1 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-02f8bf8d-6438-4d69-b5c3-e4c79bd4d0ed'] Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '36757b25-fbb6-404e-9ec8-c72602e3d894'} Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:00.948216 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f8bf8d-6438-4d69-b5c3-e4c79bd4d0ed'] Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f8bf8d-6438-4d69-b5c3-e4c79bd4d0ed'] Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f8bf8d-6438-4d69-b5c3-e4c79bd4d0ed'] Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02f8bf8d-6438-4d69-b5c3-e4c79bd4d0ed'] Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ff71f86-df9a-49df-930e-79a48d56b389 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-02f8bf8d-6438-4d69-b5c3-e4c79bd4d0ed'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ff71f86-df9a-49df-930e-79a48d56b389 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894" status: 404 len: 194 microversion: 2.1 time: 0.486245 Oct 25 03:21:00.954784 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1927/4023] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:21:00 2022] GET /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894 => generated 194 bytes in 490 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:00.964528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1ea5e6d-1fd5-4fee-9f8a-b77e129462ba tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd3374eee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-184114610", "description": "tempest-description-567008367"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:01.245164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1ea5e6d-1fd5-4fee-9f8a-b77e129462ba tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.285379 Oct 25 03:21:01.261212 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2097/4024] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:21:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:01.264990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ea615ab-680e-462c-b400-491f2f6cfadd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd3b744430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1629588724", "description": "tempest-description-169188868"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:01.868844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:01.869605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:01.883657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:01.888203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:01.891059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:01.892357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:01.893188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:01.894896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:01.915265 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ea615ab-680e-462c-b400-491f2f6cfadd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.656937 Oct 25 03:21:01.915880 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1928/4025] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:21:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:01.929352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-45bdbe70-598d-4789-9e9b-8a6b99897eb0 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd328acd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1502505277", "description": "tempest-description-1944033741"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:02.218010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:02.230726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b88c1ddc-8c62-4f6c-9d31-1ea8092a007e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.366938 Oct 25 03:21:02.232640 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2098/4026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:01 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:02.555209 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-45bdbe70-598d-4789-9e9b-8a6b99897eb0 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.629917 Oct 25 03:21:02.555826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1929/4027] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:21:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:21:02.569471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f31ad8b5-d6cc-44d8-8e0b-e7caf421a67f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd328435e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:03.036767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-306480680", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "c4bf48ef-b3f9-43d2-96b5-0a44beaba504"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:03.118017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] validate_networks() for [('c4bf48ef-b3f9-43d2-96b5-0a44beaba504', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:21:03.579509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f31ad8b5-d6cc-44d8-8e0b-e7caf421a67f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.013598 Oct 25 03:21:03.590887 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1930/4028] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:21:02 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:03.597156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-0153574f-2d06-401f-9106-cab3f4531085 req-9171671f-8a0d-4beb-b926-b4cff062b806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00b5417-31ea-4ec1-97b9-a427e4eab36e", "name": "network-vif-plugged", "status": "completed", "tag": "173ba40e-4c1c-45c7-a711-3afcb55b92d1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:03.609246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0153574f-2d06-401f-9106-cab3f4531085 req-9171671f-8a0d-4beb-b926-b4cff062b806 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:03.610010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0153574f-2d06-401f-9106-cab3f4531085 req-9171671f-8a0d-4beb-b926-b4cff062b806 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:03.610710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0153574f-2d06-401f-9106-cab3f4531085 req-9171671f-8a0d-4beb-b926-b4cff062b806 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:03.626328 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-0153574f-2d06-401f-9106-cab3f4531085 req-9171671f-8a0d-4beb-b926-b4cff062b806 service nova] Creating event network-vif-plugged:173ba40e-4c1c-45c7-a711-3afcb55b92d1 for instance f00b5417-31ea-4ec1-97b9-a427e4eab36e on n-h2-862355-1 Oct 25 03:21:03.633410 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-0153574f-2d06-401f-9106-cab3f4531085 req-9171671f-8a0d-4beb-b926-b4cff062b806 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041080 Oct 25 03:21:03.634719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1931/4029] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:03.641254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:03.642691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:03.651022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:03.652055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:03.652719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:03.653624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:03.654270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:03.654934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:04.112969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:04.123672 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-319f7ee7-8250-40c4-9bc8-d0922fc41b07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 0.485447 Oct 25 03:21:04.124472 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1932/4030] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:03 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:04.136622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d852301-e61b-453b-a1e0-ec7845289bae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd328b3550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:04.236015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:21:04.237151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:21:04.238111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:21:04.238744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:21:04.239488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:21:04.261323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:04.262321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:04.263019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:04.266071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:04.267033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:04.269760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:04.313663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Getting quotas for project 1920b3341ebc4974b112774f571cc716. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:21:04.322174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Getting quotas for user ac303ba2db7a49ddad1a5ea6fd9f8bc6 and project 1920b3341ebc4974b112774f571cc716. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:21:04.338649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:21:04.342325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:21:04.460774 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dacdf078-cf0c-45f3-91bc-1802bae62280 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.982492 Oct 25 03:21:04.462469 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2099/4031] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:21:04.479706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1030216-15da-4c65-b506-c47fa0150d40 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:04.480745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1030216-15da-4c65-b506-c47fa0150d40 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:04.612257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1030216-15da-4c65-b506-c47fa0150d40 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:04.632665 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d852301-e61b-453b-a1e0-ec7845289bae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836" status: 202 len: 0 microversion: 2.1 time: 0.505700 Oct 25 03:21:04.637000 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1933/4032] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:04 2022] DELETE /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836 => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:04.642675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70fd5b85-cccf-402f-849f-b2b268206463 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd328f5820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:04.647498 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1030216-15da-4c65-b506-c47fa0150d40 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1216 microversion: 2.1 time: 0.175824 Oct 25 03:21:04.651490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2100/4033] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:04 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:04.783973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-70fd5b85-cccf-402f-849f-b2b268206463 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:04.784907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-70fd5b85-cccf-402f-849f-b2b268206463 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group 51f7098f-7340-47f8-b041-46e5cc2fd836 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:04.789774 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-70fd5b85-cccf-402f-849f-b2b268206463 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:04.789774 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-c09ca687-5249-4b2f-8ea5-21fc38596087'] Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70fd5b85-cccf-402f-849f-b2b268206463 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836 HTTP/1.1 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-c09ca687-5249-4b2f-8ea5-21fc38596087'] Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '51f7098f-7340-47f8-b041-46e5cc2fd836'} Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:04.791839 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09ca687-5249-4b2f-8ea5-21fc38596087'] Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09ca687-5249-4b2f-8ea5-21fc38596087'] Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09ca687-5249-4b2f-8ea5-21fc38596087'] Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c09ca687-5249-4b2f-8ea5-21fc38596087'] Oct 25 03:21:04.796180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:04.798982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70fd5b85-cccf-402f-849f-b2b268206463 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:04.798982 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-c09ca687-5249-4b2f-8ea5-21fc38596087'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:04.799142 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-70fd5b85-cccf-402f-849f-b2b268206463 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836" status: 404 len: 194 microversion: 2.1 time: 0.160820 Oct 25 03:21:04.804608 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1934/4034] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:21:04 2022] GET /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836 => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:04.813953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d32b0011-8c70-4729-a0e1-6681712b9cda tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd337ad310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:05.163885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:05.170077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:05.185920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:05.194571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:05.195026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:05.200889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:05.206776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:05.208894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:05.333078 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d32b0011-8c70-4729-a0e1-6681712b9cda tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51" status: 202 len: 0 microversion: 2.1 time: 0.523668 Oct 25 03:21:05.334896 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2101/4035] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:04 2022] DELETE /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:05.354905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a079526-a004-4e05-891d-ae04edab445f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd336100d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:05.425481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-2a079526-a004-4e05-891d-ae04edab445f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:05.426415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.security_group_api [None req-2a079526-a004-4e05-891d-ae04edab445f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 not found {{(pid=120562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:05.427511 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2a079526-a004-4e05-891d-ae04edab445f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:05.427511 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-f1766f15-42ff-473e-8544-2b63906fa2e3'] Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a079526-a004-4e05-891d-ae04edab445f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51 HTTP/1.1 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: exception: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-f1766f15-42ff-473e-8544-2b63906fa2e3'] Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e94e70e9-95d9-49b0-baa7-11ec9a56fb51'} Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:05.433271 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1766f15-42ff-473e-8544-2b63906fa2e3'] Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1766f15-42ff-473e-8544-2b63906fa2e3'] Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1766f15-42ff-473e-8544-2b63906fa2e3'] Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1766f15-42ff-473e-8544-2b63906fa2e3'] Oct 25 03:21:05.436950 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:05.448393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a079526-a004-4e05-891d-ae04edab445f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:05.448393 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-f1766f15-42ff-473e-8544-2b63906fa2e3'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:05.449916 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a079526-a004-4e05-891d-ae04edab445f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51" status: 404 len: 194 microversion: 2.1 time: 0.107385 Oct 25 03:21:05.453522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2102/4036] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:21:05 2022] GET /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:21:05.477453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f149b52-fa64-48da-8856-a261dc0b05f6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd334afd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:05.927734 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f149b52-fa64-48da-8856-a261dc0b05f6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575" status: 202 len: 0 microversion: 2.1 time: 0.470472 Oct 25 03:21:05.928835 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2103/4037] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:05 2022] DELETE /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:21:05.936329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:05.937493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:05.969925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:05.971417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:05.972427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:05.975153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:05.977796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:05.979529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:06.130527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:06.147612 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f209c16-2d93-44fd-a627-cf97d18f964b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1212 microversion: 2.1 time: 0.216407 Oct 25 03:21:06.149128 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2104/4038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:05 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1212 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:06.166070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a7b51ee-c0d3-437d-ba68-81632f98a72a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd334995e0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:06.214144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-8a7b51ee-c0d3-437d-ba68-81632f98a72a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:06.215053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.security_group_api [None req-8a7b51ee-c0d3-437d-ba68-81632f98a72a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group 74dceb18-d025-4507-89b6-821e39340575 not found {{(pid=120562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:06.215827 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-8a7b51ee-c0d3-437d-ba68-81632f98a72a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:06.215827 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-fcc3ee30-8f06-427d-b221-26364fb94f9a'] Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a7b51ee-c0d3-437d-ba68-81632f98a72a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575 HTTP/1.1 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: exception: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-fcc3ee30-8f06-427d-b221-26364fb94f9a'] Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '74dceb18-d025-4507-89b6-821e39340575'} Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:06.218223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc3ee30-8f06-427d-b221-26364fb94f9a'] Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc3ee30-8f06-427d-b221-26364fb94f9a'] Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc3ee30-8f06-427d-b221-26364fb94f9a'] Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcc3ee30-8f06-427d-b221-26364fb94f9a'] Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a7b51ee-c0d3-437d-ba68-81632f98a72a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-fcc3ee30-8f06-427d-b221-26364fb94f9a'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8a7b51ee-c0d3-437d-ba68-81632f98a72a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575" status: 404 len: 194 microversion: 2.1 time: 0.070305 Oct 25 03:21:06.229081 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2105/4039] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:21:06 2022] GET /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:06.236569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08067c09-bc1f-432e-9c31-481ee627ab2e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd328beb80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:06.288788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:06.298687 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-917c5043-cd0e-4367-b9ee-2d8487f32b00 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1314 microversion: 2.1 time: 1.150727 Oct 25 03:21:06.309277 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1935/4040] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:05 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:06.656579 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08067c09-bc1f-432e-9c31-481ee627ab2e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.429646 Oct 25 03:21:06.657338 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2106/4041] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:21:06 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:06.677458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-523ac2b1-7cdf-4f84-90c6-74ae68a7061e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd32849b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-765957882", "description": "tempest-description-1534652368"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:07.178321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:07.178868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:07.186023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:07.186519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:07.186958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:07.196413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:07.197169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:07.197921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:07.314024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:07.325561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5cb106a3-6db3-494e-9285-0bab645531e6 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1274 microversion: 2.1 time: 0.152301 Oct 25 03:21:07.326963 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2107/4042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:07 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:07.352146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:07.354144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:07.368234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:07.369326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:07.369801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:07.370802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:07.371519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:07.372140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:07.802703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:07.817852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c857529f-567d-4e77-b12e-bdad8d3a33d8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1500 microversion: 2.1 time: 0.471254 Oct 25 03:21:07.822886 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2108/4043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:07 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1500 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:07.844035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:07.846841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:07.853756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:07.854749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:07.855654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:07.856602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:07.857287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:07.857962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:07.862213 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-523ac2b1-7cdf-4f84-90c6-74ae68a7061e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.190865 Oct 25 03:21:07.863917 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1936/4044] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:21:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:07.877563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca26263a-08b1-411c-a64b-5204f40833f0 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd328a98b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1458616858", "description": "tempest-description-1185848386"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:08.034843 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87dabdda-c71c-45c7-9933-9e8977be17d1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e/action" status: 202 len: 0 microversion: 2.1 time: 0.194236 Oct 25 03:21:08.039043 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2109/4045] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:21:07 2022] POST /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:08.055217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:08.056097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:08.080993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:08.081521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:08.082022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:08.082760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:08.083222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:08.083659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:08.497282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:08.510397 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f21fa706-4654-491f-8105-2c0082c66f37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1505 microversion: 2.1 time: 0.469720 Oct 25 03:21:08.531501 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2110/4046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:08 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:08.567811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:08.572928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:08.598143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:08.601287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:08.601954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:08.603629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:08.605189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:08.607868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:09.223729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:09.239816 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe9d1d1a-d653-4e15-86e9-2a8e25bb6c9f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.703802 Oct 25 03:21:09.240770 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2111/4047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:08 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:09.267550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:09.269944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:09.288839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:09.293973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:09.295636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:09.301211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:09.302234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:09.305475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:09.370663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:09.443110 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca26263a-08b1-411c-a64b-5204f40833f0 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.570258 Oct 25 03:21:09.458564 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1937/4048] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:21:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:21:09.542420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:09.543124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:09.545249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=46 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:09.565112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:09.565639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:09.566124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:09.573440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:09.580203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:09.580666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:09.970480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:09.994925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:09.997593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:10.002439 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7526807-d3f0-4508-a64b-76f79b21f291 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2944 microversion: 2.32 time: 0.746389 Oct 25 03:21:10.005441 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2112/4049] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:21:09 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2944 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:21:10.013646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-162357410", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "70da3c0a-bd4e-4ac6-982e-dae16a480aa0"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:10.131120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] validate_networks() for [('70da3c0a-bd4e-4ac6-982e-dae16a480aa0', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:21:10.460045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:10.472293 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c57ad3b7-69a8-4fd1-a289-eda916259ef8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1485 microversion: 2.1 time: 0.934809 Oct 25 03:21:10.475115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1938/4050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:09 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1485 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:10.494366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:10.495035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:10.512341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:10.514122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:10.517886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:10.521326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:10.522413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:10.523113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:11.129490 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-acfdded9-04c0-4ee7-aee7-0a64c76ec702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.648715 Oct 25 03:21:11.130303 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1939/4051] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 25 03:21:10 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977/os-interface => generated 1830 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:21:11.136662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:11.137912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:11.165976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:11.171271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:11.172109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:11.174812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:11.178051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:11.179782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:11.524877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:21:11.526988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:21:11.529375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:21:11.532594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:21:11.533425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:21:11.554072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:11.555705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:11.556487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:11.557464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:11.558462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:11.561080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:11.586560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Getting quotas for project 873bdebcdf0243d4a538c50ee6398fac. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:21:11.595643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Getting quotas for user c36a1bb95e3c4143909870897aef02fc and project 873bdebcdf0243d4a538c50ee6398fac. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:21:11.622090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:21:11.626570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:21:11.708781 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c94fbcdb-3a48-4ff6-b66f-d144bad0f14f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695452 Oct 25 03:21:11.710261 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2113/4052] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:21:11.721503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:11.722475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:11.733326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:11.735985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:11.738224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:11.739221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:11.739808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:11.742519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:11.794032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:11.806512 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c7789d0-303b-4701-a434-5ade9deddd75 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.674527 Oct 25 03:21:11.819193 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1940/4053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:11 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:11.853742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7842d2eb-38e0-4d10-aa75-d9cdc2a6d9a5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:11.858945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7842d2eb-38e0-4d10-aa75-d9cdc2a6d9a5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:11.871651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lazy-loading 'flavor' on Instance uuid f00b5417-31ea-4ec1-97b9-a427e4eab36e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:21:12.271472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7842d2eb-38e0-4d10-aa75-d9cdc2a6d9a5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:12.282789 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7842d2eb-38e0-4d10-aa75-d9cdc2a6d9a5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1215 microversion: 2.1 time: 0.461965 Oct 25 03:21:12.285893 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1941/4054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:11 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1215 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:12.295974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d6c47220-55d6-4a89-b4b0-1288dea98efc req-de5042f0-60aa-451c-84bc-6204804efb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ebbdc6-4973-485f-9b3e-5f07ef21807f", "tag": "e2575876-2fe6-4781-9690-c5f1b2819a99"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:12.313585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6c47220-55d6-4a89-b4b0-1288dea98efc req-de5042f0-60aa-451c-84bc-6204804efb13 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:12.314548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6c47220-55d6-4a89-b4b0-1288dea98efc req-de5042f0-60aa-451c-84bc-6204804efb13 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:12.315242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6c47220-55d6-4a89-b4b0-1288dea98efc req-de5042f0-60aa-451c-84bc-6204804efb13 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:12.329033 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d6c47220-55d6-4a89-b4b0-1288dea98efc req-de5042f0-60aa-451c-84bc-6204804efb13 service nova] Creating event network-changed:e2575876-2fe6-4781-9690-c5f1b2819a99 for instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f on n-h2-862355-1 Oct 25 03:21:12.335048 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d6c47220-55d6-4a89-b4b0-1288dea98efc req-de5042f0-60aa-451c-84bc-6204804efb13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046885 Oct 25 03:21:12.336377 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1942/4055] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:12.443309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a12d471-e4a2-4678-b413-d47cc5006bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e/action" status: 202 len: 0 microversion: 2.1 time: 0.731302 Oct 25 03:21:12.446505 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2114/4056] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:21:11 2022] POST /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e/action => generated 0 bytes in 735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:12.457509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:12.458542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:12.474771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:12.478722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:12.479462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:12.480360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:12.481071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:12.485070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:12.846548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:12.848750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:12.870459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:12.871829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:12.873916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:12.877224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:12.878044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:12.878755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:13.355956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:13.377309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a5f04912-4102-4bb7-be2a-918d2293c59f tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.537478 Oct 25 03:21:13.379498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2115/4057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:12 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:13.400711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:13.401355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:13.413657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:13.426947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:13.427421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:13.428226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:13.428661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:13.429323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:13.496286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:13.504962 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14d316e7-d13f-4ac6-9a3e-6743e26bea11 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1491 microversion: 2.1 time: 1.054830 Oct 25 03:21:13.518424 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1943/4058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:12 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1491 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:13.722420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:13.751538 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e3761ac-b8d5-43bc-931e-d5f5f0cc7872 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1267 microversion: 2.1 time: 0.370877 Oct 25 03:21:13.760701 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2116/4059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:13 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1267 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:14.405825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:14.407272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:14.416625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:14.418469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:14.419380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:14.420519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:14.421237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:14.422689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:14.538409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:14.539073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:14.557670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:14.558260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:14.558734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:14.559486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:14.559974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:14.560429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:14.764631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:14.783637 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e1bffc05-6cc5-4589-8767-1a547c31180c tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.379801 Oct 25 03:21:14.785101 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1944/4060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:14 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:14.793610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:14.799803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:14.804098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:14.814077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:14.814823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:14.815448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:14.818047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba4da1e9-6725-48d4-b546-eb6dfb746ab8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1512 microversion: 2.1 time: 0.282835 Oct 25 03:21:14.819173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:14.820633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:14.821542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:14.831270 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2117/4061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:14 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:15.064999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:15.074658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18275ed3-958f-4379-83b7-c1fc4c93e3c8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1273 microversion: 2.1 time: 0.288210 Oct 25 03:21:15.075267 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1945/4062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:14 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:15.810793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:15.811436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:15.827018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:15.827537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:15.828503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:15.829938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:15.832006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:15.833229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:15.848072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:15.848722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:15.868145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:15.870148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:15.870606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:15.871350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:15.871815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:15.882626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:16.204079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:16.233620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09c00c7d-2112-434a-b2d6-c19e15e79cf8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.430318 Oct 25 03:21:16.238180 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2118/4063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:15 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:16.251312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:16.256025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:16.278692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:16.283535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:16.285122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:16.288289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:16.289001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:16.289726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:16.418910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:16.430944 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94a41da0-fa9a-4f35-b63b-9cff6716990e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1273 microversion: 2.1 time: 0.191320 Oct 25 03:21:16.432195 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2119/4064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:16 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:16.565992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:16.582668 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-acdeac4e-ecaf-47a2-b999-5b0e59a7dcb3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1512 microversion: 2.1 time: 0.743552 Oct 25 03:21:16.585389 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1946/4065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:15 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1512 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:17.268898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:17.270472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:17.289482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:17.290403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:17.291075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:17.292054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:17.292787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:17.293434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:17.476202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:17.477466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:17.487319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:17.488083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:17.488690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:17.489564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:17.490200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:17.490912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:17.496930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=99 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:18.414441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:18.425529 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50e9dfcd-c28c-4ab5-8b57-7309b5bfd7d4 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 1.170736 Oct 25 03:21:18.438805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2120/4066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:17 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:18.457838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:18.459194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:18.479522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:18.480377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:18.481005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:18.482088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:18.482711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:18.483423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:18.521453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:18.564005 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82566e2e-f490-4b37-b382-995af381a46b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 1.098805 Oct 25 03:21:18.566929 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1947/4067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:17 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:18.881217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:18.894843 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3b41e78-bbd1-42b7-b30f-094e39c18e07 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.452658 Oct 25 03:21:18.898264 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2121/4068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:18 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:19.455082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:19.456008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:19.465743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:19.470369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:19.471054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:19.474944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:19.475838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:19.481374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:19.592334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:19.594754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:19.607864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:19.610349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:19.610876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:19.613782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:19.614310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:19.620179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:19.889915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:19.903543 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6d094d71-5b73-4317-a670-fb54f7726502 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 0.313444 Oct 25 03:21:19.914803 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2122/4069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:19 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:19.960065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:19.961829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:19.993480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:20.001399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:20.004843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:20.005972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:20.010433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:20.011401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:20.506043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:20.523124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-734deb66-cd25-40cf-a2bb-bb1bebdaa959 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.579765 Oct 25 03:21:20.524256 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2123/4070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:19 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:20.932102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:20.932895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:20.950179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:20.963105 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89e2cac1-d8fe-466a-80e5-34901b97a469 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 1.512337 Oct 25 03:21:20.966421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:20.967429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:20.979608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:20.979857 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1948/4071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:19 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:20.980856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:20.992017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:21.004846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:21.348851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:21.357831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b81469b3-6be3-4da4-90a8-240fec99b0f3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 0.431307 Oct 25 03:21:21.369725 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2124/4072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:20 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:21.564643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:21.565809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:21.582761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:21.583256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:21.583694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:21.584399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:21.615793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:21.616459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:21.669463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-92cf329c-5849-41bc-ae2b-ed43b01949ba req-0181922e-03c8-42bf-aae0-91682e91721c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00b5417-31ea-4ec1-97b9-a427e4eab36e", "name": "network-vif-plugged", "status": "completed", "tag": "173ba40e-4c1c-45c7-a711-3afcb55b92d1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:21.679513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:21.682905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:21.696815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-92cf329c-5849-41bc-ae2b-ed43b01949ba req-0181922e-03c8-42bf-aae0-91682e91721c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:21.699045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-92cf329c-5849-41bc-ae2b-ed43b01949ba req-0181922e-03c8-42bf-aae0-91682e91721c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:21.699764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-92cf329c-5849-41bc-ae2b-ed43b01949ba req-0181922e-03c8-42bf-aae0-91682e91721c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:21.732401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-92cf329c-5849-41bc-ae2b-ed43b01949ba req-0181922e-03c8-42bf-aae0-91682e91721c service nova] Creating event network-vif-plugged:173ba40e-4c1c-45c7-a711-3afcb55b92d1 for instance f00b5417-31ea-4ec1-97b9-a427e4eab36e on n-h2-862355-1 Oct 25 03:21:21.745345 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-92cf329c-5849-41bc-ae2b-ed43b01949ba req-0181922e-03c8-42bf-aae0-91682e91721c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079775 Oct 25 03:21:21.747074 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2125/4073] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:21:22.020504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:22.021947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:22.036105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:22.042542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:22.043937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:22.045129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:22.045853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:22.046566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:22.280226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:22.373030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:22.382789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d4951dd-2ec8-4a35-b829-4d2ca96b6a56 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.377625 Oct 25 03:21:22.407311 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2126/4074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:21 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:22.415176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:22.426741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:22.433036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:22.433535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:22.434022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:22.434729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:22.435248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:22.444211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:22.736049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:22.744435 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca390749-bff9-448b-9901-a1325c0ce34c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 0.336560 Oct 25 03:21:22.761705 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2127/4075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:22 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:23.098066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:23.127663 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f63c9e1-aa2b-4f25-b997-f5e55380901c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 1.574526 Oct 25 03:21:23.131650 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1949/4076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:21 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:23.416444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:23.426392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:23.449630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:23.460941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:23.461609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:23.462548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:23.465298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:23.474981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:23.579677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:23.780210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:23.781986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:23.815383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:23.819714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:23.823844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:23.825153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:23.829343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:23.830312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:23.937615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:23.946772 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f2d59ef6-a78f-4e1b-bdc2-3279c59182e0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.536009 Oct 25 03:21:23.947371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2128/4077] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:23 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:24.101553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-59a23c59-7d10-4cc5-b9cd-f932ac2a6b75 req-98e316f5-e035-420e-9a99-74b30298b11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ebbdc6-4973-485f-9b3e-5f07ef21807f", "name": "network-vif-plugged", "status": "completed", "tag": "e2575876-2fe6-4781-9690-c5f1b2819a99"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:24.125669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-59a23c59-7d10-4cc5-b9cd-f932ac2a6b75 req-98e316f5-e035-420e-9a99-74b30298b11c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:24.126216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-59a23c59-7d10-4cc5-b9cd-f932ac2a6b75 req-98e316f5-e035-420e-9a99-74b30298b11c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:24.126668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-59a23c59-7d10-4cc5-b9cd-f932ac2a6b75 req-98e316f5-e035-420e-9a99-74b30298b11c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:24.156774 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-59a23c59-7d10-4cc5-b9cd-f932ac2a6b75 req-98e316f5-e035-420e-9a99-74b30298b11c service nova] Creating event network-vif-plugged:e2575876-2fe6-4781-9690-c5f1b2819a99 for instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f on n-h2-862355-1 Oct 25 03:21:24.182839 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-59a23c59-7d10-4cc5-b9cd-f932ac2a6b75 req-98e316f5-e035-420e-9a99-74b30298b11c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082620 Oct 25 03:21:24.188516 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2129/4078] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:24.208791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:24.211068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:24.232224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:24.232731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:24.238726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:24.243227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:24.258978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:24.268990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:24.932946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:24.955043 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a862917-20df-4574-9317-28710b7e5c4c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.754123 Oct 25 03:21:24.956393 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2130/4079] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:24 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:25.004540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:25.005424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:25.025179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:25.032934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:25.033768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:25.035842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:25.038866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:25.039704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:25.176357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:25.200040 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fec7b740-01b2-45de-8a58-19a14f108bbf tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 1.425169 Oct 25 03:21:25.211528 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1950/4080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:23 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:25.531287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:25.588614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-643a77ee-f13c-4bc5-b5cc-47e8f9143d78 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1316 microversion: 2.1 time: 0.582947 Oct 25 03:21:25.588614 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2131/4081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:24 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:25.960377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1834d92e-58e7-4c57-b62b-76bbcf0368ed req-fb455ed9-c871-46cd-8783-cfca06344b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c88c79-876f-4840-910b-79d206f3f12f", "tag": "55565700-2c28-40b1-b99c-9117c4947dab"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:25.993060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:25.999107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:26.014140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:26.021473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:26.024869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:26.031618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:26.032823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1834d92e-58e7-4c57-b62b-76bbcf0368ed req-fb455ed9-c871-46cd-8783-cfca06344b45 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:26.033573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:26.034477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:26.042257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1834d92e-58e7-4c57-b62b-76bbcf0368ed req-fb455ed9-c871-46cd-8783-cfca06344b45 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:26.042980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1834d92e-58e7-4c57-b62b-76bbcf0368ed req-fb455ed9-c871-46cd-8783-cfca06344b45 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:26.107316 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1834d92e-58e7-4c57-b62b-76bbcf0368ed req-fb455ed9-c871-46cd-8783-cfca06344b45 service nova] Creating event network-changed:55565700-2c28-40b1-b99c-9117c4947dab for instance 90c88c79-876f-4840-910b-79d206f3f12f on n-h1-862355-1 Oct 25 03:21:26.136570 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1834d92e-58e7-4c57-b62b-76bbcf0368ed req-fb455ed9-c871-46cd-8783-cfca06344b45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184328 Oct 25 03:21:26.148809 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1951/4082] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:21:26.228356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:26.229905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:26.245370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:26.246015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:26.249221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:26.253770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:26.256921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:26.261363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:26.822046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:26.830947 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-def7651c-91d3-447c-bf00-f9dc45d705b9 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 0.607545 Oct 25 03:21:26.845842 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1952/4083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:26 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:26.848428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:26.864313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:26.889003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:26.889511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:26.901122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:26.907695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:26.908228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:26.908680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:27.175515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:27.192205 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32b62eff-6463-4e1b-b801-d12e71a5c0e9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 1.203279 Oct 25 03:21:27.208632 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2132/4084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:25 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:27.891805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:27.904693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:27.928696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:27.931040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:27.933237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:27.941778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:27.946105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:27.947169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:27.947869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:28.447854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:28.465056 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a821f8d-df89-4197-b15a-bb80cb614c15 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1505 microversion: 2.1 time: 1.624569 Oct 25 03:21:28.474050 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1953/4085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:26 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1505 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:28.485713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:28.498707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:28.510194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:28.511087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:28.511756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:28.513993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:28.514713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:28.518418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:28.769643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:28.786237 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d6fdb96-7f55-4611-95a6-8072e11c9118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.302290 Oct 25 03:21:28.798090 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1954/4086] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:28 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:28.810685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:28.823116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:28.849748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:28.852212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:28.853009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:28.854018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:28.859831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:28.861102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:28.972178 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4ee76dc8-0ffa-4588-90d8-7db929c0f1a5 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f/ips" status: 200 len: 109 microversion: 2.1 time: 0.167794 Oct 25 03:21:28.980038 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1955/4087] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:21:28 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f/ips => generated 109 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:29.019247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:29.023516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:29.043400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.048162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.052595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:29.058591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.059383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.063181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:29.143372 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec6217f5-0062-4bdd-b0f2-b76c0577bb06 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f/ips" status: 200 len: 109 microversion: 2.1 time: 0.155175 Oct 25 03:21:29.146760 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1956/4088] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:21:28 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f/ips => generated 109 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:29.162162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:29.163112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:29.180131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.183816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.188235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:29.189231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.190414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.193562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:29.286962 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89599132-f9be-4ec5-8abe-ce2a75d327c8 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f/ips/tempest-ServerAddressesTestJSON-1539143336-network" status: 200 len: 94 microversion: 2.1 time: 0.132964 Oct 25 03:21:29.304510 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1957/4089] 10.222.0.36 () {58 vars in 1401 bytes} [Tue Oct 25 03:21:29 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f/ips/tempest-ServerAddressesTestJSON-1539143336-network => generated 94 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:21:29.315086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:29.322635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:29.347823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.348753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.355435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:29.358029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.358797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.365730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:29.482787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:21:29.806104 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48e43d27-bcfd-4e8a-b230-d6d5d822676b tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 204 len: 0 microversion: 2.1 time: 0.499744 Oct 25 03:21:29.806688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1958/4090] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:21:29 2022] DELETE /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:21:29.837017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:29.837995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:29.857198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.857732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.858185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:29.859635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:29.880478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:29.881083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:30.371403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:30.415026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9be9269e-1275-4739-803c-be02f0405807 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 2.541895 Oct 25 03:21:30.433055 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2133/4091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:27 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:30.468544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:30.480041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:30.499617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:30.500119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:30.500563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:30.501283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:30.501771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:30.505584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:30.868806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:30.878040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:30.883743 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7596a3b-0e13-4837-b6d4-1f7938e0e5c0 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1511 microversion: 2.1 time: 1.068307 Oct 25 03:21:30.886083 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e46f4948-8bbe-4f36-b6be-3d051e0af59c tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.449833 Oct 25 03:21:30.887165 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2134/4092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:30 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:30.888699 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1959/4093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:29 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1511 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:31.461195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:31.461991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:31.482542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:31.486558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:31.496195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:31.497169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:31.497795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:31.498348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:31.939107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:31.939916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:31.977191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:31.985754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:31.988897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:31.998351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:32.003024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:32.007557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:32.100907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:32.109884 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea2f3e5d-52f3-476e-9762-daea1dedc279 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 0.653876 Oct 25 03:21:32.115460 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2135/4094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:31 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:32.129828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:32.137375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:32.157851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:32.164752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:32.166218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:32.167278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:32.169262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:32.170313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:32.568292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:32.583518 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c8d3bf0-cf69-495e-a43a-81e05fe854b8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.466017 Oct 25 03:21:32.607971 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2136/4095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:32 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:32.836988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac303ba2db7a49ddad1a5ea6fd9f8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1920b3341ebc4974b112774f571cc716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:32.847996 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d74f3e5-22df-47f5-9333-400ce65943a2 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 200 len: 1511 microversion: 2.1 time: 0.924799 Oct 25 03:21:32.852290 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1960/4096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:31 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 1511 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:32.893093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8e6616b1-f6d3-4434-8277-f459f4460d9c req-7c04152b-904e-4300-93d3-eeb9c876866d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ebbdc6-4973-485f-9b3e-5f07ef21807f", "name": "network-vif-deleted", "tag": "e2575876-2fe6-4781-9690-c5f1b2819a99"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:32.919038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e6616b1-f6d3-4434-8277-f459f4460d9c req-7c04152b-904e-4300-93d3-eeb9c876866d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:32.919453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e6616b1-f6d3-4434-8277-f459f4460d9c req-7c04152b-904e-4300-93d3-eeb9c876866d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:32.919889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e6616b1-f6d3-4434-8277-f459f4460d9c req-7c04152b-904e-4300-93d3-eeb9c876866d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:32.961732 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8e6616b1-f6d3-4434-8277-f459f4460d9c req-7c04152b-904e-4300-93d3-eeb9c876866d service nova] Creating event network-vif-deleted:e2575876-2fe6-4781-9690-c5f1b2819a99 for instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f on n-h2-862355-1 Oct 25 03:21:32.983072 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8e6616b1-f6d3-4434-8277-f459f4460d9c req-7c04152b-904e-4300-93d3-eeb9c876866d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093671 Oct 25 03:21:32.987451 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2137/4097] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:33.142655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:33.143903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:33.166052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:33.166807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:33.167409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:33.177090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:33.178387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:33.185667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:33.616942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:33.617649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:33.639015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:33.639595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:33.654447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:33.655246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:33.655798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:33.656429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:34.195994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:34.211744 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e25df38c-55dc-43cc-9577-908587a6b6ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.599462 Oct 25 03:21:34.226112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2138/4098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:33 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:34.237618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:34.238560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] [instance: e2ebbdc6-4973-485f-9b3e-5f07ef21807f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:34.245259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:34.245983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:34.246578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:34.247465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:34.248066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:34.248651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:34.268234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] HTTP exception thrown: Instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f could not be found. Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Request method failure captured: Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f HTTP/1.1 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1Ye8FJd1vkfaVKJ6WJNzQA76erRdiRi2Nx6oi4DFf8mxfOjjNnT9hxaEdSpD9tgYvntCn5F9wt8Vh0e8FR0YpKyKrrJBkNiXtAifzyc3eTE-yiooCqjzNd7aekeWQ3Avr2COzSe9nZnoTb-ronrF5HfN7vtZoyI0wYOSx_m30IKbW4 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 1920b3341ebc4974b112774f571cc716 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerAddressesTestJSON-497213808 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1920b3341ebc4974b112774f571cc716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1920b3341ebc4974b112774f571cc716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1920b3341ebc4974b112774f571cc716", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1920b3341ebc4974b112774f571cc716"}]}] Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerAddressesTestJSON-497213808 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 1920b3341ebc4974b112774f571cc716 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerAddressesTestJSON-497213808 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerAddressesTestJSON-497213808-project Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ac303ba2db7a49ddad1a5ea6fd9f8bc6 Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerAddressesTestJSON-497213808-project Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f could not be found. Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e2ebbdc6-4973-485f-9b3e-5f07ef21807f'} Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f could not be found. Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f could not be found. Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:34.280120 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:34.285594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:34.285594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:34.285594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:34.285594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:34.285594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:34.285594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f could not be found. Oct 25 03:21:34.285594 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:34.286922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] Returning 404 to user: Instance e2ebbdc6-4973-485f-9b3e-5f07ef21807f could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:34.287959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1451f417-58ef-4e12-8c00-891fdfa46606 tempest-ServerAddressesTestJSON-497213808 tempest-ServerAddressesTestJSON-497213808-project] 10.222.0.36 "GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f" status: 404 len: 111 microversion: 2.1 time: 0.060514 Oct 25 03:21:34.288687 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2139/4099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:34 2022] GET /compute/v2.1/servers/e2ebbdc6-4973-485f-9b3e-5f07ef21807f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:34.491003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2d190568-00b3-415b-8435-00b88a163f13 req-6f1bfbb0-727d-45b7-8ad1-e717283ed74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c88c79-876f-4840-910b-79d206f3f12f", "name": "network-vif-plugged", "status": "completed", "tag": "55565700-2c28-40b1-b99c-9117c4947dab"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:34.512368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2d190568-00b3-415b-8435-00b88a163f13 req-6f1bfbb0-727d-45b7-8ad1-e717283ed74b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:34.512780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2d190568-00b3-415b-8435-00b88a163f13 req-6f1bfbb0-727d-45b7-8ad1-e717283ed74b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:34.513218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2d190568-00b3-415b-8435-00b88a163f13 req-6f1bfbb0-727d-45b7-8ad1-e717283ed74b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:34.583307 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2d190568-00b3-415b-8435-00b88a163f13 req-6f1bfbb0-727d-45b7-8ad1-e717283ed74b service nova] Creating event network-vif-plugged:55565700-2c28-40b1-b99c-9117c4947dab for instance 90c88c79-876f-4840-910b-79d206f3f12f on n-h1-862355-1 Oct 25 03:21:34.618316 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2d190568-00b3-415b-8435-00b88a163f13 req-6f1bfbb0-727d-45b7-8ad1-e717283ed74b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326331 Oct 25 03:21:34.639632 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2140/4100] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:34.743507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:34.753853 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b6284115-dc15-4a2c-b887-5d2997e143cd tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 1.615723 Oct 25 03:21:34.757107 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1961/4101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:33 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:35.253731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:35.254455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:35.266897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:35.267632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:35.268248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:35.271654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:35.272341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:35.272986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:35.786799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:35.788078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:35.805524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:35.806349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:35.807151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:35.808146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:35.808769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:35.809370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:35.818795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:35.836579 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-83c08d6b-a497-4b0e-8311-a8226111c458 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.596203 Oct 25 03:21:35.838734 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2141/4102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:35 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:36.621826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:36.660397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e2598a51-52fd-4bcf-a172-c406fcc4988b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1315 microversion: 2.1 time: 0.880201 Oct 25 03:21:36.664716 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1962/4103] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:35 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:36.866400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:36.867079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:36.880479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:36.880479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:36.880888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:36.891909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:36.892400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:36.892882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:37.513943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:37.532170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee360507-2f44-45be-ab65-5ed64ef495c3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.666498 Oct 25 03:21:37.556085 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2142/4104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:36 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:37.690632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:37.691815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:37.724113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:37.727243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:37.728273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:37.734379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:37.735032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:37.736109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:38.282596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:38.287236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:38.353388 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47245fd4-8bce-4f00-b27e-a3eca73d2f4d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1503 microversion: 2.1 time: 0.669040 Oct 25 03:21:38.357460 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1963/4105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:37 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1503 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:38.384449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-765957882"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:38.385705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:38.417186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:38.417723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:38.423994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:38.424992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:38.435014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:38.438063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:38.561208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:38.562487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:38.579928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:38.595326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:38.597169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:38.598101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:38.603439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:38.604021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:38.819418 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.network.security_group_api [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Adding security group bb7804c6-3110-4316-a99b-5edb6ddeba01 to port 55565700-2c28-40b1-b99c-9117c4947dab Oct 25 03:21:39.760350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:39.804399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1fe9e13-1f95-4a8a-be5e-e90d3e9a5f8d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 1.244793 Oct 25 03:21:39.805441 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1964/4106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:38 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:40.187409 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8cc92dc8-bedd-45cd-913d-ebfb0190dc94 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f/action" status: 202 len: 0 microversion: 2.1 time: 1.806031 Oct 25 03:21:40.190108 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2143/4107] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:21:38 2022] POST /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f/action => generated 0 bytes in 1810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:40.200198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90bd3c11-4f2d-440c-84c1-16698151a1ec tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3308c9d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:40.234350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-01ff223c-3f4c-4ffd-81fe-95f3fccc0c95 req-44fc84ef-ff5b-416d-a0c8-6f90b014f8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c88c79-876f-4840-910b-79d206f3f12f", "tag": "55565700-2c28-40b1-b99c-9117c4947dab"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:40.269048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-01ff223c-3f4c-4ffd-81fe-95f3fccc0c95 req-44fc84ef-ff5b-416d-a0c8-6f90b014f8a0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:40.271724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-01ff223c-3f4c-4ffd-81fe-95f3fccc0c95 req-44fc84ef-ff5b-416d-a0c8-6f90b014f8a0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:40.275156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-01ff223c-3f4c-4ffd-81fe-95f3fccc0c95 req-44fc84ef-ff5b-416d-a0c8-6f90b014f8a0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:40.326422 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-01ff223c-3f4c-4ffd-81fe-95f3fccc0c95 req-44fc84ef-ff5b-416d-a0c8-6f90b014f8a0 service nova] Creating event network-changed:55565700-2c28-40b1-b99c-9117c4947dab for instance 90c88c79-876f-4840-910b-79d206f3f12f on n-h1-862355-1 Oct 25 03:21:40.354952 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-01ff223c-3f4c-4ffd-81fe-95f3fccc0c95 req-44fc84ef-ff5b-416d-a0c8-6f90b014f8a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121138 Oct 25 03:21:40.356218 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2144/4108] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:40.839324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:40.840655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:40.873290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-90bd3c11-4f2d-440c-84c1-16698151a1ec tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use.", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:40.875073 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-90bd3c11-4f2d-440c-84c1-16698151a1ec tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use. Oct 25 03:21:40.875073 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-09594d29-36c9-4a19-93a6-ea17cc4aa571'] Oct 25 03:21:40.887051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:40.894579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:40.895392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:40.896431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:40.896910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90bd3c11-4f2d-440c-84c1-16698151a1ec tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01 HTTP/1.1 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: exception: Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use. Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-09594d29-36c9-4a19-93a6-ea17cc4aa571'] Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'bb7804c6-3110-4316-a99b-5edb6ddeba01'} Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:40.901264 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use. Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09594d29-36c9-4a19-93a6-ea17cc4aa571'] Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use. Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09594d29-36c9-4a19-93a6-ea17cc4aa571'] Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use. Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09594d29-36c9-4a19-93a6-ea17cc4aa571'] Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use. Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09594d29-36c9-4a19-93a6-ea17cc4aa571'] Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90bd3c11-4f2d-440c-84c1-16698151a1ec tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 400 to user: Security Group bb7804c6-3110-4316-a99b-5edb6ddeba01 in use. Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-09594d29-36c9-4a19-93a6-ea17cc4aa571'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90bd3c11-4f2d-440c-84c1-16698151a1ec tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01" status: 400 len: 185 microversion: 2.1 time: 0.708464 Oct 25 03:21:40.912460 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1965/4109] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:40 2022] DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01 => generated 185 bytes in 711 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:21:40.921761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:40.922016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:40.933462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:40.942588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:40.959385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:40.960284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:40.960891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:40.961842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:40.962901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:40.964014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:41.132546 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e0048ade-76f6-43e2-b565-32cc654df999 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f/action" status: 202 len: 0 microversion: 2.1 time: 0.220662 Oct 25 03:21:41.136213 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1966/4110] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:21:40 2022] POST /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:21:41.167325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:41.174060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:41.189276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:41.198383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:41.199050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:41.199961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:41.200598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:41.202727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:41.424417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:41.444093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f22ebe2-455d-4bf0-b51e-4ebed2df7821 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.617262 Oct 25 03:21:41.444695 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2145/4111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:40 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:42.473621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:42.475331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:42.487965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:42.488829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:42.490175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:42.494651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:42.495662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:42.496815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:42.774481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:42.794875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b874bc6a-7d37-480b-ad66-0a13c57d0cd4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1573 microversion: 2.1 time: 1.623300 Oct 25 03:21:42.796381 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1967/4112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:41 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1573 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:42.957061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:42.973778 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-629aa7d8-3a7b-4894-8119-4f8cf1da83f4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.500436 Oct 25 03:21:42.977048 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2146/4113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:42 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:43.826847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:43.828533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:43.848850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:43.856983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:43.857606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:43.858774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:43.867277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:43.877541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:44.008106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:44.009490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:44.029911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:44.031722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:44.032342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:44.033558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:44.035968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:44.037139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:45.369195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:45.384310 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3bf9a626-d74d-4154-9689-2ea85c826ec6 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1573 microversion: 2.1 time: 1.558866 Oct 25 03:21:45.387875 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1968/4114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:43 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1573 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:45.736889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:45.775714 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-888e053a-1f74-4b76-9290-9d34a9caf3b1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 1.774015 Oct 25 03:21:45.776318 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2147/4115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:43 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:46.410420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:46.411769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:46.428411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:46.432328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:46.432829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:46.433593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:46.434108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:46.434548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:46.824584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:46.825110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:46.841927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:46.842427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:46.842898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:46.846908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:46.848864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:46.850969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:46.896936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:47.122331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:47.143010 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5824827f-99d4-4b9c-8097-f5e657bac3ce tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1571 microversion: 2.1 time: 0.737294 Oct 25 03:21:47.158940 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1969/4116] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:46 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1571 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:47.172347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1458616858"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:47.175264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:47.203208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:47.204007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:47.204644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:47.205580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:47.206235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:47.206852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:47.391275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:47.432662 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f28c4088-a50c-4ce0-b8a2-c7463f904972 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1504 microversion: 2.1 time: 0.606787 Oct 25 03:21:47.442908 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2148/4117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:46 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:47.887065 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.network.security_group_api [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Adding security group 40c18e92-70d6-42f6-b9a1-14c72181f96b to port 55565700-2c28-40b1-b99c-9117c4947dab Oct 25 03:21:48.463246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:48.463835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:48.480984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:48.482124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:48.484326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:48.485280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:48.488096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:48.489004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:48.718440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:48.730683 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a2b939b1-5c09-4691-a66a-ea5c92d5c40f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1504 microversion: 2.1 time: 0.270734 Oct 25 03:21:48.732021 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2149/4118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:48 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:49.002882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d55987d-fe3f-4d12-99a8-6257ab12d69a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f/action" status: 202 len: 0 microversion: 2.1 time: 1.836015 Oct 25 03:21:49.012949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25aec681-271d-40c3-aeb4-9196c5d07c34 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd33602160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:49.013523 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1970/4119] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:21:47 2022] POST /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f/action => generated 0 bytes in 1847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:49.088310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-5dfc30c0-a1a7-4e9f-bd6f-fd4e4530712a req-b35e2d2f-8098-46cd-885b-e6d2fd7eeb36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c88c79-876f-4840-910b-79d206f3f12f", "tag": "55565700-2c28-40b1-b99c-9117c4947dab"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:49.109616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5dfc30c0-a1a7-4e9f-bd6f-fd4e4530712a req-b35e2d2f-8098-46cd-885b-e6d2fd7eeb36 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:49.112400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5dfc30c0-a1a7-4e9f-bd6f-fd4e4530712a req-b35e2d2f-8098-46cd-885b-e6d2fd7eeb36 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:49.114236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5dfc30c0-a1a7-4e9f-bd6f-fd4e4530712a req-b35e2d2f-8098-46cd-885b-e6d2fd7eeb36 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:49.154098 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-5dfc30c0-a1a7-4e9f-bd6f-fd4e4530712a req-b35e2d2f-8098-46cd-885b-e6d2fd7eeb36 service nova] Creating event network-changed:55565700-2c28-40b1-b99c-9117c4947dab for instance 90c88c79-876f-4840-910b-79d206f3f12f on n-h1-862355-1 Oct 25 03:21:49.167218 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-5dfc30c0-a1a7-4e9f-bd6f-fd4e4530712a req-b35e2d2f-8098-46cd-885b-e6d2fd7eeb36 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081265 Oct 25 03:21:49.169735 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1971/4120] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:21:49.290110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-25aec681-271d-40c3-aeb4-9196c5d07c34 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use.", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:49.290937 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-25aec681-271d-40c3-aeb4-9196c5d07c34 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use. Oct 25 03:21:49.290937 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-6c7a3d20-1363-4216-be9a-9ad56e0717d9'] Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25aec681-271d-40c3-aeb4-9196c5d07c34 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b HTTP/1.1 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: exception: Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use. Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-6c7a3d20-1363-4216-be9a-9ad56e0717d9'] Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '40c18e92-70d6-42f6-b9a1-14c72181f96b'} Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:49.293263 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use. Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7a3d20-1363-4216-be9a-9ad56e0717d9'] Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use. Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7a3d20-1363-4216-be9a-9ad56e0717d9'] Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use. Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7a3d20-1363-4216-be9a-9ad56e0717d9'] Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use. Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c7a3d20-1363-4216-be9a-9ad56e0717d9'] Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25aec681-271d-40c3-aeb4-9196c5d07c34 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 400 to user: Security Group 40c18e92-70d6-42f6-b9a1-14c72181f96b in use. Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-6c7a3d20-1363-4216-be9a-9ad56e0717d9'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:49.297927 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-25aec681-271d-40c3-aeb4-9196c5d07c34 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b" status: 400 len: 185 microversion: 2.1 time: 0.286489 Oct 25 03:21:49.306448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:49.307080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:49.309026 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2150/4121] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:49 2022] DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b => generated 185 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:21:49.317977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:49.318488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:49.318937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:49.319660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:49.320124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:49.320560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:49.400266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:21:49.644922 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf09f8c9-d847-426a-8d21-ebade204610c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 204 len: 0 microversion: 2.1 time: 0.342724 Oct 25 03:21:49.645798 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1972/4122] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:21:49 2022] DELETE /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:21:49.656664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:49.657440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:49.692395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:49.692888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:49.693324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:49.694112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:49.694571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:49.705516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:49.759590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:49.760635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:49.785925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:49.792026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:49.792714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:49.796093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:49.803142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:49.805251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:50.306075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:50.312458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:50.317719 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f075f78-7858-4459-b9d7-8002c0d15d80 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 200 len: 1507 microversion: 2.1 time: 0.562955 Oct 25 03:21:50.321353 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1973/4123] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:49 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:50.329549 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-553d2998-b2d6-468f-b98e-cbb3929e9664 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1646 microversion: 2.1 time: 0.679019 Oct 25 03:21:50.344536 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2151/4124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:49 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1646 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:50.347063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:50.348960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:50.369001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:50.370027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:50.370818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:50.375302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:50.375949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:50.377068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:50.788319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:50.811101 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0679d1ae-b62c-49ea-8fc1-eb500f3b376a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.471123 Oct 25 03:21:50.811720 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1974/4125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:50 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:50.845865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:50.846502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:50.858570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:50.859113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:50.860714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:50.861485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:50.868394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:50.868957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:51.360747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:51.362016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:51.380161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:51.384202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:51.387930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:51.388921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:51.393616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:51.394333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:51.753986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:51.777314 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-febe9e7c-c31b-4808-844e-e37c3d09c55a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.933519 Oct 25 03:21:51.793703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2152/4126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:50 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:51.813869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4f2c4861-0368-4723-b3b8-7eedb075f199 req-96107b07-ac4f-4615-af54-0b5971b45161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00b5417-31ea-4ec1-97b9-a427e4eab36e", "name": "network-vif-unplugged", "status": "completed", "tag": "173ba40e-4c1c-45c7-a711-3afcb55b92d1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:51.870511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4f2c4861-0368-4723-b3b8-7eedb075f199 req-96107b07-ac4f-4615-af54-0b5971b45161 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:51.871204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4f2c4861-0368-4723-b3b8-7eedb075f199 req-96107b07-ac4f-4615-af54-0b5971b45161 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:51.871926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4f2c4861-0368-4723-b3b8-7eedb075f199 req-96107b07-ac4f-4615-af54-0b5971b45161 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:51.895395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_external_events [req-4f2c4861-0368-4723-b3b8-7eedb075f199 req-96107b07-ac4f-4615-af54-0b5971b45161 service nova] Unable to find a host for instance f00b5417-31ea-4ec1-97b9-a427e4eab36e. Dropping event network-vif-unplugged {{(pid=120562) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 25 03:21:51.899186 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4f2c4861-0368-4723-b3b8-7eedb075f199 req-96107b07-ac4f-4615-af54-0b5971b45161 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.112392 Oct 25 03:21:51.905530 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2153/4127] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 125 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 25 03:21:51.932540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:51.937002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:51.951995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:51.955213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:51.957952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:51.959613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:51.960500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:51.962240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:52.288569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:52.298006 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-134afaa8-360c-4466-9577-f12520d7501b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1646 microversion: 2.1 time: 0.942684 Oct 25 03:21:52.299251 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1975/4128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:51 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1646 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:52.411494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:52.438850 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f7be88f9-fd1c-4580-aeac-29db7ee02bf9 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.531720 Oct 25 03:21:52.440525 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2154/4129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:51 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:52.487284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:52.488052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:52.534120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:52.534120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:52.534120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:52.534120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:52.534120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:52.534120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.028382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:53.043550 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db1d3e01-74e7-4fd7-8d6e-d520543a0d9a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.584758 Oct 25 03:21:53.047859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1976/4130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:52 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:53.075157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ab0e399-0383-42f1-9dd1-5a85b1b41a3d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:53.084443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab0e399-0383-42f1-9dd1-5a85b1b41a3d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:53.085174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab0e399-0383-42f1-9dd1-5a85b1b41a3d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:53.086283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ab0e399-0383-42f1-9dd1-5a85b1b41a3d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.119165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ab0e399-0383-42f1-9dd1-5a85b1b41a3d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Going to try to stop instance {{(pid=120563) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:21:53.214823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3060ce37-68e0-4e5a-b9ab-e8201744c944 req-be12d6b6-276d-4513-b63b-ba5e4ec4020e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c88c79-876f-4840-910b-79d206f3f12f", "name": "network-vif-deleted", "tag": "55565700-2c28-40b1-b99c-9117c4947dab"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:53.240395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ab0e399-0383-42f1-9dd1-5a85b1b41a3d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.172610 Oct 25 03:21:53.243249 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1977/4131] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:21:53 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:21:53.255682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3060ce37-68e0-4e5a-b9ab-e8201744c944 req-be12d6b6-276d-4513-b63b-ba5e4ec4020e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:53.256395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3060ce37-68e0-4e5a-b9ab-e8201744c944 req-be12d6b6-276d-4513-b63b-ba5e4ec4020e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:53.256778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3060ce37-68e0-4e5a-b9ab-e8201744c944 req-be12d6b6-276d-4513-b63b-ba5e4ec4020e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.267471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:53.268368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:53.278933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:53.279529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:53.280938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.281888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:53.282430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:53.282998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.316494 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3060ce37-68e0-4e5a-b9ab-e8201744c944 req-be12d6b6-276d-4513-b63b-ba5e4ec4020e service nova] Creating event network-vif-deleted:55565700-2c28-40b1-b99c-9117c4947dab for instance 90c88c79-876f-4840-910b-79d206f3f12f on n-h1-862355-1 Oct 25 03:21:53.347010 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3060ce37-68e0-4e5a-b9ab-e8201744c944 req-be12d6b6-276d-4513-b63b-ba5e4ec4020e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.523202 Oct 25 03:21:53.349857 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2155/4132] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:53.362427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:53.367149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:53.385483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:53.387656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:53.388305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.391745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:53.392469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:53.394192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.510726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:53.513907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:53.514488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:53.515031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lazy-loading 'fault' on Instance uuid 90c88c79-876f-4840-910b-79d206f3f12f {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:21:53.568947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:53.576006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:53.579469 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58a324c1-1b2c-4b1c-a048-4ad2f2fddc47 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.319988 Oct 25 03:21:53.580359 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1978/4133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:53 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:53.629154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:53.644057 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f6c6414-a553-4e8e-b896-e8dd7b24988e tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 200 len: 1305 microversion: 2.1 time: 0.292382 Oct 25 03:21:53.645049 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2156/4134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:53 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 1305 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:54.345268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb6c555a-b297-466c-916e-6e2f4ca6f201 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Action: 'create', calling method: .version_select at 0x7efd328b3a60>, body: {"keypair": {"name": "tempest-keypair-1615527042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyzRGuy9ly+znGqoXeeTZgmLOWCY3uLWY4RKLNMcCTrrO5FU74X4bGwQa76cLdAHfnvNtFSpEb6h8zAyJb1gEAhhm3CaANeqobC6GzFK7muhwP+jYKhdJbBhoLcP7tBOQ=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:54.370351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-cb6c555a-b297-466c-916e-6e2f4ca6f201 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Getting quotas for project 52361f866854468785ec2bb9b1b8b6d6. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:21:54.376903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-cb6c555a-b297-466c-916e-6e2f4ca6f201 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Getting quotas for user 4c42efa78e864c56aba0ede0b2461fa8 and project 52361f866854468785ec2bb9b1b8b6d6. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:21:54.404212 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb6c555a-b297-466c-916e-6e2f4ca6f201 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188759 Oct 25 03:21:54.405080 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1979/4135] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:21:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:54.605616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:54.627181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:54.663272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:54.665101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:54.666007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:54.668353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:54.674645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:54.675145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:54.675274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:54.676542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:54.696011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:54.696531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:54.696979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:54.697725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:54.698286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:54.698723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:54.723440 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f HTTP/1.1 Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '90c88c79-876f-4840-910b-79d206f3f12f'} Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:54.726684 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:54.732141 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:54.732141 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:54.732141 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:54.732141 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:54.732141 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:54.732141 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:54.732141 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:54.735589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:54.736774 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dde9f720-bd8b-4107-9c03-899be67ded02 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 404 len: 111 microversion: 2.1 time: 0.067657 Oct 25 03:21:54.737969 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1980/4136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:54 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:21:54.746660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b6efd84b-0a79-438e-b8d6-3cb89ac7ff10 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3b744040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:55.027787 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b6efd84b-0a79-438e-b8d6-3cb89ac7ff10 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01" status: 202 len: 0 microversion: 2.1 time: 0.285067 Oct 25 03:21:55.028574 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1981/4137] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:54 2022] DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:21:55.038768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-38c44ed8-fec5-476e-b309-1fc7ccf74f0a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3b8864c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:55.297548 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-38c44ed8-fec5-476e-b309-1fc7ccf74f0a tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b" status: 202 len: 0 microversion: 2.1 time: 0.263741 Oct 25 03:21:55.298326 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1982/4138] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:55 2022] DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:55.314932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0115f21-a7aa-4303-8434-3b78525d6862 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'create', calling method: .version_select at 0x7efd328574c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1413298302", "description": "tempest-description-1630547338"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:55.389061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:55.400428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-335d782e-6e05-437a-97fd-2a4de1261b5b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.797342 Oct 25 03:21:55.404468 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2157/4139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:54 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:55.803289 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0115f21-a7aa-4303-8434-3b78525d6862 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.492830 Oct 25 03:21:55.804767 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1983/4140] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:21:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:55.817488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2159fe0d-5d78-4b33-b226-128f0dfa3c7f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Action: 'update', calling method: .version_select at 0x7efd33ed7670>, body: {"security_group": {"name": "tempest-sg-hth-1626323082", "description": "tempest-description-hth-450656421"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:56.313361 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2159fe0d-5d78-4b33-b226-128f0dfa3c7f tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/e7bc3f1d-b2d6-4883-a029-78cf720c5997" status: 200 len: 217 microversion: 2.1 time: 0.499665 Oct 25 03:21:56.314585 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2158/4141] 10.222.0.36 () {60 vars in 1290 bytes} [Tue Oct 25 03:21:55 2022] PUT /compute/v2.1/os-security-groups/e7bc3f1d-b2d6-4883-a029-78cf720c5997 => generated 217 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:56.330059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-335b9e75-8be8-4be6-bfb3-3c9ccf817de5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3b744940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:56.430472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:56.431896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:56.451220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:56.452456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:56.452931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:56.453657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:56.456779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:56.457235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:56.537877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-335b9e75-8be8-4be6-bfb3-3c9ccf817de5 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/e7bc3f1d-b2d6-4883-a029-78cf720c5997" status: 200 len: 217 microversion: 2.1 time: 0.212336 Oct 25 03:21:56.538350 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1984/4142] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:21:56 2022] GET /compute/v2.1/os-security-groups/e7bc3f1d-b2d6-4883-a029-78cf720c5997 => generated 217 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:21:56.559837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3aad2d1-0211-4730-a5cc-9c0f05f8a27d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd334f3670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:56.767839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:56.782863 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-281eedda-20ed-4e2a-9a0b-b6dfebe757c5 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.355649 Oct 25 03:21:56.788700 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2159/4143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:56 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:57.460329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3aad2d1-0211-4730-a5cc-9c0f05f8a27d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e7bc3f1d-b2d6-4883-a029-78cf720c5997" status: 202 len: 0 microversion: 2.1 time: 0.904884 Oct 25 03:21:57.462643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1985/4144] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:56 2022] DELETE /compute/v2.1/os-security-groups/e7bc3f1d-b2d6-4883-a029-78cf720c5997 => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:21:57.472708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:57.473305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:57.486921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:57.487448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:57.487898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:57.488627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:57.489085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:57.489516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:57.525314 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f HTTP/1.1 Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '90c88c79-876f-4840-910b-79d206f3f12f'} Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:21:57.527233 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.532504 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.534467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:57.535501 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-02da0069-4d77-4bc2-9acd-e6210f456ba8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 404 len: 111 microversion: 2.1 time: 0.067075 Oct 25 03:21:57.536259 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2160/4145] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:21:57 2022] DELETE /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:57.546692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:57.547314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 90c88c79-876f-4840-910b-79d206f3f12f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:57.579026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:57.579639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:57.584680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:57.586096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:57.586602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:57.587053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:57.629407 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f HTTP/1.1 Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '90c88c79-876f-4840-910b-79d206f3f12f'} Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.631536 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Instance 90c88c79-876f-4840-910b-79d206f3f12f could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:57.636639 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bec008cb-3093-4e25-abdd-9b569f8329e3 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f" status: 404 len: 111 microversion: 2.1 time: 0.092155 Oct 25 03:21:57.642713 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1986/4146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:57 2022] GET /compute/v2.1/servers/90c88c79-876f-4840-910b-79d206f3f12f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:57.643251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28768359-b512-4e4e-8fac-facfcc08500b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd32d4b3a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:57.741156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-28768359-b512-4e4e-8fac-facfcc08500b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:57.741156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.security_group_api [None req-28768359-b512-4e4e-8fac-facfcc08500b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group 40c18e92-70d6-42f6-b9a1-14c72181f96b not found {{(pid=120562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:57.741156 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-28768359-b512-4e4e-8fac-facfcc08500b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist Oct 25 03:21:57.741156 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-b6bd5ec4-1964-415d-b207-2eb87b04a2c0'] Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28768359-b512-4e4e-8fac-facfcc08500b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b HTTP/1.1 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: exception: Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-b6bd5ec4-1964-415d-b207-2eb87b04a2c0'] Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '40c18e92-70d6-42f6-b9a1-14c72181f96b'} Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:57.743189 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6bd5ec4-1964-415d-b207-2eb87b04a2c0'] Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6bd5ec4-1964-415d-b207-2eb87b04a2c0'] Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6bd5ec4-1964-415d-b207-2eb87b04a2c0'] Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6bd5ec4-1964-415d-b207-2eb87b04a2c0'] Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28768359-b512-4e4e-8fac-facfcc08500b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group 40c18e92-70d6-42f6-b9a1-14c72181f96b does not exist Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-b6bd5ec4-1964-415d-b207-2eb87b04a2c0'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28768359-b512-4e4e-8fac-facfcc08500b tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b" status: 404 len: 194 microversion: 2.1 time: 0.105826 Oct 25 03:21:57.747588 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2161/4147] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:57 2022] DELETE /compute/v2.1/os-security-groups/40c18e92-70d6-42f6-b9a1-14c72181f96b => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:57.756890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-261da26f-ea2d-4f67-b230-65ef3ba68343 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd334f3ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:57.808699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:57.809319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:57.829593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:57.831329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:57.835578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:57.836558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:57.837183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:57.837618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:57.913046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-261da26f-ea2d-4f67-b230-65ef3ba68343 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:57.913659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-261da26f-ea2d-4f67-b230-65ef3ba68343 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group bb7804c6-3110-4316-a99b-5edb6ddeba01 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:57.914425 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-261da26f-ea2d-4f67-b230-65ef3ba68343 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist Oct 25 03:21:57.914425 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-a9929d34-95d5-4421-8e8c-4fd2e85f1a2f'] Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-261da26f-ea2d-4f67-b230-65ef3ba68343 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01 HTTP/1.1 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-a9929d34-95d5-4421-8e8c-4fd2e85f1a2f'] Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'bb7804c6-3110-4316-a99b-5edb6ddeba01'} Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:57.916554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9929d34-95d5-4421-8e8c-4fd2e85f1a2f'] Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9929d34-95d5-4421-8e8c-4fd2e85f1a2f'] Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9929d34-95d5-4421-8e8c-4fd2e85f1a2f'] Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9929d34-95d5-4421-8e8c-4fd2e85f1a2f'] Oct 25 03:21:57.921866 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:57.926262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-261da26f-ea2d-4f67-b230-65ef3ba68343 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group bb7804c6-3110-4316-a99b-5edb6ddeba01 does not exist Oct 25 03:21:57.926262 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-a9929d34-95d5-4421-8e8c-4fd2e85f1a2f'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:57.927427 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-261da26f-ea2d-4f67-b230-65ef3ba68343 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01" status: 404 len: 194 microversion: 2.1 time: 0.178169 Oct 25 03:21:57.928201 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1987/4148] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:57 2022] DELETE /compute/v2.1/os-security-groups/bb7804c6-3110-4316-a99b-5edb6ddeba01 => generated 194 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:57.944213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96223f15-bdfa-4ac9-886f-c17a515ca45c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3b734430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:58.022162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-96223f15-bdfa-4ac9-886f-c17a515ca45c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:58.023092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-96223f15-bdfa-4ac9-886f-c17a515ca45c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group 74dceb18-d025-4507-89b6-821e39340575 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:58.023832 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-96223f15-bdfa-4ac9-886f-c17a515ca45c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:58.023832 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-511b845e-617d-4cd3-8e1f-83188258f0b9'] Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96223f15-bdfa-4ac9-886f-c17a515ca45c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575 HTTP/1.1 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-511b845e-617d-4cd3-8e1f-83188258f0b9'] Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '74dceb18-d025-4507-89b6-821e39340575'} Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:58.029173 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-511b845e-617d-4cd3-8e1f-83188258f0b9'] Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-511b845e-617d-4cd3-8e1f-83188258f0b9'] Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-511b845e-617d-4cd3-8e1f-83188258f0b9'] Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-511b845e-617d-4cd3-8e1f-83188258f0b9'] Oct 25 03:21:58.036072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.042622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96223f15-bdfa-4ac9-886f-c17a515ca45c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group 74dceb18-d025-4507-89b6-821e39340575 does not exist Oct 25 03:21:58.042622 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-511b845e-617d-4cd3-8e1f-83188258f0b9'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:58.044512 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96223f15-bdfa-4ac9-886f-c17a515ca45c tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575" status: 404 len: 194 microversion: 2.1 time: 0.109903 Oct 25 03:21:58.046928 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1988/4149] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:57 2022] DELETE /compute/v2.1/os-security-groups/74dceb18-d025-4507-89b6-821e39340575 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:58.066302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a338a2b8-bcee-41e3-8f39-23ff5b46b253 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3b734790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:58.152028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-a338a2b8-bcee-41e3-8f39-23ff5b46b253 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:58.152893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-a338a2b8-bcee-41e3-8f39-23ff5b46b253 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:58.153648 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a338a2b8-bcee-41e3-8f39-23ff5b46b253 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:58.153648 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-d71d08d2-1b56-4e9c-b9ae-e8e5498b1b4e'] Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a338a2b8-bcee-41e3-8f39-23ff5b46b253 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51 HTTP/1.1 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-d71d08d2-1b56-4e9c-b9ae-e8e5498b1b4e'] Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e94e70e9-95d9-49b0-baa7-11ec9a56fb51'} Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:58.156785 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d08d2-1b56-4e9c-b9ae-e8e5498b1b4e'] Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d08d2-1b56-4e9c-b9ae-e8e5498b1b4e'] Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d08d2-1b56-4e9c-b9ae-e8e5498b1b4e'] Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d08d2-1b56-4e9c-b9ae-e8e5498b1b4e'] Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a338a2b8-bcee-41e3-8f39-23ff5b46b253 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group e94e70e9-95d9-49b0-baa7-11ec9a56fb51 does not exist Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-d71d08d2-1b56-4e9c-b9ae-e8e5498b1b4e'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a338a2b8-bcee-41e3-8f39-23ff5b46b253 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51" status: 404 len: 194 microversion: 2.1 time: 0.105221 Oct 25 03:21:58.161321 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1989/4150] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:58 2022] DELETE /compute/v2.1/os-security-groups/e94e70e9-95d9-49b0-baa7-11ec9a56fb51 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:58.172003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-26a1aa1b-2150-4a0b-82c3-e3d2aca155c4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd329373a0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:58.245562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-26a1aa1b-2150-4a0b-82c3-e3d2aca155c4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:58.246222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-26a1aa1b-2150-4a0b-82c3-e3d2aca155c4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group 51f7098f-7340-47f8-b041-46e5cc2fd836 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:58.246754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-26a1aa1b-2150-4a0b-82c3-e3d2aca155c4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:58.246754 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-9d85d2e8-1d2e-4e53-896f-e557e9819c52'] Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-26a1aa1b-2150-4a0b-82c3-e3d2aca155c4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836 HTTP/1.1 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-9d85d2e8-1d2e-4e53-896f-e557e9819c52'] Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '51f7098f-7340-47f8-b041-46e5cc2fd836'} Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:58.249671 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d85d2e8-1d2e-4e53-896f-e557e9819c52'] Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d85d2e8-1d2e-4e53-896f-e557e9819c52'] Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d85d2e8-1d2e-4e53-896f-e557e9819c52'] Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d85d2e8-1d2e-4e53-896f-e557e9819c52'] Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-26a1aa1b-2150-4a0b-82c3-e3d2aca155c4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group 51f7098f-7340-47f8-b041-46e5cc2fd836 does not exist Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-9d85d2e8-1d2e-4e53-896f-e557e9819c52'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:58.253931 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-26a1aa1b-2150-4a0b-82c3-e3d2aca155c4 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836" status: 404 len: 194 microversion: 2.1 time: 0.087343 Oct 25 03:21:58.258180 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1990/4151] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:58 2022] DELETE /compute/v2.1/os-security-groups/51f7098f-7340-47f8-b041-46e5cc2fd836 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:58.261308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1627aec8-904e-4bd5-955a-3173d03b6222 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3b734790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:58.386208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-1627aec8-904e-4bd5-955a-3173d03b6222 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:21:58.387252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-1627aec8-904e-4bd5-955a-3173d03b6222 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Neutron security group 36757b25-fbb6-404e-9ec8-c72602e3d894 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:21:58.388031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-1627aec8-904e-4bd5-955a-3173d03b6222 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:58.388031 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-71b24f41-941c-411e-b3db-0da8522ab99f'] Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1627aec8-904e-4bd5-955a-3173d03b6222 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894 HTTP/1.1 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-71b24f41-941c-411e-b3db-0da8522ab99f'] Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '36757b25-fbb6-404e-9ec8-c72602e3d894'} Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:21:58.392404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b24f41-941c-411e-b3db-0da8522ab99f'] Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b24f41-941c-411e-b3db-0da8522ab99f'] Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b24f41-941c-411e-b3db-0da8522ab99f'] Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71b24f41-941c-411e-b3db-0da8522ab99f'] Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1627aec8-904e-4bd5-955a-3173d03b6222 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Security group 36757b25-fbb6-404e-9ec8-c72602e3d894 does not exist Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-71b24f41-941c-411e-b3db-0da8522ab99f'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:21:58.396665 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1627aec8-904e-4bd5-955a-3173d03b6222 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894" status: 404 len: 194 microversion: 2.1 time: 0.137528 Oct 25 03:21:58.400348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1991/4152] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:21:58 2022] DELETE /compute/v2.1/os-security-groups/36757b25-fbb6-404e-9ec8-c72602e3d894 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:21:58.410350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:58.421817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:58.441226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:58.445225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:58.449912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:58.450397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:58.451064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:58.454931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:58.459504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:58.470496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a49789ed-d799-4309-9b77-3cd986a8e256 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.665560 Oct 25 03:21:58.472289 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2162/4153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:57 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:21:58.516168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:21:58.744345 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d21ae7da-8f85-40af-bc79-6cad8feee38d tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 204 len: 0 microversion: 2.1 time: 0.342756 Oct 25 03:21:58.744998 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1992/4154] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:21:58 2022] DELETE /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:21:58.757515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:58.758799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:58.769207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=56 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:21:58.771563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:58.773399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:58.774766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:58.776575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:58.777310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:58.778003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:59.054551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1633311185", "imageRef": "f4671e64-7063-4859-8b2f-1b9a81cb81cc", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a54fa47e-392e-48e9-9510-623215165b2a"}], "security_groups": [{"name": "tempest-securitygroup--1508879835"}], "key_name": "tempest-keypair-1615527042", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:21:59.130505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:59.149311 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f7eb36c-8101-4cf7-b6c0-561bb6b2e452 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1648 microversion: 2.1 time: 0.398712 Oct 25 03:21:59.150690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2163/4155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:58 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1648 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:21:59.357287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] validate_networks() for [('a54fa47e-392e-48e9-9510-623215165b2a', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:21:59.496471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:21:59.497367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:21:59.539336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:59.539798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:59.540409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:59.541296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:21:59.541943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:21:59.542553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:21:59.851938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:21:59.864656 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2c32102-0ce3-4f01-9384-8ba878fdfdd0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.371951 Oct 25 03:21:59.886726 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2164/4156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:21:59 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:00.160518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:22:00.161005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:22:00.161414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:22:00.161924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:22:00.162377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:22:00.174905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:00.176192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:00.179700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:00.180486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:00.181582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:00.182348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:00.183077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:00.183519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:00.184246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:00.185139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:00.185428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:00.186224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:00.186703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:00.187190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:00.219810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Getting quotas for project 52361f866854468785ec2bb9b1b8b6d6. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:22:00.226569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Getting quotas for user 4c42efa78e864c56aba0ede0b2461fa8 and project 52361f866854468785ec2bb9b1b8b6d6. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:22:00.240823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:22:00.243467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4671e64-7063-4859-8b2f-1b9a81cb81cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:22:00.348428 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1979715-1a0a-47e7-8e3b-4fb98b57ad3e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.298076 Oct 25 03:22:00.355557 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1993/4157] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:21:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:22:00.361765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f319a70f-e726-4f81-be6d-0d09e60e4577 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:00.362421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f319a70f-e726-4f81-be6d-0d09e60e4577 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:00.551103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f319a70f-e726-4f81-be6d-0d09e60e4577 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:00.566908 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f319a70f-e726-4f81-be6d-0d09e60e4577 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1246 microversion: 2.1 time: 0.210109 Oct 25 03:22:00.570026 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1994/4158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:00 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1246 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:00.637730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:00.651763 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-247fb0ab-0667-413b-9cc9-9601689bf652 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1648 microversion: 2.1 time: 0.482043 Oct 25 03:22:00.653485 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2165/4159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:00 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1648 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:00.773986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1161061758", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:00.899253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:00.901511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:00.902295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] validate_networks() for [('425bd5a2-15f9-420d-af21-39cc92c0f832', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:22:00.934773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:00.935287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:00.935724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:00.937071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:00.937531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:00.948698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:01.508161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:01.517041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93cab0ca-f41b-410b-bdba-c5bd7b8f9800 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.629114 Oct 25 03:22:01.524881 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2166/4160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:00 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:01.594699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:01.596831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:01.611059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:01.611558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:01.612038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:01.612759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:01.613215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:01.613832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:01.861311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:01.885051 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-04095aa3-c417-4ff6-a867-3be634e72847 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1242 microversion: 2.1 time: 0.292514 Oct 25 03:22:01.890513 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2167/4161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:01 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:01.909151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:01.910882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:01.920446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:01.922940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:01.924078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:01.927045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:01.928288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:01.929193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:02.094129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:02.094560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:02.095278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:02.095443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lazy-loading 'fault' on Instance uuid 88194da6-151a-4ee4-8d15-788a84904e5e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:22:02.215304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36a1bb95e3c4143909870897aef02fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873bdebcdf0243d4a538c50ee6398fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:02.224895 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-012cb0e9-84be-4af2-ab13-682a15c832b7 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 200 len: 1306 microversion: 2.1 time: 0.332970 Oct 25 03:22:02.225494 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2168/4162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:01 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 1306 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:02.245643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-716efb60-29a6-4cdf-9b92-769b5aa4690b req-3e96e251-f143-48a7-9b27-fdaec8b0dbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88194da6-151a-4ee4-8d15-788a84904e5e", "name": "network-vif-deleted", "tag": "664e995d-32d3-44de-82f5-0fd6ff9564b9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:02.282546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-716efb60-29a6-4cdf-9b92-769b5aa4690b req-3e96e251-f143-48a7-9b27-fdaec8b0dbca service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:02.286442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-716efb60-29a6-4cdf-9b92-769b5aa4690b req-3e96e251-f143-48a7-9b27-fdaec8b0dbca service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:02.287103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-716efb60-29a6-4cdf-9b92-769b5aa4690b req-3e96e251-f143-48a7-9b27-fdaec8b0dbca service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:02.336502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-716efb60-29a6-4cdf-9b92-769b5aa4690b req-3e96e251-f143-48a7-9b27-fdaec8b0dbca service nova] Creating event network-vif-deleted:664e995d-32d3-44de-82f5-0fd6ff9564b9 for instance 88194da6-151a-4ee4-8d15-788a84904e5e on n-h1-862355-1 Oct 25 03:22:02.356586 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-716efb60-29a6-4cdf-9b92-769b5aa4690b req-3e96e251-f143-48a7-9b27-fdaec8b0dbca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122626 Oct 25 03:22:02.357767 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2169/4163] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:02.543136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:02.543869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:02.552785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:02.553281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:02.557306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:02.580431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:02.581159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:02.581620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:02.609634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:03.105607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:22:03.106111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:22:03.106583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:22:03.107009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:22:03.107407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:22:03.136916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:03.137413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:03.137900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:03.138637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:03.139627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:03.140055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:03.172044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Getting quotas for project 03266c4fa04c4baf8cb148f9af4751fe. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:22:03.179859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Getting quotas for user 593f6a2ef5f34326afe8fe9addabc75d and project 03266c4fa04c4baf8cb148f9af4751fe. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:22:03.198526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:22:03.200853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:22:03.248157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:03.257122 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e12135db-c780-49d5-8dce-e5784c9cee13 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1678 microversion: 2.1 time: 0.719409 Oct 25 03:22:03.260876 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2170/4164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:02 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1678 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:03.268704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:03.269220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:03.292801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:03.293596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:03.294235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:03.295190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:03.295913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:03.296717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:03.346887 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-024ec3b8-39da-4901-8395-59ff3d8cad72 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.672615 Oct 25 03:22:03.351039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1995/4165] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:22:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:22:03.363864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:03.364775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] [instance: 88194da6-151a-4ee4-8d15-788a84904e5e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:03.410591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:03.411639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:03.412292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:03.426461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:03.429592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:03.431449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:03.464501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:03.474488 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] HTTP exception thrown: Instance 88194da6-151a-4ee4-8d15-788a84904e5e could not be found. Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Request method failure captured: Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e HTTP/1.1 Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YBa5xDpxkdl-CL-KFszhrMIBjEFh0JbKkogtTCvkHkzo6-vT-E6C6E0IjUe6QPW4JumQfOw4uRwUceyaxQru1Iadr9Lf8jwqyKjMP1Ajl5ebuNVbFOUSVTEnGw7bSoxp6xdKEIGVR3xBxFj465b0n7eSZZe-TproEI6N1C0E93QLI Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/873bdebcdf0243d4a538c50ee6398fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_873bdebcdf0243d4a538c50ee6398fac", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/873bdebcdf0243d4a538c50ee6398fac"}]}] Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 873bdebcdf0243d4a538c50ee6398fac Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-932482294 Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c36a1bb95e3c4143909870897aef02fc Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsTestJSON-932482294-project Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 88194da6-151a-4ee4-8d15-788a84904e5e could not be found. Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '88194da6-151a-4ee4-8d15-788a84904e5e'} Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88194da6-151a-4ee4-8d15-788a84904e5e could not be found. Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88194da6-151a-4ee4-8d15-788a84904e5e could not be found. Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:03.476199 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:03.480670 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:03.480670 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:03.480670 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:03.480670 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:03.480670 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:03.480670 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88194da6-151a-4ee4-8d15-788a84904e5e could not be found. Oct 25 03:22:03.480670 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:03.483223 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28434202-4f67-45ff-8c58-4ba711883251 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1304 microversion: 2.1 time: 0.219836 Oct 25 03:22:03.486209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Returning 404 to user: Instance 88194da6-151a-4ee4-8d15-788a84904e5e could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:03.487582 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19d99772-05ae-4599-9960-4a7d60b4b6ae tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e" status: 404 len: 111 microversion: 2.1 time: 0.128223 Oct 25 03:22:03.488635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1996/4166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:03 2022] GET /compute/v2.1/servers/88194da6-151a-4ee4-8d15-788a84904e5e => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:22:03.501113 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2171/4167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:03 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1304 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:03.503068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ecfe774f-8bb9-4eaf-b390-82f1c751d454 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:03.504106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ecfe774f-8bb9-4eaf-b390-82f1c751d454 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:03.514909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-005e73c2-7bcf-473f-9182-8a7a4d81d2a8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd32d63550>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:03.646120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ecfe774f-8bb9-4eaf-b390-82f1c751d454 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:03.673320 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ecfe774f-8bb9-4eaf-b390-82f1c751d454 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1214 microversion: 2.1 time: 0.182279 Oct 25 03:22:03.693164 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1997/4168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:03 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:04.289196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:04.291994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:04.301401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:04.303710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:04.304403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:04.305069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:04.306062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:04.306890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:04.307988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:04.692924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:04.709664 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9776ffa6-0a09-453c-9930-d7dd94361566 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1655 microversion: 2.1 time: 0.427775 Oct 25 03:22:04.710291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1998/4169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:04 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1655 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:04.761987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:04.764969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:04.782626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:04.784168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:04.785095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:04.788202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:04.788943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:04.803163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:04.975249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:04.993590 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f87c3dff-452b-44e4-8cd3-64fee2455227 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1304 microversion: 2.1 time: 0.259993 Oct 25 03:22:04.996341 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 1999/4170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:04 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1304 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:05.010099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:05.011107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:05.029138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:05.029814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:05.030904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:05.031667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:05.032133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:05.037425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:05.182980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:05.205776 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07ac6441-a664-4844-b83d-4ae2e3292c7f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1266 microversion: 2.1 time: 0.204154 Oct 25 03:22:05.206342 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2000/4171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:04 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:05.223530 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-005e73c2-7bcf-473f-9182-8a7a4d81d2a8 tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/21c632b4-35b8-4b75-8ffd-4353b5444cfd" status: 202 len: 0 microversion: 2.1 time: 1.721186 Oct 25 03:22:05.225365 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2172/4172] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:22:03 2022] DELETE /compute/v2.1/os-security-groups/21c632b4-35b8-4b75-8ffd-4353b5444cfd => generated 0 bytes in 1724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:22:05.234213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8fee4b4e-6351-4f3f-9298-1d1b676cf8fb tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] Calling method '.version_select at 0x7efd3386f8b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:05.256331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc3623e9-bd17-49c7-af0c-ac4e7b89a75a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:05.268437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3623e9-bd17-49c7-af0c-ac4e7b89a75a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:05.272831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3623e9-bd17-49c7-af0c-ac4e7b89a75a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:05.274115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc3623e9-bd17-49c7-af0c-ac4e7b89a75a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:05.331725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc3623e9-bd17-49c7-af0c-ac4e7b89a75a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Going to try to start instance {{(pid=120563) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 25 03:22:05.425710 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc3623e9-bd17-49c7-af0c-ac4e7b89a75a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.185644 Oct 25 03:22:05.432065 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2001/4173] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:22:05 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:22:05.439684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:05.440788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:05.458997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:05.459999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:05.461123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:05.462702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:05.463322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:05.463921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:05.879655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:05.891112 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8ee1e3f-9ca8-425b-a051-aaf96bdcf385 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1664 microversion: 2.1 time: 0.457408 Oct 25 03:22:05.894186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2002/4174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:05 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1664 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:06.021199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:06.022443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:06.037887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:06.039513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:06.039930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:06.044102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:06.046150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:06.048782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:06.250743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:06.262995 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06d33c1a-918a-4510-a2b6-f5b60c4a58eb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1304 microversion: 2.1 time: 0.244171 Oct 25 03:22:06.266156 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2003/4175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:06 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:06.276657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:06.277293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:06.293550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:06.294411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:06.296750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:06.297839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:06.298485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:06.300258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:06.530226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:06.553592 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b2ef965-ced6-4d43-847b-033b75ec10e4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1272 microversion: 2.1 time: 0.286195 Oct 25 03:22:06.560443 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2004/4176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:06 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:06.668901 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8fee4b4e-6351-4f3f-9298-1d1b676cf8fb tempest-SecurityGroupsTestJSON-932482294 tempest-SecurityGroupsTestJSON-932482294-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/96c178e5-a841-43de-95eb-ee228aaa949b" status: 202 len: 0 microversion: 2.1 time: 1.439343 Oct 25 03:22:06.674321 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2173/4177] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:22:05 2022] DELETE /compute/v2.1/os-security-groups/96c178e5-a841-43de-95eb-ee228aaa949b => generated 0 bytes in 1441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:22:06.921139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:06.921851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:06.930796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:06.945516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:06.947688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:06.949653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:06.950303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:06.952867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:07.297635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:07.298369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:07.323426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:07.325000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:07.325466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:07.330466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:07.330995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:07.333338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:08.142433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:08.154034 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c036b92-35c7-42c8-84b0-f33d7e7b179c tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.867135 Oct 25 03:22:08.161547 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2174/4178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:07 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:08.175450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:08.182675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:08.214685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:08.218112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:08.222456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:08.226770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:08.233411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:08.233979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:08.491023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:08.520268 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66ceb71a-034f-476e-8d1e-16e29e5bef6d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1664 microversion: 2.1 time: 1.603830 Oct 25 03:22:08.544320 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2005/4179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:06 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1664 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:09.136121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:09.159744 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa0234f9-9303-459c-b32f-66590d9f388b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.995958 Oct 25 03:22:09.161937 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2175/4180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:08 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:09.193527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:09.194336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:09.206724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:09.208205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:09.210136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:09.212662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:09.214214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:09.214677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:09.550570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:09.551514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:09.567715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:09.575634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:09.577207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:09.586360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:09.591672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:09.593185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:10.595292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:10.607068 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b7b42058-cc4f-4126-bf2e-1df62e70f974 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1664 microversion: 2.1 time: 1.060600 Oct 25 03:22:10.610049 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2176/4181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:09 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1664 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:10.621778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:10.625706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:10.647059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:10.650409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:10.651081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:10.652576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:10.654406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:10.657279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:10.787925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:10.818897 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b7d90e5b-06a1-432d-8834-e38e39dd9a43 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 1.636568 Oct 25 03:22:10.837798 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2006/4182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:09 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:11.645219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:11.648533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:11.677640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:11.678242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:11.681220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:11.684580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:11.692564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:11.698186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:11.816105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:11.832535 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db85021f-b61b-43d6-8827-d5e37838c8b4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 1.220749 Oct 25 03:22:11.834693 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2177/4183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:10 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:11.863587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:11.870660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:11.905718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:11.906357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:11.909958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:11.910889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:11.918794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:11.919282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:12.052409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:12.063633 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa9bc003-e95c-4b3d-acda-a73a6fedfb67 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.430461 Oct 25 03:22:12.065077 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2007/4184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:11 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:12.090125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:12.090752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:12.105018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:12.106048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:12.106674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:12.107922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:12.108612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:12.109222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:12.626483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:12.635990 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2a0927d-e6f8-4324-b1a9-9f62e935c557 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.789914 Oct 25 03:22:12.636642 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2178/4185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:11 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:12.675797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f916a3ca-92ce-4aeb-992a-2ae3cfe3b06c req-6de336d0-3e37-4f43-9f9c-05cbb6b767f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431c4120-65f4-47cc-937b-66e4719957ab", "tag": "38b546da-f2af-4a5c-82d8-3f29f92a44ff"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:12.695408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f916a3ca-92ce-4aeb-992a-2ae3cfe3b06c req-6de336d0-3e37-4f43-9f9c-05cbb6b767f3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:12.695894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f916a3ca-92ce-4aeb-992a-2ae3cfe3b06c req-6de336d0-3e37-4f43-9f9c-05cbb6b767f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:12.696521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f916a3ca-92ce-4aeb-992a-2ae3cfe3b06c req-6de336d0-3e37-4f43-9f9c-05cbb6b767f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:12.746296 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f916a3ca-92ce-4aeb-992a-2ae3cfe3b06c req-6de336d0-3e37-4f43-9f9c-05cbb6b767f3 service nova] Creating event network-changed:38b546da-f2af-4a5c-82d8-3f29f92a44ff for instance 431c4120-65f4-47cc-937b-66e4719957ab on n-h1-862355-1 Oct 25 03:22:12.760297 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f916a3ca-92ce-4aeb-992a-2ae3cfe3b06c req-6de336d0-3e37-4f43-9f9c-05cbb6b767f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091928 Oct 25 03:22:12.766768 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2179/4186] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:12.853189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a85491e7-4917-4980-9822-7cd69cd05a7f req-63a0c3fe-44be-429c-a8a4-d562a19b64a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133140c4-85b6-47e1-8bab-15379403aec7", "tag": "1b12d465-db43-45f9-a868-4e14b418bcd8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:12.884560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a85491e7-4917-4980-9822-7cd69cd05a7f req-63a0c3fe-44be-429c-a8a4-d562a19b64a9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:12.885087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a85491e7-4917-4980-9822-7cd69cd05a7f req-63a0c3fe-44be-429c-a8a4-d562a19b64a9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:12.885522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a85491e7-4917-4980-9822-7cd69cd05a7f req-63a0c3fe-44be-429c-a8a4-d562a19b64a9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:12.952352 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a85491e7-4917-4980-9822-7cd69cd05a7f req-63a0c3fe-44be-429c-a8a4-d562a19b64a9 service nova] Creating event network-changed:1b12d465-db43-45f9-a868-4e14b418bcd8 for instance 133140c4-85b6-47e1-8bab-15379403aec7 on n-h2-862355-1 Oct 25 03:22:12.963641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a85491e7-4917-4980-9822-7cd69cd05a7f req-63a0c3fe-44be-429c-a8a4-d562a19b64a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114900 Oct 25 03:22:12.964288 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2180/4187] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:22:13.016156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:13.016969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:13.035012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:13.037029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:13.038201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:13.041158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:13.046152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:13.046989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:13.156294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:13.440904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:13.457359 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51496930-3941-456a-8bf0-7d01b9460fbe tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.491804 Oct 25 03:22:13.467460 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2181/4188] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:12 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:13.656467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=20 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:13.663188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:13.664277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:13.702547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:13.704029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:13.706188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:13.709696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:13.712395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:13.714123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:13.790174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:13.806535 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4358e807-e89f-425e-a2d0-63f26f9c6807 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 1.720603 Oct 25 03:22:13.807113 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2008/4189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:12 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:13.839522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:13.839944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:13.855874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:13.856378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:13.856831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:13.865970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:13.866902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:13.873622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:13.885029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:14.355096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:14.364711 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-564f2365-cf18-41d6-ad06-800d1cfbe004 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.707215 Oct 25 03:22:14.375078 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2182/4190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:13 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:14.489390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:14.490831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:14.513490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:14.527268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:14.533115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:14.536440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:14.537591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:14.542438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:14.590725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:14.608374 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d624e39-5b91-4a16-ab03-478cd28596e1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.770432 Oct 25 03:22:14.612154 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2009/4191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:13 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:14.638590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:14.639564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:14.652290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:14.652763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:14.653238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:14.654042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:14.655333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:14.655796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:15.168318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:15.183223 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-160cdd9e-0e9d-463d-9d15-a3e7dadae25f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.701442 Oct 25 03:22:15.206188 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2183/4192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:14 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:15.420412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:15.422778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:15.430751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:15.432486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:15.433502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:15.434580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:15.435279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:15.438874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:16.200482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:16.214366 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af6bd251-c47e-4026-9833-871429fada01 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.815643 Oct 25 03:22:16.218946 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2184/4193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:15 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:16.230110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:16.232969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:16.248243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:16.249077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:16.249623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:16.250468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:16.251202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:16.251728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:16.463773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:16.482968 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-864756cd-d62c-4f8d-9ca6-5c79f581dbc6 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 1.844457 Oct 25 03:22:16.486735 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2010/4194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:14 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:16.516231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:16.517300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:16.519290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:16.533866 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d0bb1f54-50cb-423b-8434-949601dc08f1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.310275 Oct 25 03:22:16.543345 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2185/4195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:16 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:16.562745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:16.563315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:16.563790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:16.569875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:16.570437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:16.570898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.088861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:17.098962 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e463a956-515b-47dd-bcc5-281a66d34bf1 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.588200 Oct 25 03:22:17.100940 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2011/4196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:16 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:17.132176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:17.133310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:17.147808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.148798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.149851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.153238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.154002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.154963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.226023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lazy-loading 'flavor' on Instance uuid fafc972b-b66f-427e-beec-c11ecd2a2d8e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:22:17.242468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:17.243762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:17.266352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.267665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.268263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.269818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.273084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.273957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.396474 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2994a3d8-b577-4606-b6d6-38d709d030ca tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.268790 Oct 25 03:22:17.397137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2186/4197] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:22:17 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:22:17.406088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:17.406800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:17.418019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.418522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.418970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.430109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.430707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.431170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.741558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:17.750290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:17.758307 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-adfaa6fa-3ba1-4ff6-9132-9540174039ec tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.522292 Oct 25 03:22:17.759045 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2012/4198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:17 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:17.764697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:17.767907 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-78b58cf2-0931-4eef-971f-b79f1c75e9bd tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1676 microversion: 2.1 time: 0.366276 Oct 25 03:22:17.768952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:17.774591 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2187/4199] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:17 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1676 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:17.791836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.792365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.792812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:17.793554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:17.794052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:17.794489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:18.332776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:18.345519 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc03a71b-cbc8-448d-ac70-ffb5090d84e7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.584933 Oct 25 03:22:18.346504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2013/4200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:17 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:18.786481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:18.789464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:18.793951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:18.796132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:18.801219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:18.802122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:18.803325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:18.804210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:18.804823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:18.805851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:18.807486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:18.813067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:18.813659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:18.815023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:18.815613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:18.820331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:18.843692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:19.089143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:19.104404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed212dfe-c95c-46ef-b98d-c4842ad0d3dc tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1659 microversion: 2.1 time: 0.314084 Oct 25 03:22:19.107963 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2014/4201] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:18 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1659 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:19.133452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:19.135064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:19.143554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:19.144381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:19.145019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:19.145956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:19.146628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:19.147249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:19.241749 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7fefc978-ee9a-4c19-8315-5b151690ed38 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action" status: 202 len: 0 microversion: 2.1 time: 0.111942 Oct 25 03:22:19.249607 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2015/4202] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:22:19 2022] POST /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:22:19.292414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:19.298926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:19.310065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:19.312006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:19.314068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:19.316142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:19.316992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:19.317767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:19.452586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:19.462853 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22b97125-4de9-4db9-87a0-e96b08f1bc29 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.682374 Oct 25 03:22:19.469453 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2188/4203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:18 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:19.484364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:19.485258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:19.498303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:19.499544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:19.504638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:19.505577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:19.506221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:19.507286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:19.785050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:19.793553 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e185a097-1b53-4137-85d7-dface095cf96 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1665 microversion: 2.1 time: 0.521326 Oct 25 03:22:19.796243 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2016/4204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:19 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1665 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:19.945642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:19.956614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da2b4ca6-12b0-45c5-8abd-c900c3369580 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.485480 Oct 25 03:22:19.958464 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2189/4205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:19 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:20.495819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:20.496788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:20.508300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:20.508951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:20.509634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:20.510574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:20.511215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:20.511827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:20.683514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:20.691983 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90b84d13-5f03-4360-9c13-064d30816dcc tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.200558 Oct 25 03:22:20.706299 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2017/4206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:20 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:20.822427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:20.822704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:20.830702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:20.831267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:20.831935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:20.832836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:20.833493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:20.834149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:20.980403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:20.981017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:20.988902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:20.990063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:20.990578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:20.991789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:20.992462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:20.993146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:21.218100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:21.248805 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43721805-b22b-4c44-a4ab-508becf40eb0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1665 microversion: 2.1 time: 0.431551 Oct 25 03:22:21.261939 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2190/4207] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:20 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1665 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:21.271139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:21.285898 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e772d496-d4ef-4996-ae82-b10dcd10aa36 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.308074 Oct 25 03:22:21.286648 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2018/4208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:20 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:21.636957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-753a5caa-9a69-455b-8564-bcf0d46d9514 req-49ed9b0b-9a10-4882-9c1c-3273297782fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431c4120-65f4-47cc-937b-66e4719957ab", "name": "network-vif-plugged", "status": "completed", "tag": "38b546da-f2af-4a5c-82d8-3f29f92a44ff"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:21.651955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-753a5caa-9a69-455b-8564-bcf0d46d9514 req-49ed9b0b-9a10-4882-9c1c-3273297782fb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:21.653497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-753a5caa-9a69-455b-8564-bcf0d46d9514 req-49ed9b0b-9a10-4882-9c1c-3273297782fb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:21.658399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-753a5caa-9a69-455b-8564-bcf0d46d9514 req-49ed9b0b-9a10-4882-9c1c-3273297782fb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:21.677813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-753a5caa-9a69-455b-8564-bcf0d46d9514 req-49ed9b0b-9a10-4882-9c1c-3273297782fb service nova] Creating event network-vif-plugged:38b546da-f2af-4a5c-82d8-3f29f92a44ff for instance 431c4120-65f4-47cc-937b-66e4719957ab on n-h1-862355-1 Oct 25 03:22:21.685891 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-753a5caa-9a69-455b-8564-bcf0d46d9514 req-49ed9b0b-9a10-4882-9c1c-3273297782fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057047 Oct 25 03:22:21.687804 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2191/4209] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:22:21.730211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:21.731409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:21.772031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:21.773313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:21.774075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:21.775064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:21.776866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:21.777694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.277998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:22.280006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:22.298015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.298515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.299136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.300023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.300646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.301238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.396801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:22.405929 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5921c4f2-4ed8-4d5a-a855-0622d04faef4 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.692778 Oct 25 03:22:22.406517 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2019/4210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:21 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:22.426951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:22.430215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:22.440768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.441268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.441912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.443874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.444502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.445177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.562379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:22.573419 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e712909b-2ec8-4c06-b620-03479f1fec95 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.300122 Oct 25 03:22:22.573843 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2192/4211] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:22 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:22.606275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:22.607173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:22.614018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.614748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.615370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.616225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.616838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.617416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.772576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:22.786627 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14e06359-771c-412c-8479-8ff465c20597 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1314 microversion: 2.1 time: 0.371692 Oct 25 03:22:22.787741 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2020/4212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:22 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:22.888744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:22.898511 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30ca2670-e80c-4101-90f8-09e8ab337929 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1668 microversion: 2.1 time: 0.297945 Oct 25 03:22:22.899253 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2193/4213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:22 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1668 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:22.927274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:22.928142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:22.936131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.937253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.938002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.939059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:22.939771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:22.940464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:22.974442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:22:22.981798 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Working on deleting snapshot 8a00e9dc-3d32-4a79-abfa-a519a71dca88 from shelved instance... Oct 25 03:22:23.431003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:23.432307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:23.442765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:23.443222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:23.443665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:23.448987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:23.449513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:23.449991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:23.836828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Doing local delete in cell 10ec2fc0-f6d0-4e98-acff-735f4bcc5b70(cell1) {{(pid=120563) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 25 03:22:23.838413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:23.839308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:23.840180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:23.840951 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 25 03:22:23.846991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] deallocate_for_instance() {{(pid=120563) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 25 03:22:23.877176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:23.886370 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-245384d8-fd1d-4006-bbe9-622ab20b954e tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.459483 Oct 25 03:22:23.887677 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2194/4214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:23 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:23.894489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:23.895423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:23.904352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:23.905356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:23.906031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:23.906827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:23.907424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:23.908051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:24.320045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:24.337259 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21d13ea5-9d6a-4577-87f6-0eb1c482459f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1499 microversion: 2.1 time: 0.446746 Oct 25 03:22:24.354633 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2195/4215] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:23 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1499 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:24.365339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-60afae48-085f-4e84-8a6f-f3e12ebf5b9f req-fd3a232e-faff-4bc3-b7d1-f2aa17aa2add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133140c4-85b6-47e1-8bab-15379403aec7", "name": "network-vif-plugged", "status": "completed", "tag": "1b12d465-db43-45f9-a868-4e14b418bcd8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:24.379712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-60afae48-085f-4e84-8a6f-f3e12ebf5b9f req-fd3a232e-faff-4bc3-b7d1-f2aa17aa2add service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:24.380394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-60afae48-085f-4e84-8a6f-f3e12ebf5b9f req-fd3a232e-faff-4bc3-b7d1-f2aa17aa2add service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:24.381227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-60afae48-085f-4e84-8a6f-f3e12ebf5b9f req-fd3a232e-faff-4bc3-b7d1-f2aa17aa2add service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:24.405590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-60afae48-085f-4e84-8a6f-f3e12ebf5b9f req-fd3a232e-faff-4bc3-b7d1-f2aa17aa2add service nova] Creating event network-vif-plugged:1b12d465-db43-45f9-a868-4e14b418bcd8 for instance 133140c4-85b6-47e1-8bab-15379403aec7 on n-h2-862355-1 Oct 25 03:22:24.416579 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-60afae48-085f-4e84-8a6f-f3e12ebf5b9f req-fd3a232e-faff-4bc3-b7d1-f2aa17aa2add service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060223 Oct 25 03:22:24.417211 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2196/4216] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:24.430089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:24.432555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:24.472687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:24.474264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:24.476059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:24.476894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:24.479926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:24.481028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:24.557976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lazy-loading 'flavor' on Instance uuid 431c4120-65f4-47cc-937b-66e4719957ab {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:22:24.707581 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b72aca7-4d4b-4638-9e9e-1fb81a3a712c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "POST /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab/action" status: 200 len: 32 microversion: 2.1 time: 0.287957 Oct 25 03:22:24.709383 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2197/4217] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:22:24 2022] POST /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:22:24.721221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:24.721969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:24.738900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:24.740641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:24.741275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:24.745959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:24.746698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:24.748429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.022752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Updating instance_info_cache with network_info: [] {{(pid=120563) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:22:25.116777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:25.138985 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ae73df76-9d46-4cc4-a97b-9d690e188e2a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.424233 Oct 25 03:22:25.140202 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2198/4218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:24 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:25.146824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:25.147953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:25.156100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.157088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.157785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.158923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.159876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.161605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.401574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:25.674394 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6294a9ed-9742-467a-86bb-ff3621203f9d tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 204 len: 0 microversion: 2.1 time: 2.752979 Oct 25 03:22:25.675363 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2021/4219] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:22:22 2022] DELETE /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 0 bytes in 2755 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:22:25.688206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-52b1b267-cf5b-4f76-a07e-133727406767 req-c59b9f09-e97e-4d1e-b5da-f7e2d314bd23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00b5417-31ea-4ec1-97b9-a427e4eab36e", "name": "network-vif-deleted", "tag": "173ba40e-4c1c-45c7-a711-3afcb55b92d1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:25.702602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-52b1b267-cf5b-4f76-a07e-133727406767 req-c59b9f09-e97e-4d1e-b5da-f7e2d314bd23 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.704693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-52b1b267-cf5b-4f76-a07e-133727406767 req-c59b9f09-e97e-4d1e-b5da-f7e2d314bd23 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.705317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-52b1b267-cf5b-4f76-a07e-133727406767 req-c59b9f09-e97e-4d1e-b5da-f7e2d314bd23 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.737789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.server_external_events [req-52b1b267-cf5b-4f76-a07e-133727406767 req-c59b9f09-e97e-4d1e-b5da-f7e2d314bd23 service nova] Unable to find a host for instance f00b5417-31ea-4ec1-97b9-a427e4eab36e. Dropping event network-vif-deleted {{(pid=120563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 25 03:22:25.738953 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-52b1b267-cf5b-4f76-a07e-133727406767 req-c59b9f09-e97e-4d1e-b5da-f7e2d314bd23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.061883 Oct 25 03:22:25.739788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:25.740724 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2022/4220] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 25 03:22:25.745784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:25.746611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: f00b5417-31ea-4ec1-97b9-a427e4eab36e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:25.749156 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e82db6a6-9653-4162-a293-989be4675cda tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1372 microversion: 2.1 time: 0.606380 Oct 25 03:22:25.752778 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2199/4221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:25 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1372 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:25.755345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.755835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.756271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.757169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.757627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.758076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.775731 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] HTTP exception thrown: Instance f00b5417-31ea-4ec1-97b9-a427e4eab36e could not be found. Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Request method failure captured: Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e HTTP/1.1 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1RWjlVE2sQh_gERIgsA6GFJ3mlQMKfGGB6JBmHqeKExER_q2xBsEZ41YuIa5yFsRyjj2ai1oDRcYnd-HPHQrK6KI6riL_Nk0ppae_wtcOI1d_0NXpHXkGs1EeZ-fmDCgTq_dyffPyZt5hZfUTcGbN6DMaz6TKjC-PKJdQQ8wD1ZMpw Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_587d3b710c1843279c9ffb9d78d6975b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/587d3b710c1843279c9ffb9d78d6975b"}]}] Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 41342d3f5062457aaee26cf5d836e441 Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f00b5417-31ea-4ec1-97b9-a427e4eab36e could not be found. Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f00b5417-31ea-4ec1-97b9-a427e4eab36e'} Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00b5417-31ea-4ec1-97b9-a427e4eab36e could not be found. Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00b5417-31ea-4ec1-97b9-a427e4eab36e could not be found. Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:25.778337 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00b5417-31ea-4ec1-97b9-a427e4eab36e could not be found. Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Returning 404 to user: Instance f00b5417-31ea-4ec1-97b9-a427e4eab36e could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a41725b-6a27-4fec-a283-8fddac15cb90 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e" status: 404 len: 111 microversion: 2.1 time: 0.038914 Oct 25 03:22:25.784747 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2023/4222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:25 2022] GET /compute/v2.1/servers/f00b5417-31ea-4ec1-97b9-a427e4eab36e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:22:25.791740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:25.792557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:25.799779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.800711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.801347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.802373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.803024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.803620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.833850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:22:25.948130 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-735aacf5-458a-48e6-b7b1-5f342f65d8e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 204 len: 0 microversion: 2.1 time: 0.159703 Oct 25 03:22:25.949662 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2200/4223] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:22:25 2022] DELETE /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:22:25.959900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:25.960839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:25.969021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.969518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.970173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:25.970904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:25.971367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:25.971801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:26.166308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:26.167401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:26.185411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:26.191200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:26.191990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:26.193003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:26.194149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:26.194871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:26.293387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:26.312918 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f66e0df8-9745-4904-8140-14b77e902de8 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1465 microversion: 2.1 time: 0.357899 Oct 25 03:22:26.313913 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2024/4224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:25 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1465 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:26.773249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:26.773914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:26.785825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:26.786351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:26.786802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:26.787525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:26.790557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:26.791448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:26.869777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:26.886246 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-13fcc788-238b-4bb9-b33b-8c6892c5e6d7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.724445 Oct 25 03:22:26.887229 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2201/4225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:26 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:27.113070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:27.122375 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b8bc0bf-52f1-4d2c-8684-ae285bd31de8 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1558 microversion: 2.1 time: 0.353323 Oct 25 03:22:27.123345 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2025/4226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:26 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1558 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:27.146860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:27.147370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:27.160893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:27.161445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:27.162131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:27.163038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:27.163664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:27.164096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:27.281705 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f918b41-f38a-45f0-93a0-7e8b31d1f783 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139273 Oct 25 03:22:27.282810 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2202/4227] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:22:27 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:27.342597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:27.343220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:27.350542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:27.351518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:27.354082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:27.355042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:27.356393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:27.358283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:27.680663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:27.696688 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90a28308-27cd-4de6-b8a8-8a3ca58ec0be tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1465 microversion: 2.1 time: 0.359683 Oct 25 03:22:27.697867 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2026/4228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:27 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1465 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:27.916254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:27.921321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:27.932405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:27.932911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:27.933559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:27.934476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:27.935893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:27.935994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:27.988394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:28.226349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:28.239150 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ebd5474e-9cd9-41af-acc6-2e7e4be700b5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.327671 Oct 25 03:22:28.241956 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2203/4229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:27 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:28.723710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:28.725217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:28.742434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:28.743631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:28.744235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:28.750546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:28.751220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:28.751863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:29.022234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-472c14a2-f693-4973-8917-b6aebe4c6144 req-b3e0eaa0-995a-4cfb-b483-bb59e8a44749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6e293f-a76f-4c33-a5a6-c31ffab08c32", "name": "network-vif-deleted", "tag": "d89e12cc-6465-436a-936e-a46ab8964407"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:29.042239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:29.045522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-472c14a2-f693-4973-8917-b6aebe4c6144 req-b3e0eaa0-995a-4cfb-b483-bb59e8a44749 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:29.046236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-472c14a2-f693-4973-8917-b6aebe4c6144 req-b3e0eaa0-995a-4cfb-b483-bb59e8a44749 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:29.047454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-472c14a2-f693-4973-8917-b6aebe4c6144 req-b3e0eaa0-995a-4cfb-b483-bb59e8a44749 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:29.095449 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-472c14a2-f693-4973-8917-b6aebe4c6144 req-b3e0eaa0-995a-4cfb-b483-bb59e8a44749 service nova] Creating event network-vif-deleted:d89e12cc-6465-436a-936e-a46ab8964407 for instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 on n-h1-862355-1 Oct 25 03:22:29.110477 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-472c14a2-f693-4973-8917-b6aebe4c6144 req-b3e0eaa0-995a-4cfb-b483-bb59e8a44749 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098267 Oct 25 03:22:29.111811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2204/4230] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:22:29.131916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:29.141293 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1cf9e186-3136-45e5-b066-99a506f9919a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 200 len: 1465 microversion: 2.1 time: 0.421611 Oct 25 03:22:29.145780 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2027/4231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:28 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 1465 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:29.269512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:29.271100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:29.285776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:29.286554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:29.287257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:29.288125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:29.288832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:29.289418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:29.711780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:29.732840 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4194bef-a7de-4856-87b4-ec7e153b68d1 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.467455 Oct 25 03:22:29.740417 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2205/4232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:29 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:30.171265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:30.172681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: dc6e293f-a76f-4c33-a5a6-c31ffab08c32] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:30.191004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:30.195067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:30.195565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:30.196950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:30.197426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:30.197888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:30.237031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] HTTP exception thrown: Instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 could not be found. Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Request method failure captured: Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 HTTP/1.1 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1RWjlVE2sQh_gERIgsA6GFJ3mlQMKfGGB6JBmHqeKExER_q2xBsEZ41YuIa5yFsRyjj2ai1oDRcYnd-HPHQrK6KI6riL_Nk0ppae_wtcOI1d_0NXpHXkGs1EeZ-fmDCgTq_dyffPyZt5hZfUTcGbN6DMaz6TKjC-PKJdQQ8wD1ZMpw Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_587d3b710c1843279c9ffb9d78d6975b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/587d3b710c1843279c9ffb9d78d6975b"}]}] Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 41342d3f5062457aaee26cf5d836e441 Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 could not be found. Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'dc6e293f-a76f-4c33-a5a6-c31ffab08c32'} Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 could not be found. Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 could not be found. Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:30.238989 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 could not be found. Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Returning 404 to user: Instance dc6e293f-a76f-4c33-a5a6-c31ffab08c32 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77562597-04c8-4272-9b75-207c74bc2cc7 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32" status: 404 len: 111 microversion: 2.1 time: 0.075497 Oct 25 03:22:30.244622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2028/4233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:30 2022] GET /compute/v2.1/servers/dc6e293f-a76f-4c33-a5a6-c31ffab08c32 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:22:30.258750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:30.259662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:30.271458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:30.272513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:30.273048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:30.273820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:30.274401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:30.275139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:30.324733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:22:30.505356 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9cc4b86d-1480-4046-b3fe-4e3b6f5e4878 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 204 len: 0 microversion: 2.1 time: 0.254267 Oct 25 03:22:30.508918 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2206/4234] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:22:30 2022] DELETE /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:22:30.516330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:30.520428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:30.532973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:30.534124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:30.538221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:30.539251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:30.539889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:30.540598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:30.954513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-210764899", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "7b3f8d32-7105-4a22-8ed7-eeeafc643b0d"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:31.049916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] validate_networks() for [('7b3f8d32-7105-4a22-8ed7-eeeafc643b0d', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:22:31.141845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:31.150748 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bff146c5-64d5-4d06-91f5-8af9136c0118 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1508 microversion: 2.1 time: 0.639176 Oct 25 03:22:31.161459 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2029/4235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:30 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:31.168746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:31.179126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:31.203406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:31.203902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:31.204340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:31.205066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:31.205526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:31.205998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:31.824564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:31.849563 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ade695c5-597e-4f63-8a64-510f90caa56d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.684542 Oct 25 03:22:31.866118 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2030/4236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:31 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:31.885274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d056ef7e-2bf4-4252-8f7e-57825e0f0534 req-c5b59767-5f86-4b63-a5bd-55962e247b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133140c4-85b6-47e1-8bab-15379403aec7", "tag": "1b12d465-db43-45f9-a868-4e14b418bcd8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:31.919461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d056ef7e-2bf4-4252-8f7e-57825e0f0534 req-c5b59767-5f86-4b63-a5bd-55962e247b2e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:31.922617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d056ef7e-2bf4-4252-8f7e-57825e0f0534 req-c5b59767-5f86-4b63-a5bd-55962e247b2e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:31.923145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d056ef7e-2bf4-4252-8f7e-57825e0f0534 req-c5b59767-5f86-4b63-a5bd-55962e247b2e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:31.954107 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d056ef7e-2bf4-4252-8f7e-57825e0f0534 req-c5b59767-5f86-4b63-a5bd-55962e247b2e service nova] Creating event network-changed:1b12d465-db43-45f9-a868-4e14b418bcd8 for instance 133140c4-85b6-47e1-8bab-15379403aec7 on n-h2-862355-1 Oct 25 03:22:31.971701 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d056ef7e-2bf4-4252-8f7e-57825e0f0534 req-c5b59767-5f86-4b63-a5bd-55962e247b2e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104083 Oct 25 03:22:31.972964 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2031/4237] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:32.094628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:22:32.095150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:22:32.095635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:22:32.096051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:22:32.096471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:22:32.115228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:32.115945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:32.116398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:32.117139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:32.119186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:32.119678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:32.166571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Getting quotas for project 7df224a934af4cf79a1a5416e3ae8c34. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:22:32.183055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Getting quotas for user 2a949134f3bd4a23b2040a9a18d832dd and project 7df224a934af4cf79a1a5416e3ae8c34. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:22:32.193055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:32.194393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:32.209850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:32.212864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:32.213569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:32.219997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:32.221084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:32.221809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:32.223291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:22:32.228267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:22:32.417357 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1905b105-aa2f-4350-a4ec-62616d491d29 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.775592 Oct 25 03:22:32.425602 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2207/4238] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:22:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:22:32.432720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3835e14b-eaca-44ac-bb64-aac6861c0099 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:32.433397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3835e14b-eaca-44ac-bb64-aac6861c0099 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:32.667895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3835e14b-eaca-44ac-bb64-aac6861c0099 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:32.681731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3835e14b-eaca-44ac-bb64-aac6861c0099 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:32.684183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3835e14b-eaca-44ac-bb64-aac6861c0099 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:32.686873 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3835e14b-eaca-44ac-bb64-aac6861c0099 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1258 microversion: 2.21 time: 0.257836 Oct 25 03:22:32.687050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2208/4239] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:32 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1258 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:32.876211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:32.876888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:32.911527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:32.912105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:32.912575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:32.913339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:32.913839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:32.914285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:33.031916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:33.062753 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7bf5d463-4b10-4a7f-a986-6444bacb0b85 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1508 microversion: 2.1 time: 0.866494 Oct 25 03:22:33.063478 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2032/4240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:32 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1508 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:33.714940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:33.715607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:33.748226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:33.748794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:33.754551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:33.758341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:33.761537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:33.762915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:34.159005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:34.182587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:34.190509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:34.192216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:34.201129 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2a7dd67-5dec-47cf-9888-734ca9765ea3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 1.329961 Oct 25 03:22:34.201983 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d5f12c4-4e5c-4273-9788-e408ba66dd03 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1254 microversion: 2.21 time: 0.487376 Oct 25 03:22:34.202812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2033/4241] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:33 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1254 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:34.217041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:34.217722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:34.218025 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2209/4242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:32 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:34.229547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-30ded2bb-0d09-4be8-8fa0-721f5b69c595 req-35dbea17-8088-44d1-a27c-ed68d9e2754c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4cdf5f-9bbe-405c-b0c6-506517c14415", "name": "network-vif-deleted", "tag": "eb885822-86a8-481f-b965-cbb4ff96f05b"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:34.239288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:34.239861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:34.241763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:34.243334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:34.243815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:34.244263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:34.250797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-30ded2bb-0d09-4be8-8fa0-721f5b69c595 req-35dbea17-8088-44d1-a27c-ed68d9e2754c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:34.255824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-30ded2bb-0d09-4be8-8fa0-721f5b69c595 req-35dbea17-8088-44d1-a27c-ed68d9e2754c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:34.256481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-30ded2bb-0d09-4be8-8fa0-721f5b69c595 req-35dbea17-8088-44d1-a27c-ed68d9e2754c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:34.293513 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-30ded2bb-0d09-4be8-8fa0-721f5b69c595 req-35dbea17-8088-44d1-a27c-ed68d9e2754c service nova] Creating event network-vif-deleted:eb885822-86a8-481f-b965-cbb4ff96f05b for instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 on n-h2-862355-1 Oct 25 03:22:34.304383 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-30ded2bb-0d09-4be8-8fa0-721f5b69c595 req-35dbea17-8088-44d1-a27c-ed68d9e2754c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084467 Oct 25 03:22:34.304997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2210/4243] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:34.509467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:34.519562 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b97165f-1b5e-42bc-bbd4-a13000368690 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 200 len: 1466 microversion: 2.1 time: 0.312528 Oct 25 03:22:34.520160 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2034/4244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:34 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 1466 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:35.226378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:35.228323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:35.237061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:35.238525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:35.247739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:35.250668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.251491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.252555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.253547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.254287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.256056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.257695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.262420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.264218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.266550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.272137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.273194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.404703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:35.420661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:35.422510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:35.424508 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-048ccf64-f011-4ca4-be1f-91abd3097897 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1316 microversion: 2.21 time: 0.195669 Oct 25 03:22:35.425566 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2035/4245] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:35 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:35.495933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:35.504818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-13b8d06c-7708-47d1-9c28-8bf6cd0ca1e8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.283218 Oct 25 03:22:35.506426 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2211/4246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:35 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:35.546094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:35.547004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fa4cdf5f-9bbe-405c-b0c6-506517c14415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:35.561558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.562368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.569772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.570737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.571410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.572008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.598646 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] HTTP exception thrown: Instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 could not be found. Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Request method failure captured: Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 HTTP/1.1 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1RWjlVE2sQh_gERIgsA6GFJ3mlQMKfGGB6JBmHqeKExER_q2xBsEZ41YuIa5yFsRyjj2ai1oDRcYnd-HPHQrK6KI6riL_Nk0ppae_wtcOI1d_0NXpHXkGs1EeZ-fmDCgTq_dyffPyZt5hZfUTcGbN6DMaz6TKjC-PKJdQQ8wD1ZMpw Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_587d3b710c1843279c9ffb9d78d6975b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/587d3b710c1843279c9ffb9d78d6975b"}]}] Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 41342d3f5062457aaee26cf5d836e441 Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 could not be found. Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fa4cdf5f-9bbe-405c-b0c6-506517c14415'} Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 could not be found. Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 could not be found. Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:35.606285 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:35.612191 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:35.612191 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:35.612191 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:35.612191 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:35.612191 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:35.612191 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 could not be found. Oct 25 03:22:35.612191 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:35.614465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Returning 404 to user: Instance fa4cdf5f-9bbe-405c-b0c6-506517c14415 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:35.616701 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d600be4b-4a6c-4ba8-8b7e-d46eb4903d43 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415" status: 404 len: 111 microversion: 2.1 time: 0.076202 Oct 25 03:22:35.621186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2036/4247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:35 2022] GET /compute/v2.1/servers/fa4cdf5f-9bbe-405c-b0c6-506517c14415 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:22:35.628238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:35.629068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:35.649798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.650933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.651599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.656086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.658447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.659154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.703257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:22:35.862807 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6380fe74-41ec-4f2e-ac4f-9874f4030a2b tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 204 len: 0 microversion: 2.1 time: 0.238092 Oct 25 03:22:35.866847 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2212/4248] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:22:35 2022] DELETE /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:22:35.877308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:35.878155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:35.885210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.886032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.886682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:35.887641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:35.888487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:35.889407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:36.303465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:36.317936 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c0f70a3-2978-43be-8322-aeaf852f07e0 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1493 microversion: 2.1 time: 0.445905 Oct 25 03:22:36.318863 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2037/4249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:35 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1493 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:36.454053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:36.454771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:36.470927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:36.471433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:36.471880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:36.472603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:36.473067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:36.473507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:36.532710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:36.533401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:36.543026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:36.544158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:36.545873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:36.546803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:36.547371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:36.548169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:36.593710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=12,nova_cell1:DELETE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:36.694139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:36.704067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:36.705812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:36.707261 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a3371e6-ec4e-4f31-ac35-f27598df579c tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1316 microversion: 2.21 time: 0.258512 Oct 25 03:22:36.709083 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2213/4250] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:36 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:36.980776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:37.025621 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6ebb8f0-41b9-435a-9cb5-ae25b4885164 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.500473 Oct 25 03:22:37.026407 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2038/4251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:36 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:37.344992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:37.345622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:37.374618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:37.375416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:37.376022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:37.377198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:37.377863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:37.378456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:37.520863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-928ee457-7c2c-4981-b636-5355a9ba8577 req-b854bb66-c179-4edc-b264-1d3b4c01853d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f3ce87-196d-4bc1-a602-1ba5ae950975", "name": "network-vif-deleted", "tag": "3f94364d-3677-4e47-a271-ffd5ad0ae912"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:37.540530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-928ee457-7c2c-4981-b636-5355a9ba8577 req-b854bb66-c179-4edc-b264-1d3b4c01853d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:37.564615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-928ee457-7c2c-4981-b636-5355a9ba8577 req-b854bb66-c179-4edc-b264-1d3b4c01853d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:37.566696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-928ee457-7c2c-4981-b636-5355a9ba8577 req-b854bb66-c179-4edc-b264-1d3b4c01853d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:37.585939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:37.600613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e56c50e-db60-49e6-b3b1-8b86ea3925c2 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 200 len: 1451 microversion: 2.1 time: 0.259592 Oct 25 03:22:37.604171 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2214/4252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:37 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 1451 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:37.620703 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-928ee457-7c2c-4981-b636-5355a9ba8577 req-b854bb66-c179-4edc-b264-1d3b4c01853d service nova] Creating event network-vif-deleted:3f94364d-3677-4e47-a271-ffd5ad0ae912 for instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 on n-h2-862355-1 Oct 25 03:22:37.634696 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-928ee457-7c2c-4981-b636-5355a9ba8577 req-b854bb66-c179-4edc-b264-1d3b4c01853d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122319 Oct 25 03:22:37.635332 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2039/4253] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:22:37.737543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:37.738525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:37.746369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:37.747235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:37.748555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:37.749497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:37.750195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:37.751037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:37.968141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:37.982818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:37.984843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:37.986057 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5bf58c3-a4f9-4c1c-a0e5-2a254a843818 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.253393 Oct 25 03:22:37.986718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2215/4254] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:37 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:38.051606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:38.053042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:38.072848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.073371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.074779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:38.078718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.079662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.080195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:38.475458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:38.485347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f4aacab-8c73-4bc8-bb43-5e21b64e94ce tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.437975 Oct 25 03:22:38.501246 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2040/4255] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:38 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: 86f3ce87-196d-4bc1-a602-1ba5ae950975] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:38.689107 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] HTTP exception thrown: Instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 could not be found. Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Request method failure captured: Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 HTTP/1.1 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1RWjlVE2sQh_gERIgsA6GFJ3mlQMKfGGB6JBmHqeKExER_q2xBsEZ41YuIa5yFsRyjj2ai1oDRcYnd-HPHQrK6KI6riL_Nk0ppae_wtcOI1d_0NXpHXkGs1EeZ-fmDCgTq_dyffPyZt5hZfUTcGbN6DMaz6TKjC-PKJdQQ8wD1ZMpw Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_587d3b710c1843279c9ffb9d78d6975b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/587d3b710c1843279c9ffb9d78d6975b"}]}] Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 41342d3f5062457aaee26cf5d836e441 Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 could not be found. Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '86f3ce87-196d-4bc1-a602-1ba5ae950975'} Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 could not be found. Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 could not be found. Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:38.758695 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 could not be found. Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Returning 404 to user: Instance 86f3ce87-196d-4bc1-a602-1ba5ae950975 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-afbf9b57-b0d3-4c2a-94f8-c032f580aa37 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975" status: 404 len: 111 microversion: 2.1 time: 0.063816 Oct 25 03:22:38.764907 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2216/4256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:38 2022] GET /compute/v2.1/servers/86f3ce87-196d-4bc1-a602-1ba5ae950975 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:38.765641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:22:38.848377 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ffa74077-5c6e-4d4f-bd2a-fb5f2ebada0e tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 204 len: 0 microversion: 2.1 time: 0.150616 Oct 25 03:22:38.850054 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2041/4257] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:22:38 2022] DELETE /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:22:38.858698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:38.859527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:38.866062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.866882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.867760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:38.868715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:38.869494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:38.871798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:39.029551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:39.030701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:39.031701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:39.040541 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81b6a7a7-9834-4a99-b0d4-307392795d1f tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1674 microversion: 2.1 time: 0.186139 Oct 25 03:22:39.041372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:39.041543 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2217/4258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:38 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:39.042272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:39.042719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:39.043433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:39.043896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:39.044860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:39.364283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:39.375717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:39.377434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:39.379737 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a4b1fab1-7bb6-43fd-a2c7-66f0f9558cda tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.366190 Oct 25 03:22:39.394950 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2042/4259] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:39 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:39.468267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6c19dc31-60f5-4ea7-aa5e-e53fc2ccab27 req-15db7df2-9ee0-4fba-9eb3-3fc4323c0293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3cbddb-c44b-4305-8f90-b40e813b2fb4", "tag": "8f54d825-7771-4ffb-8231-57c4d3bb0479"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:39.498674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6c19dc31-60f5-4ea7-aa5e-e53fc2ccab27 req-15db7df2-9ee0-4fba-9eb3-3fc4323c0293 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:39.499173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6c19dc31-60f5-4ea7-aa5e-e53fc2ccab27 req-15db7df2-9ee0-4fba-9eb3-3fc4323c0293 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:39.502278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6c19dc31-60f5-4ea7-aa5e-e53fc2ccab27 req-15db7df2-9ee0-4fba-9eb3-3fc4323c0293 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:39.508339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:39.508932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:39.518606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:39.519106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:39.519540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:39.520246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:39.520710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:39.521138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:39.526718 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6c19dc31-60f5-4ea7-aa5e-e53fc2ccab27 req-15db7df2-9ee0-4fba-9eb3-3fc4323c0293 service nova] Creating event network-changed:8f54d825-7771-4ffb-8231-57c4d3bb0479 for instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 on n-h1-862355-1 Oct 25 03:22:39.532900 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6c19dc31-60f5-4ea7-aa5e-e53fc2ccab27 req-15db7df2-9ee0-4fba-9eb3-3fc4323c0293 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070026 Oct 25 03:22:39.533617 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2218/4260] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:39.770382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:39.778402 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-267933a4-c756-4b40-b232-4927d66a251a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.273891 Oct 25 03:22:39.779932 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2043/4261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:39 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:40.071272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:40.072528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:40.082435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:40.083112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:40.083741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:40.084762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:40.085372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:40.086027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:40.328806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:40.337828 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bb4e80fa-47a9-4d29-9b5c-6c73e1baa3f3 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1674 microversion: 2.1 time: 0.274846 Oct 25 03:22:40.339966 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2219/4262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:40 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:40.412655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:40.413643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:40.422032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:40.422545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:40.423001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:40.423748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:40.424219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:40.424654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:40.808379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:40.809347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:40.850061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:40.850780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:40.851485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:40.852374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:40.852988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:40.853903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:41.096475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:41.143490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:41.156016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:41.158175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ab353d1-d555-4c1e-bbe2-68b5c754b21b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.751584 Oct 25 03:22:41.161715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2044/4263] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:40 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:41.244802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:41.274091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:41.277337 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f53c4146-2fc7-4520-a0dd-931812669465 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.476505 Oct 25 03:22:41.278291 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2220/4264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:40 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:41.364767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:41.365986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:41.382752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:41.383510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:41.384109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:41.385344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:41.386026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:41.386617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:42.190879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:42.191773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:42.196231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:42.201853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:42.202619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:42.203111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:42.203707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:42.204157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:42.204767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:42.211765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:42.223596 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1cc92dbb-672b-4ecc-ae44-6c341de008da tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1674 microversion: 2.1 time: 0.863559 Oct 25 03:22:42.241960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2045/4265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:41 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1674 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:42.305852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:42.306677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:42.314324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:42.315068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:42.315859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:42.316745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:42.317363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:42.318125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:42.376679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:42.390412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:42.392061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:42.394306 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5e4d0f5-9f0b-4b92-b1a2-80e3f525cad7 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.206718 Oct 25 03:22:42.395475 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2221/4266] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:42 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:42.704103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:42.718169 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2a43c3e-43af-4f11-92f9-baecf521a534 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.417727 Oct 25 03:22:42.724093 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2046/4267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:42 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:43.171596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3ab55f23-c878-416e-89c4-f96e866d19f6 req-9f4cfec5-a6e4-4b1f-a0f4-38e61e0baf21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafc972b-b66f-427e-beec-c11ecd2a2d8e", "name": "network-vif-deleted", "tag": "8e1101c6-1bd2-4e09-992d-0faf67c76596"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:43.177347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:43.192905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3ab55f23-c878-416e-89c4-f96e866d19f6 req-9f4cfec5-a6e4-4b1f-a0f4-38e61e0baf21 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:43.195801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3ab55f23-c878-416e-89c4-f96e866d19f6 req-9f4cfec5-a6e4-4b1f-a0f4-38e61e0baf21 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:43.200260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3ab55f23-c878-416e-89c4-f96e866d19f6 req-9f4cfec5-a6e4-4b1f-a0f4-38e61e0baf21 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:43.230640 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3ab55f23-c878-416e-89c4-f96e866d19f6 req-9f4cfec5-a6e4-4b1f-a0f4-38e61e0baf21 service nova] Creating event network-vif-deleted:8e1101c6-1bd2-4e09-992d-0faf67c76596 for instance fafc972b-b66f-427e-beec-c11ecd2a2d8e on n-h1-862355-1 Oct 25 03:22:43.238252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3ab55f23-c878-416e-89c4-f96e866d19f6 req-9f4cfec5-a6e4-4b1f-a0f4-38e61e0baf21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072525 Oct 25 03:22:43.239868 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2222/4268] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:43.250028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:43.250723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:43.257603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:43.258162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:43.258602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:43.259307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:43.259760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:43.260248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:43.427022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:43.430841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:43.446106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:43.446959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:43.447586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:43.449501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:43.451570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:43.452051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:43.466380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:43.496391 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58ddabc8-3d6a-4107-af97-39ac1f99579a tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1606 microversion: 2.1 time: 0.249463 Oct 25 03:22:43.500500 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2047/4269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:43 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1606 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:43.752861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:43.757018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:43.759472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:43.770576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:43.777881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:43.782502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:43.783231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:43.784222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:43.785148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:43.785833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:43.787028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:43.791769 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-96534fcd-11c9-4369-910e-68720d48b062 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.368411 Oct 25 03:22:43.792951 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2223/4270] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:43 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:44.114486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:44.125631 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d870ff2-29b1-4735-84d8-469700ad05ca tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.382159 Oct 25 03:22:44.127089 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2048/4271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:43 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:44.526984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:44.527818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:44.544429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:44.545394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:44.546161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:44.547332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:44.548804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:44.549818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:44.642775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:44.644400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:44.645333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:44.646080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lazy-loading 'fault' on Instance uuid fafc972b-b66f-427e-beec-c11ecd2a2d8e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:22:44.711098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41342d3f5062457aaee26cf5d836e441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587d3b710c1843279c9ffb9d78d6975b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:44.721406 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d434b658-32d4-4d4f-9f42-1ccd1746b526 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 200 len: 1328 microversion: 2.1 time: 0.198279 Oct 25 03:22:44.733700 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2224/4272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:44 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 1328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:44.819796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:44.820522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:44.835642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:44.836337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:44.836792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:44.837520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:44.838021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:44.838453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:45.117565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:45.127332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:45.130021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:45.131448 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c3e27c5-47fc-4513-ae59-6112bd519bcf tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.316129 Oct 25 03:22:45.132554 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2049/4273] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:44 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:45.152724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:45.153820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:45.167436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:45.173475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:45.174043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:45.175039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:45.175753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:45.177324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:45.387758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:45.406934 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-96a8fb1d-e979-4aef-9c15-18decb0a251f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.259935 Oct 25 03:22:45.422257 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2225/4274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:45 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:45.746563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:45.747477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] [instance: fafc972b-b66f-427e-beec-c11ecd2a2d8e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:45.766563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:45.767501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:45.768505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:45.769605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:45.770497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:45.771184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:45.789370 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] HTTP exception thrown: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e could not be found. Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Request method failure captured: Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e HTTP/1.1 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1RWjlVE2sQh_gERIgsA6GFJ3mlQMKfGGB6JBmHqeKExER_q2xBsEZ41YuIa5yFsRyjj2ai1oDRcYnd-HPHQrK6KI6riL_Nk0ppae_wtcOI1d_0NXpHXkGs1EeZ-fmDCgTq_dyffPyZt5hZfUTcGbN6DMaz6TKjC-PKJdQQ8wD1ZMpw Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/587d3b710c1843279c9ffb9d78d6975b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_587d3b710c1843279c9ffb9d78d6975b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/587d3b710c1843279c9ffb9d78d6975b"}]}] Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 587d3b710c1843279c9ffb9d78d6975b Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1356583010 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 41342d3f5062457aaee26cf5d836e441 Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1356583010-project Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e could not be found. Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fafc972b-b66f-427e-beec-c11ecd2a2d8e'} Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e could not be found. Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e could not be found. Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:45.795823 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:45.800719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:45.800719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:45.800719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:45.800719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:45.800719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:45.800719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e could not be found. Oct 25 03:22:45.800719 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:45.803521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Returning 404 to user: Instance fafc972b-b66f-427e-beec-c11ecd2a2d8e could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:45.804661 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87e35a6f-8d7d-45be-975f-ec0208ecefb4 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e" status: 404 len: 111 microversion: 2.1 time: 0.062166 Oct 25 03:22:45.806310 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2050/4275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:45 2022] GET /compute/v2.1/servers/fafc972b-b66f-427e-beec-c11ecd2a2d8e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:22:45.817309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8c9cf42-63c6-449d-8b61-de649cb51539 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] Calling method '.version_select at 0x7efd329c6310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:45.847264 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8c9cf42-63c6-449d-8b61-de649cb51539 tempest-ServerActionsTestJSON-1356583010 tempest-ServerActionsTestJSON-1356583010-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119071789" status: 202 len: 0 microversion: 2.1 time: 0.035475 Oct 25 03:22:45.852042 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2226/4276] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119071789 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:22:46.163569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:46.164195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:46.185975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:46.186913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:46.187050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:46.190813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:46.191333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:46.191792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:46.431006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:46.431632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:46.451632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:46.452139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:46.452589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:46.453311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:46.454522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:46.455036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:46.497827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:46.512560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:46.515324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:46.516767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6940b2a-61bc-4f2f-9c19-961a1c52b26b tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.360168 Oct 25 03:22:46.518785 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2051/4277] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:46 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:46.780796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:46.793483 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e707d9e5-af70-4bfc-a614-71db939d003c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.366303 Oct 25 03:22:46.802239 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2227/4278] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:46 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:47.547054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:47.547676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:47.556040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:47.557112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:47.559010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:47.560215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:47.560852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:47.561447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:47.819879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:47.821348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:47.848959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:47.849232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:47.854030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:47.855102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:47.855832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:47.867119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:47.974260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:47.992074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:47.993335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:48.014666 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c401989b-edc5-4790-802a-cc04eb91c0dd tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.466162 Oct 25 03:22:48.015725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2052/4279] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:47 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:48.131035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:48.154813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e41c917d-ccd1-463d-b418-5eb25ce06158 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.338816 Oct 25 03:22:48.155743 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2228/4280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:47 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:48.822021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-87b0cd4c-5356-47b4-8119-3c3ef7207418 req-9cadfbae-5f37-4104-9e6c-913066854166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3cbddb-c44b-4305-8f90-b40e813b2fb4", "name": "network-vif-plugged", "status": "completed", "tag": "8f54d825-7771-4ffb-8231-57c4d3bb0479"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:48.836051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-87b0cd4c-5356-47b4-8119-3c3ef7207418 req-9cadfbae-5f37-4104-9e6c-913066854166 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:48.837153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-87b0cd4c-5356-47b4-8119-3c3ef7207418 req-9cadfbae-5f37-4104-9e6c-913066854166 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:48.837838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-87b0cd4c-5356-47b4-8119-3c3ef7207418 req-9cadfbae-5f37-4104-9e6c-913066854166 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:48.852985 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-87b0cd4c-5356-47b4-8119-3c3ef7207418 req-9cadfbae-5f37-4104-9e6c-913066854166 service nova] Creating event network-vif-plugged:8f54d825-7771-4ffb-8231-57c4d3bb0479 for instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 on n-h1-862355-1 Oct 25 03:22:48.859357 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-87b0cd4c-5356-47b4-8119-3c3ef7207418 req-9cadfbae-5f37-4104-9e6c-913066854166 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043280 Oct 25 03:22:48.860545 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2053/4281] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:49.052246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:49.053751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:49.067072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:49.067573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:49.068149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:49.068778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:49.069244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:49.069542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:49.181599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:49.182727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:49.197666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:49.198128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:49.199416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:49.200379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:49.200861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:49.201300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:49.562209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:49.579187 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5c1aa45e-771c-4635-9d8c-2893e27d7af8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.402047 Oct 25 03:22:49.580748 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2054/4282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:49 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:49.640841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:49.655496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:49.661515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:49.662983 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e2879f3-bd8d-4460-994a-0bbf75794f21 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1358 microversion: 2.21 time: 0.616430 Oct 25 03:22:49.665580 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2229/4283] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:49 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1358 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:50.603953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:50.604581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:50.611318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:50.611821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:50.612272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:50.612987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:50.613456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:50.626278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:50.644355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:22:50.694959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:50.696162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:50.722194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:50.724657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:50.726283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:50.729441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:50.732969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:50.745366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:51.038030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:51.050294 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-599e94a0-04fb-490d-a75e-13531b154647 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.450071 Oct 25 03:22:51.051030 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2055/4284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:50 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:51.148090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:51.159975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:51.162300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:51.163658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a957e41-59fa-429b-b466-225532e5ab81 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1551 microversion: 2.21 time: 0.473377 Oct 25 03:22:51.164813 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2230/4285] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:50 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1551 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:51.191179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:51.191704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:51.208932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:51.210033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:51.210752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:51.212181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:51.213885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:51.214942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:51.278728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:22:51.439023 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11a2b68f-69e5-4dcc-8f58-d860a4da89ac tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 204 len: 0 microversion: 2.21 time: 0.251776 Oct 25 03:22:51.443463 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2056/4286] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:22:51 2022] DELETE /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:22:51.449033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:51.449908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:51.459562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:51.465892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:51.466918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:51.467691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:51.468171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:51.468615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:51.750378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:51.763607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:51.767950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:51.769499 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80537473-9aa7-4770-9e67-eee6e739a8e1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1557 microversion: 2.21 time: 0.324641 Oct 25 03:22:51.772228 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2231/4287] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:51 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1557 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:52.074739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:52.075723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:52.109722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:52.111845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:52.112471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:52.113390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:52.116494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:52.126016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:52.541429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:52.553188 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ff4e81af-34b8-4613-82f0-f6796e0f21c8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.483249 Oct 25 03:22:52.566609 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2057/4288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:52 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:52.804053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:52.805456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:52.835590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:52.839003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:52.841094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:52.843426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:52.843984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:52.845918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:53.290398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:53.306306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:53.307820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:53.309025 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-58bf3e5a-6840-4a03-a5ef-a8fa3593b967 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1557 microversion: 2.21 time: 0.509007 Oct 25 03:22:53.310400 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2232/4289] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:52 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1557 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:53.579497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:53.581354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:53.591678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:53.592210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:53.592660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:53.593388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:53.593888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:53.594323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:54.337224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:54.338554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:54.350992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:54.355512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:54.357664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:54.358666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:54.359323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:54.359924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:54.372046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:54.382435 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3592312b-d1e8-4b8a-8e1a-dd4dfa95dc62 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.807613 Oct 25 03:22:54.398860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2058/4290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:53 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:22:54.645415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:54.671844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:54.673333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:54.674625 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-663ffa1a-7fd8-43e3-bcf6-9b77c6f72c37 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1557 microversion: 2.21 time: 0.341798 Oct 25 03:22:54.681041 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2233/4291] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:54 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1557 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:22:55.386416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ec3e4ec7-019d-4366-b13b-4557614c5a12 req-16744ca8-3b0e-4bf6-816a-3db5b27d2649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3cbddb-c44b-4305-8f90-b40e813b2fb4", "name": "network-vif-deleted", "tag": "8f54d825-7771-4ffb-8231-57c4d3bb0479"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:55.413162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:55.413824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:55.428513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec3e4ec7-019d-4366-b13b-4557614c5a12 req-16744ca8-3b0e-4bf6-816a-3db5b27d2649 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:55.431565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec3e4ec7-019d-4366-b13b-4557614c5a12 req-16744ca8-3b0e-4bf6-816a-3db5b27d2649 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:55.432225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec3e4ec7-019d-4366-b13b-4557614c5a12 req-16744ca8-3b0e-4bf6-816a-3db5b27d2649 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:55.432454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:55.432953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:55.433393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:55.434129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:55.435423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:55.436389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:55.490487 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ec3e4ec7-019d-4366-b13b-4557614c5a12 req-16744ca8-3b0e-4bf6-816a-3db5b27d2649 service nova] Creating event network-vif-deleted:8f54d825-7771-4ffb-8231-57c4d3bb0479 for instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 on n-h1-862355-1 Oct 25 03:22:55.502959 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ec3e4ec7-019d-4366-b13b-4557614c5a12 req-16744ca8-3b0e-4bf6-816a-3db5b27d2649 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122703 Oct 25 03:22:55.534819 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2059/4292] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:22:55.703379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:55.704121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:55.722938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:55.723449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:55.723902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:55.724654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:55.725125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:55.733916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:55.857153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:55.858300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:55.859670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:55.860678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lazy-loading 'fault' on Instance uuid fa3cbddb-c44b-4305-8f90-b40e813b2fb4 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:22:55.957985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:55.977043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:55.979518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a949134f3bd4a23b2040a9a18d832dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df224a934af4cf79a1a5416e3ae8c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:55.980809 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11a412e1-6f97-4390-90b3-be79613d14da tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 200 len: 1348 microversion: 2.21 time: 0.282070 Oct 25 03:22:55.982360 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2060/4293] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:55 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 1348 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:22:56.222413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:56.233636 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67984f9e-411e-4163-8fc2-e2ba98afc906 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1505 microversion: 2.1 time: 0.823754 Oct 25 03:22:56.235147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2234/4294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:55 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1505 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:57.019300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:57.021232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:57.032318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.033276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.034090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.036363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.037015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.037618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.058382 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] HTTP exception thrown: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Request method failure captured: Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 HTTP/1.1 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Z2tGB2Pv63lv_05atp3BhLZ5O-p51K40TQtMR0710Qt7DuyGPPlT4W1DQUIOPHHMlKcaXKfK2zGCaxlP4q8RoeXn_AJf5AEfkS7TJoZPd8jvIgPu4itGDds-yXdO7diAUphtdMNZNrllsfJM6S4P6mcB7rMpKLz2nrnAzx2vQ2yhQ Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.21 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 7df224a934af4cf79a1a5416e3ae8c34 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7df224a934af4cf79a1a5416e3ae8c34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7df224a934af4cf79a1a5416e3ae8c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7df224a934af4cf79a1a5416e3ae8c34", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7df224a934af4cf79a1a5416e3ae8c34"}]}] Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 7df224a934af4cf79a1a5416e3ae8c34 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-InstanceActionsV221TestJSON-1342484937-project Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2a949134f3bd4a23b2040a9a18d832dd Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-InstanceActionsV221TestJSON-1342484937-project Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fa3cbddb-c44b-4305-8f90-b40e813b2fb4'} Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.063753 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.069283 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.073227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Returning 404 to user: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:57.074576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50ab6ab9-1751-4b83-8b59-795c64cfe8a0 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 404 len: 111 microversion: 2.21 time: 0.070582 Oct 25 03:22:57.075687 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2061/4295] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:57 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:22:57.083884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '.version_select at 0x7efd33ff11f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:57.084469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:57.091807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.092570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.093025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.093821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.094440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.095031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.199737 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-310f2c80-933f-492a-a80e-e2f6da31d5ab tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.119272 Oct 25 03:22:57.206490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2235/4296] 10.222.0.36 () {60 vars in 1337 bytes} [Tue Oct 25 03:22:57 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4/os-instance-actions => generated 611 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:22:57.221392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:57.222223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:57.235563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.236236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.236758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.237525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.242763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.244350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.262238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:57.263471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:57.269993 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] HTTP exception thrown: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Request method failure captured: Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 HTTP/1.1 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Z2tGB2Pv63lv_05atp3BhLZ5O-p51K40TQtMR0710Qt7DuyGPPlT4W1DQUIOPHHMlKcaXKfK2zGCaxlP4q8RoeXn_AJf5AEfkS7TJoZPd8jvIgPu4itGDds-yXdO7diAUphtdMNZNrllsfJM6S4P6mcB7rMpKLz2nrnAzx2vQ2yhQ Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.21 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 7df224a934af4cf79a1a5416e3ae8c34 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7df224a934af4cf79a1a5416e3ae8c34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7df224a934af4cf79a1a5416e3ae8c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7df224a934af4cf79a1a5416e3ae8c34", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7df224a934af4cf79a1a5416e3ae8c34"}]}] Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 7df224a934af4cf79a1a5416e3ae8c34 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-InstanceActionsV221TestJSON-1342484937-project Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2a949134f3bd4a23b2040a9a18d832dd Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-InstanceActionsV221TestJSON-1342484937-project Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fa3cbddb-c44b-4305-8f90-b40e813b2fb4'} Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:57.274562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.284752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.285668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.285668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.285668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.285668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.285668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.285668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.299887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Returning 404 to user: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:57.301140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-44ba2680-df88-44bd-b0e4-ffbbaf5d48c1 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 404 len: 111 microversion: 2.21 time: 0.084731 Oct 25 03:22:57.303524 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2062/4297] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:22:57 2022] DELETE /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:22:57.338604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:22:57.342124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] [instance: fa3cbddb-c44b-4305-8f90-b40e813b2fb4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:22:57.357511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.361233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.364778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.365988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:57.366923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:57.367628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:57.401907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] HTTP exception thrown: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Request method failure captured: Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 HTTP/1.1 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1Z2tGB2Pv63lv_05atp3BhLZ5O-p51K40TQtMR0710Qt7DuyGPPlT4W1DQUIOPHHMlKcaXKfK2zGCaxlP4q8RoeXn_AJf5AEfkS7TJoZPd8jvIgPu4itGDds-yXdO7diAUphtdMNZNrllsfJM6S4P6mcB7rMpKLz2nrnAzx2vQ2yhQ Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.21 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 7df224a934af4cf79a1a5416e3ae8c34 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7df224a934af4cf79a1a5416e3ae8c34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7df224a934af4cf79a1a5416e3ae8c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7df224a934af4cf79a1a5416e3ae8c34", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7df224a934af4cf79a1a5416e3ae8c34"}]}] Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 7df224a934af4cf79a1a5416e3ae8c34 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1342484937 Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-InstanceActionsV221TestJSON-1342484937-project Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 2a949134f3bd4a23b2040a9a18d832dd Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-InstanceActionsV221TestJSON-1342484937-project Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fa3cbddb-c44b-4305-8f90-b40e813b2fb4'} Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.403697 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] Returning 404 to user: Instance fa3cbddb-c44b-4305-8f90-b40e813b2fb4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:22:57.407741 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6035cbf1-95eb-449c-880b-48ae81cf79a9 tempest-InstanceActionsV221TestJSON-1342484937 tempest-InstanceActionsV221TestJSON-1342484937-project] 10.222.0.36 "GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4" status: 404 len: 111 microversion: 2.21 time: 0.081822 Oct 25 03:22:57.412230 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2063/4298] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:22:57 2022] GET /compute/v2.1/servers/fa3cbddb-c44b-4305-8f90-b40e813b2fb4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:22:58.478396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:22:58.490419 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb74ecc7-27fa-4f64-b6de-6d53c635482c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1485 microversion: 2.1 time: 1.231951 Oct 25 03:22:58.497887 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2236/4299] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:22:57 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1485 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:22:58.696848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1238614043", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:22:58.820116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] validate_networks() for [('425bd5a2-15f9-420d-af21-39cc92c0f832', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:22:59.902091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:22:59.902091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:22:59.903073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:22:59.903510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:22:59.903940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:22:59.922997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:59.923504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:59.923958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:59.924710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:22:59.925178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:22:59.925617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:22:59.964063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Getting quotas for project 03266c4fa04c4baf8cb148f9af4751fe. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:22:59.972478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Getting quotas for user 593f6a2ef5f34326afe8fe9addabc75d and project 03266c4fa04c4baf8cb148f9af4751fe. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:23:00.006305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:23:00.013793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:23:00.156843 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5739fbe1-3e7e-4ed2-935a-a1bcc947db30 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.458475 Oct 25 03:23:00.162326 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2064/4300] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:22:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:23:00.175035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-512f9e8f-fd13-462b-9461-0e6534020e6f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:00.176221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-512f9e8f-fd13-462b-9461-0e6534020e6f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:00.179715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:00.485234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-512f9e8f-fd13-462b-9461-0e6534020e6f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:00.494034 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-512f9e8f-fd13-462b-9461-0e6534020e6f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1214 microversion: 2.1 time: 0.323037 Oct 25 03:23:00.511297 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2237/4301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:00 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1214 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:01.519046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:01.519899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:01.539109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:01.548418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:01.549931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:01.551656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:01.553559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:01.554289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:01.721147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:01.736900 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c82cb16-2094-4e2c-9f7f-135f99b6d9bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1210 microversion: 2.1 time: 0.221378 Oct 25 03:23:01.740618 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2065/4302] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:01 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1210 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:02.771090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:02.771706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:02.789816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:02.791563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:02.792022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:02.792741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:02.796096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:02.797440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:03.088448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:03.108452 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d229551a-bbe6-4c5c-81f2-269293e3cce7 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1272 microversion: 2.1 time: 0.341334 Oct 25 03:23:03.114636 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2238/4303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:02 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:04.142124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:04.143382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:04.160152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:04.172856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:04.173392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:04.181816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:04.182572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:04.183039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:05.373762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:05.396617 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4dde3bd9-fae0-4928-a083-e1edbe89d49a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 1.259787 Oct 25 03:23:05.400291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2066/4304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:04 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:06.426862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:06.428293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:06.441868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:06.451145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:06.452976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:06.455258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:06.456683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:06.457900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:06.458693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:06.756824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5475941d-7e40-4fa3-baf1-d351db7f0c37 req-1ac90ea4-1e0a-4d6d-94c4-094d75ce2552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18683617-c2f1-4a72-93ea-1cd452d82b72", "tag": "83469b1e-8d9c-43e4-a8ae-52a3b86fb7ec"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:06.780480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5475941d-7e40-4fa3-baf1-d351db7f0c37 req-1ac90ea4-1e0a-4d6d-94c4-094d75ce2552 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:06.781560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5475941d-7e40-4fa3-baf1-d351db7f0c37 req-1ac90ea4-1e0a-4d6d-94c4-094d75ce2552 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:06.782092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5475941d-7e40-4fa3-baf1-d351db7f0c37 req-1ac90ea4-1e0a-4d6d-94c4-094d75ce2552 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:06.830646 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5475941d-7e40-4fa3-baf1-d351db7f0c37 req-1ac90ea4-1e0a-4d6d-94c4-094d75ce2552 service nova] Creating event network-changed:83469b1e-8d9c-43e4-a8ae-52a3b86fb7ec for instance 18683617-c2f1-4a72-93ea-1cd452d82b72 on n-h2-862355-1 Oct 25 03:23:06.837429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5475941d-7e40-4fa3-baf1-d351db7f0c37 req-1ac90ea4-1e0a-4d6d-94c4-094d75ce2552 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489749 Oct 25 03:23:06.838863 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2239/4305] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:07.443760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:07.465186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6900e8ab-c76f-4a84-bf0e-58ba42bb714c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 1.040132 Oct 25 03:23:07.472907 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2067/4306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:06 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:08.510724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:08.511643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:08.521722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:08.522640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:08.524873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:08.532000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:08.535037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:08.535659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:08.739093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:09.343140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:09.358997 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8a66bd19-d423-4e89-82f0-bfee48baa874 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.858296 Oct 25 03:23:09.378072 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2240/4307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:08 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:10.383797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:10.384614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:10.394066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:10.395251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:10.427745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:10.428300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:10.428924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:10.429660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:10.430152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:10.430587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:10.498333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:10.763809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:10.790463 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8b24f24-2e96-46d6-9076-bcdbe8e6cc5b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.409452 Oct 25 03:23:10.792754 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2068/4308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:10 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:10.860336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-408821764", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:10.980208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] validate_networks() for [('8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:23:11.820732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:11.821346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:11.839832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:11.840869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:11.843202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:11.843974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:11.844487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:11.844844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:12.198551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:12.209728 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b6fa1f79-f56c-4027-8a7c-36cd1cfe8235 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.393020 Oct 25 03:23:12.210319 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2069/4309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:11 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:12.713445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:23:12.714201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:23:12.714628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:23:12.715757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:23:12.716418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:23:12.727186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:12.727668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:12.728093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:12.729023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:12.729843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:12.730470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:12.749781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Getting quotas for project 72ae6a170f4f45d7afb16bbd44c1a1a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:23:12.755276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Getting quotas for user d6aab83e76f346efb38027f52a792eb1 and project 72ae6a170f4f45d7afb16bbd44c1a1a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:23:12.769978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:23:12.772533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:23:12.844545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cba9acb3-ffcf-488f-88b0-ab1199f945e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.417421 Oct 25 03:23:12.846226 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2241/4310] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:23:12.862440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa1fd85b-f1c3-4c84-8dc5-e414d7359c50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:12.863404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa1fd85b-f1c3-4c84-8dc5-e414d7359c50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:12.957207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18e8bb37-4739-4e30-930c-fee3788cc773 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1884705426", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:12.963543 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-18e8bb37-4739-4e30-930c-fee3788cc773 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] HTTP exception thrown: min_count must be <= max_count Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18e8bb37-4739-4e30-930c-fee3788cc773 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Request method failure captured: Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 184 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1agSPMSkUxGQMhATI6LYtS9PXEsa0981-tskhh8MXs94Q6lZwigtc11f6yztpXRzDnp8lBnHLh5W-HeBGZms7cnxc3wg6_4ycTDJdOBrNtVGRhkZy18HhRgn2f4tPYddQ2rEbn_WJaSETqafl3l4cSWB9a3wXR8RPMvG1Mqz9FtUHI Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8f765ab439ed44a6a716cfff678b0ce7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8f765ab439ed44a6a716cfff678b0ce7"}]}] Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 06fd934c330347e6a511d856863f5fa9 Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1884705426", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: exception: min_count must be <= max_count Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1884705426', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 25 03:23:12.970113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:12.975842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18e8bb37-4739-4e30-930c-fee3788cc773 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Returning 400 to user: min_count must be <= max_count {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:23:12.977042 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18e8bb37-4739-4e30-930c-fee3788cc773 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.205736 Oct 25 03:23:12.978250 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2070/4311] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:12 2022] POST /compute/v2.1/servers => generated 74 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 25 03:23:13.063724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b172e885-8ffa-4d0b-98c0-803c1b141fe2 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1644720619", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "max_count": 0}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b172e885-8ffa-4d0b-98c0-803c1b141fe2 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Request method failure captured: Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 168 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1agSPMSkUxGQMhATI6LYtS9PXEsa0981-tskhh8MXs94Q6lZwigtc11f6yztpXRzDnp8lBnHLh5W-HeBGZms7cnxc3wg6_4ycTDJdOBrNtVGRhkZy18HhRgn2f4tPYddQ2rEbn_WJaSETqafl3l4cSWB9a3wXR8RPMvG1Mqz9FtUHI Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8f765ab439ed44a6a716cfff678b0ce7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8f765ab439ed44a6a716cfff678b0ce7"}]}] Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 06fd934c330347e6a511d856863f5fa9 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1644720619", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "max_count": 0}} Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1644720619', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'max_count': 0}}} Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 0 Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:23:13.079523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 25 03:23:13.084547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.086489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b172e885-8ffa-4d0b-98c0-803c1b141fe2 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:23:13.087605 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b172e885-8ffa-4d0b-98c0-803c1b141fe2 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.035699 Oct 25 03:23:13.088835 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2071/4312] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:23:13.161874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66b737cb-ce8a-44c7-b7a9-af5c9675ada8 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-526117543", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "max_count": 2.5}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66b737cb-ce8a-44c7-b7a9-af5c9675ada8 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Request method failure captured: Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 169 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1agSPMSkUxGQMhATI6LYtS9PXEsa0981-tskhh8MXs94Q6lZwigtc11f6yztpXRzDnp8lBnHLh5W-HeBGZms7cnxc3wg6_4ycTDJdOBrNtVGRhkZy18HhRgn2f4tPYddQ2rEbn_WJaSETqafl3l4cSWB9a3wXR8RPMvG1Mqz9FtUHI Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8f765ab439ed44a6a716cfff678b0ce7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8f765ab439ed44a6a716cfff678b0ce7"}]}] Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 06fd934c330347e6a511d856863f5fa9 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-526117543", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "max_count": 2.5}} Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-526117543', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'max_count': 2.5}}} Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 2.5 Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:23:13.172365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.177352 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.178685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66b737cb-ce8a-44c7-b7a9-af5c9675ada8 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:23:13.179703 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66b737cb-ce8a-44c7-b7a9-af5c9675ada8 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027220 Oct 25 03:23:13.182272 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2072/4313] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:23:13.238117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:13.239331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:13.256482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:13.256979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:13.257609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:13.258377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:13.259007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:13.259903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:13.276687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fa1fd85b-f1c3-4c84-8dc5-e414d7359c50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:13.287429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa1fd85b-f1c3-4c84-8dc5-e414d7359c50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1216 microversion: 2.1 time: 0.433473 Oct 25 03:23:13.288891 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2242/4314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:12 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1216 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:13.298714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eeee690e-360e-4d73-9071-c5bdbe27241e tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-388985386", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 0}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eeee690e-360e-4d73-9071-c5bdbe27241e tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Request method failure captured: Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 167 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1agSPMSkUxGQMhATI6LYtS9PXEsa0981-tskhh8MXs94Q6lZwigtc11f6yztpXRzDnp8lBnHLh5W-HeBGZms7cnxc3wg6_4ycTDJdOBrNtVGRhkZy18HhRgn2f4tPYddQ2rEbn_WJaSETqafl3l4cSWB9a3wXR8RPMvG1Mqz9FtUHI Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8f765ab439ed44a6a716cfff678b0ce7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8f765ab439ed44a6a716cfff678b0ce7"}]}] Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 06fd934c330347e6a511d856863f5fa9 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-388985386", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 0}} Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-388985386', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'min_count': 0}}} Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 0 Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:23:13.314190 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 25 03:23:13.318984 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.324325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eeee690e-360e-4d73-9071-c5bdbe27241e tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:23:13.332518 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eeee690e-360e-4d73-9071-c5bdbe27241e tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.042216 Oct 25 03:23:13.333439 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2243/4315] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:13 2022] POST /compute/v2.1/servers => generated 130 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:23:13.389485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1b016f5-f282-40bf-95f5-3d0ed8915098 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-34106574", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 2.5}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1b016f5-f282-40bf-95f5-3d0ed8915098 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Request method failure captured: Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 168 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1agSPMSkUxGQMhATI6LYtS9PXEsa0981-tskhh8MXs94Q6lZwigtc11f6yztpXRzDnp8lBnHLh5W-HeBGZms7cnxc3wg6_4ycTDJdOBrNtVGRhkZy18HhRgn2f4tPYddQ2rEbn_WJaSETqafl3l4cSWB9a3wXR8RPMvG1Mqz9FtUHI Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8f765ab439ed44a6a716cfff678b0ce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8f765ab439ed44a6a716cfff678b0ce7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8f765ab439ed44a6a716cfff678b0ce7"}]}] Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8f765ab439ed44a6a716cfff678b0ce7 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1441796955 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 06fd934c330347e6a511d856863f5fa9 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1441796955-project Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-34106574", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "min_count": 2.5}} Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-34106574', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'min_count': 2.5}}} Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 2.5 Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:23:13.393761 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1b016f5-f282-40bf-95f5-3d0ed8915098 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:23:13.404801 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1b016f5-f282-40bf-95f5-3d0ed8915098 tempest-MultipleCreateNegativeTestJSON-1441796955 tempest-MultipleCreateNegativeTestJSON-1441796955-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011416 Oct 25 03:23:13.407725 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2244/4316] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:13 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:23:13.538859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:13.557733 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57b7a13e-42e9-4182-9986-b066d558d350 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.323930 Oct 25 03:23:13.558653 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2073/4317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:13 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:14.317736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:14.318377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:14.342215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:14.342760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:14.343211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:14.348935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:14.349513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:14.350004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:14.523276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:14.540559 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0540b8fb-8526-422c-b717-f4fa8dd92026 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1268 microversion: 2.1 time: 0.232242 Oct 25 03:23:14.546867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2245/4318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:14 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1268 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:14.589382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:14.592847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:14.609357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:14.612283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:14.636379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:14.640079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:14.640980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:14.641602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:15.127261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:15.138098 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15f99d33-bda2-4cc3-a564-c586cad9cf5a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.552599 Oct 25 03:23:15.153261 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2074/4319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:14 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:15.432624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:15.433758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:15.443434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:15.443941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:15.444390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:15.445114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:15.445578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:15.446187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:15.520280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:23:15.568278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:15.569149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:15.579678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:15.580553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:15.581246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:15.587254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:15.594943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:15.596194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:15.734914 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af1d4fad-39fd-447b-95cc-83853c878e6e tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 204 len: 0 microversion: 2.32 time: 0.623659 Oct 25 03:23:15.736275 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2246/4320] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:23:15 2022] DELETE /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:23:15.745698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:15.746990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:15.761338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:15.766063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:15.766713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:15.775613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:15.776295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:15.776911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:15.818458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:15.828473 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d167599-34a4-47b3-a929-de01c21ea4f2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1274 microversion: 2.1 time: 0.264670 Oct 25 03:23:15.837771 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2075/4321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:15 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:16.180553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:16.182299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:16.193587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:16.197306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:16.197816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:16.198570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:16.202396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:16.203077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:16.246084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:16.341053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:16.358902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:16.360637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:16.363591 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee144ad1-a84b-475c-9e93-874430dd8244 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2950 microversion: 2.32 time: 0.622600 Oct 25 03:23:16.366148 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2247/4322] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:15 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2950 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:16.760019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:16.783046 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e49b66ba-c540-4e16-aa91-a0fd5ad12d06 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.604135 Oct 25 03:23:16.800111 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2076/4323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:16 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:16.856476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:16.857792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:16.874973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:16.875510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:16.875971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:16.876764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:16.877234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:16.877803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:17.399301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:17.400284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:17.431003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:17.439658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:17.441316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:17.442545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:17.443974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:17.445086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:17.801643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:17.816947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-927628ee-2460-4ffb-983d-7082c4d96942 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 0.964494 Oct 25 03:23:17.818834 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2248/4324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:16 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:17.828193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7f01cffb-26a6-480c-b109-880c7e09468f req-4af6bfd6-5932-402b-9ae7-229bff85c41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18683617-c2f1-4a72-93ea-1cd452d82b72", "name": "network-vif-plugged", "status": "completed", "tag": "83469b1e-8d9c-43e4-a8ae-52a3b86fb7ec"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:17.854251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f01cffb-26a6-480c-b109-880c7e09468f req-4af6bfd6-5932-402b-9ae7-229bff85c41b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:17.858235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f01cffb-26a6-480c-b109-880c7e09468f req-4af6bfd6-5932-402b-9ae7-229bff85c41b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:17.874986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7f01cffb-26a6-480c-b109-880c7e09468f req-4af6bfd6-5932-402b-9ae7-229bff85c41b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:17.906215 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7f01cffb-26a6-480c-b109-880c7e09468f req-4af6bfd6-5932-402b-9ae7-229bff85c41b service nova] Creating event network-vif-plugged:83469b1e-8d9c-43e4-a8ae-52a3b86fb7ec for instance 18683617-c2f1-4a72-93ea-1cd452d82b72 on n-h2-862355-1 Oct 25 03:23:17.920606 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7f01cffb-26a6-480c-b109-880c7e09468f req-4af6bfd6-5932-402b-9ae7-229bff85c41b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100274 Oct 25 03:23:17.925133 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2249/4325] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:17.939947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:17.945329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:17.963794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:17.964387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:17.964840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:17.965874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:17.966505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:17.967307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:18.464121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:18.492953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:18.499728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:18.504862 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77c66c96-e654-4055-80de-e3ea9f6da2cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2950 microversion: 2.32 time: 1.109935 Oct 25 03:23:18.529071 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2077/4326] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:17 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2950 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:18.792129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:18.811166 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44c0ec17-b9de-44c0-b9f4-df2e6bc23c31 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.881400 Oct 25 03:23:18.812151 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2250/4327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:17 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:18.848958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:18.850275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:18.872012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:18.872711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:18.873202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:18.892513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:18.893353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:18.894018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:19.289527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-65959ee7-6a1e-4802-90be-341bcf4b6013 req-8017d3ef-8685-41c1-8cce-9b571d00e1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ad2d83-3644-4094-9f43-2cfcb61f180c", "tag": "7c40a79e-7be9-44c4-a654-5bda23bdf574"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:19.313896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-65959ee7-6a1e-4802-90be-341bcf4b6013 req-8017d3ef-8685-41c1-8cce-9b571d00e1bf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:19.314639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-65959ee7-6a1e-4802-90be-341bcf4b6013 req-8017d3ef-8685-41c1-8cce-9b571d00e1bf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:19.315245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-65959ee7-6a1e-4802-90be-341bcf4b6013 req-8017d3ef-8685-41c1-8cce-9b571d00e1bf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:19.345229 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-65959ee7-6a1e-4802-90be-341bcf4b6013 req-8017d3ef-8685-41c1-8cce-9b571d00e1bf service nova] Creating event network-changed:7c40a79e-7be9-44c4-a654-5bda23bdf574 for instance 01ad2d83-3644-4094-9f43-2cfcb61f180c on n-h1-862355-1 Oct 25 03:23:19.359603 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-65959ee7-6a1e-4802-90be-341bcf4b6013 req-8017d3ef-8685-41c1-8cce-9b571d00e1bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074953 Oct 25 03:23:19.360418 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2251/4328] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:23:19.431887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:19.442381 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1afd3470-5e05-465b-ad7d-81a5378ab6c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 0.600463 Oct 25 03:23:19.445332 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2078/4329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:18 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:19.539769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:19.540473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:19.549412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:19.550181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:19.550779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:19.551681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:19.552299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:19.552895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:19.840844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:19.841528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:19.864104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:19.864626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:19.865074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:19.869495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:19.870181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:19.874162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:20.107580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:20.127993 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8b3d042-2016-400d-a5fc-4cd2e3be678c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1314 microversion: 2.1 time: 0.292107 Oct 25 03:23:20.145032 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2079/4330] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:19 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:20.354517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:20.372405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:20.374278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:20.376037 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30c4baf7-268f-4ff3-ad36-18acc865d065 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2950 microversion: 2.32 time: 0.840447 Oct 25 03:23:20.390340 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2252/4331] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:19 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2950 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:20.481884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:20.482809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:20.496540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:20.497255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:20.497731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:20.498465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:20.512347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:20.512951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.155905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:21.157112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:21.171754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.172522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.177635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.178652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.179290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.179880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.433477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:21.445858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f72ed0c3-98c0-43c4-b852-9ac703d5a283 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 0.981655 Oct 25 03:23:21.447139 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2080/4332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:20 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:21.453038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:21.453896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:21.460438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.461398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.462064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.462951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.463592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.464183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.682415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:21.692974 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b83f19c-69a1-43aa-b3af-6e4c2f580523 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1499 microversion: 2.1 time: 0.541681 Oct 25 03:23:21.693586 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2253/4333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:21 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1499 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:21.723004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:21.726550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:21.738321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.739035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.740122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.740949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.741516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.742493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.773995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lazy-loading 'flavor' on Instance uuid 18683617-c2f1-4a72-93ea-1cd452d82b72 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:23:21.922025 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aeefbdbe-63e4-40a7-bfbd-c1d74557075d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "POST /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72/action" status: 200 len: 32 microversion: 2.1 time: 0.207649 Oct 25 03:23:21.923327 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2254/4334] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:23:21 2022] POST /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:23:21.935991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:21.936984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:21.946070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.947592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.952131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:21.953474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:21.954327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:21.955272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:22.083427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:22.101940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:22.103661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:22.104990 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6fa6b91-e8f6-4c08-ab6f-9c2fa635c1c1 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2929 microversion: 2.32 time: 0.656636 Oct 25 03:23:22.105636 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2081/4335] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:21 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2929 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:22.140079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-501b295f-2d11-430e-b607-7da173d09e33 req-034cd83a-8ced-4da5-82d4-4c6b89a62a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-unplugged", "status": "completed", "tag": "4d408fc1-c38d-41df-b975-f734805dd002"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:22.161411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-501b295f-2d11-430e-b607-7da173d09e33 req-034cd83a-8ced-4da5-82d4-4c6b89a62a91 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:22.170017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-501b295f-2d11-430e-b607-7da173d09e33 req-034cd83a-8ced-4da5-82d4-4c6b89a62a91 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:22.170813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-501b295f-2d11-430e-b607-7da173d09e33 req-034cd83a-8ced-4da5-82d4-4c6b89a62a91 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:22.195585 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-501b295f-2d11-430e-b607-7da173d09e33 req-034cd83a-8ced-4da5-82d4-4c6b89a62a91 service nova] Creating event network-vif-unplugged:4d408fc1-c38d-41df-b975-f734805dd002 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:22.211107 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-501b295f-2d11-430e-b607-7da173d09e33 req-034cd83a-8ced-4da5-82d4-4c6b89a62a91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076972 Oct 25 03:23:22.212377 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2082/4336] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:23:22.475387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:22.477276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:22.493958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:22.496529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:22.505816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:22.513933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:22.516404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:22.523701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:22.739748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:22.957777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:22.980527 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c5cb324c-86a1-4238-8243-c911288d1903 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 1.051755 Oct 25 03:23:22.981699 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2255/4337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:21 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:23.140326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:23.143155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:23.166150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:23.169113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:23.172042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:23.174300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:23.177058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:23.179696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:23.283787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:23.338158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:23.358700 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6c85c4f-047a-4fe5-92b8-7d975b6b5ba0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 0.886066 Oct 25 03:23:23.383745 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2083/4338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:22 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:23.969438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:23.983844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:23.987322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:23.988625 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5683c29a-c890-4738-92f7-97fe83963168 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2908 microversion: 2.32 time: 0.852847 Oct 25 03:23:23.994639 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2256/4339] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:23 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2908 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:24.014245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:24.014245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:24.025392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:24.031340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:24.031888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:24.032661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:24.033144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:24.033585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:24.262437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4c14f51d-000a-4a4d-b72c-c055798c363b req-df3aac35-5434-4271-88c4-de64fd5a6512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-unplugged", "status": "completed", "tag": "f262a55a-b193-4212-8269-aba78af92fa8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:24.280713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4c14f51d-000a-4a4d-b72c-c055798c363b req-df3aac35-5434-4271-88c4-de64fd5a6512 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:24.286344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4c14f51d-000a-4a4d-b72c-c055798c363b req-df3aac35-5434-4271-88c4-de64fd5a6512 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:24.286822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4c14f51d-000a-4a4d-b72c-c055798c363b req-df3aac35-5434-4271-88c4-de64fd5a6512 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:24.287467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:24.301818 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e47466ae-af2b-48a1-87b6-bd58d23aa8cd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.296873 Oct 25 03:23:24.303157 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2084/4340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:24 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:24.318466 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4c14f51d-000a-4a4d-b72c-c055798c363b req-df3aac35-5434-4271-88c4-de64fd5a6512 service nova] Creating event network-vif-unplugged:f262a55a-b193-4212-8269-aba78af92fa8 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:24.325859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4c14f51d-000a-4a4d-b72c-c055798c363b req-df3aac35-5434-4271-88c4-de64fd5a6512 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072294 Oct 25 03:23:24.327060 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2257/4341] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:24.391575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:24.392216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:24.401177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:24.401597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:24.402241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:24.403893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:24.404534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:24.405997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:24.740858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:24.757804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57310630-98f1-4be1-ba70-79583850fe4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 0.372639 Oct 25 03:23:24.774151 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2085/4342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:24 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:25.033498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:25.034385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:25.071850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:25.072892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:25.073564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:25.077342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:25.080745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:25.081546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:25.241854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-cdd3d796-2afa-4da1-8f10-1e2251b50bba req-154da177-d193-4eda-917a-f71b02461607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-deleted", "tag": "f262a55a-b193-4212-8269-aba78af92fa8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:25.266379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cdd3d796-2afa-4da1-8f10-1e2251b50bba req-154da177-d193-4eda-917a-f71b02461607 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:25.268338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cdd3d796-2afa-4da1-8f10-1e2251b50bba req-154da177-d193-4eda-917a-f71b02461607 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:25.269586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cdd3d796-2afa-4da1-8f10-1e2251b50bba req-154da177-d193-4eda-917a-f71b02461607 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:25.308525 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-cdd3d796-2afa-4da1-8f10-1e2251b50bba req-154da177-d193-4eda-917a-f71b02461607 service nova] Creating event network-vif-deleted:f262a55a-b193-4212-8269-aba78af92fa8 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:25.327433 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-cdd3d796-2afa-4da1-8f10-1e2251b50bba req-154da177-d193-4eda-917a-f71b02461607 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089761 Oct 25 03:23:25.328062 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2086/4343] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:23:25.336590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:25.342714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:25.358792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:25.359473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:25.360555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:25.362511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:25.369288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:25.369892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:25.836709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:25.855243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:25.863630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:25.869123 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-35ac7e34-2ac8-4319-aac5-1a74ce343757 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2862 microversion: 2.32 time: 0.836699 Oct 25 03:23:25.873384 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2258/4344] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:25 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2862 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:25.895174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:25.898205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:25.921494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:25.922024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:25.922452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:25.923167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:25.923627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:25.924057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:25.957150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:26.427430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:26.437059 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c39571c-36f2-40c7-9663-70298a02e689 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 1.106879 Oct 25 03:23:26.437714 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2087/4345] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:25 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:26.451941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-364dafeb-5305-48e0-b740-775a75a2d465 req-a8796915-a6b5-42dd-be6a-450e60fccca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-unplugged", "status": "completed", "tag": "4080e02e-5d05-4b9c-8e35-fe42cbed4c96"}, {"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-unplugged", "status": "completed", "tag": "1a0e64be-54b2-4f1d-b5a8-f846755d9c1b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:26.477586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-364dafeb-5305-48e0-b740-775a75a2d465 req-a8796915-a6b5-42dd-be6a-450e60fccca6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:26.478482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-364dafeb-5305-48e0-b740-775a75a2d465 req-a8796915-a6b5-42dd-be6a-450e60fccca6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:26.480436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-364dafeb-5305-48e0-b740-775a75a2d465 req-a8796915-a6b5-42dd-be6a-450e60fccca6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:26.513902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-364dafeb-5305-48e0-b740-775a75a2d465 req-a8796915-a6b5-42dd-be6a-450e60fccca6 service nova] Creating event network-vif-unplugged:4080e02e-5d05-4b9c-8e35-fe42cbed4c96 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:26.519265 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-364dafeb-5305-48e0-b740-775a75a2d465 req-a8796915-a6b5-42dd-be6a-450e60fccca6 service nova] Creating event network-vif-unplugged:1a0e64be-54b2-4f1d-b5a8-f846755d9c1b for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:26.530375 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-364dafeb-5305-48e0-b740-775a75a2d465 req-a8796915-a6b5-42dd-be6a-450e60fccca6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.086938 Oct 25 03:23:26.532657 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2088/4346] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:26.906381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:26.907237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:26.918900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:26.919641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:26.927615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:26.928492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:26.929065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:26.929585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:27.307842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:27.327789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6b9d7095-e0b2-4b17-ad63-eb5bbaad58ac tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 1.452359 Oct 25 03:23:27.333140 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2259/4347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:25 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:27.413171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:27.440546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:27.442844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:27.444418 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed6c574b-5699-4885-ad0d-0274371d3373 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2749 microversion: 2.32 time: 0.543609 Oct 25 03:23:27.449782 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2089/4348] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:26 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2749 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:27.464548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:27.471014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:27.485629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:27.498458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:27.498923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:27.501816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:27.502338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:27.504049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:27.935693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d2410096-2931-4739-bda8-0f81822c5d12 req-e05c596e-3eff-445f-9720-468f35b51a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-deleted", "tag": "c0254f2d-b694-462b-8660-c868db54fe1d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:27.961397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d2410096-2931-4739-bda8-0f81822c5d12 req-e05c596e-3eff-445f-9720-468f35b51a8c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:27.962142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d2410096-2931-4739-bda8-0f81822c5d12 req-e05c596e-3eff-445f-9720-468f35b51a8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:27.965361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d2410096-2931-4739-bda8-0f81822c5d12 req-e05c596e-3eff-445f-9720-468f35b51a8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:28.052502 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d2410096-2931-4739-bda8-0f81822c5d12 req-e05c596e-3eff-445f-9720-468f35b51a8c service nova] Creating event network-vif-deleted:c0254f2d-b694-462b-8660-c868db54fe1d for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:28.066155 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d2410096-2931-4739-bda8-0f81822c5d12 req-e05c596e-3eff-445f-9720-468f35b51a8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135212 Oct 25 03:23:28.067742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2090/4349] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:28.359915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:28.360645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:28.382143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:28.385323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:28.388492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:28.390722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:28.397619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:28.398415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:28.472332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:28.486947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f36f4c9c-5b4f-4942-ae8e-46e7d375044d tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 1.026199 Oct 25 03:23:28.487540 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2260/4350] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:27 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:28.517093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:28.517925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:28.535220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:28.537298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:28.537882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:28.548584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:28.549201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:28.550970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:29.147529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:29.162572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:29.164465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:29.171391 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6771e676-0d66-4954-a635-c09b5ab835cb tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2589 microversion: 2.32 time: 0.676033 Oct 25 03:23:29.172337 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2261/4351] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:28 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2589 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:29.177301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e31d0949-b676-4ac2-a0a1-35e256c65806 req-90da074d-77f3-46c4-9a99-94ce8675cea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-unplugged", "status": "completed", "tag": "c0254f2d-b694-462b-8660-c868db54fe1d"}, {"server_uuid": "01ad2d83-3644-4094-9f43-2cfcb61f180c", "name": "network-vif-plugged", "status": "completed", "tag": "7c40a79e-7be9-44c4-a654-5bda23bdf574"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:29.206392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e31d0949-b676-4ac2-a0a1-35e256c65806 req-90da074d-77f3-46c4-9a99-94ce8675cea0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:29.206903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e31d0949-b676-4ac2-a0a1-35e256c65806 req-90da074d-77f3-46c4-9a99-94ce8675cea0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:29.207349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e31d0949-b676-4ac2-a0a1-35e256c65806 req-90da074d-77f3-46c4-9a99-94ce8675cea0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:29.226462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e31d0949-b676-4ac2-a0a1-35e256c65806 req-90da074d-77f3-46c4-9a99-94ce8675cea0 service nova] Creating event network-vif-unplugged:c0254f2d-b694-462b-8660-c868db54fe1d for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:29.227479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e31d0949-b676-4ac2-a0a1-35e256c65806 req-90da074d-77f3-46c4-9a99-94ce8675cea0 service nova] Creating event network-vif-plugged:7c40a79e-7be9-44c4-a654-5bda23bdf574 for instance 01ad2d83-3644-4094-9f43-2cfcb61f180c on n-h1-862355-1 Oct 25 03:23:29.237618 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e31d0949-b676-4ac2-a0a1-35e256c65806 req-90da074d-77f3-46c4-9a99-94ce8675cea0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.063717 Oct 25 03:23:29.239085 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2262/4352] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:29.301582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:29.338458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 0.980232 Oct 25 03:23:29.341304 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2091/4353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:28 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:29.513404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:29.514325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:29.529671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:29.532899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:29.533368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:29.534151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:29.534874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:29.535308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:29.975601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:29.976872 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-af0235d2-0351-4b3b-9ddf-fcf6f6c74785 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001579 Oct 25 03:23:29.977222 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2092/4354] 10.222.0.36 () {56 vars in 886 bytes} [Tue Oct 25 03:23:29 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 25 03:23:30.037622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:30.068516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3147d910-2e6b-499e-9b94-e326619dcf5e tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.559604 Oct 25 03:23:30.069693 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2263/4355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:29 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:30.190008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-fa1791ed-0d57-423e-9d99-c7bf39c1d2be req-96d7d9be-da33-477e-8d84-a2f30e1c4009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-deleted", "tag": "4d408fc1-c38d-41df-b975-f734805dd002"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:30.202057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:30.202293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fa1791ed-0d57-423e-9d99-c7bf39c1d2be req-96d7d9be-da33-477e-8d84-a2f30e1c4009 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:30.203085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fa1791ed-0d57-423e-9d99-c7bf39c1d2be req-96d7d9be-da33-477e-8d84-a2f30e1c4009 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:30.203517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fa1791ed-0d57-423e-9d99-c7bf39c1d2be req-96d7d9be-da33-477e-8d84-a2f30e1c4009 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:30.208084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:30.225442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:30.226507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:30.227085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:30.228063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:30.230290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:30.234235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:30.259041 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-fa1791ed-0d57-423e-9d99-c7bf39c1d2be req-96d7d9be-da33-477e-8d84-a2f30e1c4009 service nova] Creating event network-vif-deleted:4d408fc1-c38d-41df-b975-f734805dd002 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:30.271636 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-fa1791ed-0d57-423e-9d99-c7bf39c1d2be req-96d7d9be-da33-477e-8d84-a2f30e1c4009 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084593 Oct 25 03:23:30.273468 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2093/4356] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:30.382224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:30.382944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:30.396573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:30.397150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:30.399063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:30.399971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:30.402512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:30.404358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:30.828999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:30.840920 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b6bad5a-cc72-46d9-8ab7-97251835a9b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1316 microversion: 2.1 time: 0.461309 Oct 25 03:23:30.843240 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2094/4357] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:30 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:30.956415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:30.967155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:30.969207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:30.971070 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c78c24da-7f64-48df-82d6-c2aff1a20d7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2543 microversion: 2.32 time: 0.773451 Oct 25 03:23:30.972129 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2264/4358] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:30 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2543 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:31.095601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:31.096425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:31.131613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:31.132736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:31.134456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:31.139999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:31.140970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:31.141641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:31.465508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:31.481290 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56defac7-9854-425c-9d92-5fbaad2713d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.390293 Oct 25 03:23:31.481917 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2095/4359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:31 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:31.867879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:31.868758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:31.880222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:31.885063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:31.885852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:31.886455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:31.888253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:31.888986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:31.889570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:32.012310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:32.014152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:32.031318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:32.032389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:32.032998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:32.033947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:32.034830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:32.035432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:32.290880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:32.305436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:32.308946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:32.312014 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd38cc3a-94e6-4307-a7c9-56b113a2b9c6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2340 microversion: 2.32 time: 0.309564 Oct 25 03:23:32.313428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2096/4360] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:32 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2340 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:32.449466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:32.457813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d51d0d5e-49e3-4bfc-adff-a1ec9969101e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.594339 Oct 25 03:23:32.460377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2265/4361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:31 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:32.507790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:32.508504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:32.520249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:32.522804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:32.523404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:32.524220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:32.526549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:32.527592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:32.571955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:32.679829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1352334012", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:32.786524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] validate_networks() for [('8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:23:32.877864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:32.894029 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dde45edb-2354-4f35-bbb8-f03cb43dab43 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.390338 Oct 25 03:23:32.910129 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2097/4362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:32 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:33.141206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d3c4e1e7-a4dc-494e-be29-a7c4e608f890 req-bdf9f60b-33d1-4a47-b7e0-1dafe3fdf23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-deleted", "tag": "1a0e64be-54b2-4f1d-b5a8-f846755d9c1b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:33.159335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d3c4e1e7-a4dc-494e-be29-a7c4e608f890 req-bdf9f60b-33d1-4a47-b7e0-1dafe3fdf23b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:33.165114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d3c4e1e7-a4dc-494e-be29-a7c4e608f890 req-bdf9f60b-33d1-4a47-b7e0-1dafe3fdf23b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:33.168986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d3c4e1e7-a4dc-494e-be29-a7c4e608f890 req-bdf9f60b-33d1-4a47-b7e0-1dafe3fdf23b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:33.202938 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d3c4e1e7-a4dc-494e-be29-a7c4e608f890 req-bdf9f60b-33d1-4a47-b7e0-1dafe3fdf23b service nova] Creating event network-vif-deleted:1a0e64be-54b2-4f1d-b5a8-f846755d9c1b for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:33.248351 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d3c4e1e7-a4dc-494e-be29-a7c4e608f890 req-bdf9f60b-33d1-4a47-b7e0-1dafe3fdf23b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098333 Oct 25 03:23:33.249773 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2098/4363] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:23:33.342422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:33.343497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:33.355600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:33.356446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:33.357057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:33.357981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:33.358588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:33.359342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:33.831960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:33.860900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:33.869013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:33.871705 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8c88220-4b0e-404f-a91c-2f30d07ebb21 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 2053 microversion: 2.32 time: 0.535197 Oct 25 03:23:33.885718 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2099/4364] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:33 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 2053 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:33.938466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:33.939098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:33.970254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:33.970761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:33.971220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:33.976613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:33.977273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:33.977745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:34.908259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:34.918140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a737b9d7-a42f-4066-8392-2f5c35f28d82 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.988283 Oct 25 03:23:34.939336 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2100/4365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:33 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:34.944614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:34.950788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:34.963516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:34.970467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:34.971219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:34.972162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:34.972794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:34.973392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:35.089469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:23:35.090327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:23:35.091135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:23:35.091711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:23:35.092289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:23:35.116075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:35.116580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:35.123815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:35.124559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:35.127904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:35.131020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:35.181253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:35.202305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:35.204455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:35.206078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a713431-85c2-4673-b1ae-f1a3a0744488 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1986 microversion: 2.32 time: 0.265369 Oct 25 03:23:35.222852 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2101/4366] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:34 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1986 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:35.242311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Getting quotas for project 72ae6a170f4f45d7afb16bbd44c1a1a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:23:35.254388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Getting quotas for user d6aab83e76f346efb38027f52a792eb1 and project 72ae6a170f4f45d7afb16bbd44c1a1a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:23:35.294353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:23:35.300801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:23:35.388813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3756ed9b-5f64-44f4-bc05-9d3a38eeb429 req-6727c848-5241-4592-83e0-3aeba51fb0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bff279-697d-42ca-af7a-ff9a4bea3977", "name": "network-vif-deleted", "tag": "4080e02e-5d05-4b9c-8e35-fe42cbed4c96"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:35.404678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3756ed9b-5f64-44f4-bc05-9d3a38eeb429 req-6727c848-5241-4592-83e0-3aeba51fb0bc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:35.405460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3756ed9b-5f64-44f4-bc05-9d3a38eeb429 req-6727c848-5241-4592-83e0-3aeba51fb0bc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:35.406949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3756ed9b-5f64-44f4-bc05-9d3a38eeb429 req-6727c848-5241-4592-83e0-3aeba51fb0bc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:35.422775 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3756ed9b-5f64-44f4-bc05-9d3a38eeb429 req-6727c848-5241-4592-83e0-3aeba51fb0bc service nova] Creating event network-vif-deleted:4080e02e-5d05-4b9c-8e35-fe42cbed4c96 for instance a3bff279-697d-42ca-af7a-ff9a4bea3977 on n-h2-862355-1 Oct 25 03:23:35.432948 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3756ed9b-5f64-44f4-bc05-9d3a38eeb429 req-6727c848-5241-4592-83e0-3aeba51fb0bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049223 Oct 25 03:23:35.434861 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2102/4367] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:23:35.451813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9d65ad1-a8fb-4d3e-8564-eb0bc6c6d2e5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.776563 Oct 25 03:23:35.452487 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2266/4368] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:23:35.485757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6186064b-3789-44be-ae48-380f71cc427a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:35.488120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6186064b-3789-44be-ae48-380f71cc427a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:35.874958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6186064b-3789-44be-ae48-380f71cc427a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:35.900921 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6186064b-3789-44be-ae48-380f71cc427a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1217 microversion: 2.1 time: 0.434236 Oct 25 03:23:35.906428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2103/4369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:35 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1217 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:35.947111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:35.947856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:35.968357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:35.972187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:35.972765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:35.973779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:35.982555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:35.986087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:36.240538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:36.241153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:36.252173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:36.253092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:36.254192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:36.256366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:36.257009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:36.258756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:36.462497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:36.489658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b4d74b8-e268-4cca-8bc3-a7dde30f8e1f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.540310 Oct 25 03:23:36.493343 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2267/4370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:35 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:36.536335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:36.563248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:36.573310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:36.575459 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-40a08700-7b8b-4369-877a-8d60556cce14 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.338850 Oct 25 03:23:36.576060 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2104/4371] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:36 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:36.932680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:36.933470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:36.947316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:36.947900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:36.949481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:36.950884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:36.951627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:36.952217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:37.449583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:37.468306 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6858a1d-e947-48b9-84e6-f04751d3f1c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1221 microversion: 2.1 time: 0.539495 Oct 25 03:23:37.474001 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2268/4372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:36 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1221 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:37.520070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:37.520699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:37.523779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=70 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:37.539684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:37.540172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:37.540623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:37.541345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:37.541842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:37.549629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:37.606782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:37.608806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:37.629601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:37.630125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:37.635095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:37.635846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:37.636329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:37.641479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:37.974759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:38.028471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:38.030788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:38.033545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e968c2ca-43c9-4431-9b3a-a0543f9530dd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.431707 Oct 25 03:23:38.037594 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2269/4373] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:37 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:38.495926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:38.497257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:38.516645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:38.518273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:38.520843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:38.521649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:38.522669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:38.524109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:38.752640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:38.761171 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d85f24f-15c2-4878-98de-dde945fb994c tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 1.244975 Oct 25 03:23:38.781742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2105/4374] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:37 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:38.869244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:38.884623 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9f8c641-18dd-4c2e-80f3-837157414cab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1269 microversion: 2.1 time: 0.393908 Oct 25 03:23:38.885223 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2270/4375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:38 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1269 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:39.077797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:39.078707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:39.087526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.088232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.088865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:39.090065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.090699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.091298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:39.131137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "409b84d2-07d8-4c49-8abe-3856290a74a9"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:39.133831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:39.144767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.145510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.149161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:39.150229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.150865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.154742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:39.270321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:39.308866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:39.323467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:39.329193 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-38b7e8eb-8641-4aad-a6fd-25d0edeed4c3 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.253404 Oct 25 03:23:39.343639 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2106/4376] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:39 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:39.629024 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-818a201e-eeda-4f7a-a943-52326787866b tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "POST /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500148 Oct 25 03:23:39.630071 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2271/4377] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:23:39 2022] POST /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:39.789716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:39.790513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:39.813840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.814533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.819444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:39.822273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.827694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.834906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:39.917121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:39.944489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:39.971835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.972362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.972810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:39.973617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:39.974272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:39.974707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:40.242409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:40.255483 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-674cf61e-a5ff-4919-a1f7-37f146350afd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1275 microversion: 2.1 time: 0.342370 Oct 25 03:23:40.256840 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2272/4378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:39 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1275 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:40.374306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:40.376559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:40.388314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:40.389740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:40.391217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:40.392183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:40.393594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:40.394161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:40.615859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:40.624987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-760df3db-845a-4be8-aebf-06cfe8ab40bf tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.839368 Oct 25 03:23:40.644746 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2107/4379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:39 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:40.740731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:40.776219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:40.779304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:40.792294 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e2a41cd0-60ed-4e5c-b8c2-f10dae02fc7b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.427529 Oct 25 03:23:40.792904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2273/4380] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:40 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:41.286419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:41.287720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:41.303795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:41.304552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:41.305438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:41.306389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:41.307025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:41.307628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:41.653199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:41.654253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:41.667036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:41.670293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:41.672569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:41.678556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:41.679300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:41.683881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:41.779119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:41.788400 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2374f465-2b19-4384-96ff-95cb085356da tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1317 microversion: 2.1 time: 0.506050 Oct 25 03:23:41.790045 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2108/4381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:41 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:41.821133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:41.822022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:41.839661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:41.840182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:41.840636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:41.841368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:41.841869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:41.842310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:42.038085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:42.047420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53f27041-24d7-4156-98ac-58a7e58a7741 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.399148 Oct 25 03:23:42.049254 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2274/4382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:41 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:42.080752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:42.090514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:42.091987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:42.093197 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4fed38d2-7ddd-4a0b-8807-349076a2588b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.276630 Oct 25 03:23:42.120116 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2109/4383] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:41 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:42.400439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-556d220a-5e49-4786-8d4f-42508a1555f3 req-183002ed-03ed-41d2-a6c5-464089ea5aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "effbeb1d-aa58-463d-8594-15882198800c", "tag": "1aa2cc5d-460b-463d-a044-70da59001e79"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:42.426159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-556d220a-5e49-4786-8d4f-42508a1555f3 req-183002ed-03ed-41d2-a6c5-464089ea5aef service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:42.426705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-556d220a-5e49-4786-8d4f-42508a1555f3 req-183002ed-03ed-41d2-a6c5-464089ea5aef service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:42.427146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-556d220a-5e49-4786-8d4f-42508a1555f3 req-183002ed-03ed-41d2-a6c5-464089ea5aef service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:42.445167 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-556d220a-5e49-4786-8d4f-42508a1555f3 req-183002ed-03ed-41d2-a6c5-464089ea5aef service nova] Creating event network-changed:1aa2cc5d-460b-463d-a044-70da59001e79 for instance effbeb1d-aa58-463d-8594-15882198800c on n-h2-862355-1 Oct 25 03:23:42.452225 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-556d220a-5e49-4786-8d4f-42508a1555f3 req-183002ed-03ed-41d2-a6c5-464089ea5aef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055703 Oct 25 03:23:42.453062 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2275/4384] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:42.814096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:42.815853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:42.835860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:42.841024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:42.841820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:42.842849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:42.843510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:42.844155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:43.071516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:43.072216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:43.097348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:43.098109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:43.098551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:43.099271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:43.099727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:43.108438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:43.163518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:43.414131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:43.430716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-473466bc-2b13-460c-a81e-7e8a3eb50620 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1317 microversion: 2.1 time: 0.620434 Oct 25 03:23:43.432401 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2110/4385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:42 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:43.450793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:43.452179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:43.468593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:43.469316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:43.469890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:43.470735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:43.471292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:43.472635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:43.523869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:43.535735 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b806060c-e89d-419f-bd3b-ba1be4700444 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.469185 Oct 25 03:23:43.542292 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2276/4386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:43 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:43.641258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:43.665663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:43.670327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:43.674853 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06151e3c-05cb-4c1c-8a1f-a940bec51293 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.239635 Oct 25 03:23:43.678467 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2111/4387] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:43 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:43.830376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f858ed74-12f1-452f-abbc-455b7e312e21 tempest-ComputeTenantNetworksTest-193917330 tempest-ComputeTenantNetworksTest-193917330-project] Calling method '.version_select at 0x7efd334c8dc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:44.263680 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f858ed74-12f1-452f-abbc-455b7e312e21 tempest-ComputeTenantNetworksTest-193917330 tempest-ComputeTenantNetworksTest-193917330-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.719655 Oct 25 03:23:44.275448 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2277/4388] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:23:43 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:44.281051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a99a51f5-b02d-4655-8dee-2484184a40dc tempest-ComputeTenantNetworksTest-193917330 tempest-ComputeTenantNetworksTest-193917330-project] Calling method '.version_select at 0x7efd33809ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:44.458950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:44.459982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:44.472430 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a99a51f5-b02d-4655-8dee-2484184a40dc tempest-ComputeTenantNetworksTest-193917330 tempest-ComputeTenantNetworksTest-193917330-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks/6ed99844-366f-43ef-a69d-e3317d4cec10" status: 200 len: 140 microversion: 2.1 time: 0.196758 Oct 25 03:23:44.473037 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2112/4389] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:23:44 2022] GET /compute/v2.1/os-tenant-networks/6ed99844-366f-43ef-a69d-e3317d4cec10 => generated 140 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:44.483428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:44.485509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:44.486202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:44.487297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:44.489438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:44.490221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:44.565210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:44.565880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:44.573293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:44.574824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:44.575393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:44.576116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:44.576578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:44.577010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:45.016999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:45.030673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b76677d5-e72b-4e65-846c-b160ce5efb48 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.469343 Oct 25 03:23:45.033146 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2113/4390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:44 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:45.046313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:45.047998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:45.061792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:45.062572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:45.063229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:45.064182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:45.064879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:45.065543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:45.183313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:45.200422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:45.219126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:45.223581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:45.225704 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f921b1bf-1c77-4b70-8726-c8182c7d818a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.190972 Oct 25 03:23:45.228411 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2114/4391] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:45 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:45.274531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:45.293937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:45.311479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-edd842fa-eb05-4d91-852f-573e9a8eaded tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1317 microversion: 2.1 time: 0.856316 Oct 25 03:23:45.333762 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2278/4392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:44 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:46.056930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:46.057475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:46.061069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:46.072293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:46.072794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:46.073236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:46.079074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:46.079579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:46.080029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:46.264460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:46.265275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:46.291070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:46.292853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:46.294259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:46.295233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:46.297811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:46.299481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:46.337080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:46.348177 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c3ffb668-424d-4ee3-a6c6-68169b430173 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.295437 Oct 25 03:23:46.350827 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2115/4393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:46 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:46.366669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:46.367691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:46.390467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:46.391291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:46.391967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:46.392926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:46.393594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:46.394267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:46.526481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:46.539283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:46.550351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:46.552021 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c109097-8a63-4b75-8a85-11aa393a63cc tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.293670 Oct 25 03:23:46.553325 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2279/4394] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:46 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:46.726083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:46.739643 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d681335-ad64-465c-9fca-69cb24725dba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1317 microversion: 2.1 time: 0.385044 Oct 25 03:23:46.750069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2116/4395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:46 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:47.374582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:47.375677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:47.387173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:47.387929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:47.388721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:47.391079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:47.391642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:47.392151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:47.578480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:47.579161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:47.587852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:47.588347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:47.588784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:47.601493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:47.602073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:47.602525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:47.661403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:47.696048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:47.706810 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a9a5545-0797-4e98-abf7-f887c36fc928 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.337582 Oct 25 03:23:47.717358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2280/4396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:47 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:47.760112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:47.766027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:47.766744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:47.772331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:47.774022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:47.774164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:47.775530 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97c953e1-526a-4c25-99d4-4f22ffafb5f6 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.201224 Oct 25 03:23:47.776647 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2117/4397] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:47 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:47.777453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:47.778027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:47.780087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:47.781375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:47.783043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:48.076916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:48.085664 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2e2227ff-e1b5-4188-aa09-cff8277bc0cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1317 microversion: 2.1 time: 0.324590 Oct 25 03:23:48.087662 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2281/4398] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:47 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:48.344109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-28e17ee5-bd6e-4534-97d5-6d2fed09a120 req-00b6374e-e42b-49e9-b905-c82fad4ea653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effbeb1d-aa58-463d-8594-15882198800c", "name": "network-vif-plugged", "status": "completed", "tag": "1aa2cc5d-460b-463d-a044-70da59001e79"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:48.370744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-28e17ee5-bd6e-4534-97d5-6d2fed09a120 req-00b6374e-e42b-49e9-b905-c82fad4ea653 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:48.374250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-28e17ee5-bd6e-4534-97d5-6d2fed09a120 req-00b6374e-e42b-49e9-b905-c82fad4ea653 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:48.374968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-28e17ee5-bd6e-4534-97d5-6d2fed09a120 req-00b6374e-e42b-49e9-b905-c82fad4ea653 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:48.406677 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-28e17ee5-bd6e-4534-97d5-6d2fed09a120 req-00b6374e-e42b-49e9-b905-c82fad4ea653 service nova] Creating event network-vif-plugged:1aa2cc5d-460b-463d-a044-70da59001e79 for instance effbeb1d-aa58-463d-8594-15882198800c on n-h2-862355-1 Oct 25 03:23:48.422636 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-28e17ee5-bd6e-4534-97d5-6d2fed09a120 req-00b6374e-e42b-49e9-b905-c82fad4ea653 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082756 Oct 25 03:23:48.425852 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2118/4399] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:48.735440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:48.736627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:48.745326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:48.746176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:48.746788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:48.747708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:48.748351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:48.748943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:48.818971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:48.819821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:48.835607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:48.836112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:48.836553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:48.837267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:48.837748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:48.838187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:49.067298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:49.089788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:49.092870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:49.103000 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3102dece-d649-4a71-9e11-bc3af9316b09 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.374620 Oct 25 03:23:49.109380 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2282/4400] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:48 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:49.125247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:49.125247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:49.125610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:49.125610 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-903abdc3-670d-40ab-b23e-ff907333f64f tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.320120 Oct 25 03:23:49.125610 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2119/4401] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:48 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:49.143941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:49.152994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:49.154124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:49.157824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:49.158943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:49.161059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:49.411699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:49.441494 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da5817f9-3004-49dd-b157-5b52d76ed52c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1317 microversion: 2.1 time: 0.331007 Oct 25 03:23:49.443130 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2283/4402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:49 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:50.133199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:50.134058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:50.155480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:50.156169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:50.161468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.162031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.166803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.168205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.168880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.169323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.172941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.173440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.177191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.178100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.178588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.184645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.398371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:50.447485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:50.457532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:50.461106 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12189264-6b19-48e9-9e92-80aa058ee5ad tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.310384 Oct 25 03:23:50.465745 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2284/4403] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:50 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:50.476527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:50.480846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:50.490477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.492766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.498319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.499316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.499964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.500382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:50.500812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.509990 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-68db7840-393f-4886-b337-c4538d96057a tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.381029 Oct 25 03:23:50.510603 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2120/4404] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:50 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:50.723489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:50.732899 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8421530a-d296-466f-b7f8-5a3c13691b78 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1506 microversion: 2.1 time: 0.260437 Oct 25 03:23:50.735323 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2285/4405] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:50 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:50.759760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:50.767154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:50.781959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.782746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.784137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.785151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:50.785627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:50.786117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:50.858338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:23:51.012705 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad723ff0-79f0-412a-afd0-6332baa2cb70 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 204 len: 0 microversion: 2.1 time: 0.258512 Oct 25 03:23:51.013895 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2121/4406] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:23:50 2022] DELETE /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:23:51.023426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:51.024413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:51.037088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:51.039312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:51.039954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:51.042331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:51.042863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:51.043405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:51.367622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:51.380969 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fcf6402-c62b-46cf-a05f-af17e4e03632 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1512 microversion: 2.1 time: 0.361783 Oct 25 03:23:51.382320 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2286/4407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:51 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:51.492737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:51.493556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:51.508166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:51.508666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:51.509114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:51.509863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:51.510326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:51.519700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:51.536754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:51.537385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:51.546502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:51.546995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:51.547437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:51.548142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:51.557902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:51.562535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:51.679517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:51.695272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:51.700459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:51.701817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5f842864-0529-47bb-977a-7682e105c0d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.213706 Oct 25 03:23:51.705358 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2122/4408] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:51 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:51.805081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:51.814564 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-777afb20-650e-4d7c-8265-99406451a736 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.281861 Oct 25 03:23:51.815657 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2287/4409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:51 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:52.424750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:52.425387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:52.450090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:52.469053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:52.469607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:52.472870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:52.473360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:52.473834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:52.731284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:52.731845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:52.740682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:52.741174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:52.741607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:52.742348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:52.742800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:52.743218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:52.831923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:52.847871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:52.851142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:52.852922 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1976d1f0-51f6-42b0-874a-ee4a5b9d0164 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.126684 Oct 25 03:23:52.866800 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2288/4410] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:52 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:52.888981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:52.890859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:52.904767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:52.911913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:52.914428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:52.918328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:52.919525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:52.921962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:52.922960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:52.934684 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-730332bc-054a-422f-8125-c5c4793a6ccf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1512 microversion: 2.1 time: 0.526937 Oct 25 03:23:52.937357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2123/4411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:52 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1512 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:53.475827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:53.484090 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f28fbd54-a9d2-4ff5-9c98-52491a36f7a2 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.614984 Oct 25 03:23:53.497878 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2289/4412] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:52 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:53.885046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:53.887159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:53.899988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:53.901718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:53.902162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:53.903625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:53.904997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:53.907631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:53.960053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:53.960755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:53.978002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:53.983553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:53.984374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:53.985433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:53.986365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:53.989148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:54.128708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:54.146707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:54.153506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:54.157837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7bf4803f-ec19-4b93-b455-62c10009c4f2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.277927 Oct 25 03:23:54.178397 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2124/4413] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:53 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:54.510900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:54.511812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:54.522105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:54.523020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:54.524308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:54.525456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:54.528070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:54.530164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:54.873405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:54.884116 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ebf551a1-b7bf-4895-a4e3-17007840195e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1512 microversion: 2.1 time: 0.928328 Oct 25 03:23:54.887019 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2290/4414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:53 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1512 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:54.986584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:55.002109 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60303e11-a155-49e4-ac00-e1b25a7ae5d4 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.490327 Oct 25 03:23:55.010599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2125/4415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:54 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:55.191382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:55.192086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:55.210412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:55.210908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:55.211341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:55.212057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:55.212511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:55.212934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:55.524961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:55.560377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:55.564076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:55.568108 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfe9ab62-025c-42dc-9e41-cbe466150150 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.381902 Oct 25 03:23:55.570205 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2291/4416] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:55 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:55.625033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3b7f6576-ac2f-43eb-8ee2-48e24041ad46 req-e077912d-5067-4573-b91d-c5d90332a12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effbeb1d-aa58-463d-8594-15882198800c", "name": "network-vif-deleted", "tag": "1aa2cc5d-460b-463d-a044-70da59001e79"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:55.651133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b7f6576-ac2f-43eb-8ee2-48e24041ad46 req-e077912d-5067-4573-b91d-c5d90332a12f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:55.654879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b7f6576-ac2f-43eb-8ee2-48e24041ad46 req-e077912d-5067-4573-b91d-c5d90332a12f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:55.655570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b7f6576-ac2f-43eb-8ee2-48e24041ad46 req-e077912d-5067-4573-b91d-c5d90332a12f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:55.704152 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3b7f6576-ac2f-43eb-8ee2-48e24041ad46 req-e077912d-5067-4573-b91d-c5d90332a12f service nova] Creating event network-vif-deleted:1aa2cc5d-460b-463d-a044-70da59001e79 for instance effbeb1d-aa58-463d-8594-15882198800c on n-h2-862355-1 Oct 25 03:23:55.710642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3b7f6576-ac2f-43eb-8ee2-48e24041ad46 req-e077912d-5067-4573-b91d-c5d90332a12f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092109 Oct 25 03:23:55.723103 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2126/4417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:23:55.912345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:55.914734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:55.924419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:55.925556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:55.929917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:55.930996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:55.931630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:55.932410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.007858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.008482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.008986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.009532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lazy-loading 'fault' on Instance uuid effbeb1d-aa58-463d-8594-15882198800c {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:23:56.030765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:56.031790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:56.066779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.067683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.069409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.070427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.071282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.072064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.114469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:56.132188 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3617e916-2fc8-4b40-9671-8c1c6342d070 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 200 len: 1307 microversion: 2.1 time: 0.223356 Oct 25 03:23:56.155377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2292/4418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:55 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:56.388518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:56.399270 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f85948ac-9371-4813-8f6f-3f0ae0d02133 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1485 microversion: 2.1 time: 0.382392 Oct 25 03:23:56.400666 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2127/4419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:56 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1485 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:56.427720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:56.428273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:56.455822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.460629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.461498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.462739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.467389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.470181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.508232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:23:56.601622 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32bb2f82-d22c-473c-a0b8-999da1695e37 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "POST /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72/action" status: 202 len: 0 microversion: 2.1 time: 0.177654 Oct 25 03:23:56.602698 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2293/4420] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:23:56 2022] POST /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:23:56.606133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:56.607974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:56.613190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:56.614193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:56.621943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.622478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.622928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.623311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.623815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.624490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.624826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.625470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.626055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.626512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:56.627274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:56.627863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:56.790688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:56.828872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:56.833303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:56.836190 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f099b186-df94-4963-9cd7-ef05cc1ef007 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.238058 Oct 25 03:23:56.839852 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2128/4421] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:56 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:56.880624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:56.902567 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc151024-1ef8-4d4e-8519-1572ae42f8f8 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1493 microversion: 2.1 time: 0.294232 Oct 25 03:23:56.904176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2294/4422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:56 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1493 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:23:57.166534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:57.169310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:57.187330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.188721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.189336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:57.191475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.192108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.194070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:57.223881 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c HTTP/1.1 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'effbeb1d-aa58-463d-8594-15882198800c'} Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:57.227397 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.232234 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:57.232234 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:57.232234 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:57.232234 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:23:57.232234 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:23:57.232234 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:23:57.232234 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.236453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:23:57.237828 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3bfb8c03-7375-4c4b-96a7-211208bcbfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 404 len: 111 microversion: 2.1 time: 0.078753 Oct 25 03:23:57.239045 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2129/4423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:57 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:23:57.249320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:57.254008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:57.273001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.274298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.274755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:57.275494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.275958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.276393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:57.526267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:57.538824 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24758d90-e922-4bca-9b4a-0bcf24879745 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.294794 Oct 25 03:23:57.539904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2295/4424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:57 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:57.837705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-981d25ee-5236-4006-97f5-d69409b928c1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-981d25ee-5236-4006-97f5-d69409b928c1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 163 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": 12345, "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 12345 Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:23:57.841773 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-981d25ee-5236-4006-97f5-d69409b928c1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:23:57.846915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-981d25ee-5236-4006-97f5-d69409b928c1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.011242 Oct 25 03:23:57.854389 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2130/4425] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:23:57 2022] POST /compute/v2.1/servers => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:23:57.860747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:57.861445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:57.866495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:57.867109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:57.885562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.886615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.891898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:57.896226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.896740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.897187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:57.904936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.905439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.905912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:57.906632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:57.907093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:57.907525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:58.094324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:58.129366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:58.133353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:58.134876 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3f4aaa3-46a7-4b5a-bc42-cb63a582c9cd tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.273009 Oct 25 03:23:58.137554 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2131/4426] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:57 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:23:58.144740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:58.153041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b8591073-966d-4e5c-b3ab-70b79cc8f396 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.303960 Oct 25 03:23:58.159433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:58.160268 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2296/4427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:57 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:58.161162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:58.181669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:58.186959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:58.200724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:58.202507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:58.202659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:58.203019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:58.203465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:58.204192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:58.204655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:58.205151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:58.205768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:58.211767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:58.212618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:58.213211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:58.500927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:58.509246 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd81f95b-7e33-47e8-9a54-ec4e26f4880d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.332156 Oct 25 03:23:58.513311 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2297/4428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:58 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:58.593782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:58.621085 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58118d01-f55b-4bb6-bcd3-b42e7a02b5f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1493 microversion: 2.1 time: 0.471975 Oct 25 03:23:58.632627 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2132/4429] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:58 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1493 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:23:59.169059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:59.173353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:59.185370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:59.186842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:59.188198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:59.189031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:59.189557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:59.190082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:59.391138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:59.403000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:59.404455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:23:59.414490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30e2c996-64c2-4756-ad22-889dfc0fac46 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.249605 Oct 25 03:23:59.415410 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2298/4430] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:23:59 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:23:59.653491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:23:59.653491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:23:59.664853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:59.665750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:59.668807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:23:59.671162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:23:59.674314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:23:59.675104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:00.050502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:00.060760 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3dcdb91a-11af-4eb6-adad-fa64b546f9b3 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1493 microversion: 2.1 time: 0.413555 Oct 25 03:24:00.061348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2133/4431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:23:59 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1493 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:00.441157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:00.442633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:00.470081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:00.473147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:00.473147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:00.473147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:00.473147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:00.474060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:00.649183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:00.669837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:00.671619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:00.672942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d282c541-9cfe-4216-ad2a-39bbf2f34d06 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.235717 Oct 25 03:24:00.673520 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2299/4432] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:00 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:01.084928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:01.086451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:01.102811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.103621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.104256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.105365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.106339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.106938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.372998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:01.396362 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbdd29eb-962c-4eff-ad0d-4b2640e58437 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1499 microversion: 2.1 time: 0.315624 Oct 25 03:24:01.411011 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2134/4433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:01 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1499 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:01.439174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:01.440464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:01.451557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.452104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.453622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.454550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.458445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.459267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.576136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:24:01.700771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:01.701624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:01.716592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.717386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.718762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.719691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.721341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.722400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.756748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:01.782266 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd98036f-bdee-49a3-ac9a-3c4d3148c67f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "DELETE /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 204 len: 0 microversion: 2.1 time: 0.347104 Oct 25 03:24:01.783274 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2300/4434] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:24:01 2022] DELETE /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:24:01.797939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:01.799896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:01.815840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.816530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.817663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.818910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:01.821335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:01.823038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:01.973028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:01.994891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:01.997870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:01.999454 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c8acb21-ac8a-4964-b733-35857c96b91b tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.303766 Oct 25 03:24:02.018014 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2135/4435] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:01 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:02.085302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:02.114163 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7cfed46-0043-47f0-bda7-87020185073b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.324446 Oct 25 03:24:02.127192 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2301/4436] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:01 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:02.616941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07125288-b380-4385-9bc1-695fd1fc1eaa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-908105066", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "521d1019-e992-4b77-b032-4ef086613045", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:02.914385 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-07125288-b380-4385-9bc1-695fd1fc1eaa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Block Device 521d1019-e992-4b77-b032-4ef086613045 is not bootable. Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07125288-b380-4385-9bc1-695fd1fc1eaa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 357 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-908105066", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "521d1019-e992-4b77-b032-4ef086613045", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: exception: Block Device 521d1019-e992-4b77-b032-4ef086613045 is not bootable. Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-908105066', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '521d1019-e992-4b77-b032-4ef086613045'}], 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 521d1019-e992-4b77-b032-4ef086613045 is not bootable. Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:02.924115 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 521d1019-e992-4b77-b032-4ef086613045 is not bootable. Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 521d1019-e992-4b77-b032-4ef086613045 is not bootable. Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07125288-b380-4385-9bc1-695fd1fc1eaa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Block Device 521d1019-e992-4b77-b032-4ef086613045 is not bootable. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07125288-b380-4385-9bc1-695fd1fc1eaa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.313712 Oct 25 03:24:02.932330 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2136/4437] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:02 2022] POST /compute/v2.1/servers => generated 110 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:02.944163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:02.944790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:02.952816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:02.967424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:02.967999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:02.968445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:02.970154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:02.970558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:02.970986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:03.028847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:03.029473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:03.041438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:03.041998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:03.043656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:03.044412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:03.044885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:03.045324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:03.240884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:03.254727 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0743c517-9c63-4d14-b7b7-199b08512875 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.320183 Oct 25 03:24:03.256219 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2302/4438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:02 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:03.289527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:03.290829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:03.306660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:03.307162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:03.307653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:03.308421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:03.308984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:03.309417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:03.537308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:03.548778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:03.560877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:03.562503 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-80b23cf7-29bd-491f-89e5-172515df961a tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.539558 Oct 25 03:24:03.586120 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2137/4439] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:03 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:03.596223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:03.598785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:03.620518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:03.621720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:03.622348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:03.626879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:03.627571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:03.628223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:03.689771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:03.716373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-111162ba-4bf5-4491-acd1-33bf3a2f3c10 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.458825 Oct 25 03:24:03.721239 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2303/4440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:03 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:04.057438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:04.075063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e11c50e7-0040-43d7-8cd9-7c7c4418985f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.487298 Oct 25 03:24:04.093759 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2138/4441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:03 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:04.602724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:04.603577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:04.627672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:04.631501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:04.632402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:04.634778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:04.638643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:04.639350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:04.743343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:04.744491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:04.763229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:04.763795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:04.764251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:04.770133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:04.779376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:04.786321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:04.802627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:04.821172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:04.826038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:04.830709 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-716063c0-74a6-4dc6-b2b5-40329da0c3b2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.232657 Oct 25 03:24:04.833708 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2304/4442] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:04 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:05.290568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:05.329909 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a2bde02a-0deb-49e4-8716-03b2c1aac6f9 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1505 microversion: 2.1 time: 0.590868 Oct 25 03:24:05.349667 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2139/4443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:04 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:05.864786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:05.865390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:05.878773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:05.883374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:05.884629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:05.887387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:05.898214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:05.898982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:06.279642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:06.320130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:06.326919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:06.333542 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1537f72-1ee9-4d0a-9456-a61584c43ea2 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.471514 Oct 25 03:24:06.343395 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2305/4444] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:05 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:06.358667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:06.360111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:06.396272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:06.396971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:06.397723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:06.403286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:06.404081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:06.405068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:06.649638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a905761e-e5ac-4474-8e50-34c40fc80e4b req-89b2d1b6-87e6-4441-a788-df3a205c7fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18683617-c2f1-4a72-93ea-1cd452d82b72", "name": "network-vif-deleted", "tag": "83469b1e-8d9c-43e4-a8ae-52a3b86fb7ec"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:06.671793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a905761e-e5ac-4474-8e50-34c40fc80e4b req-89b2d1b6-87e6-4441-a788-df3a205c7fc4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:06.673837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a905761e-e5ac-4474-8e50-34c40fc80e4b req-89b2d1b6-87e6-4441-a788-df3a205c7fc4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:06.682475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a905761e-e5ac-4474-8e50-34c40fc80e4b req-89b2d1b6-87e6-4441-a788-df3a205c7fc4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:06.701490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a905761e-e5ac-4474-8e50-34c40fc80e4b req-89b2d1b6-87e6-4441-a788-df3a205c7fc4 service nova] Creating event network-vif-deleted:83469b1e-8d9c-43e4-a8ae-52a3b86fb7ec for instance 18683617-c2f1-4a72-93ea-1cd452d82b72 on n-h2-862355-1 Oct 25 03:24:06.723498 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a905761e-e5ac-4474-8e50-34c40fc80e4b req-89b2d1b6-87e6-4441-a788-df3a205c7fc4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078166 Oct 25 03:24:06.724843 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2306/4445] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:24:06.784317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:06.787139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:06.815352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:06.818357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:06.819008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:06.819946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:06.830166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:06.830817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:06.852908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:06.875074 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ade1578-5e15-4b85-b417-58106f99afd0 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 200 len: 1463 microversion: 2.1 time: 0.519175 Oct 25 03:24:06.889847 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2140/4446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:06 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 1463 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:06.970418 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18e98b45-0bd0-45f3-a563-2cb43d1590d6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188603 Oct 25 03:24:06.983439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:06.983864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:06.991502 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2307/4447] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:24:06 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:24:07.007429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:07.018210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:07.019499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:07.020429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:07.023814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:07.024926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:07.209419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lazy-loading 'services' on Instance uuid 133140c4-85b6-47e1-8bab-15379403aec7 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:24:07.382761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:07.383613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:07.434585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:07.435094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:07.435540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:07.449850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:07.450366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:07.450809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:07.509009 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01424646-64fc-40b0-a96d-9be9731d43b9 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "DELETE /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments/409b84d2-07d8-4c49-8abe-3856290a74a9" status: 202 len: 0 microversion: 2.1 time: 0.530698 Oct 25 03:24:07.510191 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2141/4448] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:24:06 2022] DELETE /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments/409b84d2-07d8-4c49-8abe-3856290a74a9 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:24:07.552623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:07.786333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:07.806169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:07.810769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:07.815807 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4226392-f5a3-4f35-80da-1a545e77e5b7 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1604 microversion: 2.32 time: 0.433801 Oct 25 03:24:07.818146 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2308/4449] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:07 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1604 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:07.908586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:07.908939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 18683617-c2f1-4a72-93ea-1cd452d82b72] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:07.931980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:07.935301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:07.935804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:07.936415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:07.937134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:07.937576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:07.959434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:08.045866 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] HTTP exception thrown: Instance 18683617-c2f1-4a72-93ea-1cd452d82b72 could not be found. Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Request method failure captured: Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 HTTP/1.1 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1ZY9Ns6_KGUBf7Fncgrsdw02D8v03rpmC8z44LrkyWa0AfkiwpstRSH6oMn2-aewE4-uv2xc7NrIaUsqGZcyVhLoGyglMX50sjftUcZcl-3XPNmcq6QvOyhT15PhpB5XMYHti6s-qoxTyCRifC31V1qw_24JeLanujBmAuU6qWehi0 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 03266c4fa04c4baf8cb148f9af4751fe Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerRescueTestJSON-1348247646 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03266c4fa04c4baf8cb148f9af4751fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03266c4fa04c4baf8cb148f9af4751fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_03266c4fa04c4baf8cb148f9af4751fe", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/03266c4fa04c4baf8cb148f9af4751fe"}]}] Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerRescueTestJSON-1348247646 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 03266c4fa04c4baf8cb148f9af4751fe Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerRescueTestJSON-1348247646 Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerRescueTestJSON-1348247646-project Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 593f6a2ef5f34326afe8fe9addabc75d Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerRescueTestJSON-1348247646-project Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 18683617-c2f1-4a72-93ea-1cd452d82b72 could not be found. Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '18683617-c2f1-4a72-93ea-1cd452d82b72'} Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18683617-c2f1-4a72-93ea-1cd452d82b72 could not be found. Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18683617-c2f1-4a72-93ea-1cd452d82b72 could not be found. Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:08.049431 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18683617-c2f1-4a72-93ea-1cd452d82b72 could not be found. Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Returning 404 to user: Instance 18683617-c2f1-4a72-93ea-1cd452d82b72 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:08.055349 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4dc60fe-9c67-4b86-9078-7706d4449a66 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72" status: 404 len: 111 microversion: 2.1 time: 0.149807 Oct 25 03:24:08.056662 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2142/4450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:07 2022] GET /compute/v2.1/servers/18683617-c2f1-4a72-93ea-1cd452d82b72 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:24:08.063773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:08.065081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:08.080268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:08.091242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:08.096273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:08.097275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:08.110649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:08.115070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:08.181235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:24:08.476209 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37417f17-462d-4bec-a2eb-8043239ea82b tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "DELETE /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 204 len: 0 microversion: 2.1 time: 0.416553 Oct 25 03:24:08.478384 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2309/4451] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:24:08 2022] DELETE /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:24:08.491418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:08.492203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:08.513916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:08.514571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:08.519779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:08.523550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:08.531996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:08.532651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:08.849978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:08.850886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:08.863699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:08.873857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:08.874256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:08.875076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:08.875532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:08.875966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:09.026995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:09.034924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:09.035616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:09.036236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lazy-loading 'fault' on Instance uuid a3bff279-697d-42ca-af7a-ff9a4bea3977 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:24:09.117745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:09.129397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:09.137956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58d4600cedf84763bcf5671f5c54627d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7924cd765bf44932b656980b0ef6435c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:09.139455 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-52a832ff-6fb8-4334-81bd-84dcdb0aba10 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 200 len: 1609 microversion: 2.32 time: 0.294819 Oct 25 03:24:09.140148 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2310/4452] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:08 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 1609 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:09.158986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1bc2857e-f93f-4622-8547-d2e9dccb7a54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126328082", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "destination_type": "local"}, {"source_type": "volume", "uuid": "25d5785e-165d-44e8-ac13-e1ba751ee446", "destination_type": "invalid"}], "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1bc2857e-f93f-4622-8547-d2e9dccb7a54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 495 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126328082", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "destination_type": "local"}, {"source_type": "volume", "uuid": "25d5785e-165d-44e8-ac13-e1ba751ee446", "destination_type": "invalid"}], "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1126328082', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '25d5785e-165d-44e8-ac13-e1ba751ee446', 'destination_type': 'invalid'}], 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'invalid' Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:09.164136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1bc2857e-f93f-4622-8547-d2e9dccb7a54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:09.168889 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1bc2857e-f93f-4622-8547-d2e9dccb7a54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.025599 Oct 25 03:24:09.170572 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2311/4453] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:09 2022] POST /compute/v2.1/servers => generated 155 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:09.180794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:09.184776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:09.203325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:09.203857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:09.204304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:09.207473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:09.207975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:09.208421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:09.282405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:09.294139 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6a9580e6-4068-4640-b5ba-c1d3c8e51c2f tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1491 microversion: 2.1 time: 0.810779 Oct 25 03:24:09.297152 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2143/4454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:08 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1491 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:09.569126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:09.580534 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88f8fbec-e1ef-4efb-ac95-f2bd8a254ddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.405794 Oct 25 03:24:09.582980 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2312/4455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:09 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:09.616918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:09.619238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:09.649309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:09.650702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:09.652084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:09.653313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:09.654227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:09.654985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:09.898164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:09.908343 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e2f1585-a2c2-48c6-8085-f9377671139b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.296523 Oct 25 03:24:09.913190 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2144/4456] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:09 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:10.150575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b218b24-8612-41a8-867c-8886d0d07a90 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561682496", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b218b24-8612-41a8-867c-8886d0d07a90 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 491 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561682496", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-561682496', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.155540 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 25 03:24:10.158987 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.161745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b218b24-8612-41a8-867c-8886d0d07a90 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:10.162913 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b218b24-8612-41a8-867c-8886d0d07a90 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017069 Oct 25 03:24:10.167537 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2313/4457] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:10 2022] POST /compute/v2.1/servers => generated 624 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:10.172853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:10.174103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:10.179789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:10.180439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:10.196299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:10.196878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:10.199227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:10.201252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:10.202235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:10.203504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:10.205010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:10.209201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:10.211523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:10.219071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:10.222940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:10.225144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:10.238513 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] HTTP exception thrown: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Request method failure captured: Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 HTTP/1.1 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1UlA74fTu4JN7t7VRQy0Ss2wQgxW_j96ssfeDcUjbma2aTZGvmhql8c1hvCR697YHQYdKBC0HuVhJWUIuybRo1gWnCj8kKsgTPWMMNLhA83bHJufcN-wnIlwlIyPP4cJbtr5KfVE1C9VEtLuyOBA5RR3u2xlLhyBzjl6j739sfNsX8 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.32 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 7924cd765bf44932b656980b0ef6435c Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7924cd765bf44932b656980b0ef6435c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7924cd765bf44932b656980b0ef6435c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7924cd765bf44932b656980b0ef6435c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7924cd765bf44932b656980b0ef6435c"}]}] Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 7924cd765bf44932b656980b0ef6435c Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TaggedBootDevicesTest-1768556371-project Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 58d4600cedf84763bcf5671f5c54627d Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TaggedBootDevicesTest-1768556371-project Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a3bff279-697d-42ca-af7a-ff9a4bea3977'} Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.243140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Returning 404 to user: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09de82c3-fc1f-442b-a8c3-f8cc2205f3d8 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 404 len: 111 microversion: 2.32 time: 0.077713 Oct 25 03:24:10.251795 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2314/4458] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:10 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:10.281339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c39d6f1b-70d0-4b8e-98ab-ccdee8a43604 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '.version_select at 0x7efd325699d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:10.359646 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c39d6f1b-70d0-4b8e-98ab-ccdee8a43604 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324442429" status: 204 len: 0 microversion: 2.32 time: 0.104583 Oct 25 03:24:10.371704 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2315/4459] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Oct 25 03:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324442429 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:24:10.421157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:10.422045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:10.431228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:10.432123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:10.432911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:10.434485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:10.435350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:10.436059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:10.922677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:10.931990 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b74903c-4f83-4915-be32-0f589ec3d573 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1491 microversion: 2.1 time: 0.517500 Oct 25 03:24:10.950564 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2316/4460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:10 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1491 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:10.966093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:10.998200 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47d93d4d-28e4-4494-b24b-c49d538b033a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.806303 Oct 25 03:24:11.002157 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2145/4461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:10 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:11.028846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:11.029476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:11.037955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:11.038455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:11.038900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:11.039834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:11.040069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:11.040499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:11.528262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:11.561223 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50c10355-9a75-4bfa-9fda-d6658cee6d66 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.536219 Oct 25 03:24:11.562440 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2317/4462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:11 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:11.806431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a22a17e-63a2-4367-938c-ad6e24c3df9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a22a17e-63a2-4367-938c-ad6e24c3df9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 416 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:11.811329 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a22a17e-63a2-4367-938c-ad6e24c3df9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9a22a17e-63a2-4367-938c-ad6e24c3df9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010954 Oct 25 03:24:11.817873 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2146/4463] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:11 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:11.821604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:11.822604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:11.836057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:11.844145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:11.847553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:11.850430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:11.851126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:11.851748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:11.974466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:11.980266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:11.998098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:11.999473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:12.000243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:12.024349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:12.026815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:12.027718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:12.682279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:12.697705 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e79391e2-9741-41ec-901c-f6a89321bdab tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.879460 Oct 25 03:24:12.711975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:12.721099 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2318/4464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:11 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:12.735868 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2afcd116-a26b-488c-b537-29f829469107 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1491 microversion: 2.1 time: 0.776331 Oct 25 03:24:12.736486 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2147/4465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:11 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1491 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:12.742257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:12.742887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:12.782429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:12.782946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:12.783394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:12.784128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:12.784590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:12.785277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:13.005547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a05f2bfb-5fab-470a-b704-f726d2cacf4f req-86333010-2e8d-4388-8481-0e002cf9d2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431c4120-65f4-47cc-937b-66e4719957ab", "name": "network-vif-deleted", "tag": "38b546da-f2af-4a5c-82d8-3f29f92a44ff"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:13.058905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a05f2bfb-5fab-470a-b704-f726d2cacf4f req-86333010-2e8d-4388-8481-0e002cf9d2aa service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:13.059610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a05f2bfb-5fab-470a-b704-f726d2cacf4f req-86333010-2e8d-4388-8481-0e002cf9d2aa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:13.060077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a05f2bfb-5fab-470a-b704-f726d2cacf4f req-86333010-2e8d-4388-8481-0e002cf9d2aa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:13.132702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a05f2bfb-5fab-470a-b704-f726d2cacf4f req-86333010-2e8d-4388-8481-0e002cf9d2aa service nova] Creating event network-vif-deleted:38b546da-f2af-4a5c-82d8-3f29f92a44ff for instance 431c4120-65f4-47cc-937b-66e4719957ab on n-h1-862355-1 Oct 25 03:24:13.139699 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a05f2bfb-5fab-470a-b704-f726d2cacf4f req-86333010-2e8d-4388-8481-0e002cf9d2aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147036 Oct 25 03:24:13.140976 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2148/4466] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:24:13.769269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:13.771047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:13.790418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:13.794825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:13.795561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:13.797913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:13.800852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:13.820162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:13.878139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:13.878977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:13.882261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:13.882937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lazy-loading 'fault' on Instance uuid 431c4120-65f4-47cc-937b-66e4719957ab {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:24:14.046607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593f6a2ef5f34326afe8fe9addabc75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03266c4fa04c4baf8cb148f9af4751fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:14.069603 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a8ef659-2962-4773-a0d0-7d150ec730a5 tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 200 len: 1304 microversion: 2.1 time: 0.307535 Oct 25 03:24:14.072219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2149/4467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:13 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 1304 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:14.143213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:14.157465 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd1a8c71-92de-471a-ace7-85ba6cf687d4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 1.428718 Oct 25 03:24:14.172786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2319/4468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:12 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:14.367838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95a50a4e-442d-468c-8614-feb26c09e371 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2146036361", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": -1, "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:14.390395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-95a50a4e-442d-468c-8614-feb26c09e371 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Flavor -1 could not be found. Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95a50a4e-442d-468c-8614-feb26c09e371 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 206 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2146036361", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": -1, "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: exception: Flavor -1 could not be found. Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2146036361', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': -1, 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:14.392564 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 25 03:24:14.397511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:14.403988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95a50a4e-442d-468c-8614-feb26c09e371 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:14.405130 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95a50a4e-442d-468c-8614-feb26c09e371 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.041559 Oct 25 03:24:14.405935 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2150/4469] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:14 2022] POST /compute/v2.1/servers => generated 73 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:24:14.416031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:14.417843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:14.434462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:14.435221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:14.435991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:14.438157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:14.440412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:14.441302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:14.736399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:14.751516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c29ed6b4-ad63-4188-9dfa-ad4d490427ba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.339563 Oct 25 03:24:14.764385 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2320/4470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:14 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:14.786546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:14.787466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:14.794754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:14.795555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:14.796356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:14.797403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:14.798258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:14.799046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:15.099289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:15.099919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] [instance: 431c4120-65f4-47cc-937b-66e4719957ab] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:15.109844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:15.110352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:15.110797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:15.111516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:15.111979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:15.112412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:15.145623 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] HTTP exception thrown: Instance 431c4120-65f4-47cc-937b-66e4719957ab could not be found. Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Request method failure captured: Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab HTTP/1.1 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1ZY9Ns6_KGUBf7Fncgrsdw02D8v03rpmC8z44LrkyWa0AfkiwpstRSH6oMn2-aewE4-uv2xc7NrIaUsqGZcyVhLoGyglMX50sjftUcZcl-3XPNmcq6QvOyhT15PhpB5XMYHti6s-qoxTyCRifC31V1qw_24JeLanujBmAuU6qWehi0 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 03266c4fa04c4baf8cb148f9af4751fe Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerRescueTestJSON-1348247646 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03266c4fa04c4baf8cb148f9af4751fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03266c4fa04c4baf8cb148f9af4751fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_03266c4fa04c4baf8cb148f9af4751fe", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/03266c4fa04c4baf8cb148f9af4751fe"}]}] Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerRescueTestJSON-1348247646 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 03266c4fa04c4baf8cb148f9af4751fe Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerRescueTestJSON-1348247646 Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerRescueTestJSON-1348247646-project Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 593f6a2ef5f34326afe8fe9addabc75d Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerRescueTestJSON-1348247646-project Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 431c4120-65f4-47cc-937b-66e4719957ab could not be found. Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '431c4120-65f4-47cc-937b-66e4719957ab'} Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431c4120-65f4-47cc-937b-66e4719957ab could not be found. Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431c4120-65f4-47cc-937b-66e4719957ab could not be found. Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:15.157069 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.162538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:15.162538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:15.162538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:15.162538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:15.162538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:15.162538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431c4120-65f4-47cc-937b-66e4719957ab could not be found. Oct 25 03:24:15.162538 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.163843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] Returning 404 to user: Instance 431c4120-65f4-47cc-937b-66e4719957ab could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:15.165007 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a48dd088-555b-4750-9875-01275be59dcd tempest-ServerRescueTestJSON-1348247646 tempest-ServerRescueTestJSON-1348247646-project] 10.222.0.36 "GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab" status: 404 len: 111 microversion: 2.1 time: 0.070337 Oct 25 03:24:15.166228 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2321/4471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:15 2022] GET /compute/v2.1/servers/431c4120-65f4-47cc-937b-66e4719957ab => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:15.335418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:15.345771 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb6d0c97-a625-4646-872a-ce7b89721513 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.564533 Oct 25 03:24:15.363818 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2151/4472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:14 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:15.739260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aac4b2ea-6e03-42c0-a735-f5c39832abf6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607807956", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aac4b2ea-6e03-42c0-a735-f5c39832abf6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 173 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607807956", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1607807956', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi -1 Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:24:15.743961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 25 03:24:15.748391 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:15.758221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aac4b2ea-6e03-42c0-a735-f5c39832abf6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:15.760202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aac4b2ea-6e03-42c0-a735-f5c39832abf6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.025011 Oct 25 03:24:15.762112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2322/4473] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:15 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:15.770902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:15.772456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:15.784483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:15.785631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:15.786356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:15.787330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:15.792621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:15.793629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:16.147604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:16.157108 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a3005e2-3f86-422f-922d-0c5393567d04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.390976 Oct 25 03:24:16.161475 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2152/4474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:15 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:16.187586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:16.188870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:16.210704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:16.211493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:16.212109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:16.214626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:16.215276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:16.218179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:16.469423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:16.479869 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bb5636ff-9a57-469c-a7a7-c83c84b2e7c5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.296324 Oct 25 03:24:16.481528 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2323/4475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:16 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:16.668156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3fba1619-55dc-43d6-8cb0-72caeb1ccddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430223169", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:16.680597 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3fba1619-55dc-43d6-8cb0-72caeb1ccddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3fba1619-55dc-43d6-8cb0-72caeb1ccddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 215 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430223169", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-430223169', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:16.688576 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:16.694072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:16.694072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:16.694072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:16.694072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:16.694072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:16.694072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 25 03:24:16.694072 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:16.696409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3fba1619-55dc-43d6-8cb0-72caeb1ccddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:16.697546 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3fba1619-55dc-43d6-8cb0-72caeb1ccddc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.035516 Oct 25 03:24:16.699575 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2153/4476] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:16 2022] POST /compute/v2.1/servers => generated 123 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:24:16.707769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:16.708794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:16.715782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:16.716717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:16.717852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:16.719120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:16.719812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:16.720521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:16.998452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:17.009118 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ffc7f932-8e18-452a-8d7d-76fa93fd0508 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.305511 Oct 25 03:24:17.012926 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2324/4477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:16 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:17.040925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:17.042305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:17.055490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:17.057632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:17.062410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:17.063532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:17.064347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:17.065034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:17.506477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:17.541360 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa7e28b9-30f4-4e0c-8369-9251e13d4a05 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.496956 Oct 25 03:24:17.543981 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2154/4478] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:17 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:17.817317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e55ac7d5-4a5b-4bc8-8857-b73f08366266 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1121471586", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-key-1421948524", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:17.952310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:17.967162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:17.968460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-e55ac7d5-4a5b-4bc8-8857-b73f08366266 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] validate_networks() for [('8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:24:17.983662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:17.984441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:17.985132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:17.986907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:17.988945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:17.991046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.123640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6396b68e-7f40-4c77-8686-837c661814fe tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.176766 Oct 25 03:24:18.131947 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2155/4479] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:24:17 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments => generated 25 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:24:18.239821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:18.241912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:18.255411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.257419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.258620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.261391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.263128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.264346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.305363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:18.352612 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e349984-2ca0-41f2-a642-ef100ac335ba tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117079 Oct 25 03:24:18.369312 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2156/4480] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:24:18 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:24:18.451658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e55ac7d5-4a5b-4bc8-8857-b73f08366266 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Invalid key_name provided. Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e55ac7d5-4a5b-4bc8-8857-b73f08366266 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 247 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1121471586", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-key-1421948524", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid key_name provided. Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1121471586', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'key_name': 'tempest-key-1421948524', 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1421948524 not found for user d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:18.456529 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e55ac7d5-4a5b-4bc8-8857-b73f08366266 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid key_name provided. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:18.461014 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e55ac7d5-4a5b-4bc8-8857-b73f08366266 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.645340 Oct 25 03:24:18.468099 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2325/4481] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:17 2022] POST /compute/v2.1/servers => generated 70 bytes in 656 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 25 03:24:18.471299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:18.471811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:18.482318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:18.482969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:18.483427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.483927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.484368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.485869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.486758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.487589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.496675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.497184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.497630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.498379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.498842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.499275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.559933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:24:18.742896 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a8bb9c4d-0328-4539-9224-a9d9f9737ead tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "DELETE /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 204 len: 0 microversion: 2.1 time: 0.275883 Oct 25 03:24:18.743923 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2157/4482] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:24:18 2022] DELETE /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:24:18.757217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:18.761493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:18.775090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.777354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.779486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:18.780357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:18.781982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:18.782561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:19.087367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:19.099048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c3bf9785-c3e0-44ca-9104-64ca0ee23fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.629778 Oct 25 03:24:19.135094 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2326/4483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:18 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:19.144100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:19.145218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:19.157710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:19.160384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:19.162744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:19.163718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:19.166292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:19.167871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:19.605866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:19.618225 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-054b2444-6710-42da-b470-e130beb11197 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.481761 Oct 25 03:24:19.621342 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2327/4484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:19 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:19.642118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:19.652994 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43b0ee4f-33d6-4580-b60a-0a144850700a tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1683 microversion: 2.1 time: 0.903395 Oct 25 03:24:19.653604 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2158/4485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:18 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1683 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:19.831146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c59aa40-319f-425b-9dbb-b0c889ba7201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-355524212", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:20.086835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.security_group_api [None req-2c59aa40-319f-425b-9dbb-b0c889ba7201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Neutron security group does_not_exist not found {{(pid=120562) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 25 03:24:20.087722 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2c59aa40-319f-425b-9dbb-b0c889ba7201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c59aa40-319f-425b-9dbb-b0c889ba7201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 257 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-355524212", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-355524212', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 25 03:24:20.126649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 25 03:24:20.133605 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:20.148072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c59aa40-319f-425b-9dbb-b0c889ba7201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:20.148072 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c59aa40-319f-425b-9dbb-b0c889ba7201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.314231 Oct 25 03:24:20.150466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:20.150713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2328/4486] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:19 2022] POST /compute/v2.1/servers => generated 106 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:20.151322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:20.170290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:20.171318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:20.172105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:20.173660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:20.174479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:20.175409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:20.679775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:20.680394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:20.691989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:20.692489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:20.692932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:20.693643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:20.694129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:20.694555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:21.444342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:21.459199 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ae27c3a-689f-4ebd-86ea-600cb6b9011c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 1.312711 Oct 25 03:24:21.460397 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2159/4487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:20 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:21.500410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:21.501111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:21.511065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:21.514100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:21.514655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:21.517186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:21.518515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:21.520849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:21.681309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:21.690092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c786a678-471a-4b25-be72-8207794c48a5 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1683 microversion: 2.1 time: 1.014046 Oct 25 03:24:21.695898 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2329/4488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:20 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1683 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:22.062490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:22.073508 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5fd89f3-b910-4714-8415-ab2539252250 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.577957 Oct 25 03:24:22.074976 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2160/4489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:21 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:22.102730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01b4deaa-3dfb-40d6-8314-b1dbc27f2aae tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.103242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-01b4deaa-3dfb-40d6-8314-b1dbc27f2aae tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 52ee7f6b-5c32-497a-9892-80c5345ad221] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:22.119263 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-01b4deaa-3dfb-40d6-8314-b1dbc27f2aae tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 52ee7f6b-5c32-497a-9892-80c5345ad221 could not be found. Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01b4deaa-3dfb-40d6-8314-b1dbc27f2aae tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/52ee7f6b-5c32-497a-9892-80c5345ad221 HTTP/1.1 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 52ee7f6b-5c32-497a-9892-80c5345ad221 could not be found. Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '52ee7f6b-5c32-497a-9892-80c5345ad221'} Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ee7f6b-5c32-497a-9892-80c5345ad221 could not be found. Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ee7f6b-5c32-497a-9892-80c5345ad221 could not be found. Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.121604 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ee7f6b-5c32-497a-9892-80c5345ad221 could not be found. Oct 25 03:24:22.126618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.134643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01b4deaa-3dfb-40d6-8314-b1dbc27f2aae tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 52ee7f6b-5c32-497a-9892-80c5345ad221 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:22.136472 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01b4deaa-3dfb-40d6-8314-b1dbc27f2aae tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/52ee7f6b-5c32-497a-9892-80c5345ad221" status: 404 len: 111 microversion: 2.1 time: 0.039306 Oct 25 03:24:22.139619 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2330/4490] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:24:22 2022] DELETE /compute/v2.1/servers/52ee7f6b-5c32-497a-9892-80c5345ad221 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:22.147368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.147986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:22.163756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.164259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.164794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.165511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.166016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.166552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.449293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:22.458129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.458835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:22.471452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.474070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.474932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.476152 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce0c1b09-551e-4185-aba4-9fa021da1606 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.333688 Oct 25 03:24:22.477619 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2161/4491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:22 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:22.478173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.478661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.479188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.520128 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] HTTP exception thrown: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Request method failure captured: Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 HTTP/1.1 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1UlA74fTu4JN7t7VRQy0Ss2wQgxW_j96ssfeDcUjbma2aTZGvmhql8c1hvCR697YHQYdKBC0HuVhJWUIuybRo1gWnCj8kKsgTPWMMNLhA83bHJufcN-wnIlwlIyPP4cJbtr5KfVE1C9VEtLuyOBA5RR3u2xlLhyBzjl6j739sfNsX8 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.32 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 7924cd765bf44932b656980b0ef6435c Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7924cd765bf44932b656980b0ef6435c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7924cd765bf44932b656980b0ef6435c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7924cd765bf44932b656980b0ef6435c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7924cd765bf44932b656980b0ef6435c"}]}] Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 7924cd765bf44932b656980b0ef6435c Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TaggedBootDevicesTest-1768556371-project Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 58d4600cedf84763bcf5671f5c54627d Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TaggedBootDevicesTest-1768556371-project Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a3bff279-697d-42ca-af7a-ff9a4bea3977'} Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:22.524882 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.529607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Returning 404 to user: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:22.531600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.531600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:22.531863 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32cf8589-1a77-434b-809b-6aa8b2b8c112 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 404 len: 111 microversion: 2.32 time: 0.074317 Oct 25 03:24:22.531863 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2331/4492] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:24:22 2022] DELETE /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:24:22.544894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.545737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] [instance: a3bff279-697d-42ca-af7a-ff9a4bea3977] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:22.545926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.547087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.547807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.548628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.549535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.550083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.558450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.559016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.559575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.562383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.562906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.563404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.569767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:22.617541 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] HTTP exception thrown: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Request method failure captured: Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 HTTP/1.1 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1UlA74fTu4JN7t7VRQy0Ss2wQgxW_j96ssfeDcUjbma2aTZGvmhql8c1hvCR697YHQYdKBC0HuVhJWUIuybRo1gWnCj8kKsgTPWMMNLhA83bHJufcN-wnIlwlIyPP4cJbtr5KfVE1C9VEtLuyOBA5RR3u2xlLhyBzjl6j739sfNsX8 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.32 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 7924cd765bf44932b656980b0ef6435c Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7924cd765bf44932b656980b0ef6435c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7924cd765bf44932b656980b0ef6435c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7924cd765bf44932b656980b0ef6435c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7924cd765bf44932b656980b0ef6435c"}]}] Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 7924cd765bf44932b656980b0ef6435c Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1768556371 Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TaggedBootDevicesTest-1768556371-project Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 58d4600cedf84763bcf5671f5c54627d Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TaggedBootDevicesTest-1768556371-project Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a3bff279-697d-42ca-af7a-ff9a4bea3977'} Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.620062 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] Returning 404 to user: Instance a3bff279-697d-42ca-af7a-ff9a4bea3977 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:22.625342 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff60f26c-cfb9-4a95-a486-8beb81ae3702 tempest-TaggedBootDevicesTest-1768556371 tempest-TaggedBootDevicesTest-1768556371-project] 10.222.0.36 "GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977" status: 404 len: 111 microversion: 2.32 time: 0.088967 Oct 25 03:24:22.628605 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2332/4493] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:22 2022] GET /compute/v2.1/servers/a3bff279-697d-42ca-af7a-ff9a4bea3977 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:22.715064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.716480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:22.727497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.730287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.742571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.743865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.746797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.747552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.924444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:22.933554 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-743428d4-bb69-486c-b1c7-d48a2b9ab2c6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.412004 Oct 25 03:24:22.938202 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2162/4494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:22 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:22.960177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ba0b05e-4719-4c6d-8eb5-fd16f8290883 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.960570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7ba0b05e-4719-4c6d-8eb5-fd16f8290883 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 25 03:24:22.961088 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-7ba0b05e-4719-4c6d-8eb5-fd16f8290883 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ba0b05e-4719-4c6d-8eb5-fd16f8290883 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9223372036854775808 could not be found. Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9223372036854775808'} Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:22.963009 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ba0b05e-4719-4c6d-8eb5-fd16f8290883 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7ba0b05e-4719-4c6d-8eb5-fd16f8290883 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008848 Oct 25 03:24:22.967876 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2163/4495] 10.222.0.36 () {58 vars in 1188 bytes} [Tue Oct 25 03:24:22 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:24:22.973233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:22.974019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:22.985117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.985416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.985886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:22.986594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:22.987047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:22.987471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:23.008281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:23.019240 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c3c3e52-824a-4055-879e-c4bfc4547ebb tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1615 microversion: 2.1 time: 0.309690 Oct 25 03:24:23.027833 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2333/4496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:22 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1615 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:23.346404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:23.358399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec1e7ef2-662e-4629-a5da-812dad5227cf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.388741 Oct 25 03:24:23.360035 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2164/4497] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:22 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:23.392525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:23.393079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:23.402211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:23.402714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:23.403568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:23.406327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:23.406825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:23.409352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:23.664502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-82d57ab5-c7c3-4038-8517-73bed964b8ec req-e5f16511-44c2-439a-a4c2-9f8f0ba8bab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133140c4-85b6-47e1-8bab-15379403aec7", "name": "network-vif-deleted", "tag": "1b12d465-db43-45f9-a868-4e14b418bcd8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:23.687496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-82d57ab5-c7c3-4038-8517-73bed964b8ec req-e5f16511-44c2-439a-a4c2-9f8f0ba8bab6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:23.700020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-82d57ab5-c7c3-4038-8517-73bed964b8ec req-e5f16511-44c2-439a-a4c2-9f8f0ba8bab6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:23.701716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-82d57ab5-c7c3-4038-8517-73bed964b8ec req-e5f16511-44c2-439a-a4c2-9f8f0ba8bab6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:23.726841 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-82d57ab5-c7c3-4038-8517-73bed964b8ec req-e5f16511-44c2-439a-a4c2-9f8f0ba8bab6 service nova] Creating event network-vif-deleted:1b12d465-db43-45f9-a868-4e14b418bcd8 for instance 133140c4-85b6-47e1-8bab-15379403aec7 on n-h2-862355-1 Oct 25 03:24:23.732551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-82d57ab5-c7c3-4038-8517-73bed964b8ec req-e5f16511-44c2-439a-a4c2-9f8f0ba8bab6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072923 Oct 25 03:24:23.733310 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2165/4498] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:24:23.873434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:23.899260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d2b5643-35d4-4575-9411-d2c4478bde22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.512773 Oct 25 03:24:23.900401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2334/4499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:23 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:23.929920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0efb2553-d60d-4804-b6b1-723ea6658b9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:23.929920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0efb2553-d60d-4804-b6b1-723ea6658b9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Failed to fetch instance by id -1 {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 25 03:24:23.929920 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0efb2553-d60d-4804-b6b1-723ea6658b9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance -1 could not be found. Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0efb2553-d60d-4804-b6b1-723ea6658b9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance -1 could not be found. Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '-1'} Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:23.931704 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:23.938349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:23.938349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:23.938349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 25 03:24:23.938349 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:23.938349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0efb2553-d60d-4804-b6b1-723ea6658b9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:23.938349 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0efb2553-d60d-4804-b6b1-723ea6658b9a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.010792 Oct 25 03:24:23.938349 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2166/4500] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:24:23 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:24:23.943719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:23.944343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:23.952664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:23.953171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:23.953616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:23.955085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:23.955841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:23.956386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:24.061582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:24.062370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:24.080270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:24.082270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:24.083181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:24.084925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:24.085415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:24.085894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:24.155406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:24.155900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:24.157145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:24.157628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lazy-loading 'fault' on Instance uuid 133140c4-85b6-47e1-8bab-15379403aec7 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:24:24.368486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42efa78e864c56aba0ede0b2461fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52361f866854468785ec2bb9b1b8b6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:24.427227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52f57e9b-14d3-45eb-9261-65460710c6e6 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 200 len: 1332 microversion: 2.1 time: 0.372360 Oct 25 03:24:24.435889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:24.449747 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2167/4501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:24 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 1332 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:24.477613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6ffaa38-3e86-4e2f-a825-5899d2c0e3b6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.537728 Oct 25 03:24:24.490199 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2335/4502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:23 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:24.522915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:24.523763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:24.537457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:24.540898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:24.541353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:24.548582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:24.549586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:24.550303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:25.030856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:25.046048 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d268a080-a962-4560-8fdb-d5e864cbdc15 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.527195 Oct 25 03:24:25.049698 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2168/4503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:24 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:25.074312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6551090b-f5b2-4ee5-a287-449634ad7259 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:25.074312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6551090b-f5b2-4ee5-a287-449634ad7259 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 04a9b15f-f244-418c-9e69-4011ba3a95ca] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:25.081792 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6551090b-f5b2-4ee5-a287-449634ad7259 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 04a9b15f-f244-418c-9e69-4011ba3a95ca could not be found. Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6551090b-f5b2-4ee5-a287-449634ad7259 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/04a9b15f-f244-418c-9e69-4011ba3a95ca/action HTTP/1.1 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 19 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: {"forceDelete": {}} Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 04a9b15f-f244-418c-9e69-4011ba3a95ca could not be found. Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '04a9b15f-f244-418c-9e69-4011ba3a95ca', 'body': {'forceDelete': {}}} Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a9b15f-f244-418c-9e69-4011ba3a95ca could not be found. Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a9b15f-f244-418c-9e69-4011ba3a95ca could not be found. Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:25.108108 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:25.117298 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:25.117298 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:25.117298 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a9b15f-f244-418c-9e69-4011ba3a95ca could not be found. Oct 25 03:24:25.117298 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.117298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6551090b-f5b2-4ee5-a287-449634ad7259 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 04a9b15f-f244-418c-9e69-4011ba3a95ca could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:25.117298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6551090b-f5b2-4ee5-a287-449634ad7259 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/04a9b15f-f244-418c-9e69-4011ba3a95ca/action" status: 404 len: 111 microversion: 2.1 time: 0.042224 Oct 25 03:24:25.120133 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2336/4504] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:25 2022] POST /compute/v2.1/servers/04a9b15f-f244-418c-9e69-4011ba3a95ca/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:25.121455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:25.122741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:25.138774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:25.139276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:25.139716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:25.140438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:25.141012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:25.141301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:25.490597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:25.491719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:25.515121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:25.517248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:25.518948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:25.519883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:25.523101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:25.523754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:25.550650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:25.560375 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] HTTP exception thrown: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:25.562966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99cad1bf-b2c5-47cd-89b1-6101f17c5edc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.445038 Oct 25 03:24:25.564992 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2169/4505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:25 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Request method failure captured: Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 HTTP/1.1 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1YdUfmAtPIbibN_2R8OGOHs5EZ6R-GcXunOGHsNnax3beGoLUXeUpYuZVgKzjdnHhPq0gUn9Q2MyC6BLjQIjfkt7WyCpGcFgrjd1Ob7NL0ghPKfXqNp7mfp1Fj3bwN7_09Mf6qzOXk5d3DfGgwYMGK5VcGJflTHIiqAG6bSBAZY3sg Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 52361f866854468785ec2bb9b1b8b6d6 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/52361f866854468785ec2bb9b1b8b6d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/52361f866854468785ec2bb9b1b8b6d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_52361f866854468785ec2bb9b1b8b6d6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/52361f866854468785ec2bb9b1b8b6d6"}]}] Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 52361f866854468785ec2bb9b1b8b6d6 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachSCSIVolumeTestJSON-1127645164-project Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 4c42efa78e864c56aba0ede0b2461fa8 Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1127645164-project Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '133140c4-85b6-47e1-8bab-15379403aec7'} Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:25.566701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.572269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:25.572269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:25.572269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:25.572269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:25.572269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:25.572269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:25.572269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:25.575088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Returning 404 to user: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:25.578758 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3013b3b2-42c5-4133-98fa-142a5cca9c17 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 404 len: 111 microversion: 2.1 time: 0.092686 Oct 25 03:24:25.579519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2337/4506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:25 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:25.596734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:25.598733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2fcd3fa5-8ef3-4dba-bcac-4884c962fa6f tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '.version_select at 0x7efd3363e9d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:25.599793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:25.619037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:25.619595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:25.621805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:25.624016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:25.624016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:25.638566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:25.653926 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2fcd3fa5-8ef3-4dba-bcac-4884c962fa6f tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615527042" status: 202 len: 0 microversion: 2.1 time: 0.066763 Oct 25 03:24:25.657136 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2170/4507] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615527042 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:24:26.248397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:26.257962 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80f88e35-563c-4768-a16f-ce329c2ff69a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.669239 Oct 25 03:24:26.258557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2338/4508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:25 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:26.294616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-997ed290-6ab0-429a-9a6e-e4c7ae53c54a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:26.304780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-997ed290-6ab0-429a-9a6e-e4c7ae53c54a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 326f4fce-a1ca-4e04-b9d2-4e5286eab86a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:26.314714 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-997ed290-6ab0-429a-9a6e-e4c7ae53c54a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 326f4fce-a1ca-4e04-b9d2-4e5286eab86a could not be found. Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-997ed290-6ab0-429a-9a6e-e4c7ae53c54a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/326f4fce-a1ca-4e04-b9d2-4e5286eab86a/action HTTP/1.1 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 39 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: {"os-getConsoleOutput": {"length": 10}} Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 326f4fce-a1ca-4e04-b9d2-4e5286eab86a could not be found. Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '326f4fce-a1ca-4e04-b9d2-4e5286eab86a', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 326f4fce-a1ca-4e04-b9d2-4e5286eab86a could not be found. Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 326f4fce-a1ca-4e04-b9d2-4e5286eab86a could not be found. Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:26.330718 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:26.336113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:26.336113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:26.336113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:26.336113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:26.336113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 326f4fce-a1ca-4e04-b9d2-4e5286eab86a could not be found. Oct 25 03:24:26.336113 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:26.336113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-997ed290-6ab0-429a-9a6e-e4c7ae53c54a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 326f4fce-a1ca-4e04-b9d2-4e5286eab86a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:26.337588 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-997ed290-6ab0-429a-9a6e-e4c7ae53c54a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/326f4fce-a1ca-4e04-b9d2-4e5286eab86a/action" status: 404 len: 111 microversion: 2.1 time: 0.053699 Oct 25 03:24:26.341991 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2171/4509] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:26 2022] POST /compute/v2.1/servers/326f4fce-a1ca-4e04-b9d2-4e5286eab86a/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:26.351926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:26.355046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:26.362462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:26.365942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:26.368020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:26.370500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:26.372428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:26.372881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:26.692591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:26.704070 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f4b17f8f-68ef-47e8-bd81-946f5b10db3c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.355767 Oct 25 03:24:26.726760 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2339/4510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:26 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:26.741821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:26.742455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:26.765456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:26.766026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:26.766484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:26.767417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:26.767894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:26.768465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:27.151161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:27.162465 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e5cadae-b58b-4e2c-a610-6d1292cd5bf0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.424701 Oct 25 03:24:27.174731 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2340/4511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:26 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:27.198061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1460341681", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": "none"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:27.199112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-869ea600-fd42-43b4-aace-01837b29d06a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:27.199761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-869ea600-fd42-43b4-aace-01837b29d06a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 2d78d676-fdb0-4d3b-8a75-c617f6344137] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:27.205492 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-869ea600-fd42-43b4-aace-01837b29d06a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 2d78d676-fdb0-4d3b-8a75-c617f6344137 could not be found. Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-869ea600-fd42-43b4-aace-01837b29d06a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/2d78d676-fdb0-4d3b-8a75-c617f6344137 HTTP/1.1 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 2d78d676-fdb0-4d3b-8a75-c617f6344137 could not be found. Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2d78d676-fdb0-4d3b-8a75-c617f6344137'} Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d78d676-fdb0-4d3b-8a75-c617f6344137 could not be found. Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d78d676-fdb0-4d3b-8a75-c617f6344137 could not be found. Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:27.207232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:27.212440 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:27.212440 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:27.212440 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:27.212440 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d78d676-fdb0-4d3b-8a75-c617f6344137 could not be found. Oct 25 03:24:27.212440 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:27.218506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-869ea600-fd42-43b4-aace-01837b29d06a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 2d78d676-fdb0-4d3b-8a75-c617f6344137 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:27.220073 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-869ea600-fd42-43b4-aace-01837b29d06a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/2d78d676-fdb0-4d3b-8a75-c617f6344137" status: 404 len: 111 microversion: 2.1 time: 0.033024 Oct 25 03:24:27.221085 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2341/4512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:27 2022] GET /compute/v2.1/servers/2d78d676-fdb0-4d3b-8a75-c617f6344137 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:24:27.246033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:27.246785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:27.297099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:24:27.297719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:24:27.298431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:24:27.299360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:24:27.300504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:24:27.319917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:27.320818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:27.321910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:27.323795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:27.324863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:27.325408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:27.355959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Getting quotas for project e2aa210fb9034b929f578bd9a6d32cd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:24:27.367010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Getting quotas for user ed16105c73ab400b8fda98a5dd731f20 and project e2aa210fb9034b929f578bd9a6d32cd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:24:27.388134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:24:27.391873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:24:27.534266 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad23a698-8f20-4cd1-932f-480d0eb55e35 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.814846 Oct 25 03:24:27.535200 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2172/4513] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:24:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:24:27.554624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97c7e99b-fd9e-48dc-ad0b-fc4d10b84350 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:27.555243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97c7e99b-fd9e-48dc-ad0b-fc4d10b84350 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:27.652117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:27.654271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:27.655287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:27.655526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:27.655922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:27.656295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:27.675653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97c7e99b-fd9e-48dc-ad0b-fc4d10b84350 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:27.689479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97c7e99b-fd9e-48dc-ad0b-fc4d10b84350 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:27.691268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97c7e99b-fd9e-48dc-ad0b-fc4d10b84350 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:27.694980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97c7e99b-fd9e-48dc-ad0b-fc4d10b84350 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f" status: 200 len: 1278 microversion: 2.47 time: 0.144336 Oct 25 03:24:27.697317 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2173/4514] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:27 2022] GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:27.832875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1609376593", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": "none"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:28.034475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:24:28.038062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:24:28.038592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:24:28.039054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:24:28.039554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:24:28.071585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:28.072331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:28.074769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:28.076953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:28.079864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:28.080692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:28.128676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:28.132627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Getting quotas for project e2aa210fb9034b929f578bd9a6d32cd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:24:28.141500 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7f5518d1-fb4e-440e-b232-6b6e5cae8c6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.915131 Oct 25 03:24:28.141724 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2342/4515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:27 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:28.145062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Getting quotas for user ed16105c73ab400b8fda98a5dd731f20 and project e2aa210fb9034b929f578bd9a6d32cd4. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:24:28.171750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:28.172367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:28.184027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:24:28.185075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:28.187181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:24:28.195990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:28.196573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:28.197388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:28.198087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:28.198719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:28.296613 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-994a6ad6-a392-4f9c-a374-8fc3956279bd tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.468647 Oct 25 03:24:28.299011 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2174/4516] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:24:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 25 03:24:28.336409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-94f5d01d-3046-494b-acc0-a0c44c2d1be5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:28.345239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-94f5d01d-3046-494b-acc0-a0c44c2d1be5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:28.349436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:28.551223 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-94f5d01d-3046-494b-acc0-a0c44c2d1be5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "PUT /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 992 microversion: 2.47 time: 0.244070 Oct 25 03:24:28.552626 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2175/4517] 10.222.0.36 () {62 vars in 1297 bytes} [Tue Oct 25 03:24:28 2022] PUT /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 992 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:24:28.574374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dfa60e29-3b6a-4ee4-b1ed-915993fad85f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:28.574999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dfa60e29-3b6a-4ee4-b1ed-915993fad85f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:28.797393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfa60e29-3b6a-4ee4-b1ed-915993fad85f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:28.804983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfa60e29-3b6a-4ee4-b1ed-915993fad85f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:28.808037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfa60e29-3b6a-4ee4-b1ed-915993fad85f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:28.809424 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dfa60e29-3b6a-4ee4-b1ed-915993fad85f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1278 microversion: 2.47 time: 0.239980 Oct 25 03:24:28.810528 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2176/4518] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:28 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:29.528374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:29.537736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d37456c9-5368-4631-9475-c95b398bb98d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 1.370820 Oct 25 03:24:29.542882 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2343/4519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:28 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:29.798699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-30dd52e9-ea9c-42a4-98af-6f5d25fdd0be tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1202008707", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-30dd52e9-ea9c-42a4-98af-6f5d25fdd0be tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 238 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1202008707", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1202008707', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.825440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-30dd52e9-ea9c-42a4-98af-6f5d25fdd0be tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:29.833937 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-30dd52e9-ea9c-42a4-98af-6f5d25fdd0be tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033010 Oct 25 03:24:29.837002 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2177/4520] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:29.844239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:29.845073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:29.846771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:29.847456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:29.873944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:29.878728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:29.879355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:29.881770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:29.882411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:29.883703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:29.898404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:29.905553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:29.906041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:29.907242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:29.919194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:29.922378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:30.173914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:30.196518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:30.204980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:30.208806 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c764af66-c736-4f6f-bd2e-7705167896b0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1274 microversion: 2.47 time: 0.367051 Oct 25 03:24:30.234184 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2178/4521] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:29 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1274 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:30.485457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:30.506447 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c8db77c-d92e-4458-bfbc-2ede3557d065 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.667789 Oct 25 03:24:30.507732 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2344/4522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:29 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:30.535557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:30.539131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:30.564576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:30.566840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:30.568382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:30.569155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:30.569636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:30.570102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:31.239868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:31.240478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:31.267643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:31.268145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:31.268591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:31.269328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:31.271638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:31.272130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:31.412385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:31.424927 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1eb58f74-7422-4d56-80ed-507994bb9db5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.893965 Oct 25 03:24:31.428358 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2179/4523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:30 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:31.487205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:31.505443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:31.520162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:31.525334 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a098580-be26-46b7-b498-2fe8c9007517 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1336 microversion: 2.47 time: 0.289304 Oct 25 03:24:31.530679 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2345/4524] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:31 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1336 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:31.591650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35f653e0-71ca-405c-9740-8fa1d79f5ee8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1559032168", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35f653e0-71ca-405c-9740-8fa1d79f5ee8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 235 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1559032168", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1559032168', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.599051 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35f653e0-71ca-405c-9740-8fa1d79f5ee8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35f653e0-71ca-405c-9740-8fa1d79f5ee8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.016103 Oct 25 03:24:31.606425 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2180/4525] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:31 2022] POST /compute/v2.1/servers => generated 133 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:31.612555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:31.613184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:31.628361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:31.633229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:31.633921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:31.634582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:31.635572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:31.638226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:32.223697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:32.234121 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-06a378c8-b3ce-4152-92af-fbbd589cddc1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.627593 Oct 25 03:24:32.240962 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2346/4526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:31 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:32.267066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:32.268500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:32.284231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:32.287608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:32.288511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:32.289524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:32.296834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:32.297797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:32.555894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:32.558172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:32.588482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:32.589860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:32.591451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:32.592486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:32.593339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:32.594397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:32.850703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:32.865548 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06d73ebf-7787-40ce-b157-c434a637487b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.603365 Oct 25 03:24:32.883252 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2181/4527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:32 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:32.902121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c3b4e59f-8050-4c02-8705-f3460d37056c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:32.902675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c3b4e59f-8050-4c02-8705-f3460d37056c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: cf02b7b3-f229-43ad-8873-f8b3159bf90d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:32.914623 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c3b4e59f-8050-4c02-8705-f3460d37056c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance cf02b7b3-f229-43ad-8873-f8b3159bf90d could not be found. Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c3b4e59f-8050-4c02-8705-f3460d37056c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/cf02b7b3-f229-43ad-8873-f8b3159bf90d/action HTTP/1.1 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 13 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: {"pause": {}} Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance cf02b7b3-f229-43ad-8873-f8b3159bf90d could not be found. Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'cf02b7b3-f229-43ad-8873-f8b3159bf90d', 'body': {'pause': {}}} Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf02b7b3-f229-43ad-8873-f8b3159bf90d could not be found. Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf02b7b3-f229-43ad-8873-f8b3159bf90d could not be found. Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:32.922623 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:32.931104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:32.931104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:32.931104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf02b7b3-f229-43ad-8873-f8b3159bf90d could not be found. Oct 25 03:24:32.931104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:32.931104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c3b4e59f-8050-4c02-8705-f3460d37056c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance cf02b7b3-f229-43ad-8873-f8b3159bf90d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:32.931104 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c3b4e59f-8050-4c02-8705-f3460d37056c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/cf02b7b3-f229-43ad-8873-f8b3159bf90d/action" status: 404 len: 111 microversion: 2.1 time: 0.033285 Oct 25 03:24:32.931104 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2182/4528] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:32 2022] POST /compute/v2.1/servers/cf02b7b3-f229-43ad-8873-f8b3159bf90d/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:32.936874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:32.937659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:32.938313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:32.952438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:32.965218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:32.965218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:32.965218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:32.965218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:32.965218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:32.981901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:33.016645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:33.025259 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1da5f06-a69c-47b4-b746-3e702a3f8eb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1336 microversion: 2.47 time: 0.473819 Oct 25 03:24:33.032728 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2347/4529] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:32 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1336 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:33.058904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:33.373643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:33.390841 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a98b9bb8-80a8-481b-9110-bd66e500d5f1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.461278 Oct 25 03:24:33.392585 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2183/4530] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:32 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:33.421355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:33.429635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:33.446051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:33.448534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:33.449215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:33.450116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:33.450977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:33.451638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:33.452314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:33.794938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:33.817250 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1636e2e2-3fd9-4bc0-88d6-f3a3b78ef2ce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.400986 Oct 25 03:24:33.821837 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2348/4531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:33 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:33.842345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:33.843210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:33.850214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:33.850946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:33.851997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:33.852885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:33.853524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:33.854797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:34.032185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-514638c7-bac3-4380-b1b3-7c637a8070c2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 202 len: 0 microversion: 2.1 time: 0.193737 Oct 25 03:24:34.033222 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2184/4532] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:33 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:24:34.042801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:34.043347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:34.050056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:34.053549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:34.054073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:34.054829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:34.061522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:34.062291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:34.066180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:34.066903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:34.076219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:34.077057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:34.077749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:34.078715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:34.081945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:34.082682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:34.184209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:34.199578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:34.201750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:34.204726 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2aa30e78-13db-451c-a5ca-e036d42608e4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1336 microversion: 2.47 time: 0.147981 Oct 25 03:24:34.205485 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2185/4533] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:34 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1336 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:34.509708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:34.519392 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27a78055-a6a7-4c90-94d4-b82783c6023f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1510 microversion: 2.1 time: 0.481914 Oct 25 03:24:34.523385 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2349/4534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:34 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:35.237275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:35.237956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:35.254519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:35.256033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:35.256482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:35.261005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:35.261511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:35.261958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:35.472856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:35.485778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:35.487773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:35.489716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0fbc2213-56f9-433f-b466-0025b02b68f7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1336 microversion: 2.47 time: 0.256903 Oct 25 03:24:35.490477 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2186/4535] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:35 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1336 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:35.546793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:35.547536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:35.566187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:35.566828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:35.568067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:35.568918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:35.569521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:35.570105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:35.936445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:35.937364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:35.950252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:35.951131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:35.952490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:35.954075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:35.954787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:35.962112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:35.995936 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] HTTP exception thrown: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Request method failure captured: Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 HTTP/1.1 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YdUfmAtPIbibN_2R8OGOHs5EZ6R-GcXunOGHsNnax3beGoLUXeUpYuZVgKzjdnHhPq0gUn9Q2MyC6BLjQIjfkt7WyCpGcFgrjd1Ob7NL0ghPKfXqNp7mfp1Fj3bwN7_09Mf6qzOXk5d3DfGgwYMGK5VcGJflTHIiqAG6bSBAZY3sg Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 52361f866854468785ec2bb9b1b8b6d6 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/52361f866854468785ec2bb9b1b8b6d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/52361f866854468785ec2bb9b1b8b6d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_52361f866854468785ec2bb9b1b8b6d6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/52361f866854468785ec2bb9b1b8b6d6"}]}] Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 52361f866854468785ec2bb9b1b8b6d6 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachSCSIVolumeTestJSON-1127645164-project Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4c42efa78e864c56aba0ede0b2461fa8 Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1127645164-project Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '133140c4-85b6-47e1-8bab-15379403aec7'} Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:35.998033 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:36.002732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.004637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Returning 404 to user: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:36.008582 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aca01f18-b5bd-48ff-8761-a6aa7a032835 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "DELETE /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 404 len: 111 microversion: 2.1 time: 0.078296 Oct 25 03:24:36.017467 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2187/4536] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:24:35 2022] DELETE /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:24:36.026992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:36.035764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] [instance: 133140c4-85b6-47e1-8bab-15379403aec7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:36.050713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.052150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.052786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.053764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.054413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.055018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.100553 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] HTTP exception thrown: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Request method failure captured: Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 HTTP/1.1 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1YdUfmAtPIbibN_2R8OGOHs5EZ6R-GcXunOGHsNnax3beGoLUXeUpYuZVgKzjdnHhPq0gUn9Q2MyC6BLjQIjfkt7WyCpGcFgrjd1Ob7NL0ghPKfXqNp7mfp1Fj3bwN7_09Mf6qzOXk5d3DfGgwYMGK5VcGJflTHIiqAG6bSBAZY3sg Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 52361f866854468785ec2bb9b1b8b6d6 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/52361f866854468785ec2bb9b1b8b6d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/52361f866854468785ec2bb9b1b8b6d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_52361f866854468785ec2bb9b1b8b6d6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/52361f866854468785ec2bb9b1b8b6d6"}]}] Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 52361f866854468785ec2bb9b1b8b6d6 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1127645164 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachSCSIVolumeTestJSON-1127645164-project Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4c42efa78e864c56aba0ede0b2461fa8 Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1127645164-project Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '133140c4-85b6-47e1-8bab-15379403aec7'} Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:36.102386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.108706 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:36.108706 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:36.108706 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:36.108706 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:36.108706 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:36.108706 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. Oct 25 03:24:36.108706 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.111070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] Returning 404 to user: Instance 133140c4-85b6-47e1-8bab-15379403aec7 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:36.112012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6a7465a-67d7-47a6-b987-239710fba432 tempest-AttachSCSIVolumeTestJSON-1127645164 tempest-AttachSCSIVolumeTestJSON-1127645164-project] 10.222.0.36 "GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7" status: 404 len: 111 microversion: 2.1 time: 0.090578 Oct 25 03:24:36.112610 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2188/4537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:36 2022] GET /compute/v2.1/servers/133140c4-85b6-47e1-8bab-15379403aec7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:36.121102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:36.133736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ba021d1-9e1e-4000-b473-ecd600cb6a59 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1490 microversion: 2.1 time: 0.590981 Oct 25 03:24:36.137907 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2350/4538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:35 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1490 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:36.168628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:36.170838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:36.186335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.187240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.187858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.193147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.194143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.212367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.332423 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Cannot 'pause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state paused Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action HTTP/1.1 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 13 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: {"pause": {}} Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: exception: Cannot 'pause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state paused Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'pause': {}}} Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c in vm_state paused. Cannot pause while the instance is in this state. Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state paused Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:36.337859 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:36.344804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:36.344804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:36.344804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:36.344804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state paused Oct 25 03:24:36.344804 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:36.348119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 409 to user: Cannot 'pause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state paused {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:36.349548 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-039082c7-10bc-464a-8776-7536f336c8ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 409 len: 143 microversion: 2.1 time: 0.188993 Oct 25 03:24:36.352891 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2189/4539] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:36 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 143 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:24:36.363138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:36.363936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:36.391911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.393659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.398002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.399128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.407655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.414159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.516737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:36.517638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:36.529283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.531215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.534460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.535695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.536342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.536969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.541127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:36.637419 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4fe09458-9090-4367-b6d0-8411730ec95b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 202 len: 0 microversion: 2.1 time: 0.279894 Oct 25 03:24:36.642042 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2351/4540] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:36 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:24:36.653604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:36.657551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:36.674153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.677376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.677902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:36.678657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:36.679133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:36.679566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:37.272059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:37.286793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8379cc64-8729-44e9-86b9-b274bf606a8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1497 microversion: 2.1 time: 0.643431 Oct 25 03:24:37.298071 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2352/4541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:36 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1497 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:37.441933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:37.457413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:37.465928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:37.467474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-00abf8af-b362-467a-8b36-8514c1b22306 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1336 microversion: 2.47 time: 0.954889 Oct 25 03:24:37.481712 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2190/4542] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:36 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1336 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:38.312335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:38.312958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:38.334074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.334648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.335108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:38.335860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.336318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.336760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:38.500015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:38.500820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:38.512370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:38.515622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.519340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.520469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:38.522564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.523982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.525884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:38.657982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:38.670881 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e77b0230-e85f-4bc6-9ad9-e3f4e774839c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.362385 Oct 25 03:24:38.671701 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2353/4543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:38 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:38.702886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:38.703714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:38.712194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.713587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.714978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:38.716172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.717050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.717936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:38.758646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:38.781798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:38.786708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:38.788467 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66064c5c-eaf4-4d9a-945f-0b2f30d8480a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1357 microversion: 2.47 time: 0.292814 Oct 25 03:24:38.790474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2191/4544] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:38 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:38.824966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:38.833561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:38.841060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=16 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:38.851580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.853417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.854619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:38.857142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:38.858439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:38.860728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.074150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:24:39.076481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:24:39.077207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:24:39.078796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:24:39.079490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:24:39.307178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:39.326877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.329814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.332326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.333741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.335993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.352355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.396088 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f6df3c45-8129-496c-8591-5ab21c968994 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "POST /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629/action" status: 202 len: 1079 microversion: 2.47 time: 0.580750 Oct 25 03:24:39.397392 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2192/4545] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:24:38 2022] POST /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629/action => generated 1079 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 25 03:24:39.429980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:39.431112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:39.450117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.451122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.454351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.455401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.456608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.457880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.571314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:39.607558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:39.615466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:39.618015 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd6b4261-4434-440c-b11d-349129ce3ec6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.198424 Oct 25 03:24:39.635436 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2193/4546] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:39 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:39.656641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:39.694698 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1fecd490-346e-4da4-af03-36274b6222a1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.997898 Oct 25 03:24:39.706365 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2354/4547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:38 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:39.722297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:39.725339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:39.745028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.751504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.754373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.756578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.760427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.763178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.844023 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c/action HTTP/1.1 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 28 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: {"reboot": {"type": "SOFT"}} Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'effbeb1d-aa58-463d-8594-15882198800c', 'body': {'reboot': {'type': 'SOFT'}}} Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:39.851881 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:39.859481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:39.862507 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f3f3534c-302d-4325-8ce5-f618363e0e41 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c/action" status: 404 len: 111 microversion: 2.1 time: 0.144861 Oct 25 03:24:39.870941 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2194/4548] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:39 2022] POST /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c/action => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:39.881932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:39.884383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:39.894199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.894695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.895140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:39.896223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:39.896687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:39.897119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:40.440673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:40.458813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f92655a-bf1a-4d94-82f9-0949fe6ec9d9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.578978 Oct 25 03:24:40.465742 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2355/4549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:39 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:40.493255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:40.493926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:40.505669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:40.506189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:40.506631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:40.509481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:40.511201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:40.511904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:40.669590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:40.671406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:40.689086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:40.694738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:40.696220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:40.698944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:40.700615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:40.703136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:40.895895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:40.912416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:40.915437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:40.917915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-311ce1b7-6853-4238-aea2-7c735ee3e1d0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.253711 Oct 25 03:24:40.919232 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2356/4550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:40 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:41.289868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:41.306906 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f09601e-6eb0-407b-b2dc-f9775d7d5539 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.823384 Oct 25 03:24:41.311928 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2195/4551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:40 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:41.337310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-216b831e-1246-4717-afa1-7108a8ac28f5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:41.342866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-216b831e-1246-4717-afa1-7108a8ac28f5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: b82d9b29-b113-41c7-b9dc-f2e81b5db9ec] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:41.372725 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-216b831e-1246-4717-afa1-7108a8ac28f5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance b82d9b29-b113-41c7-b9dc-f2e81b5db9ec could not be found. Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-216b831e-1246-4717-afa1-7108a8ac28f5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/b82d9b29-b113-41c7-b9dc-f2e81b5db9ec/action HTTP/1.1 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 28 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: {"reboot": {"type": "SOFT"}} Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance b82d9b29-b113-41c7-b9dc-f2e81b5db9ec could not be found. Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'b82d9b29-b113-41c7-b9dc-f2e81b5db9ec', 'body': {'reboot': {'type': 'SOFT'}}} Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82d9b29-b113-41c7-b9dc-f2e81b5db9ec could not be found. Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82d9b29-b113-41c7-b9dc-f2e81b5db9ec could not be found. Oct 25 03:24:41.377426 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82d9b29-b113-41c7-b9dc-f2e81b5db9ec could not be found. Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:41.383500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-216b831e-1246-4717-afa1-7108a8ac28f5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance b82d9b29-b113-41c7-b9dc-f2e81b5db9ec could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:41.395815 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-216b831e-1246-4717-afa1-7108a8ac28f5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/b82d9b29-b113-41c7-b9dc-f2e81b5db9ec/action" status: 404 len: 111 microversion: 2.1 time: 0.063886 Oct 25 03:24:41.397997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2357/4552] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:41 2022] POST /compute/v2.1/servers/b82d9b29-b113-41c7-b9dc-f2e81b5db9ec/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (3 switches on core 0) Oct 25 03:24:41.405827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:41.408043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:41.422032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:41.422550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:41.423003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:41.423747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:41.424219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:41.424656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:41.949388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:41.950663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:41.966550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:41.970565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:41.973536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:41.975847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:41.977694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:41.980333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:42.137990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:42.161041 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-729ff157-ea44-4507-aa61-9e9885b87963 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.757074 Oct 25 03:24:42.179025 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2196/4553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:41 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:42.179613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:42.196616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:42.199509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:42.205073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:42.215181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:42.217408 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b58b77d6-ba9e-473e-8358-e355afac404d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.273429 Oct 25 03:24:42.234152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:42.234152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:42.234152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:42.234152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:42.234152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:42.234152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:42.235587 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2358/4554] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:41 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:42.677282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:42.689253 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d2ba1e68-423b-4f2c-9bd4-5cb9f616eb26 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.502793 Oct 25 03:24:42.689913 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2197/4555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:42 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:42.721196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:42.725785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:42.753628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:42.755963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:42.757817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:42.760273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:42.761596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:42.763399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:42.811937 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c/action HTTP/1.1 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 65 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'effbeb1d-aa58-463d-8594-15882198800c', 'body': {'rebuild': {'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec'}}} Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 25 03:24:42.815964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:42.820902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:42.826948 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9e5e556e-f0df-4333-bbe4-0710d2e07c38 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c/action" status: 404 len: 111 microversion: 2.1 time: 0.108061 Oct 25 03:24:42.826948 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2359/4556] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:42 2022] POST /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c/action => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:42.833157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:42.833969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:42.851708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:42.854488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:42.855447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:42.857138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:42.859717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:42.864243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:43.253342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:43.254598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:43.255231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:43.266699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:43.268632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:43.268919 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8bf4d9cf-4333-438f-ac1f-fb1a2d85b981 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.439540 Oct 25 03:24:43.269524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:43.271348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2198/4557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:42 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:43.274619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:43.275887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:43.276553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:43.302970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:43.303889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:43.316589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:43.329209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:43.330316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:43.335730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:43.342288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:43.342757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:43.345863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:43.440943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:43.459193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:43.460978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:43.462451 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b4aa5581-228f-46d9-a4a2-03c6aa42b240 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.212307 Oct 25 03:24:43.463051 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2360/4558] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:43 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:43.670433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:43.680660 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca8036b6-c23f-4048-8f01-43d529c24089 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.383688 Oct 25 03:24:43.702899 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2199/4559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:43 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:43.710595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b08d016b-28b0-4681-bc91-468e60e01a22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:43.713825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b08d016b-28b0-4681-bc91-468e60e01a22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: b236c591-8803-40e9-9f80-b0669a678ded] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:43.723036 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-b08d016b-28b0-4681-bc91-468e60e01a22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance b236c591-8803-40e9-9f80-b0669a678ded could not be found. Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b08d016b-28b0-4681-bc91-468e60e01a22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/b236c591-8803-40e9-9f80-b0669a678ded/action HTTP/1.1 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 65 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance b236c591-8803-40e9-9f80-b0669a678ded could not be found. Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'b236c591-8803-40e9-9f80-b0669a678ded', 'body': {'rebuild': {'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec'}}} Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b236c591-8803-40e9-9f80-b0669a678ded could not be found. Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 25 03:24:43.724701 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b236c591-8803-40e9-9f80-b0669a678ded could not be found. Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b236c591-8803-40e9-9f80-b0669a678ded could not be found. Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b08d016b-28b0-4681-bc91-468e60e01a22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance b236c591-8803-40e9-9f80-b0669a678ded could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b08d016b-28b0-4681-bc91-468e60e01a22 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/b236c591-8803-40e9-9f80-b0669a678ded/action" status: 404 len: 111 microversion: 2.1 time: 0.021249 Oct 25 03:24:43.736064 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2361/4560] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:43 2022] POST /compute/v2.1/servers/b236c591-8803-40e9-9f80-b0669a678ded/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:24:43.740585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:43.740585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:43.750627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:43.751055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:43.751675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:43.759351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:43.762080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:43.762554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:44.195063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:44.205767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e7f74a2c-1d58-48c1-a924-78e73ac6867f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.472624 Oct 25 03:24:44.209969 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2200/4561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:43 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:44.242431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:44.243489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:44.259756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:44.261832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:44.262338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:44.263173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:44.264440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:44.266070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:44.493905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:44.495737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:44.508116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:44.512981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:44.513747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:44.514932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:44.516551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:44.526752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:44.576868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:44.590943 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08157e8b-8090-4b03-8282-cc4ba7e70d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.354831 Oct 25 03:24:44.607331 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2362/4562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:44 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:44.626611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9f5a8fe-6f8e-4b16-b427-2649ae32c938 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:44.629635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9f5a8fe-6f8e-4b16-b427-2649ae32c938 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: e6f397ce-d036-4df6-868e-6355e7f500ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:44.642456 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-c9f5a8fe-6f8e-4b16-b427-2649ae32c938 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance e6f397ce-d036-4df6-868e-6355e7f500ae could not be found. Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9f5a8fe-6f8e-4b16-b427-2649ae32c938 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/e6f397ce-d036-4df6-868e-6355e7f500ae/action HTTP/1.1 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: {"restore": {}} Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e6f397ce-d036-4df6-868e-6355e7f500ae could not be found. Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e6f397ce-d036-4df6-868e-6355e7f500ae', 'body': {'restore': {}}} Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f397ce-d036-4df6-868e-6355e7f500ae could not be found. Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f397ce-d036-4df6-868e-6355e7f500ae could not be found. Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:44.647756 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:44.654886 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:44.654886 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:44.654886 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f397ce-d036-4df6-868e-6355e7f500ae could not be found. Oct 25 03:24:44.654886 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:44.656528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9f5a8fe-6f8e-4b16-b427-2649ae32c938 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance e6f397ce-d036-4df6-868e-6355e7f500ae could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:44.659461 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9f5a8fe-6f8e-4b16-b427-2649ae32c938 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/e6f397ce-d036-4df6-868e-6355e7f500ae/action" status: 404 len: 111 microversion: 2.1 time: 0.043399 Oct 25 03:24:44.671345 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2363/4563] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:44 2022] POST /compute/v2.1/servers/e6f397ce-d036-4df6-868e-6355e7f500ae/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:44.682515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:44.692495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:44.712522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:44.714157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:44.715946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:44.717995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:44.718886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:44.719859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:44.720601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:44.732244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:44.746338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:44.747645 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-feb76eea-1c76-4b59-ab9b-eb7830d35708 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.257850 Oct 25 03:24:44.748470 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2201/4564] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:44 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:45.019614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:45.032026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33b38a61-d1eb-4f56-9a4f-5577718867cd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.354876 Oct 25 03:24:45.034194 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2364/4565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:44 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:45.062026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:45.062885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:45.077620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.077620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.077620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.077620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.086987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.091428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.405947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:45.417414 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c0a4c72-6bae-410c-b049-caea122f5878 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.360371 Oct 25 03:24:45.418854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2202/4566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:45 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:45.444541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:45.445000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:45.456888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.457390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.457865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.458589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.459056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.459487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.515618 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Cannot 'restore' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action HTTP/1.1 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: {"restore": {}} Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'restore' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'restore': {}}} Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c in vm_state active. Cannot restore while the instance is in this state. Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:45.533979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:45.547480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:45.547480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:45.547480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:45.547480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:45.547480 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:45.547480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 409 to user: Cannot 'restore' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:45.547480 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e65b421a-b47f-47e7-8ede-509573c24183 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 409 len: 145 microversion: 2.1 time: 0.095522 Oct 25 03:24:45.548720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:45.548720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:45.559308 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2365/4567] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:45 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 145 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:24:45.564545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.565037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.565475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.566333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.566799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.567227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.777657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:45.779897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:45.803857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.804359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.804802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.805512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:45.809559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:45.810069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:45.952381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:45.969130 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9070cff9-45c1-492e-b613-fe23c91e3201 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.421801 Oct 25 03:24:45.970223 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2203/4568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:45 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:46.018071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:46.018914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:46.029556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:46.031001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:46.033405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:46.035651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:46.036509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:46.043272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:46.107716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:46.116731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:46.118118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:46.129849 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf7212f6-3ce2-4aa4-8a8f-e3efd2a5d779 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.346032 Oct 25 03:24:46.136244 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2366/4569] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:45 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:46.540555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:46.556005 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9387e51f-b673-4d3c-bac1-863b87a73c19 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.551243 Oct 25 03:24:46.558366 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2204/4570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:46 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:46.583798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05f6bfd9-1899-42d2-ba0d-0a06d864b6a8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:46.584532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05f6bfd9-1899-42d2-ba0d-0a06d864b6a8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 430447b0-6a3f-4879-ab99-348814b552ec] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:46.598068 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-05f6bfd9-1899-42d2-ba0d-0a06d864b6a8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 430447b0-6a3f-4879-ab99-348814b552ec could not be found. Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05f6bfd9-1899-42d2-ba0d-0a06d864b6a8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/430447b0-6a3f-4879-ab99-348814b552ec/action HTTP/1.1 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 14 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: {"resume": {}} Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 430447b0-6a3f-4879-ab99-348814b552ec could not be found. Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '430447b0-6a3f-4879-ab99-348814b552ec', 'body': {'resume': {}}} Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430447b0-6a3f-4879-ab99-348814b552ec could not be found. Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430447b0-6a3f-4879-ab99-348814b552ec could not be found. Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:46.613718 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:46.620503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:46.620503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:46.620503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430447b0-6a3f-4879-ab99-348814b552ec could not be found. Oct 25 03:24:46.620503 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:46.620503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05f6bfd9-1899-42d2-ba0d-0a06d864b6a8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 430447b0-6a3f-4879-ab99-348814b552ec could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:46.620503 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05f6bfd9-1899-42d2-ba0d-0a06d864b6a8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/430447b0-6a3f-4879-ab99-348814b552ec/action" status: 404 len: 111 microversion: 2.1 time: 0.033648 Oct 25 03:24:46.620503 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2367/4571] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:46 2022] POST /compute/v2.1/servers/430447b0-6a3f-4879-ab99-348814b552ec/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:46.625465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:46.626738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:46.642174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:46.643385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:46.645320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:46.647974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:46.648677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:46.650058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.174103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:47.176569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:47.194162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.195950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.197107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.199520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.201496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.203003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.342411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:47.356456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:47.363465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:47.370181 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b0c5d40-2795-4196-b38d-f99f83c0dfe4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.748892 Oct 25 03:24:47.370758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:47.373617 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2205/4572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:46 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:47.376668 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e562996-733e-4a29-aef6-9becf661d2b6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.211468 Oct 25 03:24:47.395931 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2368/4573] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:47 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:47.400310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:47.401910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:47.418859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.419658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.420722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.421638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.422280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.422867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.733814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:47.745638 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21c25446-2b96-4def-a467-e3d2579c9880 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.349932 Oct 25 03:24:47.746840 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2206/4574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:47 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:47.770417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:47.771255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:47.786095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.786627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.787309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.788044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.791815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.792337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.856060 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Cannot 'resume' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action HTTP/1.1 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 14 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: {"resume": {}} Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'resume' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'resume': {}}} Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c in vm_state active. Cannot resume while the instance is in this state. Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:47.863792 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 409 to user: Cannot 'resume' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:47.869438 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a619b99b-a6f7-40d6-98cc-37be068dd056 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 409 len: 144 microversion: 2.1 time: 0.101129 Oct 25 03:24:47.873374 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2369/4575] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:47 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 144 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:24:47.879439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:47.880257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:47.895008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.895519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.895962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:47.896692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:47.897151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:47.897580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:48.246429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:48.263875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43ee1deb-1a4b-40f4-be90-02cda5c40e5f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.388360 Oct 25 03:24:48.278106 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2207/4576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:47 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:48.293403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:48.294301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:48.301581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:48.302400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:48.303065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:48.304214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:48.304882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:48.305515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:48.413091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:48.414449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:48.434018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:48.443412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:48.444013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:48.444981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:48.445568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:48.446221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:48.582538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:48.597975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:48.599967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:48.602761 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-518d1022-9c61-4f74-bf55-e7a1baa938ec tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.193894 Oct 25 03:24:48.604083 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2208/4577] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:48 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:48.971553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:48.985808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7a97a8c-d8e0-4ee4-8db8-7563cba235ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.696101 Oct 25 03:24:49.003076 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2370/4578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:48 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:49.128960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a00dd36-98cb-4b9b-88ee-7734a4a32202 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a00dd36-98cb-4b9b-88ee-7734a4a32202 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 160 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9"}]}} Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': '', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'networks': [{'uuid': '8cec22b1-e74b-4c2e-a9bd-2c10fe1aedc9'}]}}} Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi '' Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:24:49.132710 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:49.137771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a00dd36-98cb-4b9b-88ee-7734a4a32202 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:49.142025 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a00dd36-98cb-4b9b-88ee-7734a4a32202 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016793 Oct 25 03:24:49.147420 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2209/4579] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:24:49 2022] POST /compute/v2.1/servers => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:24:49.151589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:49.152223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:49.158691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:49.159185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:49.159629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:49.160759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:49.161405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:49.162023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:49.678435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:49.681382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:49.712336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:49.713784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:49.714590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:49.715623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:49.716529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:49.717381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:49.776753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:24:49.970738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:49.989450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e8f47d4-dfb2-4ba4-ba45-c765770fbcce tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.839599 Oct 25 03:24:49.993511 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2371/4580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:49 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:50.036077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:50.036654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:50.056022 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e66cbf0f-9fe0-4ea2-bb3b-a4f8a25f70ed tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 204 len: 0 microversion: 2.1 time: 0.733600 Oct 25 03:24:50.059638 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2210/4581] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:24:49 2022] DELETE /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:24:50.063222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.070005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.071089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.073754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:50.074005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:50.074127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.074611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.075065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.111078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.112200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.112497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.115297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.116368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.116368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.344958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:50.360805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:50.367046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:50.373373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-057ad086-1ca8-40af-9c6e-f9ee694512a3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.368117 Oct 25 03:24:50.374332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2372/4582] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:49 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:50.388997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:50.390829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:50.407407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.409572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.411335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.413712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.415309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.417336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.446152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:50.722745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:50.735649 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-200cba58-9e1f-4dde-877c-7b4c70c45ec4 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.677336 Oct 25 03:24:50.736329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2211/4583] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:50 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:50.765183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9fcac5b-cebf-4eb7-8a6f-d26b1e983944 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:50.769630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e9fcac5b-cebf-4eb7-8a6f-d26b1e983944 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: a775db10-6394-4c05-9f91-b6c453345884] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:50.779843 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e9fcac5b-cebf-4eb7-8a6f-d26b1e983944 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance a775db10-6394-4c05-9f91-b6c453345884 could not be found. Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9fcac5b-cebf-4eb7-8a6f-d26b1e983944 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/a775db10-6394-4c05-9f91-b6c453345884/action HTTP/1.1 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 14 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: {"shelve": {}} Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance a775db10-6394-4c05-9f91-b6c453345884 could not be found. Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'a775db10-6394-4c05-9f91-b6c453345884', 'body': {'shelve': {}}} Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a775db10-6394-4c05-9f91-b6c453345884 could not be found. Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a775db10-6394-4c05-9f91-b6c453345884 could not be found. Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:50.787103 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:50.792940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:50.792940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:50.792940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a775db10-6394-4c05-9f91-b6c453345884 could not be found. Oct 25 03:24:50.792940 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:50.792940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9fcac5b-cebf-4eb7-8a6f-d26b1e983944 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance a775db10-6394-4c05-9f91-b6c453345884 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:50.792940 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9fcac5b-cebf-4eb7-8a6f-d26b1e983944 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/a775db10-6394-4c05-9f91-b6c453345884/action" status: 404 len: 111 microversion: 2.1 time: 0.029463 Oct 25 03:24:50.794988 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2212/4584] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:50 2022] POST /compute/v2.1/servers/a775db10-6394-4c05-9f91-b6c453345884/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:50.801123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:50.801786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:50.809895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.810456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.810896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.811862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:50.812499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:50.813187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:50.906632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:50.914787 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-afe379d2-04ff-4915-b22f-3f37e86a0a6f tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1729 microversion: 2.1 time: 0.536808 Oct 25 03:24:50.930417 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2373/4585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:50 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1729 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:51.303953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:51.316986 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19afd14c-8b8d-4610-8a6b-1b2d5970e2ea tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.519639 Oct 25 03:24:51.317844 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2213/4586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:50 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:51.346935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:51.347668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:51.356171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.365519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.366249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:51.367116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.367848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.368547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:51.493188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:51.494616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:51.516700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.520389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.521426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:51.527386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.527960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.528384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:51.676979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:51.691531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c0d13e0-9535-4737-988f-a7ecb0e77adf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.343905 Oct 25 03:24:51.706082 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2374/4587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:51 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:51.720461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:51.720712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:51.735817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:51.744934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:51.746678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:51.748084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2154ceaf-4884-450c-8016-bc36b5480d2f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.259526 Oct 25 03:24:51.748665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.748859 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2214/4588] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:51 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:51.752269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.753868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:51.755379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.756029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.756633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:51.801035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lazy-loading 'flavor' on Instance uuid 01ad2d83-3644-4094-9f43-2cfcb61f180c {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:24:51.943055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:51.943457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:51.957282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.958113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.959660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:51.961663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:51.964249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:51.965973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:52.185913 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9913374-c892-4a3d-bc41-72f395e402c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 202 len: 0 microversion: 2.1 time: 0.469275 Oct 25 03:24:52.186533 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2375/4589] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:24:51 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:24:52.234140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:52.234969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:52.259126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:52.259580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:52.260222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:52.261130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:52.265739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:52.266523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:52.535818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:52.569864 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4dd5ea46-9ddd-4262-aab7-479c313b2a00 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.372944 Oct 25 03:24:52.570775 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2376/4590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:52 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:52.789230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:52.792639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:52.811123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:52.813507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:52.814628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:52.816455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:52.818009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:52.819425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:53.053299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:53.063332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:53.064784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:53.074172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1ad653d9-57d0-4fda-a937-d4e23ac49cd4 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.289563 Oct 25 03:24:53.074814 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2377/4591] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:52 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:53.092740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:53.105251 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3080942a-ead2-4510-9f9f-fb6e630feefd tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1729 microversion: 2.1 time: 1.167097 Oct 25 03:24:53.118643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2215/4592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:51 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1729 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:53.606853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:53.607588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:53.620287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:53.620795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:53.621234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:53.625426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:53.626214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:53.626653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:54.100387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:54.101778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:54.123568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:54.124128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:54.124663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:54.128608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:54.132249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:54.132952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:54.154401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:54.165663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc9c614d-6fe2-4726-b339-a33f36dda4a9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.571185 Oct 25 03:24:54.169643 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2378/4593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:53 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:54.172757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:54.175099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:54.187985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:54.204556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:54.206569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:54.207457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:54.210146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:54.218527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:54.218992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:54.434842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:54.453628 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c45eadc8-ccb6-4630-a8f5-13d2900c8d9e tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1662 microversion: 2.1 time: 0.280459 Oct 25 03:24:54.454638 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2379/4594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:54 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1662 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:54.513715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:54.534862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:54.536942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:54.540306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aecaea32-887a-4230-b083-6f4fca4856cb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.443774 Oct 25 03:24:54.546155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2216/4595] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:54 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:54.652222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f306d6a1-4080-49ad-b508-3d48dbf5e860 req-7aab687e-672f-4d28-a48d-101a98e7cf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c947299d-7286-442e-9a54-ead975874d85", "name": "network-vif-deleted", "tag": "10eb2301-32cd-4542-b87b-00d7a3c775be"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:24:54.670182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f306d6a1-4080-49ad-b508-3d48dbf5e860 req-7aab687e-672f-4d28-a48d-101a98e7cf54 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:54.672400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f306d6a1-4080-49ad-b508-3d48dbf5e860 req-7aab687e-672f-4d28-a48d-101a98e7cf54 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:54.674239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f306d6a1-4080-49ad-b508-3d48dbf5e860 req-7aab687e-672f-4d28-a48d-101a98e7cf54 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:54.709823 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f306d6a1-4080-49ad-b508-3d48dbf5e860 req-7aab687e-672f-4d28-a48d-101a98e7cf54 service nova] Creating event network-vif-deleted:10eb2301-32cd-4542-b87b-00d7a3c775be for instance c947299d-7286-442e-9a54-ead975874d85 on n-h1-862355-1 Oct 25 03:24:54.724786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f306d6a1-4080-49ad-b508-3d48dbf5e860 req-7aab687e-672f-4d28-a48d-101a98e7cf54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078496 Oct 25 03:24:54.729421 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2380/4596] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:24:55.194455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:55.195171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:55.216015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:55.216512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:55.216953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:55.217668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:55.218156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:55.218587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:55.491349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:55.492292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:55.519516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:55.520060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:55.520739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:55.524116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:55.527881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:55.532451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:55.658416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:55.661669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:55.662715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:55.663383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lazy-loading 'fault' on Instance uuid c947299d-7286-442e-9a54-ead975874d85 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:24:55.766551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45cd7d8599c84a989dc3e74541eba7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9caf679fdf54cadbae34f5894064dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:55.777007 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c64187cb-d512-492a-b7d8-625c172db2a5 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 200 len: 1387 microversion: 2.1 time: 0.298451 Oct 25 03:24:55.785828 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2381/4597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:55 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 1387 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:55.805350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:55.806159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:55.828147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:55.831599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:55.832351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:55.838635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:55.839394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:55.839879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:55.840322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:55.846426 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf417619-ee40-4fc0-9aed-3ebd4feff26c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.656503 Oct 25 03:24:55.853771 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2217/4598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:55 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:24:56.106852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:56.124841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:56.128265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:56.132015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-271f3463-5a12-4d2e-b500-716f8f9a2d43 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.342633 Oct 25 03:24:56.134426 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2382/4599] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:55 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:24:56.801521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:56.802298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:56.834269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:56.835377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:56.836106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:56.838456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:56.839287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:56.840339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:56.863031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] HTTP exception thrown: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:56.877584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:56.878391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Request method failure captured: Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 HTTP/1.1 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1WsIbTZkQiTpdYniekorDZSx12UhhCjNvgWvj9jdob536POnkQOy7eO1E9Lh4fCuew8SXNP8O94SAZPZdcEuD2I7dgElySMnGO5JkT7IzfPn_FDaKyddPtWCF-cawcEgwNL_Lxzp_UZIv9fcip0pO87CwazVZC0bHLCiCFfKI7P_9Y Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f9caf679fdf54cadbae34f5894064dd7 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestServerBasicOps-821693412 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9caf679fdf54cadbae34f5894064dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9caf679fdf54cadbae34f5894064dd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f9caf679fdf54cadbae34f5894064dd7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f9caf679fdf54cadbae34f5894064dd7"}]}] Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestServerBasicOps-821693412 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f9caf679fdf54cadbae34f5894064dd7 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestServerBasicOps-821693412 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestServerBasicOps-821693412-project Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 45cd7d8599c84a989dc3e74541eba7b0 Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestServerBasicOps-821693412-project Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c947299d-7286-442e-9a54-ead975874d85'} Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:56.885110 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:56.890961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:56.890961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:56.890961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:56.890961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:56.890961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:56.890961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:56.890961 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:56.891512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:56.891512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:56.891771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Returning 404 to user: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:56.899465 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3a7a14bc-2985-426f-8c8b-5ef520ff084d tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 404 len: 111 microversion: 2.1 time: 0.095266 Oct 25 03:24:56.901598 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2218/4600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:56 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:56.902371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:56.903744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:56.904723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:56.905947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:57.163257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:57.165624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:57.178635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:24:57.186860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:57.187587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:57.188228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:57.189590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:57.190456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:57.190902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:57.286080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:57.298327 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0845616d-f84d-4048-91ee-2b0d6acaaa6e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.425841 Oct 25 03:24:57.314778 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2383/4601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:56 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:57.371281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:57.386394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:57.391522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:57.394795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a977bbc6-9e17-4f24-bc8e-c35b1e0b1980 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.235941 Oct 25 03:24:57.397151 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2219/4602] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:57 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:58.198394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:58.199184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:58.211066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.214980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.215785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.217797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.219114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.220871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.269753 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] HTTP exception thrown: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Request method failure captured: Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 HTTP/1.1 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1WsIbTZkQiTpdYniekorDZSx12UhhCjNvgWvj9jdob536POnkQOy7eO1E9Lh4fCuew8SXNP8O94SAZPZdcEuD2I7dgElySMnGO5JkT7IzfPn_FDaKyddPtWCF-cawcEgwNL_Lxzp_UZIv9fcip0pO87CwazVZC0bHLCiCFfKI7P_9Y Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: f9caf679fdf54cadbae34f5894064dd7 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestServerBasicOps-821693412 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9caf679fdf54cadbae34f5894064dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9caf679fdf54cadbae34f5894064dd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f9caf679fdf54cadbae34f5894064dd7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f9caf679fdf54cadbae34f5894064dd7"}]}] Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestServerBasicOps-821693412 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: f9caf679fdf54cadbae34f5894064dd7 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestServerBasicOps-821693412 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestServerBasicOps-821693412-project Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 45cd7d8599c84a989dc3e74541eba7b0 Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestServerBasicOps-821693412-project Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'c947299d-7286-442e-9a54-ead975874d85'} Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:58.272456 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.278054 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.278957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Returning 404 to user: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:58.281607 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4833e30-0a4e-4a85-8ded-5f58620ef1fe tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 404 len: 111 microversion: 2.1 time: 0.090069 Oct 25 03:24:58.284244 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2384/4603] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:24:58 2022] DELETE /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:58.293616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:58.294270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] [instance: c947299d-7286-442e-9a54-ead975874d85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:58.308654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.309570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.319791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.320565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.321055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.322844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.327582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:58.328287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:58.338533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.341704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.344270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.345266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.345962 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] HTTP exception thrown: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.347133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Request method failure captured: Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 HTTP/1.1 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1WsIbTZkQiTpdYniekorDZSx12UhhCjNvgWvj9jdob536POnkQOy7eO1E9Lh4fCuew8SXNP8O94SAZPZdcEuD2I7dgElySMnGO5JkT7IzfPn_FDaKyddPtWCF-cawcEgwNL_Lxzp_UZIv9fcip0pO87CwazVZC0bHLCiCFfKI7P_9Y Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f9caf679fdf54cadbae34f5894064dd7 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestServerBasicOps-821693412 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9caf679fdf54cadbae34f5894064dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f9caf679fdf54cadbae34f5894064dd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f9caf679fdf54cadbae34f5894064dd7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f9caf679fdf54cadbae34f5894064dd7"}]}] Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestServerBasicOps-821693412 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f9caf679fdf54cadbae34f5894064dd7 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestServerBasicOps-821693412 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestServerBasicOps-821693412-project Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 45cd7d8599c84a989dc3e74541eba7b0 Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestServerBasicOps-821693412-project Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c947299d-7286-442e-9a54-ead975874d85'} Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:24:58.347568 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Returning 404 to user: Instance c947299d-7286-442e-9a54-ead975874d85 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:24:58.353809 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1b0d87a-bd57-43fc-b6fb-5b2a840344c9 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85" status: 404 len: 111 microversion: 2.1 time: 0.060112 Oct 25 03:24:58.358164 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2220/4604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:58 2022] GET /compute/v2.1/servers/c947299d-7286-442e-9a54-ead975874d85 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:24:58.359101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.428027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:58.428752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:58.444313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.445081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.445841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.446768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:58.447949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:58.448590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:58.749700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:58.770810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:58.782785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:58.787812 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7495ad27-9b87-4f64-a957-49e3d2431bbc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.362387 Oct 25 03:24:58.796414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2221/4605] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:58 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:24:59.087579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55161327-b001-4205-b1ce-a106a2ddfe02 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] Calling method '.version_select at 0x7efd32952670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:59.131351 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55161327-b001-4205-b1ce-a106a2ddfe02 tempest-TestServerBasicOps-821693412 tempest-TestServerBasicOps-821693412-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-588161485" status: 202 len: 0 microversion: 2.1 time: 0.047653 Oct 25 03:24:59.135466 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2222/4606] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 03:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-588161485 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:24:59.371469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:24:59.379975 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d36704c0-97a2-4ebb-87c2-707b747e402a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 1.059207 Oct 25 03:24:59.393944 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2385/4607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:24:58 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:24:59.835981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:24:59.836715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:24:59.856203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:59.856712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:59.857162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:24:59.857925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:24:59.858392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:24:59.858831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:00.020009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:00.041766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:00.048912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:00.050211 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-176e2927-0ade-47b2-861f-aa6fa19717fb tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.231083 Oct 25 03:25:00.050806 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2223/4608] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:24:59 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:00.407140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:00.407775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:00.419386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:00.420224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:00.423348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:00.424570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:00.425268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:00.427408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:00.761616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:00.782054 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1ca804a-5485-4870-a76c-a16ef78e303a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.379174 Oct 25 03:25:00.802191 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2386/4609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:00 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:01.089902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:01.091581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:01.100306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:01.101143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:01.101851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:01.102825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:01.103639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:01.104514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:01.443204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:01.488138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:01.500672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:01.502860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e36e348-3353-4c94-832b-ea262d043f7b tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.421602 Oct 25 03:25:01.504682 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2224/4610] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:01 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:01.807279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:01.807880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:01.817548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:01.820611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:01.823902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:01.825940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:01.828436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:01.829426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:02.534244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:02.539665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:02.540291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:02.555688 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b7f1f34-7926-4469-847d-08bb895f168b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.753541 Oct 25 03:25:02.559383 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2387/4611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:01 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:02.561093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:02.562156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:02.562890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:02.564027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:02.564839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:02.565553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:02.686153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:02.703442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:02.705794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:02.707838 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aeb441c7-7a02-40e0-9c36-63e55d3bfcfc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.179223 Oct 25 03:25:02.708864 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2225/4612] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:02 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:03.583429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:03.584066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:03.588521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=82 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:03.603936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:03.604988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:03.605470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:03.608567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:03.609069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:03.609559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:03.736871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:03.737718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:03.752945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:03.753416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:03.763655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:03.765834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:03.770257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:03.772401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:03.988918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:03.991566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:04.000053 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d22ca8f-0632-438c-a864-2942c0a04337 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.420561 Oct 25 03:25:04.001064 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2388/4613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:03 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:04.010110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:04.019102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:04.021065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:04.027835 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e1cf75c-29d8-40a5-88e5-157a61fbfc8c tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.295628 Oct 25 03:25:04.028448 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2226/4614] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:03 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:04.891174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-52c5c961-9b7d-41d9-bc94-52ba45f360e5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3814e700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:05.026701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:05.028850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:05.051905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:05.052434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:05.052884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:05.058469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:05.059008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:05.059471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:05.317027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:05.327393 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14c933fd-8ad6-4b5d-bc9d-e1f8e3f29b60 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.307925 Oct 25 03:25:05.333744 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2227/4615] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:05 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:05.340912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:05.341878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:05.349940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:05.351124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:05.354301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:05.355341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:05.356917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:05.357858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:05.453161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:05.474944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:05.477223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:05.479381 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7eb7dd64-6c84-4920-99d0-6e4a49bc8cb0 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1366 microversion: 2.47 time: 0.149777 Oct 25 03:25:05.494257 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2228/4616] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:05 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:05.727013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-52c5c961-9b7d-41d9-bc94-52ba45f360e5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/04abc7ef-6503-40c7-8da8-286cffaa58f9" status: 200 len: 661 microversion: 2.1 time: 0.840421 Oct 25 03:25:05.738120 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2389/4617] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:04 2022] GET /compute/v2.1/images/04abc7ef-6503-40c7-8da8-286cffaa58f9 => generated 661 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:05.747214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb01bfeb-7813-4909-a77b-a69934663337 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd330bc700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:06.353713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:06.355343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:06.366068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:06.375427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:06.378500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:06.380686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:06.382751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:06.387257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:06.722233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:06.752309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb8b8a4a-73a7-4cbd-becc-58b2554d75c3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.403380 Oct 25 03:25:06.754527 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2390/4618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:06 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:06.777257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:06.783265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:06.790371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:06.791962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:06.792573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:06.793479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:06.794128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:06.794728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:06.922988 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb01bfeb-7813-4909-a77b-a69934663337 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/04abc7ef-6503-40c7-8da8-286cffaa58f9" status: 200 len: 661 microversion: 2.1 time: 1.181998 Oct 25 03:25:06.936675 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2229/4619] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:05 2022] GET /compute/v2.1/images/04abc7ef-6503-40c7-8da8-286cffaa58f9 => generated 661 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:07.049692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:07.062785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:07.064925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:07.067054 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63b76343-a86e-4c04-a950-b3cd4f9c49ad tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1372 microversion: 2.47 time: 0.309916 Oct 25 03:25:07.067796 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2391/4620] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:06 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:07.777157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:07.777918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:07.789753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:07.799926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:07.801612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:07.803564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:07.804852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:07.807271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:08.094964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:08.095590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:08.103774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:08.105174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:08.105869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:08.107071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:08.108418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:08.109031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:08.199703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:08.214067 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21d1a80b-e94e-4b92-99ff-2196f4816ffa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.441435 Oct 25 03:25:08.239617 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2230/4621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:07 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:08.298813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:08.313985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:08.316142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:08.321363 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12e0e36a-7cf5-4182-accc-08617cfa9c9a tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1372 microversion: 2.47 time: 0.226873 Oct 25 03:25:08.324450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2392/4622] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:08 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:09.248005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:09.248607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:09.263023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:09.263534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:09.263980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:09.264706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:09.265168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:09.265597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:09.354760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:09.355395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:09.362571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:09.363072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:09.363524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:09.364232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:09.364693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:09.381912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:09.573080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:09.583209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:09.593166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:09.605329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:09.606627 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e281cb13-bc1b-4b46-8ad4-0fead3c9a5e6 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1372 microversion: 2.47 time: 0.257141 Oct 25 03:25:09.607201 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2393/4623] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:09 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:09.611023 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8f1b423d-2923-4cc9-aed8-41e1b59f214b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.368148 Oct 25 03:25:09.626072 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2231/4624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:09 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:09.633867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1bf1cd23-25fb-409a-81ea-9015ee9e069e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32db4e50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:09.738461 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1bf1cd23-25fb-409a-81ea-9015ee9e069e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ad7561d8-5b9a-4b40-97b4-29cc54600ccf" status: 200 len: 662 microversion: 2.1 time: 0.130163 Oct 25 03:25:09.742203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2394/4625] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:09 2022] GET /compute/v2.1/images/ad7561d8-5b9a-4b40-97b4-29cc54600ccf => generated 662 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:09.757179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fdea87ef-36eb-4145-bd5c-a8514ed94a0e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33555820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:09.813805 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fdea87ef-36eb-4145-bd5c-a8514ed94a0e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ad7561d8-5b9a-4b40-97b4-29cc54600ccf" status: 200 len: 662 microversion: 2.1 time: 0.060787 Oct 25 03:25:09.814923 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2232/4626] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:09 2022] GET /compute/v2.1/images/ad7561d8-5b9a-4b40-97b4-29cc54600ccf => generated 662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:10.638139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:10.638745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:10.645969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:10.647536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:10.669100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:10.670850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:10.683866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:10.685728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:10.686707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:10.687058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:10.687916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:10.688861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:10.690414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:10.691054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:10.691719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:10.695038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:10.883670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:10.908439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:10.918712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:10.938793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a59f2906-00d3-4ca9-9871-fcae1b40a8e5 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1357 microversion: 2.47 time: 0.296466 Oct 25 03:25:10.942703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2395/4627] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:10 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1357 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:10.973621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:10.985915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:10.987041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Searching by: {'deleted': False, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:25:10.998173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:10.999588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:11.000237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:11.001204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:11.002035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:11.002772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:11.112172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:11.126206 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fcb86aac-58b4-46a6-850a-183d8e4ec316 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.493155 Oct 25 03:25:11.126802 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2233/4628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:10 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:11.164434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:25:11.408156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:11.429450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:11.429982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:11.430427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:11.474336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:11.475815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:11.621766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee2716f6-99fa-4249-9943-4f329bd0c36d tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.654257 Oct 25 03:25:11.622655 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2396/4629] 10.222.0.36 () {60 vars in 1187 bytes} [Tue Oct 25 03:25:10 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:11.676441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:11.679904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:11.706130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:11.707904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:11.712112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:11.716507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:11.717268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:11.717950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:11.816520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:25:12.121865 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cbfc7ed2-ef97-4100-ae69-69fbd46c022f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 204 len: 0 microversion: 2.47 time: 0.460662 Oct 25 03:25:12.125392 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2234/4630] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:25:11 2022] DELETE /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:25:12.131999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:12.132636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:12.162599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:12.163327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:12.163919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:12.164448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:12.165151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:12.166404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:12.168488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:12.170217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:12.182004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:12.182745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:12.184860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:12.190112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:12.191606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:12.196663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:12.249636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:12.495820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:12.523795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:12.527255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:12.528958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b7da92da-15b1-404f-890e-3e6e1837c839 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1363 microversion: 2.47 time: 0.402219 Oct 25 03:25:12.529642 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2397/4631] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:12 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:12.550208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-846a5e89-4f00-4857-9c16-6ba781c88926 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b890790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:12.624786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-846a5e89-4f00-4857-9c16-6ba781c88926 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/db61f38c-4a06-4128-afb9-26224e7c19b9" status: 200 len: 661 microversion: 2.1 time: 0.088720 Oct 25 03:25:12.636332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2398/4632] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:12 2022] GET /compute/v2.1/images/db61f38c-4a06-4128-afb9-26224e7c19b9 => generated 661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:12.652192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4802b224-a857-484d-bd7f-f0ac8e485b02 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd329f0430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:12.748041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4802b224-a857-484d-bd7f-f0ac8e485b02 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/db61f38c-4a06-4128-afb9-26224e7c19b9" status: 200 len: 661 microversion: 2.1 time: 0.109041 Oct 25 03:25:12.765081 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2399/4633] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:12 2022] GET /compute/v2.1/images/db61f38c-4a06-4128-afb9-26224e7c19b9 => generated 661 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:12.812175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:12.825149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-79b9cba6-abe2-4f82-87f4-9431e03c3eba tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.675648 Oct 25 03:25:12.828080 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2235/4634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:12 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:12.994222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-320562113", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:13.090915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:25:13.557577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:13.558617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:13.568387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:13.570798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:13.573871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:13.575161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:13.577029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:13.581926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:13.713125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:13.729407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:13.731049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:13.732272 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b9deb954-e129-438a-939c-69a5930765bc tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1363 microversion: 2.47 time: 0.180321 Oct 25 03:25:13.733871 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2236/4635] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:13 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:14.139834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Calling method '.version_select at 0x7efd33363940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:14.152148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.152897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.155128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.224511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.225115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.225751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.250639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.251283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.251921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.264070 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3cf9a8e9-0b0d-41b0-a07e-2929f20e0baf tempest-PortsAdminExtendedAttrsTestJSON-103264976 tempest-PortsAdminExtendedAttrsTestJSON-103264976-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.529119 Oct 25 03:25:14.266142 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2237/4636] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:25:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:14.290182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:14.294669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:14.310085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.310881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.313385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.315019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.316782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.318908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.669395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:25:14.670725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:25:14.671446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:25:14.672342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:25:14.673441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:25:14.706447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.707336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.708057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.709043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.710048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.711269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.745888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Getting quotas for project cc878f4bc7d640f58adcb21eba8d0e22. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:25:14.746754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:14.757231 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e797df9-b100-4f5c-aeb6-0330d184504b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.489618 Oct 25 03:25:14.762380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Getting quotas for user 400f4abc0def44968b7abe65bb6a2e2b and project cc878f4bc7d640f58adcb21eba8d0e22. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:25:14.774099 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2238/4637] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:14 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:14.782866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:14.794610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:14.801051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.801546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.802031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.802804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:14.803206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:14.803635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:14.804308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:25:14.810366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:25:14.915117 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93a539f8-8b64-42c5-8792-e0a96f1bb86d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925438 Oct 25 03:25:14.928631 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2400/4638] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:25:15.009895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:15.024356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:15.028470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:15.031725 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d46672eb-1a66-47d6-9d49-d02575992f8f tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 200 len: 1363 microversion: 2.47 time: 0.256186 Oct 25 03:25:15.033215 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2239/4639] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:14 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:15.164041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1984033094", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:15.388118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:25:15.780506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:15.781871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:15.809712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:15.810228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:15.810679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:15.811400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:15.811871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:15.812305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.229450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:16.246735 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2694da99-64be-485b-bf09-18130dfd8048 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.470003 Oct 25 03:25:16.262375 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2240/4640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:15 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:16.262375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:16.262375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 4af4d709-1509-418c-ab50-4d48d18b5629] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:16.263735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.266185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.266628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.268541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.269176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.269812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.302835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:25:16.303361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:25:16.304379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:25:16.305036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:25:16.305733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:25:16.330687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.330945 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] HTTP exception thrown: Instance 4af4d709-1509-418c-ab50-4d48d18b5629 could not be found. Oct 25 03:25:16.331957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Request method failure captured: Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 HTTP/1.1 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1bq0o5cljQyBreYnbu0S9jgdCzmHgDhv3VG0Zq9lg1hCBxgG-NNoRlKZ71tAQMbusgXmHQOuVQPnBClADtzMEc18XFKEAasqnMSK8hi97iCSd04SD7RdS8Q7xTF84KIlql9xPNYFLzPyQRBchgJ8MbPhBYixUy92dXGUVYBL4tCuO8 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.47 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e2aa210fb9034b929f578bd9a6d32cd4 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerShowV247Test-2118573385 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2aa210fb9034b929f578bd9a6d32cd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2aa210fb9034b929f578bd9a6d32cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2aa210fb9034b929f578bd9a6d32cd4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2aa210fb9034b929f578bd9a6d32cd4"}]}] Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerShowV247Test-2118573385 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e2aa210fb9034b929f578bd9a6d32cd4 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerShowV247Test-2118573385 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerShowV247Test-2118573385-project Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ed16105c73ab400b8fda98a5dd731f20 Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerShowV247Test-2118573385-project Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 4af4d709-1509-418c-ab50-4d48d18b5629 could not be found. Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '4af4d709-1509-418c-ab50-4d48d18b5629'} Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af4d709-1509-418c-ab50-4d48d18b5629 could not be found. Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af4d709-1509-418c-ab50-4d48d18b5629 could not be found. Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:25:16.332404 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af4d709-1509-418c-ab50-4d48d18b5629 could not be found. Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:16.340683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Returning 404 to user: Instance 4af4d709-1509-418c-ab50-4d48d18b5629 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:25:16.344944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.346385 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1cd86888-e89a-4c4a-8933-b376fbc13bb3 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629" status: 404 len: 111 microversion: 2.47 time: 0.085189 Oct 25 03:25:16.347120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.347927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.349090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.353742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2241/4641] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:16 2022] GET /compute/v2.1/servers/4af4d709-1509-418c-ab50-4d48d18b5629 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:25:16.377122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:16.377642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:16.388910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.389415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.399917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Getting quotas for project cc878f4bc7d640f58adcb21eba8d0e22. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:25:16.400513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.401622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.402309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.402925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.414213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Getting quotas for user 400f4abc0def44968b7abe65bb6a2e2b and project cc878f4bc7d640f58adcb21eba8d0e22. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:25:16.457564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:25:16.459814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:25:16.471860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:25:16.557698 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-819d85e2-bbeb-453f-b895-87453e7534db tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.399971 Oct 25 03:25:16.558415 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2401/4642] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:25:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:25:16.570970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15280502-9012-476e-bd57-6376a6e0ba2b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:16.572276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-15280502-9012-476e-bd57-6376a6e0ba2b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:16.718634 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c02404ff-e2e7-4c21-a52c-600769e0f24e tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f" status: 204 len: 0 microversion: 2.47 time: 0.363336 Oct 25 03:25:16.723479 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2242/4643] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:25:16 2022] DELETE /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:25:16.738804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:16.741604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:16.753829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.754336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.756231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:16.758375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:16.767237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:16.769829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:17.041346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:17.059913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:17.061380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:17.064350 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9e8f6d2-5b0e-4ec6-b132-5ff670a8bf31 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f" status: 200 len: 1363 microversion: 2.47 time: 0.337050 Oct 25 03:25:17.067387 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2243/4644] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:16 2022] GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:17.278576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:17.279204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:17.290039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:17.294675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:17.295503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:17.296498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:17.296980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:17.297417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:17.356089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-15280502-9012-476e-bd57-6376a6e0ba2b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:17.364405 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-15280502-9012-476e-bd57-6376a6e0ba2b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1218 microversion: 2.1 time: 0.797371 Oct 25 03:25:17.365010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2402/4645] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:16 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1218 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:18.092800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:18.093883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:18.116275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:18.118909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:18.125959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:18.127212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:18.128704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:18.129158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:18.249731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:18.271031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c324e941-f9c3-4ee0-af91-c9042b282ca5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.993409 Oct 25 03:25:18.277988 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2244/4646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:17 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:18.390523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:18.392394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:18.404927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:18.405427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:18.406933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:18.408605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:18.410602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:18.412129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:18.451293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:18.467666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:18.471210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:18.474743 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a645bb4-48d3-4ce7-90c7-48824d2beeb7 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f" status: 200 len: 1363 microversion: 2.47 time: 0.386040 Oct 25 03:25:18.489710 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2403/4647] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:18 2022] GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:18.584645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:18.602151 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-24f6202e-fd9f-4a2b-8988-a64dffb60da7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1270 microversion: 2.1 time: 0.214455 Oct 25 03:25:18.602892 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2245/4648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:18 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:19.307064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:19.307892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:19.327717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:19.333369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:19.333974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:19.334760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:19.335250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:19.335688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:19.503873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:19.505311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:19.530078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:19.531863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:19.532880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:19.536142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:19.536874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:19.539891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:19.745884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:19.757759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:19.763597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed16105c73ab400b8fda98a5dd731f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2aa210fb9034b929f578bd9a6d32cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:19.769549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7fbf6d14-f291-47c8-9b27-b14f87b484e2 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f" status: 200 len: 1363 microversion: 2.47 time: 0.267915 Oct 25 03:25:19.771960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2246/4649] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:19 2022] GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:19.784967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:19.786399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:19.803205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:19.805198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:19.806382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:19.809609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:19.810430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:19.811198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:20.284058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:20.300669 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-10e40c3c-e10f-4b7c-b579-c37b74066b39 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1276 microversion: 2.1 time: 0.526405 Oct 25 03:25:20.301258 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2247/4650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:19 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1276 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:20.555162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:20.571930 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6874fe4e-ac0a-4a99-9a70-45067e1bef01 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1532 microversion: 2.1 time: 1.278173 Oct 25 03:25:20.577053 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2404/4651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:19 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1532 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:20.804357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:20.805517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] [instance: 8d3efe41-c055-4581-a024-ecb537e7981f] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:20.818915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:20.827697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:20.829782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:20.831475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:20.832137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:20.832805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:20.896399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] HTTP exception thrown: Instance 8d3efe41-c055-4581-a024-ecb537e7981f could not be found. Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Request method failure captured: Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f HTTP/1.1 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1bq0o5cljQyBreYnbu0S9jgdCzmHgDhv3VG0Zq9lg1hCBxgG-NNoRlKZ71tAQMbusgXmHQOuVQPnBClADtzMEc18XFKEAasqnMSK8hi97iCSd04SD7RdS8Q7xTF84KIlql9xPNYFLzPyQRBchgJ8MbPhBYixUy92dXGUVYBL4tCuO8 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.47 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e2aa210fb9034b929f578bd9a6d32cd4 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerShowV247Test-2118573385 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2aa210fb9034b929f578bd9a6d32cd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e2aa210fb9034b929f578bd9a6d32cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e2aa210fb9034b929f578bd9a6d32cd4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e2aa210fb9034b929f578bd9a6d32cd4"}]}] Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerShowV247Test-2118573385 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e2aa210fb9034b929f578bd9a6d32cd4 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerShowV247Test-2118573385 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerShowV247Test-2118573385-project Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ed16105c73ab400b8fda98a5dd731f20 Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerShowV247Test-2118573385-project Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 8d3efe41-c055-4581-a024-ecb537e7981f could not be found. Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '8d3efe41-c055-4581-a024-ecb537e7981f'} Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3efe41-c055-4581-a024-ecb537e7981f could not be found. Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3efe41-c055-4581-a024-ecb537e7981f could not be found. Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:25:20.898354 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:20.904138 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:20.904138 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:25:20.904138 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:25:20.904138 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:25:20.904138 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:25:20.904138 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3efe41-c055-4581-a024-ecb537e7981f could not be found. Oct 25 03:25:20.904138 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:25:20.908734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] Returning 404 to user: Instance 8d3efe41-c055-4581-a024-ecb537e7981f could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:25:20.909898 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0c36839-c237-4616-841e-f74344c6a6f9 tempest-ServerShowV247Test-2118573385 tempest-ServerShowV247Test-2118573385-project] 10.222.0.36 "GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f" status: 404 len: 111 microversion: 2.47 time: 0.109377 Oct 25 03:25:20.913860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2248/4652] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:20 2022] GET /compute/v2.1/servers/8d3efe41-c055-4581-a024-ecb537e7981f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:25:20.938253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6c4edde5-facf-4aa4-9ca0-4363bbdbbf53 req-d693f59a-7fbd-4f70-a8a7-3aa35aad95c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96fd4fd-b50c-485c-a521-34fa71082f92", "tag": "36ae65b4-6263-4fdc-911f-5659139037d7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:20.969397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6c4edde5-facf-4aa4-9ca0-4363bbdbbf53 req-d693f59a-7fbd-4f70-a8a7-3aa35aad95c4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:20.969931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6c4edde5-facf-4aa4-9ca0-4363bbdbbf53 req-d693f59a-7fbd-4f70-a8a7-3aa35aad95c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:20.971412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6c4edde5-facf-4aa4-9ca0-4363bbdbbf53 req-d693f59a-7fbd-4f70-a8a7-3aa35aad95c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:21.012012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6c4edde5-facf-4aa4-9ca0-4363bbdbbf53 req-d693f59a-7fbd-4f70-a8a7-3aa35aad95c4 service nova] Creating event network-changed:36ae65b4-6263-4fdc-911f-5659139037d7 for instance c96fd4fd-b50c-485c-a521-34fa71082f92 on n-h1-862355-1 Oct 25 03:25:21.027624 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6c4edde5-facf-4aa4-9ca0-4363bbdbbf53 req-d693f59a-7fbd-4f70-a8a7-3aa35aad95c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094888 Oct 25 03:25:21.031653 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2405/4653] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:21.325818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:21.326839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:21.339366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:21.342952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:21.344132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:21.346532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:21.348211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:21.348737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:21.584786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:21.599060 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb5fe6c2-2ff8-4a4c-b112-2d31c37ef537 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1276 microversion: 2.1 time: 0.277245 Oct 25 03:25:21.600957 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2249/4654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:21 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:21.605859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:21.607261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:21.649023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:21.650089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:21.655209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:21.661432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:21.666207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:21.667025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:22.625865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:22.626684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:22.647426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:22.650401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:22.650989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:22.654208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:22.656940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:22.658301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:23.048230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:23.062303 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-453ee309-6c89-4c43-ae13-6c95435042e6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1276 microversion: 2.1 time: 0.441577 Oct 25 03:25:23.068764 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2250/4655] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:22 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1276 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:23.493096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:23.514251 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00e95485-de37-42d2-a7c6-d8ecf65ab907 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 1.901562 Oct 25 03:25:23.517177 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2406/4656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:21 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:24.098584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:24.099843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:24.112704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:24.115024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:24.122107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:24.123076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:24.123573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:24.124034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:24.332680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:24.341070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:24.375589 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-814bd144-fef6-4231-be09-b2700d99f507 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1276 microversion: 2.1 time: 0.284449 Oct 25 03:25:24.395549 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2251/4657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:24 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:24.556363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:24.557511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:24.595298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:24.598335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:24.599033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:24.606867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:24.607654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:24.610430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:24.980104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-5857ce52-6e18-4ec2-b85d-72a33f2db123 req-0f342d5e-d82b-41eb-8920-cc6833a46652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ad2d83-3644-4094-9f43-2cfcb61f180c", "name": "network-vif-plugged", "status": "completed", "tag": "7c40a79e-7be9-44c4-a654-5bda23bdf574"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:25.021584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5857ce52-6e18-4ec2-b85d-72a33f2db123 req-0f342d5e-d82b-41eb-8920-cc6833a46652 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:25.027649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5857ce52-6e18-4ec2-b85d-72a33f2db123 req-0f342d5e-d82b-41eb-8920-cc6833a46652 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:25.028219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5857ce52-6e18-4ec2-b85d-72a33f2db123 req-0f342d5e-d82b-41eb-8920-cc6833a46652 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:25.129459 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-5857ce52-6e18-4ec2-b85d-72a33f2db123 req-0f342d5e-d82b-41eb-8920-cc6833a46652 service nova] Creating event network-vif-plugged:7c40a79e-7be9-44c4-a654-5bda23bdf574 for instance 01ad2d83-3644-4094-9f43-2cfcb61f180c on n-h1-862355-1 Oct 25 03:25:25.150816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-5857ce52-6e18-4ec2-b85d-72a33f2db123 req-0f342d5e-d82b-41eb-8920-cc6833a46652 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179475 Oct 25 03:25:25.151482 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2252/4658] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 25 03:25:25.422234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:25.422960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:25.441280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:25.450829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:25.451926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:25.452704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:25.460863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:25.465636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:25.623893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:25.722181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7334b8e6-f214-4a89-b4a6-6c0bfb31b8ff tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 1.179074 Oct 25 03:25:25.725393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:25.737012 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2407/4659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:24 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:25.749308 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2cf6d852-419e-4ace-aeba-5b95911b2b25 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1276 microversion: 2.1 time: 0.320329 Oct 25 03:25:25.765709 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2253/4660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:25 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1276 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:26.455448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:26.701491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1553548837", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": "none"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:26.770120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:26.771976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:26.790666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:26.793722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:26.794368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:26.795231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:26.795813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:26.796387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:26.846268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:25:26.847547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:25:26.849464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:25:26.851055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:25:26.851870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:25:26.867557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:26.869447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:26.870133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:26.873344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:26.874198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:26.874942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:26.909897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Getting quotas for project 0231a312712247afb9f8a61448083400. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:25:26.918618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Getting quotas for user 9a67f6fd2ae0477fa3a6b97833da1857 and project 0231a312712247afb9f8a61448083400. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:25:26.941475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:25:26.945032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:25:26.975478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:27.026618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2c11c5c-8f83-4760-a990-a85f9c975a50 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.254716 Oct 25 03:25:27.042526 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2254/4661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:26 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:27.054398 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9db36fa9-1bf0-42bc-9bde-33c8016256b4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.603536 Oct 25 03:25:27.055392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2408/4662] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:25:27.068574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:27.069188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d48713c8-17fc-4e38-8512-aef7dbd9034a tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:27.069897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d48713c8-17fc-4e38-8512-aef7dbd9034a tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:27.070790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:27.121791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:27.132890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:27.136421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:27.141871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:27.142648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:27.144096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:27.497484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:27.507178 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82623586-b975-459a-b3a9-02bc279d2794 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.462950 Oct 25 03:25:27.508505 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2255/4663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:27 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:27.570914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d48713c8-17fc-4e38-8512-aef7dbd9034a tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:27.580132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d48713c8-17fc-4e38-8512-aef7dbd9034a tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:27.591190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d48713c8-17fc-4e38-8512-aef7dbd9034a tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:27.592457 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d48713c8-17fc-4e38-8512-aef7dbd9034a tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1278 microversion: 2.57 time: 0.527872 Oct 25 03:25:27.593371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2409/4664] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:27 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1278 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:28.096287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:28.111109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:28.121996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:28.136534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:28.138535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:28.140804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:28.144467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:28.145329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:28.146105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:28.537523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:28.538333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:28.553215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:28.564527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:28.569094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:28.572957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:28.576178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:28.576964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:28.808859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:28.830349 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e12cbed-1307-4f77-beaf-a8a0f1de1660 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.770664 Oct 25 03:25:28.832711 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2256/4665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:28 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:28.879116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:28.881217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:28.913571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:28.914441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:28.916190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:28.918059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:28.918757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:28.919594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:29.102114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:29.114501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:29.115960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:29.131036 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f6826354-cbc2-40e4-8edc-00948b3eb1d4 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1330 microversion: 2.57 time: 0.294568 Oct 25 03:25:29.137207 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2257/4666] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:28 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1330 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:29.143673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-bc8c03d6-cccc-4dcd-8295-9e946bc3eb0c req-841bc617-baf4-42eb-a4ca-abd1d0b31dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96fd4fd-b50c-485c-a521-34fa71082f92", "name": "network-vif-plugged", "status": "completed", "tag": "36ae65b4-6263-4fdc-911f-5659139037d7"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:29.180155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bc8c03d6-cccc-4dcd-8295-9e946bc3eb0c req-841bc617-baf4-42eb-a4ca-abd1d0b31dd4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:29.181609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bc8c03d6-cccc-4dcd-8295-9e946bc3eb0c req-841bc617-baf4-42eb-a4ca-abd1d0b31dd4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:29.186122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bc8c03d6-cccc-4dcd-8295-9e946bc3eb0c req-841bc617-baf4-42eb-a4ca-abd1d0b31dd4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:29.212973 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-bc8c03d6-cccc-4dcd-8295-9e946bc3eb0c req-841bc617-baf4-42eb-a4ca-abd1d0b31dd4 service nova] Creating event network-vif-plugged:36ae65b4-6263-4fdc-911f-5659139037d7 for instance c96fd4fd-b50c-485c-a521-34fa71082f92 on n-h1-862355-1 Oct 25 03:25:29.220746 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-bc8c03d6-cccc-4dcd-8295-9e946bc3eb0c req-841bc617-baf4-42eb-a4ca-abd1d0b31dd4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079854 Oct 25 03:25:29.222362 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2258/4667] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:29.855936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:29.856851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:29.871408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:29.872107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:29.872675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:29.873627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:29.878755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:29.879857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:29.978991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:29.995079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8388b311-2a6b-4802-a1e4-38c8cc5d66f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 1.461751 Oct 25 03:25:29.996205 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2410/4668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:28 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:30.166315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:30.167397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:30.186114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:30.187689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:30.188421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:30.189449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:30.190204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:30.193912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:30.225056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:30.270474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-187c5ebf-3b1a-4cdb-bf5f-97737ecddd6a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.419479 Oct 25 03:25:30.271515 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2259/4669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:29 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:30.372379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:30.383327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:30.386988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:30.388562 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cd27948-5874-4274-bb7d-ca495e50a7fd tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1336 microversion: 2.57 time: 0.228180 Oct 25 03:25:30.403866 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2411/4670] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:30 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1336 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:31.029598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:31.030829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:31.043922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:31.049243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:31.050257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:31.053269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:31.053941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:31.054853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:31.177003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1429739194", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "7b4c0aa8-f1e1-4d38-9caf-81f88df10ecb"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:31.310432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] validate_networks() for [('7b4c0aa8-f1e1-4d38-9caf-81f88df10ecb', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:25:31.311779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:31.323227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c3c1c25f-5652-4ccd-aa7a-a8bd7b52b814 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.298598 Oct 25 03:25:31.324055 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2260/4671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:31 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:31.330645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:31.331573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:31.346662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:31.347453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:31.348067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:31.348946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:31.349567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:31.350202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:31.696729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:31.709207 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43623a69-4ebf-45a9-bb86-3204d667a334 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.383500 Oct 25 03:25:31.710935 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2261/4672] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:31 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:31.725742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:31.731564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:31.761567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:31.762174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:31.764877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:31.765775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:31.768614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:31.770017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:31.916588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:31.930433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:31.932767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:31.948695 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f755af50-5f4d-45af-b504-793e1a11c3e6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1336 microversion: 2.57 time: 0.229666 Oct 25 03:25:31.949607 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2262/4673] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:31 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1336 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:32.349305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:32.350235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:32.363890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:32.364597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:32.365221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:32.366411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:32.369286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:32.369994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:32.638487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:32.646902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-014fa8c7-3535-4abd-ba51-9fc493fdf601 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.302878 Oct 25 03:25:32.649771 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2263/4674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:32 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:32.735218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:32.736650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:32.747861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:32.751328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:32.753093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:32.757500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:32.762513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:32.764067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.202978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:25:33.203433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:25:33.203864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:25:33.204274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:25:33.204686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:25:33.228053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.230418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.242554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.244247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.247281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.251959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.291631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Getting quotas for project 8371bf273fe04e57950c2b1b6b06635e. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:25:33.319010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Getting quotas for user 9798047eedd6447a9590ff3235cb1974 and project 8371bf273fe04e57950c2b1b6b06635e. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:25:33.325761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:33.373265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:25:33.374992 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19825caf-6533-402e-beb3-62b61b151273 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.644037 Oct 25 03:25:33.377355 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2264/4675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:32 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:33.382028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:25:33.391828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-abc1d6b4-4d77-4bab-abbe-84068ee2d166 req-b2026464-0655-4cdf-bc01-789e5c04d1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade7b0be-f3d6-4149-91ab-bdac6f1f5547", "tag": "d1f2cbba-3217-49fb-8f52-abbcfedb4c1e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:33.429858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:33.440667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-abc1d6b4-4d77-4bab-abbe-84068ee2d166 req-b2026464-0655-4cdf-bc01-789e5c04d1b0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.442019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-abc1d6b4-4d77-4bab-abbe-84068ee2d166 req-b2026464-0655-4cdf-bc01-789e5c04d1b0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.443037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-abc1d6b4-4d77-4bab-abbe-84068ee2d166 req-b2026464-0655-4cdf-bc01-789e5c04d1b0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.493873 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-abc1d6b4-4d77-4bab-abbe-84068ee2d166 req-b2026464-0655-4cdf-bc01-789e5c04d1b0 service nova] Creating event network-changed:d1f2cbba-3217-49fb-8f52-abbcfedb4c1e for instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 on n-h2-862355-1 Oct 25 03:25:33.508515 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-abc1d6b4-4d77-4bab-abbe-84068ee2d166 req-b2026464-0655-4cdf-bc01-789e5c04d1b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126166 Oct 25 03:25:33.511329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2265/4676] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:33.534161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:33.538372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:33.564090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.566891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.569211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.576439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.578014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.579232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.588232 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-42812564-c5de-46dd-a0b2-76c5ef46f21d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.502013 Oct 25 03:25:33.595636 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2412/4677] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:25:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:25:33.638821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a475f66-a2c4-41f5-887f-f19f38327ffa tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:33.651859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4a475f66-a2c4-41f5-887f-f19f38327ffa tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:33.811596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4a475f66-a2c4-41f5-887f-f19f38327ffa tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:33.822256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a475f66-a2c4-41f5-887f-f19f38327ffa tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1218 microversion: 2.1 time: 0.219014 Oct 25 03:25:33.823370 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2413/4678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:33 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:33.832194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:33.838983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:33.848171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.853236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.854006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.855006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.856109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.856775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.884592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:33.896459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:33.897294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:33.911251 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7adcc423-4ffe-4477-bab4-3e7ee5e7b309 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1357 microversion: 2.57 time: 0.394322 Oct 25 03:25:33.911953 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2266/4679] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:33 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1357 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:33.957643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:33.960964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:33.982410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.987430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:33.988034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:33.988833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:33.989310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:34.000227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:34.187371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:25:34.188149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:25:34.188857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:25:34.190109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:25:34.190715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:25:34.388516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:34.426016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:34.428395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:34.429039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:34.429994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:34.432325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:34.433787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:34.548057 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-949601f2-5a3d-4643-9ba7-593868a94d57 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "POST /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69/action" status: 202 len: 1138 microversion: 2.57 time: 0.606631 Oct 25 03:25:34.550670 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2267/4680] 10.222.0.36 () {62 vars in 1320 bytes} [Tue Oct 25 03:25:33 2022] POST /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69/action => generated 1138 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 25 03:25:34.578892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:34.582972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:34.621275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:34.622464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:34.623887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:34.625471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:34.626571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:34.627301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:34.684245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:34.738086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:34.751489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cdb6b805-34de-4f56-b930-aa8f570a6ced tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.926827 Oct 25 03:25:34.754926 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2414/4681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:33 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:34.781048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:34.796166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:34.820806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:34.821641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:34.822221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:34.829718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:34.830466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:34.831022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:34.859138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:35.085581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:35.096469 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-67f5d831-1b50-41f8-890c-fccdccbb73f7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.542917 Oct 25 03:25:35.103448 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2268/4682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:34 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:35.110496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:35.113738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:35.128051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:35.131281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:35.131826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:35.132752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:35.133561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:35.139186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:35.233964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:35.254504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:35.262641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:35.264923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:35.270649 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b385538-0595-47f9-ba16-4f49e8bf18b7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1222 microversion: 2.1 time: 0.165541 Oct 25 03:25:35.271482 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2269/4683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:35 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1222 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:35.273794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc36b58c-14bb-4177-9069-eada829f3550 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.504465 Oct 25 03:25:35.279276 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2415/4684] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:34 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:35.788587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:35.791786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:35.800425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:35.800920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:35.801356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:35.805555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:35.806303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:35.812254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:36.134700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:36.135413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:36.162346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:36.163818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:36.164719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:36.166733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:36.167699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:36.168362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:36.454120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:36.467598 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c974277f-755f-43ba-89df-88a989892906 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.678751 Oct 25 03:25:36.468826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2270/4685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:35 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:36.482491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:36.483454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:36.502205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:36.505914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:36.507346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:36.510201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:36.511736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:36.514422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:37.154861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:37.163780 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d88ebd6-a98b-43ca-b322-1cc12c24635a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1276 microversion: 2.1 time: 0.693021 Oct 25 03:25:37.165945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:37.174458 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2271/4686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:36 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1276 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:37.194178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:37.195304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:37.196662 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-39706e07-6a4d-464e-b7fc-963d6653c3d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 1.067390 Oct 25 03:25:37.208307 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2416/4687] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:36 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:37.220388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:37.221017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:37.226134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:37.229021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:37.229850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:37.230526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:37.411008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:37.423772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:37.429555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:37.431748 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5441b4b0-ee5d-4e70-abf8-1240922df032 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.255315 Oct 25 03:25:37.432565 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2272/4688] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:37 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:37.495273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:37.505519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:37.519252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:37.520021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:37.521429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:37.522384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:37.523017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:37.523611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:37.996603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:38.009440 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c11c8c4b-37eb-43b6-9eb2-92ec1edca759 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.518376 Oct 25 03:25:38.032708 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2417/4689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:37 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:38.210255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:38.214368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:38.233080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:38.233722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:38.243964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:38.245448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:38.247487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:38.247953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:38.248679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:38.249139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:38.251837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:38.254454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:38.255188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:38.256262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:38.262542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:38.264411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:38.578917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:38.587546 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-368aad15-113b-4a24-b60c-ecdff4ff4296 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.358076 Oct 25 03:25:38.598626 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2418/4690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:38 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:38.609560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:38.618763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:38.644084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:38.644560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:38.645005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:38.645743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:38.646496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:38.647171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:38.793232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:38.809936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:38.815479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:38.816936 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8194b2a9-2453-4313-a6c2-e0123eaec998 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.216738 Oct 25 03:25:38.820000 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2419/4691] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:38 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:39.037004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:39.037736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:39.049168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:39.057370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:39.061081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:39.063842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:39.067563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:39.068226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:39.247342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:39.261505 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01bc14cb-e829-4740-9b83-615c266b8e9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1276 microversion: 2.1 time: 1.062264 Oct 25 03:25:39.268740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2273/4692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:38 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1276 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:39.388839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:39.408260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a96089b-36e4-4315-b8ef-36498eb43d7e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.374879 Oct 25 03:25:39.410507 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2420/4693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:39 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:39.625307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:39.626367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:39.641912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:39.642444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:39.642890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:39.643609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:39.644066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:39.644494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:39.854915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:39.879152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:39.912856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:39.916992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:39.921101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:39.925830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:39.927101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:39.928399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:40.064788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:40.072852 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9a2da834-f454-45df-819a-af3b1f742460 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.451861 Oct 25 03:25:40.091663 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2274/4694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:39 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:40.296042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:40.296716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:40.313439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:40.314067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:40.314405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:40.315103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:40.315568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:40.316027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:40.324362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:40.340999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:40.342485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:40.343714 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-724c4685-53d7-432f-bdac-f2db9e7fac2f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.499562 Oct 25 03:25:40.363410 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2421/4695] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:39 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:40.438562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:40.439219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:40.448690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:40.449194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:40.449639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:40.450388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:40.450848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:40.451280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:41.094348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:41.113958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a6715d5-2c9d-4227-bae6-c3e08a238e55 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.686065 Oct 25 03:25:41.118855 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2422/4696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:40 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:41.129452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:41.155722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:41.156433 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2797c92-46dd-4de5-af0a-e50417a18f62 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1318 microversion: 2.1 time: 0.862978 Oct 25 03:25:41.157923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:41.158895 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2275/4697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:40 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:41.176304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:41.177123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:41.177818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:41.178751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:41.179413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:41.180105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:41.375100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:41.376435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:41.404609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:41.406169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:41.406906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:41.407936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:41.408648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:41.412050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:41.571619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:41.585328 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88ff0395-3413-4e96-bbf2-bf81f4b54fe8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.464187 Oct 25 03:25:41.608065 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2423/4698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:41 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:41.680807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ecccd2f2-072c-4bae-838d-3b9663a9dedf req-df35398d-fb11-453f-927c-cb4ada7963a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade7b0be-f3d6-4149-91ab-bdac6f1f5547", "name": "network-vif-plugged", "status": "completed", "tag": "d1f2cbba-3217-49fb-8f52-abbcfedb4c1e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:41.698826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ecccd2f2-072c-4bae-838d-3b9663a9dedf req-df35398d-fb11-453f-927c-cb4ada7963a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:41.700162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ecccd2f2-072c-4bae-838d-3b9663a9dedf req-df35398d-fb11-453f-927c-cb4ada7963a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:41.700992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ecccd2f2-072c-4bae-838d-3b9663a9dedf req-df35398d-fb11-453f-927c-cb4ada7963a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:41.719534 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ecccd2f2-072c-4bae-838d-3b9663a9dedf req-df35398d-fb11-453f-927c-cb4ada7963a7 service nova] Creating event network-vif-plugged:d1f2cbba-3217-49fb-8f52-abbcfedb4c1e for instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 on n-h2-862355-1 Oct 25 03:25:41.727910 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ecccd2f2-072c-4bae-838d-3b9663a9dedf req-df35398d-fb11-453f-927c-cb4ada7963a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053652 Oct 25 03:25:41.730374 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2424/4699] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:41.784276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:41.810370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:41.819537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:41.825798 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-299f764f-86d4-41c0-a488-e1cbc90fd32c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.459373 Oct 25 03:25:41.851234 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2276/4700] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:41 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:42.156706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:42.159594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:42.183346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:42.183970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:42.189380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.192812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.193609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.193966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.194148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.194596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.195162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.195302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.195779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.196963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.197491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.198272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.508169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:42.521305 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8b456d6d-6c7f-4374-856f-4a3d3cd0e9f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.374140 Oct 25 03:25:42.522730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2425/4701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:42 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:42.628140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:42.629997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:42.644804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.646802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.652532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.655890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.656726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.658835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.801153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:42.870656 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ea8f6e0-8410-4df8-a08c-30ffec487346 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1318 microversion: 2.1 time: 0.691840 Oct 25 03:25:42.886812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2277/4702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:42 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:42.905644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:42.906762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:42.928593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.929125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.929651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.930197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:42.931268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:42.931894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:42.987061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:43.015117 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00c92b9a-3a25-40b1-89d2-a4b2006ce998 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.404877 Oct 25 03:25:43.032523 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2426/4703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:42 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:43.117119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:43.129588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:43.141052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:43.142988 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a92b3bbc-57a2-40f6-9b19-369b591e9738 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.255165 Oct 25 03:25:43.144252 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2278/4704] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:42 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:43.287364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-de7f26dd-9bb9-43b5-b2c5-5719ccaa4ac6 req-9ffecc7d-0fff-471e-a429-c7a5da96d583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0313aa2b-c237-41f0-b6fe-5eee8c62e168", "tag": "e72d65ea-e118-40e5-a25a-c90efdea23d3"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:43.297160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:43.308785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-de7f26dd-9bb9-43b5-b2c5-5719ccaa4ac6 req-9ffecc7d-0fff-471e-a429-c7a5da96d583 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:43.309281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-de7f26dd-9bb9-43b5-b2c5-5719ccaa4ac6 req-9ffecc7d-0fff-471e-a429-c7a5da96d583 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:43.314527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-de7f26dd-9bb9-43b5-b2c5-5719ccaa4ac6 req-9ffecc7d-0fff-471e-a429-c7a5da96d583 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:43.330385 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-de7f26dd-9bb9-43b5-b2c5-5719ccaa4ac6 req-9ffecc7d-0fff-471e-a429-c7a5da96d583 service nova] Creating event network-changed:e72d65ea-e118-40e5-a25a-c90efdea23d3 for instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 on n-h1-862355-1 Oct 25 03:25:43.336263 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-de7f26dd-9bb9-43b5-b2c5-5719ccaa4ac6 req-9ffecc7d-0fff-471e-a429-c7a5da96d583 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052817 Oct 25 03:25:43.340992 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2427/4705] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:43.550519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:43.551162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:43.570243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:43.570760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:43.571445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:43.572133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:43.572604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:43.573039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:43.911801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=32 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:43.920254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:43.922239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:43.932648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:43.933712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:43.934377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:43.936005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:43.936916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:43.937534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:43.945025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:43.963332 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5604d39-753a-4403-8b0a-0061ea538236 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1318 microversion: 2.1 time: 0.412833 Oct 25 03:25:43.964004 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2279/4706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:43 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:44.043659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:44.044361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:44.056718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:44.059742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:44.060974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:44.061826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:44.062405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:44.062910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:44.280818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:44.297188 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fbb93acf-fca2-40b0-855e-86095fb9d7ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1318 microversion: 2.1 time: 0.383698 Oct 25 03:25:44.309998 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2428/4707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:43 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:44.318361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:44.330965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:44.333955 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe7c87f5-89ae-4278-a9d8-b3969e7edf77 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.292065 Oct 25 03:25:44.334574 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2280/4708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:44 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:44.339820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:44.359800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:44.360582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:44.361158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:44.362062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:44.364975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:44.365694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:44.478306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:44.530476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:44.532570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:44.534589 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb0821aa-b746-4b4f-8946-06cc3cc0b7d0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.231714 Oct 25 03:25:44.557649 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2429/4709] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:44 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:44.999679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:45.000274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:45.013338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.013853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.014295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.014995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.015441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.015934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.297454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:45.306846 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f9623b22-23d0-4c34-879c-0ba83ea5d7f9 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1468 microversion: 2.1 time: 0.316145 Oct 25 03:25:45.310430 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2281/4710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:44 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1468 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:45.337546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:45.339134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:45.343866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:45.344574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:45.346437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.347213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.347717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.348678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.349397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.350089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.360786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.361302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.361779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.362520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.362979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.363407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.575627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:45.584579 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44ed599c-02d3-4a38-b791-ec67e9680224 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1318 microversion: 2.1 time: 0.256723 Oct 25 03:25:45.586314 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2430/4711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:45 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:45.605843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:45.606391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:45.617366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.617938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.618624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.619176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.619711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.620134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.780636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:45.793693 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66475c6c-0088-4692-a1c0-97c560e517f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 1466 microversion: 2.1 time: 0.459224 Oct 25 03:25:45.797171 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2282/4712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:45 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 1466 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:45.819732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:45.826475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:45.849817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.852079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.853121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:45.857359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:45.857721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:45.858289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:46.042398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:46.051371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:46.056200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:46.058743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:46.061518 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce012ae4-84de-423c-b777-a21f96468aa0 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.262011 Oct 25 03:25:46.062357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2283/4713] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:45 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:46.069863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-110595602"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:46.072584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:46.079289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:46.080496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:46.080496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:46.081441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:46.082109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:46.082701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:46.111915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b54ef13-5fae-4843-aedc-70d8d0aab3b7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.519854 Oct 25 03:25:46.114368 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2431/4714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:45 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:46.469137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:46.589666 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c5ef0d2-8105-42eb-853f-0f458ef56360 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "POST /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92/action" status: 202 len: 0 microversion: 2.1 time: 0.522561 Oct 25 03:25:46.603761 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2284/4715] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:25:46 2022] POST /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:25:46.615922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:46.616632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:46.624290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0116b5e1-0d93-4a40-9ba5-ffd6c7b014af tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b72a790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:46.639388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:46.640012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:46.641528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:46.645973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:46.646669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:46.647315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:46.742856 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0116b5e1-0d93-4a40-9ba5-ffd6c7b014af tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.131703 Oct 25 03:25:46.746453 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2285/4716] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:46 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:46.969440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:46.980749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d47356eb-8624-4b0f-899a-d0641297821a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1318 microversion: 2.1 time: 0.368809 Oct 25 03:25:46.998046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2432/4717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:46 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:47.092053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:47.092797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:47.103843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:47.104604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:47.105242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:47.106927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:47.107654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:47.108548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:47.142918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:47.143762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:47.166329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:47.166896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:47.170692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:47.176403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:47.178711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:47.183832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:47.190923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:47.200541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:47.215424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:47.219005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:47.221001 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb03e0c1-4130-4ce2-acb6-22c7b9da2bb1 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.133275 Oct 25 03:25:47.222334 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2286/4718] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:47 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:47.474489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:47.499983 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0435ceec-1c6c-482b-bfbc-01b15273a0bc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1527 microversion: 2.1 time: 0.361811 Oct 25 03:25:47.501158 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2433/4719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:47 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1527 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:47.761217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a93592c4-982c-41c5-ac0f-cf53d1ecc422 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b72aca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:47.827520 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a93592c4-982c-41c5-ac0f-cf53d1ecc422 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.070289 Oct 25 03:25:47.829825 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2287/4720] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:47 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:48.007476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:48.008102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:48.027690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:48.028258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:48.028749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:48.029955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:48.030626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:48.031098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:48.229506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:48.241093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20eb71aa-79ba-4245-85f6-bb16b361b4bb tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1318 microversion: 2.1 time: 0.237176 Oct 25 03:25:48.243197 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2434/4721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:48 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:48.268120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:48.268786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:48.276478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:48.276982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:48.277416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:48.278149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:48.278602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:48.279027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:48.412313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:48.433028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:48.435487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:48.436724 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f4a9a2a1-c006-427f-acde-2798c151ec51 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.172593 Oct 25 03:25:48.437326 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2288/4722] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:48 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:48.520445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4e02c940-bb3a-4a8b-a5c0-8feeac907827 req-d624baae-a568-4e4b-8db2-9f2efac70407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0313aa2b-c237-41f0-b6fe-5eee8c62e168", "name": "network-vif-plugged", "status": "completed", "tag": "e72d65ea-e118-40e5-a25a-c90efdea23d3"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:48.529755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:48.530686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:48.547760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:48.548773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4e02c940-bb3a-4a8b-a5c0-8feeac907827 req-d624baae-a568-4e4b-8db2-9f2efac70407 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:48.549696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4e02c940-bb3a-4a8b-a5c0-8feeac907827 req-d624baae-a568-4e4b-8db2-9f2efac70407 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:48.550303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:48.550971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:48.551697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:48.551878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4e02c940-bb3a-4a8b-a5c0-8feeac907827 req-d624baae-a568-4e4b-8db2-9f2efac70407 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:48.553357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:48.556393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:48.591945 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4e02c940-bb3a-4a8b-a5c0-8feeac907827 req-d624baae-a568-4e4b-8db2-9f2efac70407 service nova] Creating event network-vif-plugged:e72d65ea-e118-40e5-a25a-c90efdea23d3 for instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 on n-h1-862355-1 Oct 25 03:25:48.598437 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4e02c940-bb3a-4a8b-a5c0-8feeac907827 req-d624baae-a568-4e4b-8db2-9f2efac70407 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083484 Oct 25 03:25:48.599358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2435/4723] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:25:48.847166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9eb4a687-8af1-49e2-8b51-dbbdb01c3a34 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32b6cd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:48.944543 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9eb4a687-8af1-49e2-8b51-dbbdb01c3a34 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.099134 Oct 25 03:25:48.946985 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2436/4724] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:48 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:49.057318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:49.065869 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9acfec19-c9a7-49e8-b960-ccb575f720f9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1509 microversion: 2.1 time: 0.541385 Oct 25 03:25:49.071606 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2289/4725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:48 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1509 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:49.266177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:49.267673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:49.282207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:49.284525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:49.284997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:49.286008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:49.289122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:49.289660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:49.468422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:49.469716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:49.481868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:49.482954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:49.484574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:49.485519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:49.488536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:49.489222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:49.533250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:49.545631 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0fea6e9-98c5-4f4e-94ac-f05aacb5c358 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1318 microversion: 2.1 time: 0.284572 Oct 25 03:25:49.546316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2437/4726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:49 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:49.599072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:49.615212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:49.618912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:49.622707 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-baf179a1-2463-46ae-9b01-cb0b9e4a5a9e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.159516 Oct 25 03:25:49.624534 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2290/4727] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:49 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:49.962708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d20f7e33-24de-48ef-aba1-9344eabd4298 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33624d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:50.071713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d20f7e33-24de-48ef-aba1-9344eabd4298 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.113032 Oct 25 03:25:50.072781 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2438/4728] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:49 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:50.099400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:50.100042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:50.107335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:50.108282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:50.108748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:50.110043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:50.110835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:50.111530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:50.580913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:50.581760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:50.608321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:50.620079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:50.620823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:50.628284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:50.642391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:50.643115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:50.787668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:50.799956 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-169bdb07-2f54-48cf-9c0e-4047b0ea454b tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1509 microversion: 2.1 time: 0.707446 Oct 25 03:25:50.804183 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2291/4729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:50 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1509 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:50.824516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:50.825558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:50.843583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:50.849103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:50.849865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:50.850850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:50.851471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:50.855044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:50.979321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:51.005080 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0300c8c5-700c-428b-9fd3-bbedf70633e2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1508 microversion: 2.1 time: 0.424704 Oct 25 03:25:51.006036 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2439/4730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:50 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:51.032112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:51.033007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:51.051246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.052407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.053284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.054670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.055751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.056635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.063549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:51.082501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:51.084350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:51.088037 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dbc82a52-29ed-4f17-bc70-7913d3a9e91e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.282074 Oct 25 03:25:51.112809 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2292/4731] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:50 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:51.118000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9bf54c6c-d139-4c13-938b-89d506a7f0b2 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b72a670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:51.212084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9bf54c6c-d139-4c13-938b-89d506a7f0b2 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.097468 Oct 25 03:25:51.213289 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2293/4732] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:51 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:51.291903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:51.306628 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9625a8d3-816a-4170-95f6-20e48d343a9c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1508 microversion: 2.1 time: 0.282198 Oct 25 03:25:51.308329 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2440/4733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:51 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:51.337759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:51.340590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:51.351352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.351850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.352859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.353563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.365197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.365721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.499064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:25:51.502462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:25:51.503121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:25:51.503660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:25:51.504082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:25:51.592417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:51.599996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.600771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.601452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.602461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.603299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.603989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.644118 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbd15f39-f6a0-4dd9-ad53-dc066353e8d4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "POST /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168/action" status: 202 len: 1110 microversion: 2.1 time: 0.310990 Oct 25 03:25:51.645252 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2294/4734] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:25:51 2022] POST /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168/action => generated 1110 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 25 03:25:51.667930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:51.669187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:51.689329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.690151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.691185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.692095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.692720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.693350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.825517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:51.826119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:51.847653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.848159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.848822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.849769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:51.850578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:51.851166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:51.995580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:52.015938 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67b99993-7f96-4c67-acb2-9b4f49f8663c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.351556 Oct 25 03:25:52.017853 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2441/4735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:51 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:52.125727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:52.127062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:52.148198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:52.151224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:52.152397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:52.155063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:52.159062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:52.160183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:52.215381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:52.228222 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6d32eec6-dfc9-4309-a35f-aa7ffde433ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1509 microversion: 2.1 time: 0.407212 Oct 25 03:25:52.230483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2295/4736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:51 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:25:52.235916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fad60481-ae46-422a-b305-21bec20eb825 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd333b1e50>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:52.319860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fad60481-ae46-422a-b305-21bec20eb825 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.088073 Oct 25 03:25:52.320964 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2296/4737] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:52 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:52.558757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:52.573272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:52.576654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:52.578719 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff31f59c-6da8-4794-8beb-bd46f5307614 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.461814 Oct 25 03:25:52.596882 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2442/4738] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:52 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:53.042616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:53.044485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:53.061341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:53.076980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:53.077445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:53.079443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:53.079915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:53.080357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:53.257220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:53.259215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:53.278261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:53.278766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:53.279212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:53.279927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:53.280387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:53.280824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:53.552421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:53.574612 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b7a95f39-a94d-4f95-82fe-3f656a3aead0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.527364 Oct 25 03:25:53.576338 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2297/4739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:53 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:53.584414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4da05c2e-d201-49c4-9c4d-37633c7f7846 req-4e995024-80e4-4a17-b504-c422f5421923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96fd4fd-b50c-485c-a521-34fa71082f92", "name": "network-vif-plugged", "status": "completed", "tag": "36ae65b4-6263-4fdc-911f-5659139037d7"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:53.634701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4da05c2e-d201-49c4-9c4d-37633c7f7846 req-4e995024-80e4-4a17-b504-c422f5421923 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:53.635794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4da05c2e-d201-49c4-9c4d-37633c7f7846 req-4e995024-80e4-4a17-b504-c422f5421923 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:53.638313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4da05c2e-d201-49c4-9c4d-37633c7f7846 req-4e995024-80e4-4a17-b504-c422f5421923 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:53.659969 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4da05c2e-d201-49c4-9c4d-37633c7f7846 req-4e995024-80e4-4a17-b504-c422f5421923 service nova] Creating event network-vif-plugged:36ae65b4-6263-4fdc-911f-5659139037d7 for instance c96fd4fd-b50c-485c-a521-34fa71082f92 on n-h1-862355-1 Oct 25 03:25:53.680718 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4da05c2e-d201-49c4-9c4d-37633c7f7846 req-4e995024-80e4-4a17-b504-c422f5421923 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102359 Oct 25 03:25:53.682472 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2298/4740] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:25:53.688553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-499b640c-9e91-4910-9d88-ebabf7b4ff10 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd328f5b80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:53.765468 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-499b640c-9e91-4910-9d88-ebabf7b4ff10 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.081492 Oct 25 03:25:53.769221 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2299/4741] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:53 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:53.778011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:53.782962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:53.792748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:53.793610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:53.794444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:53.795420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:53.796132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:53.796813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:53.926754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:53.943018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:53.945045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:53.952668 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d2a059f4-1e05-4e91-a7ac-e6c46b5abd45 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.177357 Oct 25 03:25:53.954051 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2300/4742] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:53 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:54.364643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:54.377463 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b9aba643-99e4-4c05-b0ff-6d66ffb95700 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1509 microversion: 2.1 time: 1.122515 Oct 25 03:25:54.393700 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2443/4743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:53 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1509 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:54.607062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:54.608339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:54.623535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:54.624774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:54.629851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:54.631130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:54.631130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:54.631601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:54.784235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77201da2-c780-4c77-8bf5-7ff1a9296a02 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3370d790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:54.876034 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77201da2-c780-4c77-8bf5-7ff1a9296a02 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.095610 Oct 25 03:25:54.880077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2444/4744] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:54 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:54.986685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:54.987736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:55.004700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:55.005449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:55.006221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:55.007143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:55.007890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:55.008567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:55.165009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:55.173944 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6510d2a4-6e15-43b1-885d-a89367c35b5c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.573852 Oct 25 03:25:55.176826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2301/4745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:54 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:55.193345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:55.203958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:55.205885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:55.207424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a7bbed9-b0f6-4ce8-a406-1f1020ef67c6 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.225445 Oct 25 03:25:55.208252 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2445/4746] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:54 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:55.415855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:55.416540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:55.446943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:55.447747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:55.448429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:55.449341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:55.450016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:55.450643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:55.773445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:55.783140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6599d645-251e-4ea2-8bfb-fea1e40bf429 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1452 microversion: 2.1 time: 0.378387 Oct 25 03:25:55.784127 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2302/4747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:55 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1452 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:55.809434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:55.810822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:55.818703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:55.819855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:55.820586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:55.822043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:55.822683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:55.823284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:55.896090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c0838de-334d-479f-8081-4b570e53c41e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd328f5e50>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:56.018535 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c0838de-334d-479f-8081-4b570e53c41e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.126510 Oct 25 03:25:56.023416 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2303/4748] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:55 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:56.202086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:56.202703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:56.210318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.210803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.211238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.215762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.216253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.216883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.256423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:56.270439 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d29cba26-d046-48f0-aab0-940c8217a7fe tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1452 microversion: 2.1 time: 0.466575 Oct 25 03:25:56.273191 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2446/4749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:55 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1452 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:56.320440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:56.325092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:56.347473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.347870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.348317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.354241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.355071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.355717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.512586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:56.512887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:56.525699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:56.527020 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c5ba81a-5e41-43ac-9e92-cc778fbc61be tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.327710 Oct 25 03:25:56.527812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2304/4750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:56 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:56.533109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d443b970-df78-427d-b241-394350780f69 req-ccbc142c-acc6-4590-a6ad-7c778124e5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ad2d83-3644-4094-9f43-2cfcb61f180c", "name": "network-vif-unplugged", "status": "completed", "tag": "7c40a79e-7be9-44c4-a654-5bda23bdf574"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:56.534826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:56.539354 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f987a98e-5f85-405d-bfb4-8451c213fb4b tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.262869 Oct 25 03:25:56.551972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d443b970-df78-427d-b241-394350780f69 req-ccbc142c-acc6-4590-a6ad-7c778124e5b3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.552839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d443b970-df78-427d-b241-394350780f69 req-ccbc142c-acc6-4590-a6ad-7c778124e5b3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.553476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d443b970-df78-427d-b241-394350780f69 req-ccbc142c-acc6-4590-a6ad-7c778124e5b3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.557650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:56.560079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2447/4751] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:56 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:25:56.570453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.server_external_events [req-d443b970-df78-427d-b241-394350780f69 req-ccbc142c-acc6-4590-a6ad-7c778124e5b3 service nova] Unable to find a host for instance 01ad2d83-3644-4094-9f43-2cfcb61f180c. Dropping event network-vif-unplugged {{(pid=120563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 25 03:25:56.572399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d443b970-df78-427d-b241-394350780f69 req-ccbc142c-acc6-4590-a6ad-7c778124e5b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043199 Oct 25 03:25:56.573530 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2305/4752] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 25 03:25:56.577625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:56.579087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:56.595739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.596646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.599140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.600256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.601032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.602321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.641171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lazy-loading 'flavor' on Instance uuid 01ad2d83-3644-4094-9f43-2cfcb61f180c {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:25:56.686381 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Cannot 'shelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state shelved_offloaded Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action HTTP/1.1 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 14 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: {"shelve": {}} Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'shelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state shelved_offloaded Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'shelve': {}}} Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:25:56.689948 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state shelved_offloaded Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state shelved_offloaded Oct 25 03:25:56.694947 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:25:56.701295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 409 to user: Cannot 'shelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state shelved_offloaded {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:25:56.702617 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1ba680a2-5861-4b26-b103-c645d47ecacd tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 409 len: 155 microversion: 2.1 time: 0.141002 Oct 25 03:25:56.708316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2448/4753] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:25:56 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 155 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:25:56.718142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:25:56.718752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:56.755118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.755672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.759639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.760395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:56.760866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:56.768277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:56.881443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120563) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 25 03:25:56.923716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:25:57.017745 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1129f0d0-89d2-4330-874c-a6011c93a191 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 202 len: 0 microversion: 2.1 time: 0.309240 Oct 25 03:25:57.030110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:57.032344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:57.039222 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2306/4754] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:25:56 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:25:57.053128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:57.054047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf99205b-00e3-4d7c-bb63-4000c2148d70 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd331e6ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:57.054511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:57.057942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:57.059953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:57.060532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:57.062399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:57.321989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:57.333568 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-012d012b-62ae-4d8b-a6e9-ccd3ad7d3bdf tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1460 microversion: 2.1 time: 0.309227 Oct 25 03:25:57.345709 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2449/4755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:57 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1460 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:57.496125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf99205b-00e3-4d7c-bb63-4000c2148d70 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.448538 Oct 25 03:25:57.496760 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2307/4756] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:57 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:57.561253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:57.563061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:57.574258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:57.579248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:57.580084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:57.580784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:57.584341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:57.585281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:57.586087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:57.587662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:57.600581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:57.601087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:57.601529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:57.602409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:57.606418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:57.606883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:57.873239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:57.882042 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89c9ebfa-0099-4529-b51b-37f8adcf6406 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.330654 Oct 25 03:25:57.882649 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2450/4757] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:57 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:57.941639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:57.950574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:57.957779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:57.958953 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e3fbbf6-d1b2-402b-9a46-e8926f3bbf2c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.383968 Oct 25 03:25:57.962635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2308/4758] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:57 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:58.369894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:58.370498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:58.386933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:58.387858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:58.388487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:58.392305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:58.395668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:58.396420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:58.512949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db70997f-9c10-4e99-8a02-bc655c53ddf8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd328935e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:58.607610 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db70997f-9c10-4e99-8a02-bc655c53ddf8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.099980 Oct 25 03:25:58.612727 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2309/4759] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:58 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:58.767021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:58.779418 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c1201ca6-43d0-4e4b-a778-d06f476f3beb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1460 microversion: 2.1 time: 0.415322 Oct 25 03:25:58.781782 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2451/4760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:58 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1460 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:58.914140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:58.916971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:58.932477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:58.936707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:58.937350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:58.938451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:58.939108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:58.941335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:58.990154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:58.990987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:59.002314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:59.005258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:59.005977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:59.006909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:59.007547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:59.010009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:59.244803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:59.293740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:59.296813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:59.327663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e3f0394a-44c6-4107-8197-f029bf79bf3c tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.341553 Oct 25 03:25:59.331727 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2452/4761] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:25:58 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:25:59.336390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:25:59.357941 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eca721a3-4408-4f3b-b790-2919b18e1203 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.451307 Oct 25 03:25:59.360469 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2310/4762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:58 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:59.627669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f3cc703d-943c-44e3-a8dc-50e7aafe15be tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32d761f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:59.797277 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f3cc703d-943c-44e3-a8dc-50e7aafe15be tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.177191 Oct 25 03:25:59.804773 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2453/4763] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:25:59 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:25:59.809708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:25:59.810444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:25:59.824828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:59.825530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:59.827007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:25:59.830172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:25:59.831024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:25:59.843862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:00.181017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:00.199439 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f74342a-376c-430b-9b6b-3a00d03ccf6f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.394678 Oct 25 03:26:00.200344 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2311/4764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:25:59 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:00.359625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:00.360681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:00.373175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:00.382272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:00.382900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:00.384444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:00.385183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:00.386593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:00.387301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:00.387965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:00.397797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:00.401746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:00.402215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:00.406668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:00.408320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:00.408776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:00.420184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:00.646228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:00.657186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:00.658692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:00.667230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8864f1f-7b5c-43bf-b452-de694589339e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.311483 Oct 25 03:26:00.667852 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2454/4765] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:00 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:00.820383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec22f51d-d30f-4c0c-8671-b04b375eb146 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd338088b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:00.902390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:00.905479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec22f51d-d30f-4c0c-8671-b04b375eb146 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.088266 Oct 25 03:26:00.906659 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2455/4766] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:00 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:00.931055 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55540bd6-7b22-4d2c-aba4-987ffb94b700 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.549831 Oct 25 03:26:00.931717 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2312/4767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:00 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:01.226188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:01.227831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:01.247015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:01.248038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:01.248703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:01.249662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:01.250846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:01.251463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:01.567641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:01.584193 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7da88b0d-9e22-4afc-bb9e-3d7dd57fce0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.362277 Oct 25 03:26:01.585496 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2456/4768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:01 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:01.704379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:01.706712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:01.724419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:01.727389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:01.730063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:01.732750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:01.735421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:01.740349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:01.923138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3356dae4-1e0a-4579-abba-b68c979f54f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3374e790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:02.012771 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3356dae4-1e0a-4579-abba-b68c979f54f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1454 microversion: 2.1 time: 0.093874 Oct 25 03:26:02.014631 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2457/4769] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:01 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:02.026660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:02.028818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:02.049985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:02.052481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:02.056283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:02.057473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:02.064538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:02.065234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:02.219045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:02.230023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:02.231376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:02.238467 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f809e86e-05ee-4c33-8d58-296aefe422e8 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1366 microversion: 2.57 time: 0.543598 Oct 25 03:26:02.251525 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2313/4770] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:01 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:02.326097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:02.341577 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1d5252d-9063-492e-8d13-7e9e46fcc5a3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.324303 Oct 25 03:26:02.342610 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2458/4771] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:02 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:02.608833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:02.610345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:02.626973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:02.628383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:02.632066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:02.640315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:02.643569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:02.644141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:03.029406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0711377f-7dd0-416a-882e-4c37ab61a2aa tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3814e670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:03.374752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:03.406445 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bafbb0a7-af38-4bc5-994a-624a524eeb73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.801153 Oct 25 03:26:03.406980 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2314/4772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:02 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:03.433468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:03.434484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:03.443697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:03.444661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:03.445319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:03.447766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:03.449019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:03.450003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:03.635690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:03.650620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:03.655287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:03.662211 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19b1c7da-7e9f-4612-b17c-f610273d0e83 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1384 microversion: 2.57 time: 0.241395 Oct 25 03:26:03.664291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2315/4773] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:03 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1384 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:03.670383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:03.671282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:03.680971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:03.683964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:03.692620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:03.694901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:03.700677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:03.701456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:03.998913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:04.011670 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4db36812-b8d0-48a4-a188-7991fc5b0ebf tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.344880 Oct 25 03:26:04.013734 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2316/4774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:03 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:04.435054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:04.435839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:04.451609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:04.452127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:04.452573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:04.453317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:04.453794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:04.454226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:04.830093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:04.844673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14d07c76-c925-4fff-b076-3125fd342b31 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.414117 Oct 25 03:26:04.870162 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2317/4775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:04 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:04.886408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:04.888178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:04.906747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:04.909998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:04.912261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:04.913294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:04.914392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:04.916357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:05.109375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:05.124693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:05.126909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:05.128457 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b6af6b6-86ba-4188-b601-089dd1f07951 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1372 microversion: 2.57 time: 0.253345 Oct 25 03:26:05.131742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2318/4776] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:04 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:05.138638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:05.139552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:05.148491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:05.150815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:05.152210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:05.153787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:05.154765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:05.155988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:05.849195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:05.859829 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-efc8f3c6-8fa6-4074-b496-1971f742ed58 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.726827 Oct 25 03:26:05.860646 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2319/4777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:05 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:05.885257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:05.886171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:05.896366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:05.897043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:05.900052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:05.901606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:05.904456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:05.906458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:06.495265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:06.506092 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-807f411e-f7b9-45ce-a2d7-b622cd5b898d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.627296 Oct 25 03:26:06.521636 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2320/4778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:05 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:06.551858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:06.552496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:06.576125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:06.577194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:06.579224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:06.580267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:06.581063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:06.581898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:06.695153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:06.706370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:06.708068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:06.709492 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-603d6502-e4f2-4fa7-944e-d6341ece349e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1372 microversion: 2.57 time: 0.175557 Oct 25 03:26:06.710405 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2321/4779] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:06 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:06.887804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:06.888639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:06.922432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:06.925438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:06.926105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:06.927006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:06.929535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:06.930824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:07.248021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:07.259153 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0323cc22-2282-4152-9bc9-3dc15b24960b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.376216 Oct 25 03:26:07.260196 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2322/4780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:06 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:07.537908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:07.539206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:07.555946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:07.561109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:07.562733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:07.565263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:07.565964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:07.566810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:07.614393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:07.969185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:07.988247 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-67bdedae-d78d-41b9-b1d3-15d5f1919c04 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.455596 Oct 25 03:26:07.999447 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2323/4781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:07 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:08.021691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:08.025081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:08.053203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:08.056255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:08.056655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:08.060672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:08.061249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:08.063872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:08.243153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:08.263612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:08.267441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:08.271609 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90eb1edb-3a50-4b04-a1b4-fc6e151219b5 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1372 microversion: 2.57 time: 0.269529 Oct 25 03:26:08.272866 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2324/4782] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:08 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:08.302914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:08.304358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:08.313217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:08.316519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:08.317080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:08.318714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:08.320530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:08.324699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:08.708891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:08.723234 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-20be095d-d837-49ec-b606-0aa9f291c333 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.428135 Oct 25 03:26:08.725498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2325/4783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:08 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:09.023634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:09.025037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:09.050637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:09.052965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:09.055409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:09.057155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:09.057646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:09.059831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:09.561521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:09.571569 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc280c1d-343a-4720-91b0-3757f4c532e0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.551882 Oct 25 03:26:09.584960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2326/4784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:09 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:09.603341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:09.604028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:09.659230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:09.659732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:09.660168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:09.671686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:09.672235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:09.672684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:10.091753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:10.104450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:10.109194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:10.114586 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-daec3176-bcba-4e7f-aac7-abcf1cd0397f tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1357 microversion: 2.57 time: 0.527142 Oct 25 03:26:10.115461 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2327/4785] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:09 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1357 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:10.155566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:10.162845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:10.174361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:10.175242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:10.175916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:10.183070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:10.183774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:10.184452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:10.580469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:10.607321 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-180394b9-9ea1-4aee-a514-f1248caedf9a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.459220 Oct 25 03:26:10.617866 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2328/4786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:10 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:10.628744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:10.629448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:10.642698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:10.643451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:10.648495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:10.652004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:10.653309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:10.653951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:10.736693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:26:10.928965 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52cd60a1-6e83-446b-8f82-a9e14b061886 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 204 len: 0 microversion: 2.57 time: 0.309450 Oct 25 03:26:10.929598 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2329/4787] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:26:10 2022] DELETE /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:26:10.947002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:10.948034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:10.959905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:10.960703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:10.961369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:10.962501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:10.963142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:10.963778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:11.217572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:11.239719 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c2ce28c-c036-47b5-b77a-cb3acec81165 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.303047 Oct 25 03:26:11.241643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2330/4788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:10 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:11.249948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:11.251174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:11.259601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:11.260839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:11.261649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:11.263027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:11.264188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:11.264919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:11.384979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:11.401919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:11.403422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:11.404937 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3f42f248-2091-4dd3-892c-f5764825757e tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1363 microversion: 2.57 time: 0.159372 Oct 25 03:26:11.421172 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2331/4789] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:11 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:11.648532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:11.653381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:11.684562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:11.687576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:11.689644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:11.690895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:11.692575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:11.693282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:12.037887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=82 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:12.093036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:12.119294 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-421fda70-365c-487c-8072-42f208fd9b68 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.482130 Oct 25 03:26:12.134206 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2332/4790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:11 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:12.268035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:12.271073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:12.280363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:12.283939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:12.285068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:12.287989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:12.291101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:12.291825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:12.333285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=15 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:12.644594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:12.657522 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-093bbe4f-6a7e-49d9-b4a6-e36f13b4893e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.393121 Oct 25 03:26:12.659273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2333/4791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:12 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:12.669047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:12.670178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:12.677516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:12.679179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:12.680427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:12.681321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:12.681963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:12.682543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:12.779084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:12.791312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:12.794001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a67f6fd2ae0477fa3a6b97833da1857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0231a312712247afb9f8a61448083400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:12.795730 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a29ceaf0-3e23-4204-9408-42e7bf4e9f95 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 200 len: 1363 microversion: 2.57 time: 0.134009 Oct 25 03:26:12.796780 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2334/4792] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:12 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 1363 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:13.168203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:13.387261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:13.395117 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91340a62-137c-47f2-a380-ecf3a3df8b67 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.253878 Oct 25 03:26:13.396147 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2335/4793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:13 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:13.690222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:13.690222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:13.704514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:13.707372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:13.708260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:13.709580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:13.714577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:13.715028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:14.005141 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0711377f-7dd0-416a-882e-4c37ab61a2aa tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1463 microversion: 2.1 time: 10.979559 Oct 25 03:26:14.010781 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2459/4794] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:03 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1463 bytes in 10985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:14.021864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:14.023702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] [instance: dcafe6f5-d520-4b40-94e4-a76e689abf69] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:14.045525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:14.046455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:14.048655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:14.050597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:14.052488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:14.054338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:14.092473 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] HTTP exception thrown: Instance dcafe6f5-d520-4b40-94e4-a76e689abf69 could not be found. Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Request method failure captured: Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 HTTP/1.1 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1cmzqYs7DssamPWIkDALl6SlaWZHp6BmYZ5LmzrkZ-s0V4bADphs36-h8wPtCm7pM5_QJ1EwkjTpn9EC8uw_ni9977CkF9hHZpCtWA1YznMbzYOfJ3-TYeZ_HeiOCIJANnGe7-TPsJGI1fbHy2GFvALXjTtfkGMxI2xQHDuNTz_25c Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.57 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0231a312712247afb9f8a61448083400 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerShowV257Test-1254182136 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0231a312712247afb9f8a61448083400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0231a312712247afb9f8a61448083400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0231a312712247afb9f8a61448083400", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0231a312712247afb9f8a61448083400"}]}] Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerShowV257Test-1254182136 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0231a312712247afb9f8a61448083400 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerShowV257Test-1254182136 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerShowV257Test-1254182136-project Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9a67f6fd2ae0477fa3a6b97833da1857 Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerShowV257Test-1254182136-project Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance dcafe6f5-d520-4b40-94e4-a76e689abf69 could not be found. Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'dcafe6f5-d520-4b40-94e4-a76e689abf69'} Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcafe6f5-d520-4b40-94e4-a76e689abf69 could not be found. Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcafe6f5-d520-4b40-94e4-a76e689abf69 could not be found. Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:14.097347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:14.105186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:14.105186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:14.105186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:14.105186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:26:14.105186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:26:14.105186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcafe6f5-d520-4b40-94e4-a76e689abf69 could not be found. Oct 25 03:26:14.105186 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:14.106697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] Returning 404 to user: Instance dcafe6f5-d520-4b40-94e4-a76e689abf69 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:26:14.107811 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-38ad0916-a7c3-4763-b82b-fce9107d91f9 tempest-ServerShowV257Test-1254182136 tempest-ServerShowV257Test-1254182136-project] 10.222.0.36 "GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69" status: 404 len: 111 microversion: 2.57 time: 0.095743 Oct 25 03:26:14.108698 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2460/4795] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:14 2022] GET /compute/v2.1/servers/dcafe6f5-d520-4b40-94e4-a76e689abf69 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:26:14.120407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f271c063-07bb-45d7-bb94-1c3e714bcb08 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3392cdc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:14.199930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:14.209127 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6848b4b4-f9de-4427-8ae1-1d67b16c8e92 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.525257 Oct 25 03:26:14.211444 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f271c063-07bb-45d7-bb94-1c3e714bcb08 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 200 len: 1463 microversion: 2.1 time: 0.101340 Oct 25 03:26:14.222501 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2461/4797] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:14 2022] GET /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 1463 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:14.222795 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2336/4797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:13 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:14.231065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:14.232579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:14.246957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:14.251059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:14.251958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:14.253295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:14.254155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:14.254935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:14.425065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:14.427159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:14.443530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:14.444948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:14.447912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:14.450800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:14.454853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:14.458232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:14.794762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:14.809976 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4d7bbcb9-b332-4753-a23e-3dd430490ad8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 1479 microversion: 2.1 time: 0.583115 Oct 25 03:26:14.815707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2462/4798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:14 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 1479 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:14.922553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:14.938781 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81238ca0-5ad1-4cab-8a93-5df6de72aa9f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.518471 Oct 25 03:26:14.966043 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2337/4799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:14 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:15.234739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:15.235674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:15.248675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:15.255181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:15.256670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:15.257608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:15.261168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:15.261892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:15.529878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:15.551397 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0549f8d7-4419-40f4-9e7e-b898cca9d67d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.319281 Oct 25 03:26:15.554163 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2463/4800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:15 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:15.844722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:15.846011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:15.856622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:15.860562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:15.861216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:15.864060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:15.864707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:15.868953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:15.903596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:15.994682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:15.995600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:16.018383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:16.022422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:16.023478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:16.029067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:16.029067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:16.029476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:16.252836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:16.264384 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9365feb-2e38-46b5-b79c-3ed9073cfae8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 1466 microversion: 2.1 time: 0.424388 Oct 25 03:26:16.265546 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2338/4801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:15 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 1466 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:16.291557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1682882409"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:16.295771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:16.319591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:16.322551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:16.323797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:16.325590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:16.327426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:16.329256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:16.393015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:16.403927 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d3c69c6b-2303-4a15-9989-765066d81dd0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.413925 Oct 25 03:26:16.408877 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2464/4802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:15 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:16.606318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:16.606318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:16.609527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:16.612302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:16.612906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:16.613879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:16.622499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:16.625060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:16.899643 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73a3ce18-9826-4d37-9041-f01f64657419 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "POST /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547/action" status: 202 len: 0 microversion: 2.1 time: 0.612859 Oct 25 03:26:16.907260 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2339/4803] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:16 2022] POST /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:26:16.931673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3891394d-4997-4822-bb00-c7ccf5a38a09 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3284b5e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:17.019886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:17.039515 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c951e479-f9fd-42a0-9437-e215859a5309 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.455301 Oct 25 03:26:17.042230 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2465/4804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:16 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:17.075629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3891394d-4997-4822-bb00-c7ccf5a38a09 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.159279 Oct 25 03:26:17.090898 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2340/4805] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:16 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:17.437568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:17.438347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:17.453030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:17.457080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:17.457762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:17.458777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:17.460595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:17.462832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:17.734289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:17.743182 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b284fdd-4c02-4d1a-a3f2-82e262da061a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.309910 Oct 25 03:26:17.748444 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2466/4806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:17 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:18.073911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:18.075715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:18.086832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:18.088017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:18.088909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:18.090444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:18.096650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5cfa5e28-7f58-4aba-a61a-fcfa6c7afb3e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32d091f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:18.108357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:18.109759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:18.243831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5cfa5e28-7f58-4aba-a61a-fcfa6c7afb3e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.151117 Oct 25 03:26:18.245332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2467/4807] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:18 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:18.577119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:18.594092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-886d1575-2be1-48c6-accd-7d82d1c5ebfe req-b250e2f0-6cfe-494f-a7d0-847ad70992a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96fd4fd-b50c-485c-a521-34fa71082f92", "name": "network-vif-unplugged", "status": "completed", "tag": "36ae65b4-6263-4fdc-911f-5659139037d7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:18.605461 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-822b0506-9e3a-41ae-914a-e81d5b6b9319 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.537524 Oct 25 03:26:18.606143 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2341/4808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:18 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:18.643109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-886d1575-2be1-48c6-accd-7d82d1c5ebfe req-b250e2f0-6cfe-494f-a7d0-847ad70992a3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:18.643109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-886d1575-2be1-48c6-accd-7d82d1c5ebfe req-b250e2f0-6cfe-494f-a7d0-847ad70992a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:18.643109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-886d1575-2be1-48c6-accd-7d82d1c5ebfe req-b250e2f0-6cfe-494f-a7d0-847ad70992a3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:18.658708 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-886d1575-2be1-48c6-accd-7d82d1c5ebfe req-b250e2f0-6cfe-494f-a7d0-847ad70992a3 service nova] Creating event network-vif-unplugged:36ae65b4-6263-4fdc-911f-5659139037d7 for instance c96fd4fd-b50c-485c-a521-34fa71082f92 on n-h1-862355-1 Oct 25 03:26:18.667079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-886d1575-2be1-48c6-accd-7d82d1c5ebfe req-b250e2f0-6cfe-494f-a7d0-847ad70992a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077176 Oct 25 03:26:18.668995 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2468/4809] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:26:18.777175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:18.777900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:18.788099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:18.788099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:18.793895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:18.796499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:18.800944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:18.802947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:19.275544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-556dae83-c235-4856-b1a5-4a1ecb2f3a6f tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3280d280>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:19.409276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-556dae83-c235-4856-b1a5-4a1ecb2f3a6f tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.151124 Oct 25 03:26:19.411076 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2469/4810] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:19 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:19.635451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:19.636847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:19.670635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:19.671570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:19.671570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:19.672281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:19.672846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:19.673177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:19.743684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:19.771414 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f4ef1b4-ca51-46f6-935e-4b71831e6527 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1515 microversion: 2.1 time: 0.998109 Oct 25 03:26:19.772825 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2342/4811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:18 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1515 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:20.081479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:20.103919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d2b8864-03a4-4b10-88c0-082c70348ba5 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.473897 Oct 25 03:26:20.111826 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2470/4812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:19 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:20.430742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1c462e3-8317-458e-962b-c9edc9a14dfa tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3284b790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:20.548731 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1c462e3-8317-458e-962b-c9edc9a14dfa tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.125864 Oct 25 03:26:20.551996 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2343/4813] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:20 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:20.797720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:20.799046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:20.808286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:20.809117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:20.809812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:20.810702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:20.811350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:20.811970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:21.137299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:21.138208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:21.156938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:21.159916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:21.160450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:21.161466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:21.161940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:21.162379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:21.699552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:21.713044 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e131e4d-6e60-4908-abbd-391d4784b49b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1533 microversion: 2.1 time: 0.918269 Oct 25 03:26:21.731340 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2471/4814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:20 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1533 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:21.745110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61d42299-eefb-4701-9c1a-41dd88bbd842 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b8061f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:21.835192 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61d42299-eefb-4701-9c1a-41dd88bbd842 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.102596 Oct 25 03:26:21.843001 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2472/4815] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:21 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:21.982933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:21.995594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc0e5a39-9333-4ec7-af19-e414cb7a8c8c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.860588 Oct 25 03:26:22.009703 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2344/4816] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:21 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:22.746759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:22.747599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:22.766281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:22.767090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:22.769213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:22.771306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:22.772641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:22.775753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:22.853361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8182757-e735-4374-bfbc-1b04affc4675 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3284baf0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:22.933091 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8182757-e735-4374-bfbc-1b04affc4675 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.083935 Oct 25 03:26:22.945418 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2345/4817] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:22 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:23.028445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:23.029209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:23.047255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:23.047863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:23.048319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:23.049068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:23.049958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:23.050607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:23.299926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:23.316532 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ec74f6c-eada-456c-9ed0-e0ae5ae5c309 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.575885 Oct 25 03:26:23.322104 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2473/4818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:22 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:23.827582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:23.836880 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-691fda99-60cc-4f84-b9ef-d6f360c383ad tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.813703 Oct 25 03:26:23.838652 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2346/4819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:23 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:23.955513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cab936b-a389-4a23-9048-0b675d9dcb90 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd335daca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:24.059736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cab936b-a389-4a23-9048-0b675d9dcb90 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.110639 Oct 25 03:26:24.068473 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2474/4820] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:23 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:24.350141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:24.352517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:24.363480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:24.373244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:24.373801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:24.374723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:24.375197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:24.375631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:24.685104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9117696e-d60f-4ac0-90d4-6f5ded2d6591 req-e49f67ad-6322-4b05-8fe1-1785a339fe07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0313aa2b-c237-41f0-b6fe-5eee8c62e168", "name": "network-vif-unplugged", "status": "completed", "tag": "e72d65ea-e118-40e5-a25a-c90efdea23d3"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:24.709140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9117696e-d60f-4ac0-90d4-6f5ded2d6591 req-e49f67ad-6322-4b05-8fe1-1785a339fe07 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:24.713598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9117696e-d60f-4ac0-90d4-6f5ded2d6591 req-e49f67ad-6322-4b05-8fe1-1785a339fe07 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:24.719501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9117696e-d60f-4ac0-90d4-6f5ded2d6591 req-e49f67ad-6322-4b05-8fe1-1785a339fe07 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:24.756398 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9117696e-d60f-4ac0-90d4-6f5ded2d6591 req-e49f67ad-6322-4b05-8fe1-1785a339fe07 service nova] Creating event network-vif-unplugged:e72d65ea-e118-40e5-a25a-c90efdea23d3 for instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 on n-h1-862355-1 Oct 25 03:26:24.776058 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9117696e-d60f-4ac0-90d4-6f5ded2d6591 req-e49f67ad-6322-4b05-8fe1-1785a339fe07 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100145 Oct 25 03:26:24.780237 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2475/4821] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:26:24.865402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:24.866391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:24.882098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:24.883599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:24.884214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:24.885153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:24.885820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:24.889434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:25.027145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:25.048908 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-690f88a8-8bff-42da-b867-5348222c7066 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.701679 Oct 25 03:26:25.065704 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2347/4822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:24 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:25.078684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4a4d07f-a484-4fe6-8f50-1bbdc326079e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3298cd30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:25.159935 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4a4d07f-a484-4fe6-8f50-1bbdc326079e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.087235 Oct 25 03:26:25.171236 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2348/4823] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:25 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:25.725269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:25.737924 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63e61d3a-f141-4668-9c4e-67a00d9514ef tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.877117 Oct 25 03:26:25.738527 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2476/4824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:24 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:26.080630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:26.082367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:26.095113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:26.098689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:26.099620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:26.100574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:26.103232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:26.104029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:26.177442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e64203bd-dd05-4cfd-ba70-5b1dc375ef3f tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33892280>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:26.268326 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e64203bd-dd05-4cfd-ba70-5b1dc375ef3f tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.095732 Oct 25 03:26:26.269171 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2477/4825] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:26 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:26.372616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:26.382583 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52dfbc3a-2fde-4b31-86cf-8d5437925b2e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.306645 Oct 25 03:26:26.396231 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2349/4826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:26 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:26.767980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:26.769227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:26.781532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:26.785087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:26.787909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:26.788831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:26.790741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:26.791330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:27.285503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b06bc81f-a091-4d96-bd85-a75ea0d21a4d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3284b280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:27.365302 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b06bc81f-a091-4d96-bd85-a75ea0d21a4d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.083299 Oct 25 03:26:27.366091 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2350/4827] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:27 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:27.424013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:27.424638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:27.435614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:27.438872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:27.439431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:27.439876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:27.447996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:27.448438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:27.448969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:27.643516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:27.655080 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d84af7b-ebdd-46c1-8e3f-40e57a0de544 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.892616 Oct 25 03:26:27.669255 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2478/4828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:26 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:27.899197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:27.940491 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b26ba2b-445d-4bb1-867c-719b5bc9ea6b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.516116 Oct 25 03:26:27.949758 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2351/4829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:27 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:28.381846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8fad28e5-bf60-4878-b0f9-70179220b495 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd335daca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:28.468123 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8fad28e5-bf60-4878-b0f9-70179220b495 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.090120 Oct 25 03:26:28.472707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2479/4830] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:28 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:28.686324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:28.686949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:28.706427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:28.713099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:28.716410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:28.720265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:28.723385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:28.727119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:28.972300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:28.972934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:28.982372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:28.998217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:28.999182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:29.000162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:29.002655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:29.006276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:29.511773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:29.526926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5914e4be-ef45-4a7a-8110-9f9d37454765 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.560125 Oct 25 03:26:29.556230 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2480/4831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:28 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:29.556774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:29.572556 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a8c33b4f-a17c-4b2a-9425-200a80bd79a3 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.887804 Oct 25 03:26:29.573823 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2352/4832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:28 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:29.588816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-071bd2a7-2947-4bc6-827f-3f80a724310b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd335da1f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:29.697357 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-071bd2a7-2947-4bc6-827f-3f80a724310b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.139385 Oct 25 03:26:29.701225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2481/4833] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:29 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:30.564136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:30.567617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:30.582321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:30.583231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:30.583898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:30.584800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:30.585421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:30.586125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:30.600170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:30.601412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:30.627800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:30.631621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:30.636032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:30.637014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:30.637621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:30.640589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:30.981610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:31.006199 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a252f49-fa17-4818-88e1-9aca72e95e94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.445839 Oct 25 03:26:31.017966 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2353/4834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:30 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:31.029944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18440cb9-e663-4a8e-af07-a931a5e559c2 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32869dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:31.093084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:31.111614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21a8f075-7ac9-476b-bb2f-995ef8878533 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.515749 Oct 25 03:26:31.131523 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2482/4835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:30 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:31.181959 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18440cb9-e663-4a8e-af07-a931a5e559c2 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.157597 Oct 25 03:26:31.183221 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2354/4836] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:31 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:31.841236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-71eb74e3-7137-4ccb-bc30-5f8c85a52018 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'create', calling method: .version_select at 0x7efd3374e790>, body: {"keypair": {"name": "tempest-keypair-389177982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9uVt0Kl0bUEDb+snt65mj5vKSw6QmnCWU7jxRL2Hzu88usxTzjQmIWko/jOVTO/xt5fqCQcjq2z8IdDrU7zfPhI1YPKaa5qtNOE0mrKZzK1jQ2MKIw5EPNMTKswaSOrA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:31.877057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-869e8536-b4b1-4e58-b4c5-122878765d4c req-40e2faa7-581a-4392-84b7-aea49531ca23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade7b0be-f3d6-4149-91ab-bdac6f1f5547", "name": "network-vif-plugged", "status": "completed", "tag": "d1f2cbba-3217-49fb-8f52-abbcfedb4c1e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:31.897063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-71eb74e3-7137-4ccb-bc30-5f8c85a52018 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:26:31.903403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-869e8536-b4b1-4e58-b4c5-122878765d4c req-40e2faa7-581a-4392-84b7-aea49531ca23 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:31.904268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-869e8536-b4b1-4e58-b4c5-122878765d4c req-40e2faa7-581a-4392-84b7-aea49531ca23 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:31.905127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-869e8536-b4b1-4e58-b4c5-122878765d4c req-40e2faa7-581a-4392-84b7-aea49531ca23 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:31.925435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-71eb74e3-7137-4ccb-bc30-5f8c85a52018 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for user 9b8a3ce5bebf4745b1f095653b010f5e and project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:26:31.933344 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-869e8536-b4b1-4e58-b4c5-122878765d4c req-40e2faa7-581a-4392-84b7-aea49531ca23 service nova] Creating event network-vif-plugged:d1f2cbba-3217-49fb-8f52-abbcfedb4c1e for instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 on n-h2-862355-1 Oct 25 03:26:31.959185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-869e8536-b4b1-4e58-b4c5-122878765d4c req-40e2faa7-581a-4392-84b7-aea49531ca23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086498 Oct 25 03:26:31.960619 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2355/4837] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:26:31.994594 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71eb74e3-7137-4ccb-bc30-5f8c85a52018 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [a953044b-09c0-478b-a7ea-489143a581d5] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 03:26:32.049228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:32.053213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:32.073994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:32.074664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:32.076765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:32.078065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:32.081708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:32.082391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:32.513967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:32.527424 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52cdde7b-e84f-4f79-915a-2cd8e0d27bdd tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.489193 Oct 25 03:26:32.536928 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2356/4838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:32 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:32.544424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:32.545047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:32.563329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:32.563845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:32.564294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:32.565014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:32.565494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:32.565962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:32.838534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:32.847941 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2ff43c5-47e0-4465-97e3-df492e0b75d8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.309834 Oct 25 03:26:32.848549 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2357/4839] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:32 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:32.868612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c57331ba-23e5-4a3b-afd5-3b226c07ec83 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3280ce50>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:32.943115 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c57331ba-23e5-4a3b-afd5-3b226c07ec83 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.087779 Oct 25 03:26:32.944490 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2358/4840] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:32 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:33.010763 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [None req-71eb74e3-7137-4ccb-bc30-5f8c85a52018 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [a953044b-09c0-478b-a7ea-489143a581d5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 40398. Oct 25 03:26:33.038444 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-71eb74e3-7137-4ccb-bc30-5f8c85a52018 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.905215 Oct 25 03:26:33.039552 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2483/4841] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:26:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1907 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 25 03:26:33.552961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:33.554043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:33.571420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:33.576060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:33.576847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:33.579004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:33.584206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:33.585505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:33.882139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:33.882139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:33.905393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:33.905940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:33.906388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:33.907253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:33.907557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:33.908082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:34.160653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:34.181649 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14210267-51d0-44b8-9756-b9bda53a6fec tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.632434 Oct 25 03:26:34.184250 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2359/4842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:33 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:34.203177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ceae570e-19d2-40ba-8e90-78a029e33394 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd328698b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:34.333839 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ceae570e-19d2-40ba-8e90-78a029e33394 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.142958 Oct 25 03:26:34.334892 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2360/4843] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:34 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:34.562699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:34.579218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87fca649-6226-40a6-ae70-2708722dc85f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.710112 Oct 25 03:26:34.594521 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2484/4844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:33 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:35.119576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-91ddaac3-5250-43c5-9d2b-31637a550d66 req-1f7d3a04-8425-4902-ab23-952965db6a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ad2d83-3644-4094-9f43-2cfcb61f180c", "name": "network-vif-plugged", "status": "completed", "tag": "7c40a79e-7be9-44c4-a654-5bda23bdf574"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:35.147274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91ddaac3-5250-43c5-9d2b-31637a550d66 req-1f7d3a04-8425-4902-ab23-952965db6a17 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:35.147764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91ddaac3-5250-43c5-9d2b-31637a550d66 req-1f7d3a04-8425-4902-ab23-952965db6a17 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:35.148196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91ddaac3-5250-43c5-9d2b-31637a550d66 req-1f7d3a04-8425-4902-ab23-952965db6a17 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:35.182935 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-91ddaac3-5250-43c5-9d2b-31637a550d66 req-1f7d3a04-8425-4902-ab23-952965db6a17 service nova] Creating event network-vif-plugged:7c40a79e-7be9-44c4-a654-5bda23bdf574 for instance 01ad2d83-3644-4094-9f43-2cfcb61f180c on n-h1-862355-1 Oct 25 03:26:35.210329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:35.211214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:35.225337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:35.227976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:35.229760 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-91ddaac3-5250-43c5-9d2b-31637a550d66 req-1f7d3a04-8425-4902-ab23-952965db6a17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.893392 Oct 25 03:26:35.230923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:35.231679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:35.232148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:35.232584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:35.248874 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2361/4845] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:26:35.351085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-944592d0-2aa9-46f4-9483-07afe2535933 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3298c4c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:35.479688 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-944592d0-2aa9-46f4-9483-07afe2535933 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.132823 Oct 25 03:26:35.481094 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2362/4846] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:35 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:35.614785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:35.615893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:35.647811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:35.648944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:35.650452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:35.661332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:35.666039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:35.666746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:35.929978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:35.942033 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec698c1d-1e3d-42a2-9c6d-8af0d9993368 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.732194 Oct 25 03:26:35.957786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2485/4847] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:35 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:36.497745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-531fc0ce-276d-47fb-b25c-017e780bc1a1 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd329f0670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:36.594141 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-531fc0ce-276d-47fb-b25c-017e780bc1a1 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.100609 Oct 25 03:26:36.596219 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2486/4848] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:36 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:36.832237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:36.841536 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cea0f3ae-e70c-4162-8587-717d4849cfd1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 1.232793 Oct 25 03:26:36.845347 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2363/4849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:35 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:36.966623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:36.967756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:36.979193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:36.983137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:36.983594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:36.987889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:36.988557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:36.995490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:37.301571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d49a8bc0-6c9b-49dd-b9e5-2623c3735b57 req-841397d9-0918-42a6-8e53-0ec5b5bbbfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0313aa2b-c237-41f0-b6fe-5eee8c62e168", "name": "network-vif-plugged", "status": "completed", "tag": "e72d65ea-e118-40e5-a25a-c90efdea23d3"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:37.329609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d49a8bc0-6c9b-49dd-b9e5-2623c3735b57 req-841397d9-0918-42a6-8e53-0ec5b5bbbfd9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:37.330778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d49a8bc0-6c9b-49dd-b9e5-2623c3735b57 req-841397d9-0918-42a6-8e53-0ec5b5bbbfd9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:37.331415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d49a8bc0-6c9b-49dd-b9e5-2623c3735b57 req-841397d9-0918-42a6-8e53-0ec5b5bbbfd9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:37.363548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:37.368965 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d49a8bc0-6c9b-49dd-b9e5-2623c3735b57 req-841397d9-0918-42a6-8e53-0ec5b5bbbfd9 service nova] Creating event network-vif-plugged:e72d65ea-e118-40e5-a25a-c90efdea23d3 for instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 on n-h1-862355-1 Oct 25 03:26:37.394399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d49a8bc0-6c9b-49dd-b9e5-2623c3735b57 req-841397d9-0918-42a6-8e53-0ec5b5bbbfd9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097047 Oct 25 03:26:37.397995 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2364/4850] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:26:37.451722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-258779139", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39a6132f-d4fd-4e72-b376-0f3f0d2d7b0e"}], "security_groups": [{"name": "tempest-securitygroup--1855998070"}], "key_name": "tempest-keypair-389177982", "user_data": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:37.475308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:37.498190 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0baf900d-3f5e-4754-af2d-5e1ffa6ceaad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 0.535350 Oct 25 03:26:37.504512 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2487/4851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:36 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:37.612683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5474bb0e-9a66-4657-8f9f-243e9c177633 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd337addc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:37.710545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5474bb0e-9a66-4657-8f9f-243e9c177633 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.102607 Oct 25 03:26:37.712242 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2488/4852] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:37 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:37.814406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] validate_networks() for [('39a6132f-d4fd-4e72-b376-0f3f0d2d7b0e', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:26:37.870080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:37.870728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:37.885426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:37.887464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:37.890011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:37.900001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:37.900529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:37.900989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:37.980138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:38.387329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:38.396050 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6cd45a0e-3a58-43c2-aa11-391d3f7e2aa9 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 0.531400 Oct 25 03:26:38.396643 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2489/4853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:37 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:38.526422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:38.527288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:38.546407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:38.554433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:38.556821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:38.558471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:38.559280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:38.560506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:39.626799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:39.643200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea4bfb17-18fc-4855-88e0-5aca60d3f1f2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1521 microversion: 2.1 time: 1.121989 Oct 25 03:26:39.646276 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2490/4854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:38 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1521 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:39.660483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9eb3073c-f125-4716-8229-b9c2f3c5b846 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3377e430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:39.699731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:26:39.700626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:26:39.701261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:26:39.701829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:26:39.702457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:26:39.723992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:39.729565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:39.730257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:39.732152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:39.734264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:39.734825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:39.809019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:26:39.847081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for user 9b8a3ce5bebf4745b1f095653b010f5e and project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:26:39.932350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:26:39.944777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:26:40.129121 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7764df8e-c694-48c5-ba16-ec1b8e80b761 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.682618 Oct 25 03:26:40.136946 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2365/4855] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:26:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 25 03:26:40.160647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:40.165163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:40.169651 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9eb3073c-f125-4716-8229-b9c2f3c5b846 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.517741 Oct 25 03:26:40.173474 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2491/4856] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:39 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:40.186665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:40.193758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:40.195198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:40.197792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:40.205070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:40.206580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0dfb0724-0aaa-43c7-9c2f-8113d6d00ab4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:40.206979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:40.207080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0dfb0724-0aaa-43c7-9c2f-8113d6d00ab4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:40.525326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dfb0724-0aaa-43c7-9c2f-8113d6d00ab4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:40.562178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dfb0724-0aaa-43c7-9c2f-8113d6d00ab4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:40.570831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dfb0724-0aaa-43c7-9c2f-8113d6d00ab4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:40.574860 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0dfb0724-0aaa-43c7-9c2f-8113d6d00ab4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1280 microversion: 2.20 time: 0.389590 Oct 25 03:26:40.578611 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2492/4857] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:40 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1280 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:40.675134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:40.681053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:40.733901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:40.737781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:40.738281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:40.739062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:40.739523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:40.739998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:41.224642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:41.251033 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6dfd2d09-fa49-476f-a5fb-1c5de0c575da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1506 microversion: 2.1 time: 0.579314 Oct 25 03:26:41.252843 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2493/4858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:40 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:41.258884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed0aab8a-1e13-4db6-ad41-f6f61583a797 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd335da700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:41.371674 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed0aab8a-1e13-4db6-ad41-f6f61583a797 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.117009 Oct 25 03:26:41.381795 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2494/4859] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:41 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:41.393348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:41.394216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:41.401796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:41.402708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:41.403305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:41.404306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:41.404946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:41.405546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:41.793476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:41.811262 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ae6d724f-d5b2-4bf6-b862-7855cd525e0d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 200 len: 1506 microversion: 2.1 time: 0.419089 Oct 25 03:26:41.812555 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2495/4860] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:41 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:41.819321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:41.820236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:41.830926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:41.838279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:41.839295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:41.840254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:41.840874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:41.841448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:42.007445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:42.020657 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4566daaa-0e84-4cfc-a41c-9606a0548422 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1518 microversion: 2.1 time: 1.881332 Oct 25 03:26:42.021537 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2366/4861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:40 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1518 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:42.029263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1727246253", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:42.064750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:42.088563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:42.091610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:42.092972 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-75643153-e4f5-4725-8f78-0373249f4b4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1276 microversion: 2.20 time: 0.277923 Oct 25 03:26:42.111613 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2496/4862] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:41 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:42.127346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:42.127880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:42.132267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:42.140462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:42.141204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:42.141830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:42.142701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:42.143322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:42.144164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:42.194575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:26:42.200859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:26:42.519379 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c725e1dd-c522-4451-b43c-bbf1db02ef56 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 204 len: 0 microversion: 2.1 time: 0.393743 Oct 25 03:26:42.526206 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2497/4863] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:26:42 2022] DELETE /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:26:42.533618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c298605f-da67-4901-b16d-8a362451df50 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b80d3a0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:42.681198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c298605f-da67-4901-b16d-8a362451df50 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.157852 Oct 25 03:26:42.698528 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2498/4864] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:42 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:42.863889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-332877694", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "7b4c0aa8-f1e1-4d38-9caf-81f88df10ecb"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:42.990302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] validate_networks() for [('7b4c0aa8-f1e1-4d38-9caf-81f88df10ecb', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:26:43.194235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:26:43.196179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:26:43.196899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:26:43.202065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:26:43.202590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:26:43.232312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:43.232441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:43.240660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:43.241801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:43.243198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:43.244781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:43.272489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Getting quotas for project 40263784b9b443fc8ee18b3a5aef384d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:26:43.286018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Getting quotas for user 0eb5f02ac0914b8aab71589dd0ea0f68 and project 40263784b9b443fc8ee18b3a5aef384d. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:26:43.327269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:26:43.339670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:26:43.517911 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39f26694-f88e-4b60-bd2c-eecc9eb380a4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492192 Oct 25 03:26:43.536530 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2367/4865] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:26:43.569129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:43.575569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:43.640158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:43.645258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:43.671412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:43.674119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:43.674625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:43.675268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:44.329512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:26:44.330694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:26:44.331614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:26:44.332218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:26:44.338603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:26:44.356337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:44.357794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:44.359351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:44.361338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:44.362677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:44.363828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:44.440894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Getting quotas for project 8371bf273fe04e57950c2b1b6b06635e. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:26:44.463464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Getting quotas for user 9798047eedd6447a9590ff3235cb1974 and project 8371bf273fe04e57950c2b1b6b06635e. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:26:44.505916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:26:44.516190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:26:44.765101 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c2164413-6d8a-47da-8859-16089ae706e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.904118 Oct 25 03:26:44.767716 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2499/4866] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:26:44.809839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:44.810974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:44.840896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:44.841659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:44.842332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:44.843428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:44.846215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:44.846864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:45.100878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:45.161906 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf6050b4-cf2c-42ff-b579-e20f7b682d4a tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 1.619582 Oct 25 03:26:45.163365 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2368/4867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:43 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:45.197541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3688da62-3cbd-4d56-bf3e-d078f3787d91 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:45.198245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3688da62-3cbd-4d56-bf3e-d078f3787d91 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:45.272296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:45.295036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:45.304448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:45.306224 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-302dcac2-ae7d-4f44-8f73-3002167daab8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1338 microversion: 2.20 time: 0.536070 Oct 25 03:26:45.313568 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2500/4868] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:44 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1338 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:45.319649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45c523df-7026-473b-91a4-3b913e92b594 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b82ce50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:45.422855 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45c523df-7026-473b-91a4-3b913e92b594 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.107955 Oct 25 03:26:45.423431 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2501/4869] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:45 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:45.428538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3ed7b07-2307-4794-a88d-103ac1a0bd8a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:45.429139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3ed7b07-2307-4794-a88d-103ac1a0bd8a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:45.608377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b3ed7b07-2307-4794-a88d-103ac1a0bd8a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:45.616837 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3ed7b07-2307-4794-a88d-103ac1a0bd8a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1217 microversion: 2.1 time: 0.192365 Oct 25 03:26:45.621364 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2502/4870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:45 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:45.629926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:45.645881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:45.693281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:45.696007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:45.696883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:45.702169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:45.702931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:45.707293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:46.155803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3688da62-3cbd-4d56-bf3e-d078f3787d91 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:46.175671 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3688da62-3cbd-4d56-bf3e-d078f3787d91 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1214 microversion: 2.1 time: 1.003352 Oct 25 03:26:46.177615 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2369/4871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:45 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1214 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:46.344288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:46.345350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:46.365922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:46.368067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:46.370430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:46.374584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:46.378073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:46.378934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:47.319185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:47.329088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:47.347853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:47.357648 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2e6886b-7816-4577-a3ca-472f45ef13b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 1.029000 Oct 25 03:26:47.361232 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2370/4872] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:46 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:26:47.381939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:47.394936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37a3675d-361b-4ad2-8d22-fdfba703996e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3281ec10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:47.406183 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0affc9ce-420f-4526-8fe0-c338321c2768 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 1.768969 Oct 25 03:26:47.408371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2503/4873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:45 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:47.421578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:47.443788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:47.485612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:47.487410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:47.491561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:47.498355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:47.501896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:47.502611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:47.516164 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37a3675d-361b-4ad2-8d22-fdfba703996e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.150767 Oct 25 03:26:47.519765 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2371/4874] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:47 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:47.530547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:47.546489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:47.562792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:47.563541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:47.564206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:47.565185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:47.565917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:47.567119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:47.764036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:47.779291 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a401ab5-09b2-4bea-9ee3-76edb5cc21e0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1269 microversion: 2.1 time: 0.369109 Oct 25 03:26:47.780899 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2504/4875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:47 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1269 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:47.802162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c01f1684-939b-4972-887a-79bc2d3f13ec req-0c6a9156-2803-4057-ab58-a1b0a0534881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0313aa2b-c237-41f0-b6fe-5eee8c62e168", "name": "network-vif-deleted", "tag": "e72d65ea-e118-40e5-a25a-c90efdea23d3"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:47.850019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c01f1684-939b-4972-887a-79bc2d3f13ec req-0c6a9156-2803-4057-ab58-a1b0a0534881 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:47.850726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c01f1684-939b-4972-887a-79bc2d3f13ec req-0c6a9156-2803-4057-ab58-a1b0a0534881 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:47.851112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c01f1684-939b-4972-887a-79bc2d3f13ec req-0c6a9156-2803-4057-ab58-a1b0a0534881 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:47.919318 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c01f1684-939b-4972-887a-79bc2d3f13ec req-0c6a9156-2803-4057-ab58-a1b0a0534881 service nova] Creating event network-vif-deleted:e72d65ea-e118-40e5-a25a-c90efdea23d3 for instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 on n-h1-862355-1 Oct 25 03:26:47.948167 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c01f1684-939b-4972-887a-79bc2d3f13ec req-0c6a9156-2803-4057-ab58-a1b0a0534881 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156540 Oct 25 03:26:47.954665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:47.958043 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2505/4876] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:26:47.965545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:47.966295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:47.990149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:47.991804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:47.994164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:47.995092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:47.995707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:47.996308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:48.026718 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-de9dc711-232a-4e7d-8b0b-0d5b746d08b3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1272 microversion: 2.1 time: 0.472500 Oct 25 03:26:48.028800 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2372/4877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:47 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1272 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:48.392349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:48.394111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:48.409967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:48.412680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:48.414601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:48.416357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:48.418360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:48.419908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:48.989058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:49.001789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:49.004227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:49.008237 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dab3be90-ad07-4c1a-a0b0-fa100314a728 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.619596 Oct 25 03:26:49.017634 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2373/4878] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:48 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:26:49.022637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb086542-6235-4e7c-b760-4765eb0143d7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3280c5e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:49.104448 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb086542-6235-4e7c-b760-4765eb0143d7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.082793 Oct 25 03:26:49.105393 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2374/4879] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:49 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:49.124920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:49.126353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:49.134203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:49.134963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:49.135612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:49.136630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:49.137298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:49.138155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:49.249458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:49.257371 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-38b2e418-d322-416f-b82d-05320eead1da tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1275 microversion: 2.1 time: 0.150884 Oct 25 03:26:49.258127 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2375/4880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:49 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:49.276732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:49.279023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:49.299161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:49.300159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:49.311444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:49.314426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:49.315493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:49.318700 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ad921af-c853-43b5-9254-5705d86cdc73 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 1.355549 Oct 25 03:26:49.319761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:49.320737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:49.338876 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2506/4881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:47 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:49.358199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53e0bed3-4ebd-49af-8759-34d4043454c8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:49.375925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-53e0bed3-4ebd-49af-8759-34d4043454c8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 3d23f81a-f0fb-43bb-93c9-b02e483e16e6 has no mapping to a cell. Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53e0bed3-4ebd-49af-8759-34d4043454c8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/3d23f81a-f0fb-43bb-93c9-b02e483e16e6/action HTTP/1.1 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: {"os-stop": {}} Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 3d23f81a-f0fb-43bb-93c9-b02e483e16e6 has no mapping to a cell. Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '3d23f81a-f0fb-43bb-93c9-b02e483e16e6', 'body': {'os-stop': {}}} Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 3d23f81a-f0fb-43bb-93c9-b02e483e16e6 has no mapping to a cell. Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:26:49.389836 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d23f81a-f0fb-43bb-93c9-b02e483e16e6 has no mapping to a cell. Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d23f81a-f0fb-43bb-93c9-b02e483e16e6 has no mapping to a cell. Oct 25 03:26:49.393901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:49.396241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53e0bed3-4ebd-49af-8759-34d4043454c8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 3d23f81a-f0fb-43bb-93c9-b02e483e16e6 has no mapping to a cell. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:26:49.397448 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53e0bed3-4ebd-49af-8759-34d4043454c8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/3d23f81a-f0fb-43bb-93c9-b02e483e16e6/action" status: 404 len: 117 microversion: 2.1 time: 0.050368 Oct 25 03:26:49.405174 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2507/4882] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:49 2022] POST /compute/v2.1/servers/3d23f81a-f0fb-43bb-93c9-b02e483e16e6/action => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:26:49.416224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:49.423901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:49.450318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:49.451798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:49.463272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:49.467921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:49.468581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:49.469208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:49.565369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:49.579053 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-258aa72a-a29a-4ffd-ba76-902a78b093d4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1272 microversion: 2.1 time: 0.319497 Oct 25 03:26:49.582385 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2376/4883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:49 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:50.045411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:50.046406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:50.064256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:50.071867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:50.076093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:50.082102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:50.082818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:50.087836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:50.515244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:50.539875 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af668815-2da8-418d-a436-93b64a709169 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 1.131760 Oct 25 03:26:50.543093 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2508/4884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:49 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:50.576114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a80f33d3-3f44-460b-bada-6182558a19fb tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33ee7ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:50.667096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a80f33d3-3f44-460b-bada-6182558a19fb tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.122762 Oct 25 03:26:50.674123 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2509/4885] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:50 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:50.685517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:50.694238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:50.710153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:50.711321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:50.726346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:50.728018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:50.738400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:50.738858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:50.854339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:50.864219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:50.865802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:50.875074 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ea57df0-1ad6-40bc-927e-5786f6193d54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.833743 Oct 25 03:26:50.880174 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2377/4886] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:50 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:50.891713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:50.910743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:50.930857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:50.931392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:50.931838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:50.934061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:50.934655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:50.935879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:51.135273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:51.146602 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8076e4d3-0839-4a9f-b44d-b55531857fd7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1275 microversion: 2.1 time: 0.471312 Oct 25 03:26:51.158097 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2510/4887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:50 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1275 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:51.165054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:51.165731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:51.210020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:51.213983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:51.220867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:51.221514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:51.222575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:51.223193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:51.223778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:51.229516 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f353c1e-1f36-45be-86c3-f0e89e9f6d08 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.344644 Oct 25 03:26:51.237813 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2378/4888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:50 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:51.255863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d5b8228-f78b-4f96-b189-b1c49ee3197d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:51.256831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7d5b8228-f78b-4f96-b189-b1c49ee3197d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 1ead20da-7046-4c07-a3f2-0f59c50c85b4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:51.273097 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-7d5b8228-f78b-4f96-b189-b1c49ee3197d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 1ead20da-7046-4c07-a3f2-0f59c50c85b4 could not be found. Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d5b8228-f78b-4f96-b189-b1c49ee3197d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/1ead20da-7046-4c07-a3f2-0f59c50c85b4/action HTTP/1.1 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 15 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: {"suspend": {}} Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 1ead20da-7046-4c07-a3f2-0f59c50c85b4 could not be found. Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1ead20da-7046-4c07-a3f2-0f59c50c85b4', 'body': {'suspend': {}}} Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ead20da-7046-4c07-a3f2-0f59c50c85b4 could not be found. Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ead20da-7046-4c07-a3f2-0f59c50c85b4 could not be found. Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:51.283948 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:51.289528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:26:51.289528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:26:51.289528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ead20da-7046-4c07-a3f2-0f59c50c85b4 could not be found. Oct 25 03:26:51.289528 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:26:51.289528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d5b8228-f78b-4f96-b189-b1c49ee3197d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 1ead20da-7046-4c07-a3f2-0f59c50c85b4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:26:51.291572 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7d5b8228-f78b-4f96-b189-b1c49ee3197d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/1ead20da-7046-4c07-a3f2-0f59c50c85b4/action" status: 404 len: 111 microversion: 2.1 time: 0.039812 Oct 25 03:26:51.294035 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2379/4889] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:51 2022] POST /compute/v2.1/servers/1ead20da-7046-4c07-a3f2-0f59c50c85b4/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:26:51.310945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:51.323231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:51.383845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:51.385782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:51.401173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:51.417327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:51.418545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:51.419135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:51.723278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:51.740261 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8282bb16-223d-4cca-a629-f269b9a9e9c7 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.436548 Oct 25 03:26:51.765053 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2380/4890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:51 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:51.772147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4243ee0e-2521-472c-8380-980389ca02f1 req-510cc4d6-9988-405c-b842-eb716b64f665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "607eba3e-2e4d-4aad-9dcd-a91d25ed665d", "tag": "892d2ec9-9480-448e-9f12-bdc878a287e5"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:51.832234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4243ee0e-2521-472c-8380-980389ca02f1 req-510cc4d6-9988-405c-b842-eb716b64f665 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:51.832749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4243ee0e-2521-472c-8380-980389ca02f1 req-510cc4d6-9988-405c-b842-eb716b64f665 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:51.834933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4243ee0e-2521-472c-8380-980389ca02f1 req-510cc4d6-9988-405c-b842-eb716b64f665 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:51.871053 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4243ee0e-2521-472c-8380-980389ca02f1 req-510cc4d6-9988-405c-b842-eb716b64f665 service nova] Creating event network-changed:892d2ec9-9480-448e-9f12-bdc878a287e5 for instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d on n-h2-862355-1 Oct 25 03:26:51.883628 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4243ee0e-2521-472c-8380-980389ca02f1 req-510cc4d6-9988-405c-b842-eb716b64f665 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115299 Oct 25 03:26:51.884572 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2381/4891] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:26:51.895425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be08dcae-a299-4ee4-a6cd-690b2009a6b8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32813820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:51.982564 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-be08dcae-a299-4ee4-a6cd-690b2009a6b8 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1455 microversion: 2.1 time: 0.096722 Oct 25 03:26:51.989130 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2382/4892] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:51 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:52.008057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:52.008875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:52.044257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:52.044814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:52.050844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:52.051669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:52.053128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:52.053650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:52.194035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:52.221601 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5dd1846f-5d67-4284-b11c-b6dfffa6df01 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 1.053867 Oct 25 03:26:52.222543 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2511/4893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:51 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:52.263525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:52.269048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:52.296608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:52.297280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:52.298228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:52.299078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:52.299647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:52.304507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:52.795827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:52.811586 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c3e8133-e6af-4cdd-8c39-72b917227727 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.816959 Oct 25 03:26:52.814115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2383/4894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:51 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:52.828311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:52.840123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:52.858216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:52.858777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:52.863993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:52.864787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:52.865262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:52.871124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.156478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:53.169599 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba5be30b-33a2-4dc3-95c6-318aee30376b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.353635 Oct 25 03:26:53.182987 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2384/4895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:52 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:53.194526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:53.195931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:53.204472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.204976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.205423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.207246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.207877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.209244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.249464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lazy-loading 'flavor' on Instance uuid 01ad2d83-3644-4094-9f43-2cfcb61f180c {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:26:53.262016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:53.366525 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa6ab273-3eba-4493-89c0-25ae11a82c54 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 202 len: 0 microversion: 2.1 time: 0.175031 Oct 25 03:26:53.372906 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2385/4896] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:53 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:26:53.380575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07585322-ea07-4f9a-a45b-aaa79017c004 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd332f5040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:53.451120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:53.483534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:53.486411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:53.486966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07585322-ea07-4f9a-a45b-aaa79017c004 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1464 microversion: 2.1 time: 0.106019 Oct 25 03:26:53.488822 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2386/4897] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:53 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1464 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:53.490365 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1abe20be-63bb-4b01-932b-360702d0607a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 1.265038 Oct 25 03:26:53.506820 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2512/4898] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:52 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:53.510265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:53.513248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:53.515910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:53.516765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:53.525291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.526312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.526943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.527075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.527587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.528103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.528356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.528991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.529551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.529838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.530212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.530871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.827672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:53.834029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:53.836742 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-940404d8-4d4b-4233-b860-733d4a611048 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.345239 Oct 25 03:26:53.837355 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2387/4899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:53 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:53.841776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce1679d3-2e83-4a4a-a445-0b7f198547bf tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32850f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:53.909325 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce1679d3-2e83-4a4a-a445-0b7f198547bf tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 200 len: 1464 microversion: 2.1 time: 0.069355 Oct 25 03:26:53.910840 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2388/4900] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:53 2022] GET /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 1464 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:53.935372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:53.936449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:53.952695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.953353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.954051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:53.955027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:53.955721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:53.957340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.043441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:54.048243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:54.067590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0386e4a4-9960-464c-be67-e703b3e7254c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1513 microversion: 2.1 time: 0.559494 Oct 25 03:26:54.071845 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2513/4901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:53 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1513 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:54.201331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:54.202670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:54.211836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.212878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.223314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.224770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.226920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.227599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.269333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:54.301069 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a8d0cf5-faaf-42fe-9fd8-622b00a45355 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1468 microversion: 2.1 time: 0.361133 Oct 25 03:26:54.318688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2389/4902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:53 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1468 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:54.329263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1105715196"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:54.331843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:54.339907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.340451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.340920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.341696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.342318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.342931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.391002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:54.628568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:54.644446 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67a046f2-ca0e-46d9-abc0-ae541d715a39 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.451843 Oct 25 03:26:54.650883 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2514/4903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:54 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:54.656712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:54.658380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:54.666563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.667605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.668206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.668907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.669359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.669826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.680401 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5408127-05ff-4b8b-8c4b-481dd0d8e113 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "POST /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92/action" status: 202 len: 0 microversion: 2.1 time: 0.355816 Oct 25 03:26:54.681435 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2390/4904] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:54 2022] POST /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 25 03:26:54.696913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fdd3980d-c517-4178-a2b5-2bae370bbdcf tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32875670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:54.808700 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fdd3980d-c517-4178-a2b5-2bae370bbdcf tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.117697 Oct 25 03:26:54.816893 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2391/4905] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:54 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:54.863866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:54.868610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:54.880773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.882297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.883792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:54.885033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:54.885732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:54.886457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.091407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:55.128327 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-915f1942-f30e-4178-9198-98d800890583 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.271515 Oct 25 03:26:55.128953 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2392/4906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:54 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:55.141515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:55.142252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:55.151082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.157511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.158173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.159361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.160666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.161243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.182837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:55.200012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:55.201493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:55.202682 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-176763c1-ae66-42e9-97b8-a235fde0c6a2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.550598 Oct 25 03:26:55.203237 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2515/4907] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:54 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:55.365611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:55.378737 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c2fc30d-4846-4e9b-938c-66db3e2141cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1496 microversion: 2.1 time: 0.240678 Oct 25 03:26:55.379534 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2393/4908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:55 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1496 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:55.407652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:55.408662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:55.416360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.420535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.421209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.422435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.423100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.423747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.443826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-8117b1fa-e2c6-400e-a554-0ee79dcf86f7 req-02fac4b3-f68d-42ac-a00b-95a956a5ba22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c", "tag": "8fc3a922-6bce-4335-9197-ddc6012d6923"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:55.464619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8117b1fa-e2c6-400e-a554-0ee79dcf86f7 req-02fac4b3-f68d-42ac-a00b-95a956a5ba22 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.465112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8117b1fa-e2c6-400e-a554-0ee79dcf86f7 req-02fac4b3-f68d-42ac-a00b-95a956a5ba22 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.465545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8117b1fa-e2c6-400e-a554-0ee79dcf86f7 req-02fac4b3-f68d-42ac-a00b-95a956a5ba22 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.486974 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-8117b1fa-e2c6-400e-a554-0ee79dcf86f7 req-02fac4b3-f68d-42ac-a00b-95a956a5ba22 service nova] Creating event network-changed:8fc3a922-6bce-4335-9197-ddc6012d6923 for instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c on n-h2-862355-1 Oct 25 03:26:55.501869 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-8117b1fa-e2c6-400e-a554-0ee79dcf86f7 req-02fac4b3-f68d-42ac-a00b-95a956a5ba22 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063187 Oct 25 03:26:55.503656 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2394/4909] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:26:55.513839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lazy-loading 'flavor' on Instance uuid 01ad2d83-3644-4094-9f43-2cfcb61f180c {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:26:55.533868 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Cannot 'suspend' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state suspended Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action HTTP/1.1 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: {"suspend": {}} Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'suspend' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state suspended Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'suspend': {}}} Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c in vm_state suspended. Cannot suspend while the instance is in this state. Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 25 03:26:55.536240 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state suspended Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state suspended Oct 25 03:26:55.540238 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:55.543855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 409 to user: Cannot 'suspend' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state suspended {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:26:55.545059 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-385499f7-df6c-416d-af17-ee25cb19145e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 409 len: 148 microversion: 2.1 time: 0.141763 Oct 25 03:26:55.546949 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2516/4910] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:55 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 148 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:26:55.557857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:55.558644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:55.562933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:55.567043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.567764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.568409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.569449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.570741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.571377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.649628 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c04f5e0-17f1-40fe-b7d9-7f817e14f366 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 202 len: 0 microversion: 2.1 time: 0.097738 Oct 25 03:26:55.651090 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2395/4911] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:55 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:26:55.659012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:55.660195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:55.662681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:55.671117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.671724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.672210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.673059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.673695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.674298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.676027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:55.676974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:55.684478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.685509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.686293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:55.687339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:55.691442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:55.692272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:56.019179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:56.019485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:56.032053 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56736556-fb79-4ffc-bbd3-080fa99351cc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1502 microversion: 2.1 time: 0.376919 Oct 25 03:26:56.033508 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2517/4912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:55 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1502 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:56.040497 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6058f9c3-dc2e-4cc5-8c33-3d3a9821f303 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.362173 Oct 25 03:26:56.041021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67adf829-a7dd-4e64-88d6-c4ffff2fef83 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33ee7820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:56.059359 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2396/4913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:55 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:56.119479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67adf829-a7dd-4e64-88d6-c4ffff2fef83 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.084208 Oct 25 03:26:56.120515 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2518/4914] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:56 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:56.154858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:56.156171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:56.164957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:56.165598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:56.171297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:56.171297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:56.180396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:56.180396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:56.180396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=14 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:26:56.233565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:56.234499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:56.262734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:56.263481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:56.264087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:56.265115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:56.266158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:56.266734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:56.457283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:56.467006 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b64feb89-1432-4664-8a25-decfb58e31cf tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.316369 Oct 25 03:26:56.479270 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2397/4915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:56 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:56.876361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:56.886839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:56.888302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:56.889439 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-663e6086-c5ef-4485-b9b1-9a7d46632eaf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.660247 Oct 25 03:26:56.890730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2519/4916] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:56 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:57.061254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:57.062337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:57.067492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:57.068131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:57.070642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.071387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.072042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.072985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.073692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.074489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.081525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.082695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.083572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.083863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.084327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.084764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.253183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:57.262796 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7660e200-a95c-4716-b5ee-3ddb985c36db tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1502 microversion: 2.1 time: 0.206579 Oct 25 03:26:57.263393 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2398/4917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:57 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1502 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:57.271109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-8aa8ad24-9de8-400e-ab60-a8703435e3d2 req-bf9426ef-4415-44c0-9dfa-e251b380a4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade7b0be-f3d6-4149-91ab-bdac6f1f5547", "name": "network-vif-unplugged", "status": "completed", "tag": "d1f2cbba-3217-49fb-8f52-abbcfedb4c1e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:57.283021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8aa8ad24-9de8-400e-ab60-a8703435e3d2 req-bf9426ef-4415-44c0-9dfa-e251b380a4f9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.283756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8aa8ad24-9de8-400e-ab60-a8703435e3d2 req-bf9426ef-4415-44c0-9dfa-e251b380a4f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.284395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8aa8ad24-9de8-400e-ab60-a8703435e3d2 req-bf9426ef-4415-44c0-9dfa-e251b380a4f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.297799 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-8aa8ad24-9de8-400e-ab60-a8703435e3d2 req-bf9426ef-4415-44c0-9dfa-e251b380a4f9 service nova] Creating event network-vif-unplugged:d1f2cbba-3217-49fb-8f52-abbcfedb4c1e for instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 on n-h2-862355-1 Oct 25 03:26:57.303011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-8aa8ad24-9de8-400e-ab60-a8703435e3d2 req-bf9426ef-4415-44c0-9dfa-e251b380a4f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035702 Oct 25 03:26:57.303980 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2399/4918] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:26:57.309983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-972e82e2-524a-41cd-b40f-0050114443f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33312550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:57.358738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-972e82e2-524a-41cd-b40f-0050114443f7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.053056 Oct 25 03:26:57.359329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2400/4919] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:57 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:57.492064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:57.492827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:57.501897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.502397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.502899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.503668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.504124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.504547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.679996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:57.689495 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-719df59d-4175-4cae-ab07-4ed2e94160d5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.201265 Oct 25 03:26:57.693443 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2401/4920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:57 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:57.709385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-8b849b1d-678d-4fe9-a9a1-d473d2c5219d req-dba27b84-d117-4fce-877a-2232072d6e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadbb6f2-47c6-4821-8699-2564f9f02c92", "tag": "69ceefe2-e00e-4216-bab5-5c7bbd3970ea"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:57.720725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8b849b1d-678d-4fe9-a9a1-d473d2c5219d req-dba27b84-d117-4fce-877a-2232072d6e46 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.721492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8b849b1d-678d-4fe9-a9a1-d473d2c5219d req-dba27b84-d117-4fce-877a-2232072d6e46 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.722131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8b849b1d-678d-4fe9-a9a1-d473d2c5219d req-dba27b84-d117-4fce-877a-2232072d6e46 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.735330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-8b849b1d-678d-4fe9-a9a1-d473d2c5219d req-dba27b84-d117-4fce-877a-2232072d6e46 service nova] Creating event network-changed:69ceefe2-e00e-4216-bab5-5c7bbd3970ea for instance eadbb6f2-47c6-4821-8699-2564f9f02c92 on n-h2-862355-1 Oct 25 03:26:57.740122 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-8b849b1d-678d-4fe9-a9a1-d473d2c5219d req-dba27b84-d117-4fce-877a-2232072d6e46 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045522 Oct 25 03:26:57.740768 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2402/4921] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:26:57.900630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:57.911820 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6d21592c-e413-40f6-a83f-d6314b3d4320 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.848646 Oct 25 03:26:57.912783 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2520/4922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:57 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:57.915719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:57.916423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:57.928293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.929405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.930791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:57.932653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:57.933638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:57.934356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:58.292861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:58.293361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:58.294717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:58.317305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:58.319847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:58.324413 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-201e4bb1-db35-4be4-b9f4-a669444c31ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.411397 Oct 25 03:26:58.326190 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2403/4923] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:57 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:26:58.332297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:58.336399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:58.336992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:58.338578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:58.339054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:58.342760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:58.374889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02b75e16-2a6a-459c-b0a0-0e9f0cf7d72d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32813430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:58.465509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02b75e16-2a6a-459c-b0a0-0e9f0cf7d72d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.094445 Oct 25 03:26:58.466666 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2404/4924] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:58 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:58.704899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:58.717103 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ea5bb4c-0aee-4fc8-9ac0-02d99dfe3f8f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.433254 Oct 25 03:26:58.717718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2521/4925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:58 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:58.717834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:58.718436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:58.729278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:58.730066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:58.730521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:58.731603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:58.732194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:58.732850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:58.743006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:58.743892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:58.750844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:58.751331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:58.751944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:58.752819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:58.761445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:58.763268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:58.964731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:58.973473 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8e3e795-73cb-4140-9ea7-68e6da5dfc69 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.260250 Oct 25 03:26:58.975802 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2405/4926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:58 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:58.990142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:58.990142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:59.009752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:59.025459 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f1052ed-7a39-4a25-9b89-9d992b1fe978 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.286505 Oct 25 03:26:59.026501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.026617 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2522/4927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:58 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:59.027663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.030438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.031463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.032102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.032733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.055255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c8df56c-c74f-4fe9-8563-27f1146958e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:26:59.056141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c8df56c-c74f-4fe9-8563-27f1146958e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 6408bfdb-1667-4790-bcfe-06f2d0d8aa6e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:59.062587 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3c8df56c-c74f-4fe9-8563-27f1146958e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 6408bfdb-1667-4790-bcfe-06f2d0d8aa6e could not be found. Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c8df56c-c74f-4fe9-8563-27f1146958e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/6408bfdb-1667-4790-bcfe-06f2d0d8aa6e/action HTTP/1.1 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: {"unpause": {}} Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6408bfdb-1667-4790-bcfe-06f2d0d8aa6e could not be found. Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6408bfdb-1667-4790-bcfe-06f2d0d8aa6e', 'body': {'unpause': {}}} Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6408bfdb-1667-4790-bcfe-06f2d0d8aa6e could not be found. Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6408bfdb-1667-4790-bcfe-06f2d0d8aa6e could not be found. Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:26:59.064794 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:26:59.069295 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:26:59.069295 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:26:59.069295 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6408bfdb-1667-4790-bcfe-06f2d0d8aa6e could not be found. Oct 25 03:26:59.069295 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:26:59.069295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c8df56c-c74f-4fe9-8563-27f1146958e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 6408bfdb-1667-4790-bcfe-06f2d0d8aa6e could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:26:59.069295 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c8df56c-c74f-4fe9-8563-27f1146958e6 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/6408bfdb-1667-4790-bcfe-06f2d0d8aa6e/action" status: 404 len: 111 microversion: 2.1 time: 0.016335 Oct 25 03:26:59.069295 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2523/4928] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:26:59 2022] POST /compute/v2.1/servers/6408bfdb-1667-4790-bcfe-06f2d0d8aa6e/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:26:59.076012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:59.076775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:59.084824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.086304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.086877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.087832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.088398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.089048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.315033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:59.327487 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15ea4bb4-7f9d-42fe-a0a6-1b8aa15e6b37 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.352252 Oct 25 03:26:59.328735 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2406/4929] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:58 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:59.351065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:59.352903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:59.359640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.360213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.360718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.361481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.362028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.362516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.501301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:59.514359 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3a1cecad-ad2a-4002-851c-0860be0bf39f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.440215 Oct 25 03:26:59.515393 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2524/4930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:59 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:26:59.546915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-519bea9a-f7c5-47c8-aeb5-1700ce61ae5b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd337ad040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:59.654757 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-519bea9a-f7c5-47c8-aeb5-1700ce61ae5b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.120850 Oct 25 03:26:59.681746 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2525/4931] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:26:59 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:26:59.700795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:59.701988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:26:59.715213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.716215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.716883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.719486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:26:59.720221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:26:59.720874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:26:59.771657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:59.797235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:59.800083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:26:59.801254 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-811d1fdc-d3f3-4420-a6a7-e910296f5e4b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.454198 Oct 25 03:26:59.802158 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2407/4932] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:26:59 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:26:59.998468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:26:59.999347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:00.015578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.018885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.024922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.025940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.026600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.028817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.041356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:00.061654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:00.073612 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-539dcc48-6ea2-4851-b07c-b2a5effce8e2 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.378019 Oct 25 03:27:00.084191 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2526/4933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:59 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:00.112626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:00.122244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:00.148292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.150461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.151127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.152453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.156676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.157408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.209903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Cannot 'unpause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action HTTP/1.1 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 15 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: {"unpause": {}} Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'unpause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'unpause': {}}} Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c in vm_state active. Cannot unpause while the instance is in this state. Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:00.230659 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:00.234321 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:00.234321 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:00.234321 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:00.234321 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:00.234321 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:00.236805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 409 to user: Cannot 'unpause' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:00.237939 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9f50b4e-933e-42a2-a630-865c5ebf38e1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 409 len: 145 microversion: 2.1 time: 0.129572 Oct 25 03:27:00.246145 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2527/4934] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:27:00 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 145 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:27:00.272509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:00.273764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:00.322323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.323827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.324382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.325714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.326883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.327474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.537284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:00.546253 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-62c3fc71-64fd-4c35-bc09-6caecc2d1904 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.551572 Oct 25 03:27:00.577046 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2408/4935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:26:59 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:00.583354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:00.589770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:00.598378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.608483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.608483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.608483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.608483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.608483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.833913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:00.846571 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-742e73a9-1a09-445d-b9f9-781bc49e8f4a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.267477 Oct 25 03:27:00.850771 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2409/4936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:00 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:00.859975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3fe1be86-cd07-41d0-8cf4-5a0291375a9a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f34c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:00.948175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3fe1be86-cd07-41d0-8cf4-5a0291375a9a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.095944 Oct 25 03:27:00.948767 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2410/4937] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:00 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:00.956766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:00.957378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:00.979289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.979785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.983487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:00.984335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:00.988608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:00.989097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.128354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:01.138566 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7e5b9bb-ee99-4edf-9e7d-339b1287b000 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.890942 Oct 25 03:27:01.141122 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2528/4938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:00 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:01.167586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:01.170595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:01.201585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.202251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.202803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.220427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.224415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.226887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.312234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:01.322380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:01.326672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:01.328158 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a95d9524-39c5-4086-965c-3f27af2faa98 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.378448 Oct 25 03:27:01.335234 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2411/4939] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:27:00 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:27:01.533466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:01.547888 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-834a6812-6902-42e4-8b83-cb2c226e6558 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.381342 Oct 25 03:27:01.549266 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2529/4940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:01 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:01.580491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11d494ee-1779-45d9-bef7-5715003b81fa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:01.583452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11d494ee-1779-45d9-bef7-5715003b81fa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: c1a96a35-946f-4ec5-a430-200c5330765e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:01.591155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:01.591909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:01.609391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.609949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.612277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.613038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.614696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.615271 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-11d494ee-1779-45d9-bef7-5715003b81fa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance c1a96a35-946f-4ec5-a430-200c5330765e could not be found. Oct 25 03:27:01.616086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11d494ee-1779-45d9-bef7-5715003b81fa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/c1a96a35-946f-4ec5-a430-200c5330765e/action HTTP/1.1 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 18 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: {"unshelve": null} Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c1a96a35-946f-4ec5-a430-200c5330765e could not be found. Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c1a96a35-946f-4ec5-a430-200c5330765e', 'body': {'unshelve': None}} Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a96a35-946f-4ec5-a430-200c5330765e could not be found. Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a96a35-946f-4ec5-a430-200c5330765e could not be found. Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:01.620733 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a96a35-946f-4ec5-a430-200c5330765e could not be found. Oct 25 03:27:01.624983 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:01.629437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11d494ee-1779-45d9-bef7-5715003b81fa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance c1a96a35-946f-4ec5-a430-200c5330765e could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:01.634669 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11d494ee-1779-45d9-bef7-5715003b81fa tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/c1a96a35-946f-4ec5-a430-200c5330765e/action" status: 404 len: 111 microversion: 2.1 time: 0.061036 Oct 25 03:27:01.639288 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2412/4941] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:27:01 2022] POST /compute/v2.1/servers/c1a96a35-946f-4ec5-a430-200c5330765e/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:27:01.644386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:01.658584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:01.672010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.686048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.688685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.689862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.692583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.693396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.931180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:01.940900 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-30be7553-12ff-4cc9-9de7-5fcf69386885 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.300390 Oct 25 03:27:01.942028 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2413/4942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:01 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:01.947522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:01.948394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:01.955339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.955912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.957627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:01.957627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:01.958556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:01.959009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.241555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:02.252180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-415c2a4e-8fef-41f1-abb5-d95d0b2606dc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.308801 Oct 25 03:27:02.253313 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2414/4943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:01 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:02.281075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f91ffbc-95f5-45ff-8871-f7aaec7f56b6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f35e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:02.392578 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f91ffbc-95f5-45ff-8871-f7aaec7f56b6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.125194 Oct 25 03:27:02.393181 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2415/4944] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:02 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:02.408154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:02.408154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:02.424921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.425242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.425702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.426411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.442416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.442879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.543572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:02.552649 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63ccc127-3b94-4ad7-927d-cc94eea8c753 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.975901 Oct 25 03:27:02.553264 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2530/4945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:01 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:02.569495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:02.571229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:02.602820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.607219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.607751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.609988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.610401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.621458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.683681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:02.701799 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5cc9ca6f-dfec-44ee-9ce7-c340e897347f tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.307399 Oct 25 03:27:02.703883 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2416/4946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:02 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:02.732753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:02.733650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:02.751092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.751092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.751092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.755340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.758302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.761327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.802618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Cannot 'unshelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action HTTP/1.1 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 18 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: {"unshelve": null} Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: exception: Cannot 'unshelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'unshelve': None}} Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c in vm_state active. Cannot unshelve while the instance is in this state. Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:27:02.804606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:02.809410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 409 to user: Cannot 'unshelve' instance 01ad2d83-3644-4094-9f43-2cfcb61f180c while it is in vm_state active {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:02.810912 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02c62aad-313c-49b8-bfaf-6f1dc3a7a24e tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action" status: 409 len: 146 microversion: 2.1 time: 0.084375 Oct 25 03:27:02.814571 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2417/4947] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:27:02 2022] POST /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c/action => generated 146 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:27:02.821233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:02.822096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:02.863929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.864826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.865417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:02.866558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:02.867499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:02.868242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:03.136058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:03.147624 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ffbc4508-90ad-453e-af41-0b08160398dc tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.331322 Oct 25 03:27:03.151183 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2418/4948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:02 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:03.179005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:03.180280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:03.191926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:03.192423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:03.192858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:03.193568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:03.196017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:03.196552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:03.483735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:03.495512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:03.496958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:03.521342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:03.536001 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7951ea12-a6e5-43da-b03c-87f1c98665ca tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.980222 Oct 25 03:27:03.542268 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2531/4949] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:27:02 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:27:03.548948 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f6dbc4c-3d01-4f50-89c2-4c4e5a786eb1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.369547 Oct 25 03:27:03.562781 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2419/4950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:03 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:03.574755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:03.575501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:03.583544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e0f1cf6b-1d4a-4ce2-b244-247f66eb77ab tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f9ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:03.596369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:03.596879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:03.597325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:03.598075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:03.605854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:03.606496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:03.643116 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e0f1cf6b-1d4a-4ce2-b244-247f66eb77ab tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.089269 Oct 25 03:27:03.643969 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2420/4951] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:03 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:03.650002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d73c558-4fa9-4e33-926d-4e6b99f1005d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-606113284_updated"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:03.653237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8d73c558-4fa9-4e33-926d-4e6b99f1005d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: fc564bd1-363b-481e-ab67-914aa7b616c2] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:03.659115 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-8d73c558-4fa9-4e33-926d-4e6b99f1005d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance fc564bd1-363b-481e-ab67-914aa7b616c2 could not be found. Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d73c558-4fa9-4e33-926d-4e6b99f1005d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/servers/fc564bd1-363b-481e-ab67-914aa7b616c2 HTTP/1.1 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 80 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-606113284_updated"}} Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fc564bd1-363b-481e-ab67-914aa7b616c2 could not be found. Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fc564bd1-363b-481e-ab67-914aa7b616c2', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-606113284_updated'}}} Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc564bd1-363b-481e-ab67-914aa7b616c2 could not be found. Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 25 03:27:03.661003 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc564bd1-363b-481e-ab67-914aa7b616c2 could not be found. Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc564bd1-363b-481e-ab67-914aa7b616c2 could not be found. Oct 25 03:27:03.665030 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:03.680321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d73c558-4fa9-4e33-926d-4e6b99f1005d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance fc564bd1-363b-481e-ab67-914aa7b616c2 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:03.681525 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d73c558-4fa9-4e33-926d-4e6b99f1005d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "PUT /compute/v2.1/servers/fc564bd1-363b-481e-ab67-914aa7b616c2" status: 404 len: 111 microversion: 2.1 time: 0.036444 Oct 25 03:27:03.684825 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2421/4952] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:27:03 2022] PUT /compute/v2.1/servers/fc564bd1-363b-481e-ab67-914aa7b616c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:27:03.698778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:03.699797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:03.716241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:03.716989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:03.717648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:03.718603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:03.719260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:03.719885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:03.974932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:03.987808 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9cb98439-21ab-4c2e-8867-efc07dbfc2cc tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.301148 Oct 25 03:27:03.988408 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2422/4953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:03 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:04.000656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:04.008016 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53276592-e542-48c0-9a03-bdffa81dae1f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.462797 Oct 25 03:27:04.011823 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2532/4954] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:03 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:04.018263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:04.018944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:04.032909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.033406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.034334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-cd6ee700-c2b7-4355-8448-5ed52041ed6b req-1660e528-3844-410a-8458-d5b1fb75e33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607eba3e-2e4d-4aad-9dcd-a91d25ed665d", "name": "network-vif-plugged", "status": "completed", "tag": "892d2ec9-9480-448e-9f12-bdc878a287e5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:04.037419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.038196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.039232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.039871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.053376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cd6ee700-c2b7-4355-8448-5ed52041ed6b req-1660e528-3844-410a-8458-d5b1fb75e33c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.056095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cd6ee700-c2b7-4355-8448-5ed52041ed6b req-1660e528-3844-410a-8458-d5b1fb75e33c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.056725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cd6ee700-c2b7-4355-8448-5ed52041ed6b req-1660e528-3844-410a-8458-d5b1fb75e33c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.091084 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-cd6ee700-c2b7-4355-8448-5ed52041ed6b req-1660e528-3844-410a-8458-d5b1fb75e33c service nova] Creating event network-vif-plugged:892d2ec9-9480-448e-9f12-bdc878a287e5 for instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d on n-h2-862355-1 Oct 25 03:27:04.100889 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-cd6ee700-c2b7-4355-8448-5ed52041ed6b req-1660e528-3844-410a-8458-d5b1fb75e33c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081983 Oct 25 03:27:04.108018 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2533/4955] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:04.322398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:04.347280 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f9776f7a-0b2c-4841-9bd5-ccb39084c93d tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.334378 Oct 25 03:27:04.355425 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2423/4956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:03 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:04.375095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:04.376221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:04.391379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.391897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.392346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.393073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.393539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.394006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.438110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:04.568726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:04.569740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:04.583631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.587256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.587971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.598832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.599682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.600363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.832735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:04.858254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:04.860003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:04.860528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:04.863772 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b50169a-8d0f-46a5-a062-250afc7c6730 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.299181 Oct 25 03:27:04.864666 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2424/4957] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:27:04 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:27:04.869848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb34f42f-1b80-4615-8a71-ac344a157fe7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f33a0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:04.876401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47905433-eb15-4c9f-9981-6a7c159217d0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.505179 Oct 25 03:27:04.891749 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2534/4958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:04 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:04.921716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a389ae1-6017-4ad2-99c5-2f7476cfb0bb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a389ae1-6017-4ad2-99c5-2f7476cfb0bb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: request: PUT /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c HTTP/1.1 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 280 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:04.926229 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 25 03:27:04.929154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:04.933397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a389ae1-6017-4ad2-99c5-2f7476cfb0bb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:04.936809 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a389ae1-6017-4ad2-99c5-2f7476cfb0bb tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "PUT /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 400 len: 619 microversion: 2.1 time: 0.027089 Oct 25 03:27:04.938051 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2535/4959] 10.222.0.36 () {60 vars in 1257 bytes} [Tue Oct 25 03:27:04 2022] PUT /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:27:04.965548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:04.969575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:04.985247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.986104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.986805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.987793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:04.988459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:04.989083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:04.991125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb34f42f-1b80-4615-8a71-ac344a157fe7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.124962 Oct 25 03:27:04.991715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2425/4960] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:04 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:05.022665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:05.025827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:05.049609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.050417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.055735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:05.057481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.059169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.059628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:05.307823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:05.321621 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-26590b3a-9974-41ba-acb6-8dd197bc7f91 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.378615 Oct 25 03:27:05.325475 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2536/4961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:04 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:05.336513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:05.337542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:05.353982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.355351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.358125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:05.359185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.359804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.363645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:05.640873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:05.650239 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1c730793-45c4-4b92-bba7-7f3462df4bc6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.323130 Oct 25 03:27:05.650445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:05.654236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2537/4962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:05 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:05.660181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:05.667040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:05.675265 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0fc951df-f03e-4b9d-b7dc-2ecc63ac1a2b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.663738 Oct 25 03:27:05.676117 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2426/4963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:05 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:05.685917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.685917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.685917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:05.685917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.686240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.686501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:05.892666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:05.893474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:05.910408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.911122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.912200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:05.913111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:05.914360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:05.914946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:06.119639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:06.130702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:06.133521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:06.135537 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f9a04004-8706-4845-bdc2-aedbbdad3991 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.246826 Oct 25 03:27:06.136401 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2427/4964] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:27:05 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:27:06.142310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47bebbe7-7fb9-4f60-9975-52dbf88198b1 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f3160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:06.206866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:06.228770 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6bfcdd03-877b-48e5-b152-4d30155e4f68 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.572273 Oct 25 03:27:06.229243 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2538/4965] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:05 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:06.236712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47bebbe7-7fb9-4f60-9975-52dbf88198b1 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.099039 Oct 25 03:27:06.237651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6e953708-7b3e-450d-b7b1-ab750519797f req-40026e91-b643-48e4-aeb7-81b49ffcdd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96fd4fd-b50c-485c-a521-34fa71082f92", "name": "network-vif-plugged", "status": "completed", "tag": "36ae65b4-6263-4fdc-911f-5659139037d7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:06.237843 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2428/4966] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:06 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:06.255370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ceb7bf5-929c-44c9-b55c-e67ab0a7ebe0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:06.260706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6e953708-7b3e-450d-b7b1-ab750519797f req-40026e91-b643-48e4-aeb7-81b49ffcdd12 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:06.261408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6e953708-7b3e-450d-b7b1-ab750519797f req-40026e91-b643-48e4-aeb7-81b49ffcdd12 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:06.262383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6e953708-7b3e-450d-b7b1-ab750519797f req-40026e91-b643-48e4-aeb7-81b49ffcdd12 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ceb7bf5-929c-44c9-b55c-e67ab0a7ebe0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c HTTP/1.1 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 24 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": ""}} Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c', 'body': {'server': {'name': ''}}} Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi '' Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:27:06.277351 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:06.282160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ceb7bf5-929c-44c9-b55c-e67ab0a7ebe0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:06.282756 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6e953708-7b3e-450d-b7b1-ab750519797f req-40026e91-b643-48e4-aeb7-81b49ffcdd12 service nova] Creating event network-vif-plugged:36ae65b4-6263-4fdc-911f-5659139037d7 for instance c96fd4fd-b50c-485c-a521-34fa71082f92 on n-h1-862355-1 Oct 25 03:27:06.283601 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6e953708-7b3e-450d-b7b1-ab750519797f req-40026e91-b643-48e4-aeb7-81b49ffcdd12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052844 Oct 25 03:27:06.284225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2539/4967] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:06.285173 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ceb7bf5-929c-44c9-b55c-e67ab0a7ebe0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "PUT /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 400 len: 108 microversion: 2.1 time: 0.034261 Oct 25 03:27:06.285798 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2429/4968] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:27:06 2022] PUT /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:27:06.306136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:06.309142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:06.324352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:06.325181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:06.326742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:06.330668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:06.331402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:06.332035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:06.682944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:06.683520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:06.706439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:06.707366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:06.713059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:06.721844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:06.722722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:06.723393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:06.766520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:06.779789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28ec0f8c-f47f-4611-9c6d-bfa32d958050 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1505 microversion: 2.1 time: 0.484605 Oct 25 03:27:06.803875 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2540/4969] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:06 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:06.821701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:06.826447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:06.840628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:06.841524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:06.843170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:06.844036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:06.845926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:06.846438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:07.158969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:07.170882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a3f8ff9-4c01-4fce-883f-48e84f42fc17 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.493885 Oct 25 03:27:07.174235 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2430/4970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:06 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:07.192186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:07.193179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:07.204453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:07.205401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:07.206117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:07.208204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:07.208866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:07.211622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:07.523289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:07.534372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:07.535844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:07.538106 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a58054c-6708-413b-95b9-864e1b4d7b0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1406 microversion: 2.20 time: 0.350982 Oct 25 03:27:07.539742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2431/4971] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:27:07 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:27:07.545404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fbfbf2b4-2510-427e-885e-9c0cb25f4c4a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327fa940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:07.615479 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fbfbf2b4-2510-427e-885e-9c0cb25f4c4a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.071218 Oct 25 03:27:07.627661 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2432/4972] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:07 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:07.834268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:07.849522 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66e93703-3de9-4219-9979-83e9a3cd48c3 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 1.046397 Oct 25 03:27:07.866481 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2541/4973] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:06 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:08.201659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:08.202926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:08.219944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:08.224057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:08.226718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:08.228500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:08.231138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:08.233119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:08.387772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5ddbe51a-e13f-46ed-9895-ddd7fe981085 req-800d97af-5cf9-4de8-9455-6d59afb9ed18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadbb6f2-47c6-4821-8699-2564f9f02c92", "name": "network-vif-plugged", "status": "completed", "tag": "69ceefe2-e00e-4216-bab5-5c7bbd3970ea"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:08.413399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:08.421266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ddbe51a-e13f-46ed-9895-ddd7fe981085 req-800d97af-5cf9-4de8-9455-6d59afb9ed18 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:08.422059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ddbe51a-e13f-46ed-9895-ddd7fe981085 req-800d97af-5cf9-4de8-9455-6d59afb9ed18 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:08.422677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ddbe51a-e13f-46ed-9895-ddd7fe981085 req-800d97af-5cf9-4de8-9455-6d59afb9ed18 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:08.455041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5ddbe51a-e13f-46ed-9895-ddd7fe981085 req-800d97af-5cf9-4de8-9455-6d59afb9ed18 service nova] Creating event network-vif-plugged:69ceefe2-e00e-4216-bab5-5c7bbd3970ea for instance eadbb6f2-47c6-4821-8699-2564f9f02c92 on n-h2-862355-1 Oct 25 03:27:08.470757 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5ddbe51a-e13f-46ed-9895-ddd7fe981085 req-800d97af-5cf9-4de8-9455-6d59afb9ed18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088974 Oct 25 03:27:08.472572 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2542/4974] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:08.574086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:08.575109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:08.601962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:08.602806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:08.604298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:08.605512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:08.611792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:08.615173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:08.828579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:08.842065 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50247534-9902-4a13-8d12-2e052269d3ed tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.644854 Oct 25 03:27:08.854131 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2433/4975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:08 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:08.859120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-950ff21c-da2f-45fa-8315-dc0c3182cb6e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327fa280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:08.976762 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-950ff21c-da2f-45fa-8315-dc0c3182cb6e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.120703 Oct 25 03:27:08.989811 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2434/4976] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:08 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:08.997788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:08.998414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:08.999490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:09.015917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:09.016424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:09.016565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:09.016862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:09.017578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:09.018865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:09.020316 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c57c6f6b-74d5-4829-a6db-9275f6e7dfb8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1599 microversion: 2.20 time: 0.452428 Oct 25 03:27:09.021563 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2543/4977] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:27:08 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1599 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:27:09.022281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:09.022738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:09.027958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:09.050848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:09.052286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:09.067355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:09.072363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:09.072994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:09.075938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:09.077270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:09.077880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:09.289127 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ef69a38-6d4e-46e3-8237-09a2d3bff923 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.242882 Oct 25 03:27:09.289773 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2544/4978] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 25 03:27:09 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:27:09.374576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:09.387466 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e4db278-ef66-4c61-967b-8e35acfce8ae tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1314 microversion: 2.1 time: 0.396410 Oct 25 03:27:09.389109 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2435/4979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:08 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:09.868733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:09.869566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:09.887305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:09.888845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:09.891693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:09.892563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:09.895448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:09.897625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:10.000139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01be9412-1a7d-498f-b004-d11d7fb703e5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32869940>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:10.100526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01be9412-1a7d-498f-b004-d11d7fb703e5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.107419 Oct 25 03:27:10.102864 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2436/4980] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:09 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:10.416426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:10.417981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:10.437698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:10.439280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:10.440620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:10.443496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:10.446731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:10.449178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:10.766808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:10.795697 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-624aad01-0a59-46d0-9a71-2c8308c1495e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.926204 Oct 25 03:27:10.800279 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2545/4981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:09 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:10.854644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:10.867470 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-45a02293-307d-4689-92f8-baff90c24568 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1463 microversion: 2.1 time: 0.454232 Oct 25 03:27:10.869197 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2437/4982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:10 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1463 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:10.896008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89344396-0fcf-4201-837a-5a4cdeb28eea", "device": "/dev/sdb"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:10.898995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:10.917489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:10.918182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:10.918724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:10.919561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:10.927178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:10.927869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:11.118409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac3f6a2a-bd11-463f-b9e0-4bbb9ebc9463 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3298cb80>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:11.233998 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac3f6a2a-bd11-463f-b9e0-4bbb9ebc9463 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.120182 Oct 25 03:27:11.235285 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2438/4983] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:11 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:11.472623 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03869ea8-8f24-4ae9-886c-0824f721df19 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "POST /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580484 Oct 25 03:27:11.485039 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2546/4984] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:27:10 2022] POST /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:11.828731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:11.829344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:11.846490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:11.847006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:11.847453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:11.848184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:11.848656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:11.849092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:12.251761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ea13a44-be3f-4245-b791-e93e54176297 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd338261f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:12.383801 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ea13a44-be3f-4245-b791-e93e54176297 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.136511 Oct 25 03:27:12.385779 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2547/4985] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:12 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:12.826979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:12.836470 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4144b562-37d8-49de-a80b-ee3a280b4499 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 1.011817 Oct 25 03:27:12.872060 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2439/4986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:11 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:13.094884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e51a15af-7415-4c42-8430-056a9703b698 req-1fefa57c-dc50-4379-8a63-b9ef6c67f3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "607eba3e-2e4d-4aad-9dcd-a91d25ed665d", "tag": "892d2ec9-9480-448e-9f12-bdc878a287e5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:13.130549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e51a15af-7415-4c42-8430-056a9703b698 req-1fefa57c-dc50-4379-8a63-b9ef6c67f3a6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:13.131056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e51a15af-7415-4c42-8430-056a9703b698 req-1fefa57c-dc50-4379-8a63-b9ef6c67f3a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:13.131501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e51a15af-7415-4c42-8430-056a9703b698 req-1fefa57c-dc50-4379-8a63-b9ef6c67f3a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:13.161496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e51a15af-7415-4c42-8430-056a9703b698 req-1fefa57c-dc50-4379-8a63-b9ef6c67f3a6 service nova] Creating event network-changed:892d2ec9-9480-448e-9f12-bdc878a287e5 for instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d on n-h2-862355-1 Oct 25 03:27:13.216957 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e51a15af-7415-4c42-8430-056a9703b698 req-1fefa57c-dc50-4379-8a63-b9ef6c67f3a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121614 Oct 25 03:27:13.219414 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2548/4987] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:13.406396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25859343-4fb1-4777-8baf-48dd012e2109 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32869af0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:13.501172 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-25859343-4fb1-4777-8baf-48dd012e2109 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.104307 Oct 25 03:27:13.508639 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2440/4988] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:13 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:13.880826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:13.881704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:13.900051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:13.900551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:13.900987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:13.910447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:13.910955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:13.911396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:14.046231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b623fb1a-4e49-4c98-b097-ec36c9d24b12 req-fbf55eec-3239-456e-b13d-6df31f28c4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c", "name": "network-vif-plugged", "status": "completed", "tag": "8fc3a922-6bce-4335-9197-ddc6012d6923"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:14.072344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b623fb1a-4e49-4c98-b097-ec36c9d24b12 req-fbf55eec-3239-456e-b13d-6df31f28c4a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:14.072863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b623fb1a-4e49-4c98-b097-ec36c9d24b12 req-fbf55eec-3239-456e-b13d-6df31f28c4a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:14.073305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b623fb1a-4e49-4c98-b097-ec36c9d24b12 req-fbf55eec-3239-456e-b13d-6df31f28c4a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:14.109703 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b623fb1a-4e49-4c98-b097-ec36c9d24b12 req-fbf55eec-3239-456e-b13d-6df31f28c4a7 service nova] Creating event network-vif-plugged:8fc3a922-6bce-4335-9197-ddc6012d6923 for instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c on n-h2-862355-1 Oct 25 03:27:14.129283 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b623fb1a-4e49-4c98-b097-ec36c9d24b12 req-fbf55eec-3239-456e-b13d-6df31f28c4a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094180 Oct 25 03:27:14.137713 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2441/4989] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:27:14.518585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b4192c6-b8b6-403b-b2d3-1ce9bc5d15c0 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3278c430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:14.602560 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b4192c6-b8b6-403b-b2d3-1ce9bc5d15c0 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.088557 Oct 25 03:27:14.603171 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2442/4990] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:14 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:14.828107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:14.836622 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-be69a2dc-e736-4572-bfab-2bc93cdee4cc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.959974 Oct 25 03:27:14.837240 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2549/4991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:13 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:15.626582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aae83f03-9a2c-4834-884b-ac1471784c65 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32789ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:15.737396 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aae83f03-9a2c-4834-884b-ac1471784c65 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.122250 Oct 25 03:27:15.746409 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2443/4992] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:15 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:15.861646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:15.862295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:15.891089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:15.891918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:15.892616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:15.893507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:15.906186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:15.906756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.284956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:16.285622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:16.330322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.339972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.341990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.364966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.366381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.367899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.389538 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c HTTP/1.1 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'effbeb1d-aa58-463d-8594-15882198800c'} Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:27:16.391464 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14e4c714-80b1-4e26-a1f3-fcd5ec13d0e8 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 404 len: 111 microversion: 2.1 time: 0.113234 Oct 25 03:27:16.396180 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2444/4993] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:27:16 2022] DELETE /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:27:16.404916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:16.409601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: effbeb1d-aa58-463d-8594-15882198800c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:16.430334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.434281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.434941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.446597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.447206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.459672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.502207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:16.516530 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3aa68456-98d9-4c39-8f1c-cf0220d32092 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1317 microversion: 2.1 time: 0.658870 Oct 25 03:27:16.517131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2550/4994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:15 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:16.520512 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c HTTP/1.1 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'effbeb1d-aa58-463d-8594-15882198800c'} Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:16.525752 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.529849 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:16.529849 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:16.529849 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:16.529849 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:16.529849 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:16.529849 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. Oct 25 03:27:16.529849 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:16.531114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance effbeb1d-aa58-463d-8594-15882198800c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:16.533334 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba9f119f-e9bf-4d70-9bf5-eea68e7c97b1 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c" status: 404 len: 111 microversion: 2.1 time: 0.133719 Oct 25 03:27:16.537146 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2445/4995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:16 2022] GET /compute/v2.1/servers/effbeb1d-aa58-463d-8594-15882198800c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:27:16.547397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:16.548090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:16.567762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.568673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.569273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.574837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.575568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.576185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.640172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:27:16.758914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3207c0f7-580e-4d0b-93aa-d75981f47596 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32796e50>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:16.859771 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba226377-24b0-4a53-b398-a15e0fb80d99 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "DELETE /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 204 len: 0 microversion: 2.1 time: 0.316428 Oct 25 03:27:16.860463 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2551/4996] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:27:16 2022] DELETE /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:16.870522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:16.872343 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3207c0f7-580e-4d0b-93aa-d75981f47596 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.120396 Oct 25 03:27:16.874602 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2446/4997] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:16 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:16.875206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:16.891668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.892178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.894745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.895670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:16.899015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:16.899605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:16.958151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:17.295836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:17.303865 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7ca1e66-eaaa-4a3e-9ab6-51ef93d9c965 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.438756 Oct 25 03:27:17.304507 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2552/4998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:16 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:17.543544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:17.546135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:17.577228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:17.578065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:17.586570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:17.589373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:17.590766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:17.591408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:17.889395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8bad6671-60e4-43a7-88c2-cdd34fef5e8a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33de70d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:17.957218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8bad6671-60e4-43a7-88c2-cdd34fef5e8a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.071880 Oct 25 03:27:17.958119 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2553/4999] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:17 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:18.007769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:18.034453 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad80b33e-efd8-4df5-84e7-67d15e0cb824 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1506 microversion: 2.1 time: 0.480045 Oct 25 03:27:18.035428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2447/5000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:17 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:18.075135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:18.076479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:18.095471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.102381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.103018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.104027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.104723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.105284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.331566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:18.332720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:18.349328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.357795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.358476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.361595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.362299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.363960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.467992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:18.476844 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cdadc6d2-f68b-4275-b7f3-c5a2365c0e22 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1506 microversion: 2.1 time: 0.413284 Oct 25 03:27:18.481210 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2554/5001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:18 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:18.503945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:18.510574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:18.524026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.524557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.525006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.525784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.532071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.533747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.670296 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9840bf20-0f14-4d5c-ae58-f51df54786ff tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "PUT /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1078 microversion: 2.1 time: 0.169477 Oct 25 03:27:18.672302 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2555/5002] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:27:18 2022] PUT /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1078 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:18.691949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:18.692573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:18.705643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.711877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.712377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.713368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:18.713879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:18.714313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:18.876913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:18.893924 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-00bed76b-01db-4109-8e54-23af176fee27 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1511 microversion: 2.1 time: 0.567214 Oct 25 03:27:18.918057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2448/5003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:18 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1511 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:18.946794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:18.957958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e54be633-f159-4302-9634-eae0f04752af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1504 microversion: 2.1 time: 0.270190 Oct 25 03:27:18.958574 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2556/5004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:18 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:18.979443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50df3ac3-ed48-4b12-b53c-20e94d037150 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32796f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:19.000539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:19.001265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:19.022453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:19.029980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:19.032862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:19.032862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:19.050200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:19.052540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:19.098118 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50df3ac3-ed48-4b12-b53c-20e94d037150 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.123031 Oct 25 03:27:19.102596 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2449/5005] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:18 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:19.394130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:19.404171 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5eceb4fb-493a-4bda-9a7b-90db2a2d1105 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1504 microversion: 2.1 time: 0.420563 Oct 25 03:27:19.404766 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2557/5006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:18 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:19.436695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:19.439584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:19.452581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:19.453362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:19.454060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:19.454993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:19.455626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:19.456404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:19.703392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:27:19.704132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:27:19.705630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:27:19.706343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:27:19.706916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:27:19.863902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:19.894896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:19.895406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:19.895877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:19.897515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:19.898607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:19.899236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:20.078298 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89e29551-47e7-4cd0-ae34-8067b2a320e6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "POST /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c/action" status: 202 len: 1110 microversion: 2.1 time: 0.645447 Oct 25 03:27:20.090489 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2450/5007] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:27:19 2022] POST /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c/action => generated 1110 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 25 03:27:20.105708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:20.106391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:20.164053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:20.164909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:20.168632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:20.168757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-916aa2e9-d484-49e7-ac66-c760e4ca8752 req-102d9dcd-2988-4075-863d-dd67d8452ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ad2d83-3644-4094-9f43-2cfcb61f180c", "name": "network-vif-deleted", "tag": "7c40a79e-7be9-44c4-a654-5bda23bdf574"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:20.172878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:20.173612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:20.178628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:20.190826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-916aa2e9-d484-49e7-ac66-c760e4ca8752 req-102d9dcd-2988-4075-863d-dd67d8452ee6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:20.191367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-916aa2e9-d484-49e7-ac66-c760e4ca8752 req-102d9dcd-2988-4075-863d-dd67d8452ee6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:20.191808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-916aa2e9-d484-49e7-ac66-c760e4ca8752 req-102d9dcd-2988-4075-863d-dd67d8452ee6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:20.250015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-916aa2e9-d484-49e7-ac66-c760e4ca8752 req-102d9dcd-2988-4075-863d-dd67d8452ee6 service nova] Creating event network-vif-deleted:7c40a79e-7be9-44c4-a654-5bda23bdf574 for instance 01ad2d83-3644-4094-9f43-2cfcb61f180c on n-h1-862355-1 Oct 25 03:27:20.261499 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-916aa2e9-d484-49e7-ac66-c760e4ca8752 req-102d9dcd-2988-4075-863d-dd67d8452ee6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.488102 Oct 25 03:27:20.263705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:20.267654 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2558/5008] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:27:20.268369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:20.269061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:20.269785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lazy-loading 'fault' on Instance uuid 01ad2d83-3644-4094-9f43-2cfcb61f180c {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:27:20.288350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:20.303919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:20.330817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:20.332547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:20.334909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:20.336426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:20.340802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:20.342279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:20.817055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:20.844429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9663532-86e8-4ac6-b6dc-6b015c82304d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.572447 Oct 25 03:27:20.845045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2559/5009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:20 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:20.864372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad3d8282-76a3-4a96-b19a-1dfc95523eb0 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd337148b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:20.980179 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad3d8282-76a3-4a96-b19a-1dfc95523eb0 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.120452 Oct 25 03:27:20.981346 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2560/5010] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:20 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:21.189456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6aab83e76f346efb38027f52a792eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ae6a170f4f45d7afb16bbd44c1a1a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:21.200859 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-53885f21-fa7d-4d7e-b6aa-24828f085f0c tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 200 len: 1306 microversion: 2.1 time: 1.109020 Oct 25 03:27:21.224316 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2451/5011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:20 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 1306 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:21.872085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:21.873738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:21.888012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:21.891304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:21.892402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:21.893583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:21.894436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:21.895503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:21.996855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6319012e-5464-4169-a236-a8d50070ddbe tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f3a60>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:22.140609 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6319012e-5464-4169-a236-a8d50070ddbe tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.147651 Oct 25 03:27:22.155296 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2452/5012] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:21 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:22.229846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:22.230867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] [instance: 01ad2d83-3644-4094-9f43-2cfcb61f180c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:22.237973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:22.260065 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2825aff5-48fd-49b5-b3ee-30d2c0a3fbbc tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.393020 Oct 25 03:27:22.263229 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2561/5013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:21 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:22.265976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:22.266495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:22.266965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:22.267720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:22.268185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:22.268612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:22.312196 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] HTTP exception thrown: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c could not be found. Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Request method failure captured: Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c HTTP/1.1 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1aeE-8dU3BlWn8jqV0EmykSr_nRp_H_rYzjQpnMBcWYNKdl0rf8-8tPTd645doWrnN1v-3nAlNeyO0uvaXo6ShInMSnWp-SNi2YmDOD6EHicODZAvx16FRs2gckaiKeX3eFqMlYivNP5RGifDxwYToLJRBzHvtjsbBw2ST8MYtJzY0 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72ae6a170f4f45d7afb16bbd44c1a1a2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72ae6a170f4f45d7afb16bbd44c1a1a2"}]}] Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 72ae6a170f4f45d7afb16bbd44c1a1a2 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-104793066 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6aab83e76f346efb38027f52a792eb1 Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-104793066-project Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c could not be found. Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '01ad2d83-3644-4094-9f43-2cfcb61f180c'} Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c could not be found. Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c could not be found. Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:22.314083 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:22.318549 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:22.318549 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:22.318549 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:22.318549 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:22.318549 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:22.318549 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c could not be found. Oct 25 03:27:22.318549 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:22.322124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] Returning 404 to user: Instance 01ad2d83-3644-4094-9f43-2cfcb61f180c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:22.323175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1ded3d8-8359-4ed7-98aa-9bb08e4adcd0 tempest-ServersNegativeTestJSON-104793066 tempest-ServersNegativeTestJSON-104793066-project] 10.222.0.36 "GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c" status: 404 len: 111 microversion: 2.1 time: 0.098605 Oct 25 03:27:22.325897 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2453/5014] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:22 2022] GET /compute/v2.1/servers/01ad2d83-3644-4094-9f43-2cfcb61f180c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:27:23.175268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00381152-b674-4ee7-8a55-a004e6a198f0 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33de0940>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:23.265411 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00381152-b674-4ee7-8a55-a004e6a198f0 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1455 microversion: 2.1 time: 0.097042 Oct 25 03:27:23.266766 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2562/5015] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:23 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:23.311818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:23.312406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:23.322917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:23.323418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:23.323855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:23.324565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:23.325066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:23.325490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:23.884716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:23.896410 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d835191f-d692-46b3-80fc-ebef6621d234 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.588574 Oct 25 03:27:23.902185 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2454/5016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:23 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:24.284003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-583c9020-c31c-40f0-8b00-9c996a7431ff tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33714b80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:24.341993 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-583c9020-c31c-40f0-8b00-9c996a7431ff tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1464 microversion: 2.1 time: 0.063491 Oct 25 03:27:24.344344 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2563/5017] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:24 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:24.358084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb111343-2460-44af-b76c-5043933f43d4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f33a0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:24.436146 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb111343-2460-44af-b76c-5043933f43d4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 200 len: 1464 microversion: 2.1 time: 0.082166 Oct 25 03:27:24.438392 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2455/5018] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:24 2022] GET /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 1464 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:24.452864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:24.453502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:24.462498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:24.466938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:24.467822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:24.468765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:24.469439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:24.470153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:24.825102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:24.836560 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4b7d4e9-e053-45ed-a84f-03471e782d87 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 1466 microversion: 2.1 time: 0.387982 Oct 25 03:27:24.838232 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2564/5019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:24 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 1466 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:24.871669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a329559-aef3-4c7d-882e-7954fdc9aa2b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd328695e0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:24.923969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:24.924900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:24.936742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:24.939501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:24.941462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:24.943666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:24.944263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:24.946522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:25.093973 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a329559-aef3-4c7d-882e-7954fdc9aa2b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?changes-since=2022-10-25T03%3A25%3A10Z" status: 200 len: 1902 microversion: 2.1 time: 0.229043 Oct 25 03:27:25.094697 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2456/5020] 10.222.0.36 () {58 vars in 1199 bytes} [Tue Oct 25 03:27:24 2022] GET /compute/v2.1/images?changes-since=2022-10-25T03%3A25%3A10Z => generated 1902 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:25.116091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-591b4455-a771-4a19-9eb9-1b5c4f4560cb tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327a8ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:25.203916 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-591b4455-a771-4a19-9eb9-1b5c4f4560cb tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-653210551" status: 200 len: 484 microversion: 2.1 time: 0.097277 Oct 25 03:27:25.204928 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2457/5021] 10.222.0.36 () {58 vars in 1229 bytes} [Tue Oct 25 03:27:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-653210551 => generated 484 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:25.225313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b0e2bba-b4bf-48d7-a715-e019c8719149 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f3ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:25.402782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b0e2bba-b4bf-48d7-a715-e019c8719149 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?server=c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 957 microversion: 2.1 time: 0.185125 Oct 25 03:27:25.405469 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2458/5022] 10.222.0.36 () {58 vars in 1209 bytes} [Tue Oct 25 03:27:25 2022] GET /compute/v2.1/images?server=c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 957 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:25.423535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-26b5a439-6c8d-42ec-a6c7-3213c805a6a3 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd330bc0d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:25.522116 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-26b5a439-6c8d-42ec-a6c7-3213c805a6a3 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 485 microversion: 2.1 time: 0.106650 Oct 25 03:27:25.523551 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2459/5023] 10.222.0.36 () {58 vars in 1317 bytes} [Tue Oct 25 03:27:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 485 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:25.537231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e289ce87-f905-4ade-a4e0-d2f739c66f53 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327f34c0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:25.547575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:25.558786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3de4b05-889a-4005-9640-5f0400cd0ea1 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.639237 Oct 25 03:27:25.561168 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2565/5024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:24 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:25.612793 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e289ce87-f905-4ade-a4e0-d2f739c66f53 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 485 microversion: 2.1 time: 0.079874 Oct 25 03:27:25.613477 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2460/5025] 10.222.0.36 () {58 vars in 1303 bytes} [Tue Oct 25 03:27:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 485 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:27:25.634494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e12fc7b5-fe7c-4877-ac79-84f823a3280b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33892f70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:25.765157 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e12fc7b5-fe7c-4877-ac79-84f823a3280b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.135653 Oct 25 03:27:25.768864 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2566/5026] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:27:25 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:25.787509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56ca5a8a-8db5-4670-ae9e-4bad895030f3 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327a8ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:25.906689 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56ca5a8a-8db5-4670-ae9e-4bad895030f3 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.123768 Oct 25 03:27:25.926033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99b710a0-121c-4058-ae38-56a8ef9fb025 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33de04c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:25.935919 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2461/5027] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:27:25 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:25.997662 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-99b710a0-121c-4058-ae38-56a8ef9fb025 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.077163 Oct 25 03:27:26.014810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac9efe82-a03c-44c8-98a0-ac464c2cda7d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32869160>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.023928 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2567/5028] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:27:25 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:26.160537 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac9efe82-a03c-44c8-98a0-ac464c2cda7d tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/detail?changes-since=2022-10-25T03%3A25%3A03Z" status: 200 len: 6333 microversion: 2.1 time: 0.149586 Oct 25 03:27:26.175512 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2462/5029] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-25T03%3A25%3A03Z => generated 6333 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:26.187636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ad6b499-3042-438e-a307-cce51b3ac96b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b8039d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.263519 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ad6b499-3042-438e-a307-cce51b3ac96b tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-653210551" status: 200 len: 664 microversion: 2.1 time: 0.074112 Oct 25 03:27:26.265090 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2568/5030] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-653210551 => generated 664 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:26.287855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8be983a-2ac3-427f-a0d4-7edb8df2e658 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327a80d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.352696 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8be983a-2ac3-427f-a0d4-7edb8df2e658 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1467 microversion: 2.1 time: 0.069031 Oct 25 03:27:26.364679 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2463/5031] 10.222.0.36 () {58 vars in 1338 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1467 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:26.371368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32fef1ea-2e53-43b9-9268-b6953370dd04 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3387b160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.434920 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32fef1ea-2e53-43b9-9268-b6953370dd04 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1467 microversion: 2.1 time: 0.068741 Oct 25 03:27:26.436320 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2569/5032] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1467 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:26.457231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-329fe17d-868e-4ae3-bace-1661add6972a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd330bc700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.564950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-329fe17d-868e-4ae3-bace-1661add6972a tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.113077 Oct 25 03:27:26.574389 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2464/5033] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:26.586539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.587971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:26.592516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5347a02-9286-4425-9f90-7cd9c4ddc689 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd32869310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.595284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:26.596064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:26.596744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:26.597708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:26.598398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:26.599212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:26.714182 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5347a02-9286-4425-9f90-7cd9c4ddc689 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.121631 Oct 25 03:27:26.727189 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2465/5034] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:26.734653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-88ab6de8-a322-47ec-8439-fdebadf896e7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd38e57f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.843603 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-88ab6de8-a322-47ec-8439-fdebadf896e7 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/aaf4b9eb-e26e-4d56-8bee-d6f868921bec" status: 200 len: 784 microversion: 2.1 time: 0.104426 Oct 25 03:27:26.845093 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2466/5035] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/aaf4b9eb-e26e-4d56-8bee-d6f868921bec => generated 784 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:27:26.862963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8f3a2dcb-cd18-47db-ac2a-4218c2c8995e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd328698b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:26.870575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:26.880836 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8b8515f5-5edc-45da-b61c-7ca7b47deb5b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.298640 Oct 25 03:27:26.882460 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2570/5036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:26.977970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8f3a2dcb-cd18-47db-ac2a-4218c2c8995e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.118962 Oct 25 03:27:26.979094 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2467/5037] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:27:26 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:26.998699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-258fe97d-8fcc-4609-8cd3-e9f641178119 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b803ca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:27.907990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:27.909281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:27.936044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=90 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:27.945697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:27.946418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:27.949802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:27.950763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:27.954087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:27.955002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:28.294496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:28.302885 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d88bf662-50cb-49a9-9202-08ce0586a893 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.401043 Oct 25 03:27:28.303801 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2468/5038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:27 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:28.315376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-851c3ef7-31b0-4ba5-b273-efa84e80602f req-1fff8509-02d3-4c45-96f2-b76e056516d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96fd4fd-b50c-485c-a521-34fa71082f92", "name": "network-vif-unplugged", "status": "completed", "tag": "36ae65b4-6263-4fdc-911f-5659139037d7"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:28.326714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-851c3ef7-31b0-4ba5-b273-efa84e80602f req-1fff8509-02d3-4c45-96f2-b76e056516d0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:28.327162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-851c3ef7-31b0-4ba5-b273-efa84e80602f req-1fff8509-02d3-4c45-96f2-b76e056516d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:28.327659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-851c3ef7-31b0-4ba5-b273-efa84e80602f req-1fff8509-02d3-4c45-96f2-b76e056516d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:28.341376 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-258fe97d-8fcc-4609-8cd3-e9f641178119 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59" status: 204 len: 0 microversion: 2.1 time: 1.347215 Oct 25 03:27:28.342027 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2571/5039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:26 2022] DELETE /compute/v2.1/images/ea366a37-aeb1-4f00-b845-a9e77857cc59 => generated 0 bytes in 1349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:28.343003 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-851c3ef7-31b0-4ba5-b273-efa84e80602f req-1fff8509-02d3-4c45-96f2-b76e056516d0 service nova] Creating event network-vif-unplugged:36ae65b4-6263-4fdc-911f-5659139037d7 for instance c96fd4fd-b50c-485c-a521-34fa71082f92 on n-h1-862355-1 Oct 25 03:27:28.348379 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-851c3ef7-31b0-4ba5-b273-efa84e80602f req-1fff8509-02d3-4c45-96f2-b76e056516d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042813 Oct 25 03:27:28.349284 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2469/5040] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:28.351726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c02a8658-19a4-4047-9682-d23ae4645962 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33429c10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:29.330363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:29.331918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:29.347445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:29.349271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:29.350313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:29.352274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:29.354137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:29.356129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:29.466524 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c02a8658-19a4-4047-9682-d23ae4645962 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19" status: 204 len: 0 microversion: 2.1 time: 1.120072 Oct 25 03:27:29.470678 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2572/5041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:28 2022] DELETE /compute/v2.1/images/55775588-9d07-4b97-acf9-8b576154ab19 => generated 0 bytes in 1121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:27:29.477528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed7ed195-4a34-4297-9650-a3adc8f33438 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3b7ecca0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:30.070600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:30.082590 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81e90232-29d4-473f-adc1-f6edddec06ce tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.757431 Oct 25 03:27:30.083801 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2470/5042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:29 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:30.484450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed7ed195-4a34-4297-9650-a3adc8f33438 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911" status: 204 len: 0 microversion: 2.1 time: 1.012344 Oct 25 03:27:30.488183 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2573/5043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:29 2022] DELETE /compute/v2.1/images/80605be8-8a44-41e0-922a-99964595e911 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:30.493755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:30.494272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:30.505056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:30.505506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:30.506104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:30.506915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:30.508920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:30.509553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:30.543675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:27:30.672887 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e131c7d-5f11-41e6-ab44-fe936bc376f5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 204 len: 0 microversion: 2.1 time: 0.182908 Oct 25 03:27:30.680413 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2471/5044] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:27:30 2022] DELETE /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:30.683764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:30.684396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:30.692833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:30.693330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:30.693803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:30.695972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:30.695972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:30.699193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:31.111767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:31.112605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:31.120359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:31.120847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:31.121280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:31.129734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:31.130256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:31.131634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:31.180573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:31.244871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:31.253867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-76cf0aa1-2476-4f8a-82b7-aa227ca452f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1474 microversion: 2.1 time: 0.575046 Oct 25 03:27:31.254462 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2574/5045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:30 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1474 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:31.355947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:31.365269 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34e25316-9aa1-4785-9757-e4fdad0f0c1e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.258115 Oct 25 03:27:31.378473 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2472/5046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:31 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:32.280169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:32.282109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:32.295404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:32.296691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:32.298465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:32.299513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:32.300205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:32.301347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:32.392589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:32.393304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:32.406238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:32.407702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:32.408409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:32.409977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:32.411026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:32.415100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:32.585823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:32.597039 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5dc58894-f26f-4656-bd96-108dd450df8e tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1474 microversion: 2.1 time: 0.322327 Oct 25 03:27:32.601784 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2575/5047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:32 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:32.661670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:32.671229 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-98288127-0b21-4a35-a278-d403d373fa76 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.284017 Oct 25 03:27:32.671823 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2473/5048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:32 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:33.627309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:33.627938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:33.664465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:33.665888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:33.666514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:33.670010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:33.670666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-64732314-49e9-4bab-8e5a-facb219a58a1 req-e0b90a30-de93-48a8-b123-fa59aafbc590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade7b0be-f3d6-4149-91ab-bdac6f1f5547", "name": "network-vif-deleted", "tag": "d1f2cbba-3217-49fb-8f52-abbcfedb4c1e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:33.671624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:33.672226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:33.709408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64732314-49e9-4bab-8e5a-facb219a58a1 req-e0b90a30-de93-48a8-b123-fa59aafbc590 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:33.711306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64732314-49e9-4bab-8e5a-facb219a58a1 req-e0b90a30-de93-48a8-b123-fa59aafbc590 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:33.714244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64732314-49e9-4bab-8e5a-facb219a58a1 req-e0b90a30-de93-48a8-b123-fa59aafbc590 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:33.743282 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-64732314-49e9-4bab-8e5a-facb219a58a1 req-e0b90a30-de93-48a8-b123-fa59aafbc590 service nova] Creating event network-vif-deleted:d1f2cbba-3217-49fb-8f52-abbcfedb4c1e for instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 on n-h2-862355-1 Oct 25 03:27:33.748861 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-64732314-49e9-4bab-8e5a-facb219a58a1 req-e0b90a30-de93-48a8-b123-fa59aafbc590 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081824 Oct 25 03:27:33.754755 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2474/5049] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:33.763412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:33.764711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:33.801439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:33.802602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:33.803055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:33.806070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:33.806872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:33.808116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:33.857429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:33.872773 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1a22d2b-77a1-4a42-935f-72ea4183bd95 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 200 len: 1303 microversion: 2.1 time: 0.250896 Oct 25 03:27:33.874327 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2576/5050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:33 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:34.097150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:34.109739 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b52a48e-f6f0-4183-8515-8ec45db7cc13 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.352109 Oct 25 03:27:34.110939 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2475/5051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:33 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:34.904864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:34.905590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: ade7b0be-f3d6-4149-91ab-bdac6f1f5547] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:34.924878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:34.926416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:34.930189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:34.931168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:34.931663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:34.932087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:34.947187 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] HTTP exception thrown: Instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 could not be found. Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Request method failure captured: Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 HTTP/1.1 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1cNp_TmjEc8KNWmDLMYU5GnFsB_oBN76dBAe5SWxwTWE2HU2HU6rjP_74PqisFsShy2wi4Qp_RrBQgZbb7nQlMkLh7DAHQ0FFKw15zmyvJnqcwTgJXBnrfsx4fuft08ynNZ7klT_sWt7e4gCl22SG8gvTgNBqrB-Oej2w-P-nm9-F4 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: cc878f4bc7d640f58adcb21eba8d0e22 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ListImageFiltersTestJSON-1977597376 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc878f4bc7d640f58adcb21eba8d0e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc878f4bc7d640f58adcb21eba8d0e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cc878f4bc7d640f58adcb21eba8d0e22", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cc878f4bc7d640f58adcb21eba8d0e22"}]}] Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ListImageFiltersTestJSON-1977597376 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: cc878f4bc7d640f58adcb21eba8d0e22 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1977597376 Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ListImageFiltersTestJSON-1977597376-project Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 400f4abc0def44968b7abe65bb6a2e2b Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ListImageFiltersTestJSON-1977597376-project Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 could not be found. Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'ade7b0be-f3d6-4149-91ab-bdac6f1f5547'} Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 could not be found. Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 could not be found. Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:34.949150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:34.953624 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:34.953624 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:34.953624 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:34.953624 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:34.953624 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:34.953624 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 could not be found. Oct 25 03:27:34.953624 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:27:34.954924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Returning 404 to user: Instance ade7b0be-f3d6-4149-91ab-bdac6f1f5547 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:34.955975 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b864a193-afcf-4c6c-ad9c-3d919fcef1ef tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547" status: 404 len: 111 microversion: 2.1 time: 0.062108 Oct 25 03:27:34.957038 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2577/5052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:34 2022] GET /compute/v2.1/servers/ade7b0be-f3d6-4149-91ab-bdac6f1f5547 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:27:34.966045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:34.966542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:34.978830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:34.979351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:34.979804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:34.980534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:34.981003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:34.981437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:35.036525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:27:35.135873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:35.137024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:35.150701 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-698e9d73-bf53-4739-a8e1-0581c9906db5 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 204 len: 0 microversion: 2.1 time: 0.189084 Oct 25 03:27:35.153782 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2476/5053] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:27:34 2022] DELETE /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:35.160535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:35.161248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:35.161854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:35.162511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:35.163086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:35.164086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:35.165270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:35.165933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:35.171307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:35.172223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:35.172928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:35.174002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:35.174537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:35.175142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:35.390066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:35.399118 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d214c0d5-0f67-40e9-af51-378deda896ee tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 1472 microversion: 2.1 time: 0.242749 Oct 25 03:27:35.399716 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2477/5054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:35 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:35.410116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:35.419042 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7fd62a6-0a0b-474a-947d-9b0b36fb421f tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.287812 Oct 25 03:27:35.419637 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2578/5055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:35 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:36.426093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:36.427542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:36.438316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:36.439641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:36.440243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:36.441074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:36.441948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:36.443776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:36.451564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:36.452384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:36.464714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:36.468867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:36.469576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:36.470524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:36.471147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:36.471745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:36.703516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:36.717412 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-785245f1-db83-4bb9-8a80-d970439986e8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.269849 Oct 25 03:27:36.718216 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2579/5056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:36 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:36.733122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:36.744630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce75ce98-8a3a-4b2b-b3b8-f4fea9c73946 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 1472 microversion: 2.1 time: 0.323477 Oct 25 03:27:36.746046 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2478/5057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:36 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:37.743608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:37.744237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:37.757449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:37.757985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:37.758425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:37.759156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:37.759624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:37.760064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:37.770037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:37.771121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:37.794814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:37.795331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:37.804604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:37.807038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:37.811639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:37.813842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:38.196563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:38.205992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:38.211689 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-15c21eb1-9d81-4966-a63a-1a77491f9fd2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.473012 Oct 25 03:27:38.234406 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2580/5058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:37 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:38.446113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-37d77c12-06fb-4033-8520-fe08bb0fb839 req-fc26f058-6e56-46fb-a754-20433097efaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96fd4fd-b50c-485c-a521-34fa71082f92", "name": "network-vif-deleted", "tag": "36ae65b4-6263-4fdc-911f-5659139037d7"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:38.472421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-37d77c12-06fb-4033-8520-fe08bb0fb839 req-fc26f058-6e56-46fb-a754-20433097efaf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:38.472924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-37d77c12-06fb-4033-8520-fe08bb0fb839 req-fc26f058-6e56-46fb-a754-20433097efaf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:38.473375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-37d77c12-06fb-4033-8520-fe08bb0fb839 req-fc26f058-6e56-46fb-a754-20433097efaf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:38.520520 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-37d77c12-06fb-4033-8520-fe08bb0fb839 req-fc26f058-6e56-46fb-a754-20433097efaf service nova] Creating event network-vif-deleted:36ae65b4-6263-4fdc-911f-5659139037d7 for instance c96fd4fd-b50c-485c-a521-34fa71082f92 on n-h1-862355-1 Oct 25 03:27:38.550088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-37d77c12-06fb-4033-8520-fe08bb0fb839 req-fc26f058-6e56-46fb-a754-20433097efaf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109297 Oct 25 03:27:38.550716 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2581/5059] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 25 03:27:38.580464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f4abc0def44968b7abe65bb6a2e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc878f4bc7d640f58adcb21eba8d0e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:38.602177 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5bfe65a7-6749-45c0-9aa4-92aa8bc70321 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 200 len: 1472 microversion: 2.1 time: 0.835472 Oct 25 03:27:38.617945 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2479/5060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:37 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 1472 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:39.251284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:39.252117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:39.256438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:39.282410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:39.282908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:39.283405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:39.284119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:39.284571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:39.284991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:39.549505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:39.561505 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aaeffc75-0f9b-4b86-907c-46c5407baded tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.314106 Oct 25 03:27:39.562659 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2582/5061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:39 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:39.639017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:39.640496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] [instance: c96fd4fd-b50c-485c-a521-34fa71082f92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:39.674685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:39.675119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:39.680623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:39.684445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:39.686559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:39.687023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:39.745257 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] HTTP exception thrown: Instance c96fd4fd-b50c-485c-a521-34fa71082f92 could not be found. Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Request method failure captured: Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 HTTP/1.1 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1cNp_TmjEc8KNWmDLMYU5GnFsB_oBN76dBAe5SWxwTWE2HU2HU6rjP_74PqisFsShy2wi4Qp_RrBQgZbb7nQlMkLh7DAHQ0FFKw15zmyvJnqcwTgJXBnrfsx4fuft08ynNZ7klT_sWt7e4gCl22SG8gvTgNBqrB-Oej2w-P-nm9-F4 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: cc878f4bc7d640f58adcb21eba8d0e22 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListImageFiltersTestJSON-1977597376 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc878f4bc7d640f58adcb21eba8d0e22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc878f4bc7d640f58adcb21eba8d0e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cc878f4bc7d640f58adcb21eba8d0e22", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cc878f4bc7d640f58adcb21eba8d0e22"}]}] Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListImageFiltersTestJSON-1977597376 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: cc878f4bc7d640f58adcb21eba8d0e22 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1977597376 Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListImageFiltersTestJSON-1977597376-project Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 400f4abc0def44968b7abe65bb6a2e2b Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListImageFiltersTestJSON-1977597376-project Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c96fd4fd-b50c-485c-a521-34fa71082f92 could not be found. Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c96fd4fd-b50c-485c-a521-34fa71082f92'} Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c96fd4fd-b50c-485c-a521-34fa71082f92 could not be found. Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c96fd4fd-b50c-485c-a521-34fa71082f92 could not be found. Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:39.747514 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:39.751415 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:39.751415 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:39.751415 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:39.751415 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:39.751415 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:39.751415 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c96fd4fd-b50c-485c-a521-34fa71082f92 could not be found. Oct 25 03:27:39.751415 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:39.752713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Returning 404 to user: Instance c96fd4fd-b50c-485c-a521-34fa71082f92 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:39.753599 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-312b20c1-5282-421f-9d8b-7c11c67b1314 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92" status: 404 len: 111 microversion: 2.1 time: 0.125028 Oct 25 03:27:39.755341 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2480/5062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:39 2022] GET /compute/v2.1/servers/c96fd4fd-b50c-485c-a521-34fa71082f92 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:27:39.765322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7a87180-58ad-4517-a420-70c6eec722f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd33a4f820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:40.609256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7a87180-58ad-4517-a420-70c6eec722f6 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/images/db61f38c-4a06-4128-afb9-26224e7c19b9" status: 204 len: 0 microversion: 2.1 time: 0.849483 Oct 25 03:27:40.610901 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2583/5063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:39 2022] DELETE /compute/v2.1/images/db61f38c-4a06-4128-afb9-26224e7c19b9 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:27:40.619541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:40.620535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:40.629157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-31cae679-1984-4916-867f-ed4bc6334fce tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd3363b040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:40.646936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:40.654570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:40.658997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:40.661057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:40.663077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:40.664894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:41.010756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:41.022255 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ebb45a2-9733-4ade-bdea-bc56736602ef tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.425894 Oct 25 03:27:41.022255 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2481/5064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:40 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:41.661230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-31cae679-1984-4916-867f-ed4bc6334fce tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/images/ad7561d8-5b9a-4b40-97b4-29cc54600ccf" status: 204 len: 0 microversion: 2.1 time: 1.046111 Oct 25 03:27:41.663243 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2584/5065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:40 2022] DELETE /compute/v2.1/images/ad7561d8-5b9a-4b40-97b4-29cc54600ccf => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:41.672056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c2bd8c0-f555-45a2-b9ed-8fe9431799f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] Calling method '.version_select at 0x7efd327a8f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:42.048563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:42.049612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:42.063630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:42.064146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:42.064737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:42.071279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:42.072139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:42.074152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:42.430612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:42.440936 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7f34d986-77eb-47be-add4-4e47579f0f93 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.398884 Oct 25 03:27:42.446635 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2585/5066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:42 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:42.707767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4c2bd8c0-f555-45a2-b9ed-8fe9431799f4 tempest-ListImageFiltersTestJSON-1977597376 tempest-ListImageFiltersTestJSON-1977597376-project] 10.222.0.36 "DELETE /compute/v2.1/images/04abc7ef-6503-40c7-8da8-286cffaa58f9" status: 204 len: 0 microversion: 2.1 time: 1.033590 Oct 25 03:27:42.708608 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2482/5067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:41 2022] DELETE /compute/v2.1/images/04abc7ef-6503-40c7-8da8-286cffaa58f9 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:43.475526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:43.477361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:43.484993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:43.485771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:43.486373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:43.487817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:43.488449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:43.489054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:43.847296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:43.883153 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16b78d96-98ce-46c2-a112-00333cb1645d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.409709 Oct 25 03:27:43.893709 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2586/5068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:43 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:44.914785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:44.915412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:44.924705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:44.925201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:44.925643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:44.933211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:44.935226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:44.935705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:45.170225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:45.182027 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4b3fca24-31bd-4ebc-a070-a26ab2452710 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.274072 Oct 25 03:27:45.183275 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2483/5069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:44 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:46.213881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:46.214414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:46.234851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:46.237515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:46.241229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:46.243996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:46.245148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:46.246352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:46.461514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:46.470392 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-709679ff-8ada-4b3d-9696-ba31d15166a6 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1515 microversion: 2.1 time: 0.261168 Oct 25 03:27:46.472462 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2587/5070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:46 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:47.252550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6473515a-9e1e-4c5b-ba73-1a91c4b3bc81 tempest-ListImageFiltersNegativeTestJSON-9266524 tempest-ListImageFiltersNegativeTestJSON-9266524-project] Calling method '.version_select at 0x7efd33dd2f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:47.296627 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-6473515a-9e1e-4c5b-ba73-1a91c4b3bc81 tempest-ListImageFiltersNegativeTestJSON-9266524 tempest-ListImageFiltersNegativeTestJSON-9266524-project] HTTP exception thrown: Image not found. Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6473515a-9e1e-4c5b-ba73-1a91c4b3bc81 tempest-ListImageFiltersNegativeTestJSON-9266524 tempest-ListImageFiltersNegativeTestJSON-9266524-project] Request method failure captured: Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/images/fd7ececa-ff18-457b-9783-6c8a2c11a403 HTTP/1.1 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1eychybjmzjtnBgooNyfwkDSgmpe5w_R4L0i-dsXfAlXgERe9j6oGtBXpi3zSPPPoS40pzBdcag6VK2MhySEMc26bGBnkKooeQXfp4cgj4GQflZbY0UQhjdq4jZWc_vJtkfEW5bvnclZsm8HnVWjceVj1-MbNmrH09kKPcBhoT2aC4 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: f57e8732e3704c95a73243882bcd21ef Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-9266524 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f57e8732e3704c95a73243882bcd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f57e8732e3704c95a73243882bcd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f57e8732e3704c95a73243882bcd21ef", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f57e8732e3704c95a73243882bcd21ef"}]}] Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-9266524 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: f57e8732e3704c95a73243882bcd21ef Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-9266524 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListImageFiltersNegativeTestJSON-9266524-project Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: b4be652bd8dd4c98b29bc14d03e1dcb6 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-9266524-project Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: exception: Image not found. Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fd7ececa-ff18-457b-9783-6c8a2c11a403'} Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fd7ececa-ff18-457b-9783-6c8a2c11a403 Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 25 03:27:47.308475 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fd7ececa-ff18-457b-9783-6c8a2c11a403 could not be found. Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6473515a-9e1e-4c5b-ba73-1a91c4b3bc81 tempest-ListImageFiltersNegativeTestJSON-9266524 tempest-ListImageFiltersNegativeTestJSON-9266524-project] Returning 404 to user: Image not found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6473515a-9e1e-4c5b-ba73-1a91c4b3bc81 tempest-ListImageFiltersNegativeTestJSON-9266524 tempest-ListImageFiltersNegativeTestJSON-9266524-project] 10.222.0.36 "GET /compute/v2.1/images/fd7ececa-ff18-457b-9783-6c8a2c11a403" status: 404 len: 62 microversion: 2.1 time: 0.503481 Oct 25 03:27:47.312950 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2484/5071] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Oct 25 03:27:46 2022] GET /compute/v2.1/images/fd7ececa-ff18-457b-9783-6c8a2c11a403 => generated 62 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:27:47.498174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:47.498970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:47.509509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:47.510030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:47.510467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:47.511601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:47.512422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:47.514853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:47.686047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:47.706320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f08ae76-a1e9-4022-aa47-800264b04ea9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1521 microversion: 2.1 time: 0.212536 Oct 25 03:27:47.730883 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2588/5072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:47 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:48.744453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:48.745072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:48.762132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:48.762633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:48.763076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:48.763790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:48.764245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:48.764676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:49.102268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:49.115064 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f61c4548-ae96-47de-a909-2378ae907668 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1521 microversion: 2.1 time: 0.379952 Oct 25 03:27:49.130115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2485/5073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:48 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:50.142417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:50.143040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:50.159298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:50.160440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:50.161446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:50.162725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:50.163871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:50.164551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:50.382034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:50.391612 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-171e1a3c-e5bf-480e-8e4b-172d53a90f61 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1521 microversion: 2.1 time: 0.253630 Oct 25 03:27:50.392203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2589/5074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:50 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:51.327922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] Calling method '.version_select at 0x7efd33363550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:51.364572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:51.367355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:51.368639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:51.372029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:51.374752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:51.375477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:51.418228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:51.419582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:51.436858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12a89fdb-2f3e-4c48-a3d8-643f5062c5e5 tempest-AbsoluteLimitsTestJSON-791938041 tempest-AbsoluteLimitsTestJSON-791938041-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.423332 Oct 25 03:27:51.437521 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2486/5075] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Oct 25 03:27:51 2022] GET /compute/v2.1/limits => generated 511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:51.448975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:51.455494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:51.456581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:51.458439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:51.459669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:51.461743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:51.462991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a7b530f6-7f83-4ab6-9300-5208626a015a req-1dd3df37-a9e8-4be1-a5ea-399a94a22542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c", "name": "network-vif-unplugged", "status": "completed", "tag": "8fc3a922-6bce-4335-9197-ddc6012d6923"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:51.480896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a7b530f6-7f83-4ab6-9300-5208626a015a req-1dd3df37-a9e8-4be1-a5ea-399a94a22542 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:51.481737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a7b530f6-7f83-4ab6-9300-5208626a015a req-1dd3df37-a9e8-4be1-a5ea-399a94a22542 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:51.482404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a7b530f6-7f83-4ab6-9300-5208626a015a req-1dd3df37-a9e8-4be1-a5ea-399a94a22542 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:51.511791 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a7b530f6-7f83-4ab6-9300-5208626a015a req-1dd3df37-a9e8-4be1-a5ea-399a94a22542 service nova] Creating event network-vif-unplugged:8fc3a922-6bce-4335-9197-ddc6012d6923 for instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c on n-h2-862355-1 Oct 25 03:27:51.519372 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a7b530f6-7f83-4ab6-9300-5208626a015a req-1dd3df37-a9e8-4be1-a5ea-399a94a22542 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064465 Oct 25 03:27:51.521124 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2487/5076] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:27:51.749072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:51.760660 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c945cd80-1800-4aed-9129-d7fd3bdcf463 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1521 microversion: 2.1 time: 0.348017 Oct 25 03:27:51.761901 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2590/5077] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:51 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:27:52.787028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:52.789277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:52.798992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:52.800098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:52.812281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:52.813210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:52.813724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:52.814181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:53.017588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:53.027887 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ab1e811-397b-4745-8682-09f1d6f629b2 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1521 microversion: 2.1 time: 0.246641 Oct 25 03:27:53.029285 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2488/5078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:52 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:53.589814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6bd2e0fe-6f46-4d2d-8fd4-75fab891f10e req-a1ce090b-5b7d-48f7-96b5-46acc1ccf91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c", "name": "network-vif-plugged", "status": "completed", "tag": "8fc3a922-6bce-4335-9197-ddc6012d6923"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:53.634033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6bd2e0fe-6f46-4d2d-8fd4-75fab891f10e req-a1ce090b-5b7d-48f7-96b5-46acc1ccf91f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:53.638223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6bd2e0fe-6f46-4d2d-8fd4-75fab891f10e req-a1ce090b-5b7d-48f7-96b5-46acc1ccf91f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:53.639841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6bd2e0fe-6f46-4d2d-8fd4-75fab891f10e req-a1ce090b-5b7d-48f7-96b5-46acc1ccf91f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:53.667455 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6bd2e0fe-6f46-4d2d-8fd4-75fab891f10e req-a1ce090b-5b7d-48f7-96b5-46acc1ccf91f service nova] Creating event network-vif-plugged:8fc3a922-6bce-4335-9197-ddc6012d6923 for instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c on n-h2-862355-1 Oct 25 03:27:53.680648 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6bd2e0fe-6f46-4d2d-8fd4-75fab891f10e req-a1ce090b-5b7d-48f7-96b5-46acc1ccf91f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097386 Oct 25 03:27:53.681326 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2591/5079] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:27:54.067053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:54.071109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:54.087959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:54.088983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:54.089798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:54.090766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:54.091509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:54.092645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:54.388602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:54.412018 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-27df02cb-0898-46a2-a33e-31fe2d55f67b tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1521 microversion: 2.1 time: 0.353145 Oct 25 03:27:54.431142 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2489/5080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:54 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:55.441259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:55.442009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:55.472254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:55.472750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:55.481075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:55.481940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:55.482481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:55.482957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:56.077937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:56.089837 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0d2e4ae-0deb-41a8-890a-ce9f6fa19e82 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1506 microversion: 2.1 time: 0.653509 Oct 25 03:27:56.091289 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2592/5081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:55 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:56.116616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:56.118353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:56.130580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:56.133396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:56.135186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:56.136106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:56.138113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:56.138753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:56.447146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:56.467820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9dce7ce-2443-4d44-922b-cb2abb674d6c tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 200 len: 1506 microversion: 2.1 time: 0.357316 Oct 25 03:27:56.470331 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2490/5082] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:56 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:56.496103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:56.497331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:56.551912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:56.554224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:56.555309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:56.557644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:56.558368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:56.559699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:56.614668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:27:56.797420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-acdb3e54-4828-4ff8-bd70-461a806dcf84 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 204 len: 0 microversion: 2.1 time: 0.302834 Oct 25 03:27:56.799924 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2593/5083] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:27:56 2022] DELETE /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:27:57.015652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-48891629", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "7b4c0aa8-f1e1-4d38-9caf-81f88df10ecb"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:27:57.168724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] validate_networks() for [('7b4c0aa8-f1e1-4d38-9caf-81f88df10ecb', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:27:58.182887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:27:58.184251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:27:58.184889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:27:58.186005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:27:58.186910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:27:58.195364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:27:58.239175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:58.239729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:58.240489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:58.240928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:27:58.256140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:27:58.259584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:27:58.343751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Getting quotas for project 8371bf273fe04e57950c2b1b6b06635e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:27:58.353237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Getting quotas for user 9798047eedd6447a9590ff3235cb1974 and project 8371bf273fe04e57950c2b1b6b06635e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:27:58.387121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:27:58.391225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:27:58.543667 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48176a7a-fb11-4224-b651-8705838e997d tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539695 Oct 25 03:27:58.548658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2491/5084] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:27:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:27:58.559764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6566efb8-e466-40e5-b5df-ce9de17bd052 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:58.560398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6566efb8-e466-40e5-b5df-ce9de17bd052 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:58.685150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6566efb8-e466-40e5-b5df-ce9de17bd052 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:58.695591 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6566efb8-e466-40e5-b5df-ce9de17bd052 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1216 microversion: 2.1 time: 0.139246 Oct 25 03:27:58.697993 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2594/5085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:58 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:27:59.721059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-465f182c-3a0b-4d61-950d-cbe28508daad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:27:59.721768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-465f182c-3a0b-4d61-950d-cbe28508daad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:27:59.872042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-465f182c-3a0b-4d61-950d-cbe28508daad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:27:59.898797 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-465f182c-3a0b-4d61-950d-cbe28508daad tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1216 microversion: 2.1 time: 0.181802 Oct 25 03:27:59.899433 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2492/5086] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:27:59 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:00.927900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:00.932569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:00.966718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:00.970272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:00.970766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:00.971508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:00.979836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:00.980373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:01.473449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:01.473732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-01ae2dfa-5fa9-424b-8c35-f78a8997f10d req-ab6381cf-45e3-43b2-9ddb-f135b03dc9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c", "name": "network-vif-deleted", "tag": "8fc3a922-6bce-4335-9197-ddc6012d6923"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:01.495079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20fd236b-b78e-4f54-9a5e-831bfd222c85 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1268 microversion: 2.1 time: 0.571168 Oct 25 03:28:01.525801 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2595/5087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:00 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1268 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:01.529251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-01ae2dfa-5fa9-424b-8c35-f78a8997f10d req-ab6381cf-45e3-43b2-9ddb-f135b03dc9ba service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:01.536696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-01ae2dfa-5fa9-424b-8c35-f78a8997f10d req-ab6381cf-45e3-43b2-9ddb-f135b03dc9ba service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:01.537450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-01ae2dfa-5fa9-424b-8c35-f78a8997f10d req-ab6381cf-45e3-43b2-9ddb-f135b03dc9ba service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:01.564583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:01.608747 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-01ae2dfa-5fa9-424b-8c35-f78a8997f10d req-ab6381cf-45e3-43b2-9ddb-f135b03dc9ba service nova] Creating event network-vif-deleted:8fc3a922-6bce-4335-9197-ddc6012d6923 for instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c on n-h2-862355-1 Oct 25 03:28:01.666875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-01ae2dfa-5fa9-424b-8c35-f78a8997f10d req-ab6381cf-45e3-43b2-9ddb-f135b03dc9ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193003 Oct 25 03:28:01.670580 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2493/5088] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:28:02.541539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:02.542912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:02.579328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:02.581523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:02.582385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:02.591819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:02.602036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:02.602831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:02.891408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:02.908919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-331e52c6-bb98-40de-9e38-5e5cd7dfb471 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1274 microversion: 2.1 time: 0.372236 Oct 25 03:28:02.909507 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2596/5089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:02 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1274 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:03.955856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:03.956644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:03.975559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:03.979584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:03.982085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:03.984912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:03.985803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:03.986725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:05.015578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:05.031955 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02c00ac7-5fda-45dc-95c1-15d2dd8547b4 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 1.081072 Oct 25 03:28:05.044422 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2494/5090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:03 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:06.064437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:06.064908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:06.092637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:06.093151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:06.093572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:06.094545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:06.095213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:06.095826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:06.377989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:06.395746 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0032820d-a711-4fa9-bce3-0f5627f9f419 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 0.333438 Oct 25 03:28:06.398371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2597/5091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:06 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:07.427283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:07.430156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:07.467419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:07.468346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:07.468997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:07.469933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:07.470544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:07.471279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:08.203622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-048ccd82-c9c9-44ba-8630-601fa3ac720b req-cc0c95b0-6a45-4b71-aa30-a9d799adad1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6", "tag": "ffdeeedb-f5a4-4dae-b3f1-5eeb84b0d123"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:08.230851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-048ccd82-c9c9-44ba-8630-601fa3ac720b req-cc0c95b0-6a45-4b71-aa30-a9d799adad1d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:08.240451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-048ccd82-c9c9-44ba-8630-601fa3ac720b req-cc0c95b0-6a45-4b71-aa30-a9d799adad1d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:08.248327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-048ccd82-c9c9-44ba-8630-601fa3ac720b req-cc0c95b0-6a45-4b71-aa30-a9d799adad1d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:08.291571 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-048ccd82-c9c9-44ba-8630-601fa3ac720b req-cc0c95b0-6a45-4b71-aa30-a9d799adad1d service nova] Creating event network-changed:ffdeeedb-f5a4-4dae-b3f1-5eeb84b0d123 for instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 on n-h1-862355-1 Oct 25 03:28:08.292661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:08.302621 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-048ccd82-c9c9-44ba-8630-601fa3ac720b req-cc0c95b0-6a45-4b71-aa30-a9d799adad1d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105093 Oct 25 03:28:08.304378 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2598/5092] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:08.457530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:08.472313 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06f33613-bc79-42ce-9c21-9a464a7202d9 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 1.051633 Oct 25 03:28:08.477277 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2495/5093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:07 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:09.500756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:09.507156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:09.508264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:09.523249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:09.525481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:09.538702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:09.539162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:09.539927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:09.540392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:09.540830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:09.545362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:09.841959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:09.852318 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b632b97-f77b-4652-9598-4c2e485b39f3 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 0.352411 Oct 25 03:28:09.853290 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2599/5094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:09 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:10.485348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:10.665067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a2fac57-75d4-42c4-98bc-6a941ada9bb8 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd3b81e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-381685256", "description": "tempest-description-642370137"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:10.876384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:10.877266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:10.888103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:10.890212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:10.892716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:10.893735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:10.894399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:10.897434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:10.971407 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a2fac57-75d4-42c4-98bc-6a941ada9bb8 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.491093 Oct 25 03:28:10.972114 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2496/5095] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:28:10 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:10.986856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9ec39d03-cad9-41fe-bef6-87b43dfe9756 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd33064940>, body: {"security_group_rule": {"parent_group_id": "1f5c5cb8-0f06-4668-bb90-0d78116734e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:11.224723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:11.233854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e3e3c5d5-9dae-46be-8164-3e45792669e7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 0.361231 Oct 25 03:28:11.246416 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2600/5096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:10 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:11.858793 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9ec39d03-cad9-41fe-bef6-87b43dfe9756 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.875899 Oct 25 03:28:11.868294 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2497/5097] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:28:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:28:11.873891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e0ba571-7e9b-41df-a6df-9c3fa40fe6ea tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd327e4ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1191524698", "description": "tempest-description-314632159"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:12.218129 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e0ba571-7e9b-41df-a6df-9c3fa40fe6ea tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.349042 Oct 25 03:28:12.219056 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2601/5098] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:28:11 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:12.232652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6cfb5f92-dc74-4f48-9322-99a488718e52 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd33363f70>, body: {"security_group_rule": {"parent_group_id": "c4abb7d7-dc14-4797-a1ba-ad1ac3b6f457", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:12.260738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:12.261369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:12.277412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:12.279587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:12.282111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:12.282926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:12.283342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:12.287358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:12.622776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:12.657527 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-303382b2-5cb9-45bd-ad67-e4233b48dea0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 0.391339 Oct 25 03:28:12.659666 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2602/5099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:12 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:12.995162 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6cfb5f92-dc74-4f48-9322-99a488718e52 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.766318 Oct 25 03:28:13.009793 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2498/5100] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:28:12 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:13.013817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1dec929-089d-4667-b651-07f6aaa5e89a tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd32d63550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-106804826", "description": "tempest-description-799911613"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:13.361221 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1dec929-089d-4667-b651-07f6aaa5e89a tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.351237 Oct 25 03:28:13.362238 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2603/5101] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:28:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:13.380405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5f9a492-bf0f-4cd8-9c93-0c136c13cfa3 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd3b81e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-898188122", "description": "tempest-description-917451397"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:13.636907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5f9a492-bf0f-4cd8-9c93-0c136c13cfa3 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.263689 Oct 25 03:28:13.645345 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2499/5102] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:28:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:13.651620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f6f2087-7953-4b55-9fbb-fdc850094077 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd327e4ee0>, body: {"security_group_rule": {"parent_group_id": "3f25146f-59c7-48de-a0e3-47acf24f9b25", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "53a786e8-97ef-4a84-ab59-c7ec75e293b2"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:13.681452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:13.682204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:13.693844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:13.696102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:13.697921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:13.706922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:13.707734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:13.708363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:14.099552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:14.122919 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13c90b68-fdac-492c-987b-51ec68c55d80 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 0.445580 Oct 25 03:28:14.126451 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2500/5103] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:13 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:14.376181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f6f2087-7953-4b55-9fbb-fdc850094077 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.728969 Oct 25 03:28:14.378648 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2604/5104] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:28:13 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:14.392494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e7a0b99-73d1-42b4-9a38-7d26852f3380 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd33871670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-381365747", "description": "tempest-description-250852164"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:14.763891 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e7a0b99-73d1-42b4-9a38-7d26852f3380 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.375467 Oct 25 03:28:14.764521 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2501/5105] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:28:14 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:14.779269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7d7bf90-4b15-405d-9509-6aa159026ea1 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd33892f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-360015630", "description": "tempest-description-914681822"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:15.098324 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7d7bf90-4b15-405d-9509-6aa159026ea1 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.323082 Oct 25 03:28:15.107046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2605/5106] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:28:14 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:15.113925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7770ac0d-79a3-4257-b9f7-6af2a48fd6fe tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd330643a0>, body: {"security_group_rule": {"parent_group_id": "f0fa85fe-8d4e-411c-b50d-8709c1b14d11", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "733460ae-3a87-45bd-8cfe-b307b9398e85"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:15.154067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:15.154833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:15.164309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:15.165091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:15.166187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:15.168779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:15.169458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:15.170136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:15.471197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:15.482525 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c477ada-8afa-4345-a6c7-d289b50b8614 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 0.332440 Oct 25 03:28:15.483706 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2606/5107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:15 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:28:15.599682 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7770ac0d-79a3-4257-b9f7-6af2a48fd6fe tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.490818 Oct 25 03:28:15.600934 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2502/5108] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:28:15 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:15.613730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ed145fe-0768-46d6-9f62-d1b74ca2b367 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd338928b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:15.968525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2f68eaeb-fd6b-44c4-8309-eb7fa487be6e req-289af1d6-8d59-46b3-a676-0d5c46be0881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6", "name": "network-vif-plugged", "status": "completed", "tag": "ffdeeedb-f5a4-4dae-b3f1-5eeb84b0d123"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:15.983813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2f68eaeb-fd6b-44c4-8309-eb7fa487be6e req-289af1d6-8d59-46b3-a676-0d5c46be0881 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:15.985124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2f68eaeb-fd6b-44c4-8309-eb7fa487be6e req-289af1d6-8d59-46b3-a676-0d5c46be0881 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:15.985643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2f68eaeb-fd6b-44c4-8309-eb7fa487be6e req-289af1d6-8d59-46b3-a676-0d5c46be0881 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:15.998149 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ed145fe-0768-46d6-9f62-d1b74ca2b367 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/733460ae-3a87-45bd-8cfe-b307b9398e85" status: 202 len: 0 microversion: 2.1 time: 0.388303 Oct 25 03:28:15.998802 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2607/5109] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:15 2022] DELETE /compute/v2.1/os-security-groups/733460ae-3a87-45bd-8cfe-b307b9398e85 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:16.008110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90174fbb-1fb2-46cf-b2fe-2135a64441c6 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd3b8ba310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:16.042063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2f68eaeb-fd6b-44c4-8309-eb7fa487be6e req-289af1d6-8d59-46b3-a676-0d5c46be0881 service nova] Creating event network-vif-plugged:ffdeeedb-f5a4-4dae-b3f1-5eeb84b0d123 for instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 on n-h1-862355-1 Oct 25 03:28:16.060925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2f68eaeb-fd6b-44c4-8309-eb7fa487be6e req-289af1d6-8d59-46b3-a676-0d5c46be0881 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096902 Oct 25 03:28:16.063369 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2503/5110] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:16.180842 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90174fbb-1fb2-46cf-b2fe-2135a64441c6 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/f0fa85fe-8d4e-411c-b50d-8709c1b14d11" status: 200 len: 246 microversion: 2.1 time: 0.177365 Oct 25 03:28:16.181873 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2608/5111] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:28:16 2022] GET /compute/v2.1/os-security-groups/f0fa85fe-8d4e-411c-b50d-8709c1b14d11 => generated 246 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:16.199953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c13eda1a-5bc0-47c2-b3ba-61824da93929 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd3b81edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1732442020", "description": "tempest-description-863640819"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:16.524215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:16.524987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:16.549785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:16.550766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:16.551468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:16.552514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:16.554094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:16.554781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:16.698204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c13eda1a-5bc0-47c2-b3ba-61824da93929 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.505190 Oct 25 03:28:16.702054 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2504/5112] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:28:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:16.714939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c4589f6-d2b3-4b44-bdd7-59976501e99d tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd33363790>, body: {"security_group_rule": {"parent_group_id": "111176d9-3fad-4ebd-b53c-2ffbdd778afb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:16.808513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:16.817891 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1ba218da-0ccd-48e4-85d6-4c1034146ee8 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1316 microversion: 2.1 time: 0.314630 Oct 25 03:28:16.819355 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2609/5113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:16 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:16.992807 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c4589f6-d2b3-4b44-bdd7-59976501e99d tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.283880 Oct 25 03:28:16.994000 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2505/5114] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:28:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:17.024971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2f109d7-f42c-4a1d-bc5c-385fdec519a1 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Action: 'create', calling method: .version_select at 0x7efd328be1f0>, body: {"security_group_rule": {"parent_group_id": "111176d9-3fad-4ebd-b53c-2ffbdd778afb", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:17.222109 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2f109d7-f42c-4a1d-bc5c-385fdec519a1 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.218044 Oct 25 03:28:17.223041 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2610/5115] 10.222.0.36 () {60 vars in 1195 bytes} [Tue Oct 25 03:28:17 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:17.235037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02b2f0b6-6b6a-4832-80cd-195f24332e16 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd330bc430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:17.290810 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02b2f0b6-6b6a-4832-80cd-195f24332e16 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/111176d9-3fad-4ebd-b53c-2ffbdd778afb" status: 200 len: 664 microversion: 2.1 time: 0.059735 Oct 25 03:28:17.292310 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2506/5116] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:28:17 2022] GET /compute/v2.1/os-security-groups/111176d9-3fad-4ebd-b53c-2ffbdd778afb => generated 664 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:17.306354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24a038de-5df0-44ca-85d6-4ad4a4b57f40 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd3b8ba160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:17.480079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24a038de-5df0-44ca-85d6-4ad4a4b57f40 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/e63db9c5-e031-461e-9c72-2d8905faa171" status: 202 len: 0 microversion: 2.1 time: 0.177625 Oct 25 03:28:17.481386 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2611/5117] 10.222.0.36 () {58 vars in 1287 bytes} [Tue Oct 25 03:28:17 2022] DELETE /compute/v2.1/os-security-group-rules/e63db9c5-e031-461e-9c72-2d8905faa171 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:17.490535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-226b0ebf-0646-4198-aca8-3aae92ab39f5 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd3339fc10>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:17.773880 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-226b0ebf-0646-4198-aca8-3aae92ab39f5 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/111176d9-3fad-4ebd-b53c-2ffbdd778afb" status: 202 len: 0 microversion: 2.1 time: 0.286988 Oct 25 03:28:17.775105 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2507/5118] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:17 2022] DELETE /compute/v2.1/os-security-groups/111176d9-3fad-4ebd-b53c-2ffbdd778afb => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:17.787536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77eaff3c-987a-4610-9c45-7c315a0d9b6e tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd3b872790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:17.843312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-77eaff3c-987a-4610-9c45-7c315a0d9b6e tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:28:17.843971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.security_group_api [None req-77eaff3c-987a-4610-9c45-7c315a0d9b6e tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Neutron security group 733460ae-3a87-45bd-8cfe-b307b9398e85 not found {{(pid=120562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:28:17.844509 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-77eaff3c-987a-4610-9c45-7c315a0d9b6e tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] HTTP exception thrown: Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist Oct 25 03:28:17.844509 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-e76fb0b2-e1ac-43fb-a738-fa65c10be03f'] Oct 25 03:28:17.848731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:17.849538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77eaff3c-987a-4610-9c45-7c315a0d9b6e tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Request method failure captured: Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-security-groups/733460ae-3a87-45bd-8cfe-b307b9398e85 HTTP/1.1 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1fKutcXQBG8flzpn0o0MljUPMzyDyIQyy4AJ927yPTF4z52I9MoukW8C4t4yN38zegi2uLfGGdo8z9WVP2xbh-8iDeutTFmYljKOE1zJVI5rEcvgU97f1Viav4HScJK3eU_mii5bF8STRuNSNEK747QlK4wmwES4gHtJrVVkoFQb10 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 518cfa2329a0411ca4eacad9b924f94a Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2027043268 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/518cfa2329a0411ca4eacad9b924f94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/518cfa2329a0411ca4eacad9b924f94a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_518cfa2329a0411ca4eacad9b924f94a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/518cfa2329a0411ca4eacad9b924f94a"}]}] Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2027043268 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 518cfa2329a0411ca4eacad9b924f94a Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2027043268 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupRulesTestJSON-2027043268-project Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f52ac3312d264186840935181f46ed25 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2027043268-project Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: exception: Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-e76fb0b2-e1ac-43fb-a738-fa65c10be03f'] Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '733460ae-3a87-45bd-8cfe-b307b9398e85'} Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:28:17.853520 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e76fb0b2-e1ac-43fb-a738-fa65c10be03f'] Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e76fb0b2-e1ac-43fb-a738-fa65c10be03f'] Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e76fb0b2-e1ac-43fb-a738-fa65c10be03f'] Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e76fb0b2-e1ac-43fb-a738-fa65c10be03f'] Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77eaff3c-987a-4610-9c45-7c315a0d9b6e tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Returning 404 to user: Security group 733460ae-3a87-45bd-8cfe-b307b9398e85 does not exist Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-e76fb0b2-e1ac-43fb-a738-fa65c10be03f'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77eaff3c-987a-4610-9c45-7c315a0d9b6e tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/733460ae-3a87-45bd-8cfe-b307b9398e85" status: 404 len: 194 microversion: 2.1 time: 0.077674 Oct 25 03:28:17.858013 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2612/5119] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:17 2022] DELETE /compute/v2.1/os-security-groups/733460ae-3a87-45bd-8cfe-b307b9398e85 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:17.872772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:17.873281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:17.873764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:17.875834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01f1e723-7363-46b2-804f-c99136f33537 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd3b8ba430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:17.878268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:17.881151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:17.881662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.098179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:18.112981 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01f5161a-a1f4-4cda-8174-bed7b895e6a0 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1505 microversion: 2.1 time: 0.272578 Oct 25 03:28:18.113648 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2508/5120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:17 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:28:18.144641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:18.145295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:18.164373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.164879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.165333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.166090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.166553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.166987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.346058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:18.359006 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01f1e723-7363-46b2-804f-c99136f33537 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/f0fa85fe-8d4e-411c-b50d-8709c1b14d11" status: 202 len: 0 microversion: 2.1 time: 0.495835 Oct 25 03:28:18.363134 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2613/5121] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:17 2022] DELETE /compute/v2.1/os-security-groups/f0fa85fe-8d4e-411c-b50d-8709c1b14d11 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:18.381241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d41db792-75bf-43bd-8b3b-3018bebb8912 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd33de7160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:18.393200 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d9b31a3-f384-4f8c-8210-194cf99535af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1505 microversion: 2.1 time: 0.251614 Oct 25 03:28:18.395432 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2509/5122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:18 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:18.425524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:18.440849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:18.454578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.455687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.456675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.462520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.463029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.463503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.580944 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ccfcd0e-ebbe-42bb-9b57-d9ba9cf5cd66 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "PUT /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1077 microversion: 2.1 time: 0.160273 Oct 25 03:28:18.599667 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2510/5123] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:28:18 2022] PUT /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1077 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:28:18.604882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:18.605718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:18.613482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.614047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.614570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.615471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.617743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.618364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.734441 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d41db792-75bf-43bd-8b3b-3018bebb8912 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/53a786e8-97ef-4a84-ab59-c7ec75e293b2" status: 202 len: 0 microversion: 2.1 time: 0.363423 Oct 25 03:28:18.735500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2614/5124] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:18 2022] DELETE /compute/v2.1/os-security-groups/53a786e8-97ef-4a84-ab59-c7ec75e293b2 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:18.744560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-be51dc19-183a-4e33-b583-ff6c02c87482 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd33892e50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:18.860762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:18.873181 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8860e381-7658-414a-ae89-43b28ba9c8d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1503 microversion: 2.1 time: 0.272541 Oct 25 03:28:18.876700 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2511/5125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:18 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:18.899233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:18.900191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:18.914030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.914634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.915071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:18.915834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:18.916331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:18.927498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.129178 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-be51dc19-183a-4e33-b583-ff6c02c87482 tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/3f25146f-59c7-48de-a0e3-47acf24f9b25" status: 202 len: 0 microversion: 2.1 time: 0.389050 Oct 25 03:28:19.129796 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2615/5126] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:18 2022] DELETE /compute/v2.1/os-security-groups/3f25146f-59c7-48de-a0e3-47acf24f9b25 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:19.141268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44c61e5f-f9d6-4bd1-a403-a311061a8c5c tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd32666e50>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:19.198507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:19.211145 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-750e47a1-ad80-48ee-baf9-954ee15ef1af tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1503 microversion: 2.1 time: 0.315330 Oct 25 03:28:19.234038 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2512/5127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:18 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:19.243757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:19.247514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:19.255921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:19.257238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:19.258034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.258978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:19.259589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:19.260273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.347908 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac674451-ee3f-4544-9dac-0b519e0ef1ca tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "PUT /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1079 microversion: 2.1 time: 0.112276 Oct 25 03:28:19.361792 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2513/5128] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:28:19 2022] PUT /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1079 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:19.370023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:19.370671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:19.378738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:19.379428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:19.379852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.380588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:19.381117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:19.382732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.421516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44c61e5f-f9d6-4bd1-a403-a311061a8c5c tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c4abb7d7-dc14-4797-a1ba-ad1ac3b6f457" status: 202 len: 0 microversion: 2.1 time: 0.286687 Oct 25 03:28:19.422465 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2616/5129] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:19 2022] DELETE /compute/v2.1/os-security-groups/c4abb7d7-dc14-4797-a1ba-ad1ac3b6f457 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:19.432593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24f5fed1-fa51-4fac-8222-cb2594c9f49c tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] Calling method '.version_select at 0x7efd33c28ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:19.570896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:19.579909 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60438a33-9133-4e16-bc4e-95f70328808e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1505 microversion: 2.1 time: 0.213589 Oct 25 03:28:19.598202 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2514/5130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:19 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:28:19.604216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:19.605045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:19.611719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:19.612376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:19.612964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.613869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:19.614474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:19.615049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.685537 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24f5fed1-fa51-4fac-8222-cb2594c9f49c tempest-SecurityGroupRulesTestJSON-2027043268 tempest-SecurityGroupRulesTestJSON-2027043268-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1f5c5cb8-0f06-4668-bb90-0d78116734e1" status: 202 len: 0 microversion: 2.1 time: 0.258164 Oct 25 03:28:19.686296 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2617/5131] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:19 2022] DELETE /compute/v2.1/os-security-groups/1f5c5cb8-0f06-4668-bb90-0d78116734e1 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:28:19.932121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:19.956358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46be9c4f-aeb3-4b78-b4ca-f4b2996752d7 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1505 microversion: 2.1 time: 0.356710 Oct 25 03:28:19.956967 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2515/5132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:19 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:19.979989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:19.980843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:19.990381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:19.996630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:19.997305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:19.998278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:20.000894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:20.001520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:20.033538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:28:20.164929 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c724839d-2189-4a31-8b9d-9ecfcabdb746 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 204 len: 0 microversion: 2.1 time: 0.187464 Oct 25 03:28:20.167409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2618/5133] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:28:19 2022] DELETE /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:28:20.178645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:20.179274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:20.186442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:20.186939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:20.187384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:20.188087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:20.188598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:20.189026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:20.223351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:28:20.290246 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Instance is already in deleting state, ignoring this request Oct 25 03:28:20.291579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4c2b1cf8-c0e9-4628-9f2b-f7d5a6dcfdba tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 204 len: 0 microversion: 2.1 time: 0.117074 Oct 25 03:28:20.293076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2516/5134] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:28:20 2022] DELETE /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:28:20.302195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:20.302928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:20.311601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:20.312091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:20.312528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:20.313238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:20.313719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:20.314129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:20.588370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:20.598349 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27c4964e-7db0-4ec4-8154-702912fc5a94 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1511 microversion: 2.1 time: 0.300860 Oct 25 03:28:20.599507 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2619/5135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:20 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:21.625806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:21.626601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:21.644252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:21.650427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:21.651207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:21.652091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:21.652694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:21.653279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:22.253060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:22.263803 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a34af065-be1c-4ec0-aa51-cc42a854740a tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1511 microversion: 2.1 time: 0.644667 Oct 25 03:28:22.265160 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2517/5136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:21 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1511 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:23.287727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:23.288744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:23.309097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:23.314160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:23.314725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:23.315561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:23.316133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:23.317050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:23.460619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9798047eedd6447a9590ff3235cb1974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8371bf273fe04e57950c2b1b6b06635e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:23.468631 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d4480ccc-2e3f-4828-8513-c76d0e998237 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 200 len: 1469 microversion: 2.1 time: 0.185220 Oct 25 03:28:23.469244 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2620/5137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:23 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:23.494818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e4e33a40-6fbd-4dae-ac00-840c864d8afe req-5b01dd2a-e9b9-4282-ab83-0918d89dfd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6", "name": "network-vif-deleted", "tag": "ffdeeedb-f5a4-4dae-b3f1-5eeb84b0d123"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:23.522276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e4e33a40-6fbd-4dae-ac00-840c864d8afe req-5b01dd2a-e9b9-4282-ab83-0918d89dfd5d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:23.523152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e4e33a40-6fbd-4dae-ac00-840c864d8afe req-5b01dd2a-e9b9-4282-ab83-0918d89dfd5d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:23.523720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e4e33a40-6fbd-4dae-ac00-840c864d8afe req-5b01dd2a-e9b9-4282-ab83-0918d89dfd5d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:23.559616 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e4e33a40-6fbd-4dae-ac00-840c864d8afe req-5b01dd2a-e9b9-4282-ab83-0918d89dfd5d service nova] Creating event network-vif-deleted:ffdeeedb-f5a4-4dae-b3f1-5eeb84b0d123 for instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 on n-h1-862355-1 Oct 25 03:28:23.577150 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e4e33a40-6fbd-4dae-ac00-840c864d8afe req-5b01dd2a-e9b9-4282-ab83-0918d89dfd5d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086625 Oct 25 03:28:23.578248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2518/5138] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:24.492849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:24.493471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:24.502679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.503413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.503902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.504621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.505086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.505738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.521037 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] HTTP exception thrown: Instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 could not be found. Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Request method failure captured: Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 HTTP/1.1 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1cqvnd256hnuan4DiLvu5mTXVaP-1RLTLKo9GKKzDXm8OLai73wFe4oNwYkVmYSHGl44yj_wcrYh53DOt5g8Ocu5I7xlv6LpXyZFRSXtUvM7690dfFG5eD5NjmBh3a_hnHc2JoWl8x5LbwxTTaFd5gB_ijQICcIqp2jC-kRHAmmsQc Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8371bf273fe04e57950c2b1b6b06635e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8371bf273fe04e57950c2b1b6b06635e"}]}] Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9798047eedd6447a9590ff3235cb1974 Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 could not be found. Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6'} Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 could not be found. Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 could not be found. Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.524500 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.529940 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.529940 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.529940 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.529940 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:24.529940 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:24.529940 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 could not be found. Oct 25 03:28:24.529940 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.533638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Returning 404 to user: Instance df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:24.535518 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a3cca50-c877-49ba-84ab-8b782455abda tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6" status: 404 len: 111 microversion: 2.1 time: 0.047378 Oct 25 03:28:24.543389 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2621/5139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:24 2022] GET /compute/v2.1/servers/df0e1883-ac8d-433d-a1a5-bbbe23ee6fa6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:24.548653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:24.549488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:24.560007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.560785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.561451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.562932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.563627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.564294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.567563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:24.604729 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] HTTP exception thrown: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Request method failure captured: Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c HTTP/1.1 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1cqvnd256hnuan4DiLvu5mTXVaP-1RLTLKo9GKKzDXm8OLai73wFe4oNwYkVmYSHGl44yj_wcrYh53DOt5g8Ocu5I7xlv6LpXyZFRSXtUvM7690dfFG5eD5NjmBh3a_hnHc2JoWl8x5LbwxTTaFd5gB_ijQICcIqp2jC-kRHAmmsQc Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8371bf273fe04e57950c2b1b6b06635e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8371bf273fe04e57950c2b1b6b06635e"}]}] Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 9798047eedd6447a9590ff3235cb1974 Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c'} Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:28:24.607062 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.611347 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.618575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Returning 404 to user: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:24.621656 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-348544fb-3037-4876-af8a-1d8fa9489662 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 404 len: 111 microversion: 2.1 time: 0.079307 Oct 25 03:28:24.625759 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2519/5140] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:28:24 2022] DELETE /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:24.642323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:24.643041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:24.655933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.656506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.659257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.660063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.667304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.668024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.695329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] HTTP exception thrown: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Request method failure captured: Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c HTTP/1.1 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1cqvnd256hnuan4DiLvu5mTXVaP-1RLTLKo9GKKzDXm8OLai73wFe4oNwYkVmYSHGl44yj_wcrYh53DOt5g8Ocu5I7xlv6LpXyZFRSXtUvM7690dfFG5eD5NjmBh3a_hnHc2JoWl8x5LbwxTTaFd5gB_ijQICcIqp2jC-kRHAmmsQc Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8371bf273fe04e57950c2b1b6b06635e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8371bf273fe04e57950c2b1b6b06635e"}]}] Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9798047eedd6447a9590ff3235cb1974 Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c'} Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.697158 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Returning 404 to user: Instance 5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:24.700941 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dbfe0810-fc44-4340-af0e-64858b3a8928 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c" status: 404 len: 111 microversion: 2.1 time: 0.068685 Oct 25 03:28:24.714848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:24.717187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:24.728292 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2622/5141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:24 2022] GET /compute/v2.1/servers/5c7bc8f7-f39c-4c91-b8b5-847ccf7ca42c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:24.737659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.740122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.741352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.746260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.746764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.747214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.764400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:24.764951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:24.780179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.783186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.783649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.784408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.784889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.785407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.814123 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] HTTP exception thrown: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Request method failure captured: Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 HTTP/1.1 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1cqvnd256hnuan4DiLvu5mTXVaP-1RLTLKo9GKKzDXm8OLai73wFe4oNwYkVmYSHGl44yj_wcrYh53DOt5g8Ocu5I7xlv6LpXyZFRSXtUvM7690dfFG5eD5NjmBh3a_hnHc2JoWl8x5LbwxTTaFd5gB_ijQICcIqp2jC-kRHAmmsQc Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8371bf273fe04e57950c2b1b6b06635e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8371bf273fe04e57950c2b1b6b06635e"}]}] Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 9798047eedd6447a9590ff3235cb1974 Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0313aa2b-c237-41f0-b6fe-5eee8c62e168'} Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:28:24.815877 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Returning 404 to user: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:24.821218 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-423e141d-65cd-4d76-909f-ad7653a62115 tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 404 len: 111 microversion: 2.1 time: 0.113340 Oct 25 03:28:24.825992 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2520/5142] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:28:24 2022] DELETE /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:24.837310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:24.838276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] [instance: 0313aa2b-c237-41f0-b6fe-5eee8c62e168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:24.849308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.849843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.850335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.851061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:24.851532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:24.851968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:24.854697 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2e435fb-7de2-44d9-874b-565c405e023e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/ips" status: 200 len: 153 microversion: 2.20 time: 0.094790 Oct 25 03:28:24.856038 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2623/5143] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Oct 25 03:28:24 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/ips => generated 153 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:28:24.911412 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] HTTP exception thrown: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Request method failure captured: Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 HTTP/1.1 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1cqvnd256hnuan4DiLvu5mTXVaP-1RLTLKo9GKKzDXm8OLai73wFe4oNwYkVmYSHGl44yj_wcrYh53DOt5g8Ocu5I7xlv6LpXyZFRSXtUvM7690dfFG5eD5NjmBh3a_hnHc2JoWl8x5LbwxTTaFd5gB_ijQICcIqp2jC-kRHAmmsQc Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8371bf273fe04e57950c2b1b6b06635e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8371bf273fe04e57950c2b1b6b06635e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8371bf273fe04e57950c2b1b6b06635e"}]}] Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8371bf273fe04e57950c2b1b6b06635e Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-573497100 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 9798047eedd6447a9590ff3235cb1974 Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerDiskConfigTestJSON-573497100-project Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0313aa2b-c237-41f0-b6fe-5eee8c62e168'} Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:24.913547 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] Returning 404 to user: Instance 0313aa2b-c237-41f0-b6fe-5eee8c62e168 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:24.917281 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5246ee33-b326-43e1-8351-e898af097d6e tempest-ServerDiskConfigTestJSON-573497100 tempest-ServerDiskConfigTestJSON-573497100-project] 10.222.0.36 "GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168" status: 404 len: 111 microversion: 2.1 time: 0.088147 Oct 25 03:28:24.921792 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2521/5144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:24 2022] GET /compute/v2.1/servers/0313aa2b-c237-41f0-b6fe-5eee8c62e168 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:28.197384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:28.197956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:28.212629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:28.216348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:28.217296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:28.218855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:28.219857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:28.221730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:28.271120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lazy-loading 'flavor' on Instance uuid 607eba3e-2e4d-4aad-9dcd-a91d25ed665d {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:28:28.625852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a2f4238d-f11f-41cb-844c-0b62d658de67 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/action" status: 202 len: 0 microversion: 2.20 time: 0.432794 Oct 25 03:28:28.626509 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2624/5145] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:28:28 2022] POST /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:28:28.635493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:28.636556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:28.646067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:28.652160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:28.656650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:28.657404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:28.658441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:28.659278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:28.659956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:29.139978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:29.158966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:29.166295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:29.194097 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d4e10fa-1c6a-4cfe-a5e6-341264896583 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.558790 Oct 25 03:28:29.210699 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2522/5146] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:28 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:30.229929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:30.231766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:30.256401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:30.257994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:30.258722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:30.260053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:30.262092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:30.262745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:30.613935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:30.656529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:30.658236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:30.659443 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe7dc531-dfa6-495c-bed9-482c34480bcd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.437636 Oct 25 03:28:30.660019 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2625/5147] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:30 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:31.686173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:31.686845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:31.701134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:31.701533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:31.703008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:31.704437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:31.705518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:31.706193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:32.364058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:32.376526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:32.379893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:32.392208 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8b69bd1-0aac-469b-b1f5-a9cefa04fdf5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.710775 Oct 25 03:28:32.400490 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2523/5148] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:31 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:33.434070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:33.434070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:33.441642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:33.442322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:33.443081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:33.444865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:33.445336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:33.445807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:33.700434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:33.717932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:33.719383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:33.720721 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-255a4bcb-ec8a-47c5-9138-91eab0eabb15 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.301738 Oct 25 03:28:33.740213 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2626/5149] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:33 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:34.751243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:34.751909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:34.779998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:34.782079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:34.783008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:34.784957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:34.787225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:34.789430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:35.313717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:35.323814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:35.331191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:35.332501 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-614d3539-229b-4eaa-b718-cba273e68b7c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.589514 Oct 25 03:28:35.346094 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2524/5150] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:34 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:36.364645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:36.367672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:36.391471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:36.392077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:36.393184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:36.396247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:36.396815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:36.397489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:36.963269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:36.965988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:36.979248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:36.983126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:36.987651 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61d3246d-e59e-4461-86cd-797d5fc18ffb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.628193 Oct 25 03:28:37.001954 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2627/5151] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:36 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:38.020337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:38.021079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:38.040814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:38.041326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:38.041808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:38.042551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:38.043022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:38.043461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:38.997306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:39.016600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:39.025050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:39.030889 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d847a8ce-18ee-4574-bf12-6a043febca59 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 1.015288 Oct 25 03:28:39.031504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2525/5152] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:38 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:40.056498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:40.057122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:40.063702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:40.067789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:40.068479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:40.069979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:40.076407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:40.077075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:40.077690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:41.439597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:41.458020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:41.464999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:41.468115 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-64f92d19-5526-4c83-b5da-1d3023817177 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1745 microversion: 2.20 time: 1.414147 Oct 25 03:28:41.473022 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2628/5153] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:40 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1745 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:42.497988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:42.498828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:42.519285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:42.525649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:42.526878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:42.543110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:42.544372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:42.546329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:42.921361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b600ce2-2cd8-4dc6-92bf-e21dc0e40962 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Calling method '.version_select at 0x7efd38046ee0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:43.031519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-9b600ce2-2cd8-4dc6-92bf-e21dc0e40962 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:28:43.032132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-9b600ce2-2cd8-4dc6-92bf-e21dc0e40962 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Neutron security group c94f1aee-9529-45a3-810f-8401b2c95947 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:28:43.032664 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9b600ce2-2cd8-4dc6-92bf-e21dc0e40962 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] HTTP exception thrown: Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist Oct 25 03:28:43.032664 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-e0ccc059-d8ac-43b5-9fc4-26e3de885b45'] Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b600ce2-2cd8-4dc6-92bf-e21dc0e40962 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Request method failure captured: Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/c94f1aee-9529-45a3-810f-8401b2c95947 HTTP/1.1 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1fqkIGlb1vAXWdeCttNNWmSoXk0QssRhFhRCmnMuyuJH00YHehMag1FBlmbw2uDFj-aNlueCBw9R9mNQFBzbyOjppJxsh31HEz5slhfPkxEz_cOljNYbbedZYUM-b1Irt2iQwpyJZ0snMeuWZdKqx4ZW9ScxC9-FF5ZjsfkBru0t0o Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2e7f8a9bcf94b989e55a96e764b6a89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2e7f8a9bcf94b989e55a96e764b6a89"}]}] Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4b123ad3720e4d0fae610d9985c6c041 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-e0ccc059-d8ac-43b5-9fc4-26e3de885b45'] Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c94f1aee-9529-45a3-810f-8401b2c95947'} Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:28:43.048863 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0ccc059-d8ac-43b5-9fc4-26e3de885b45'] Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0ccc059-d8ac-43b5-9fc4-26e3de885b45'] Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0ccc059-d8ac-43b5-9fc4-26e3de885b45'] Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0ccc059-d8ac-43b5-9fc4-26e3de885b45'] Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b600ce2-2cd8-4dc6-92bf-e21dc0e40962 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Returning 404 to user: Security group c94f1aee-9529-45a3-810f-8401b2c95947 does not exist Oct 25 03:28:43.054203 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-e0ccc059-d8ac-43b5-9fc4-26e3de885b45'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:43.067397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b600ce2-2cd8-4dc6-92bf-e21dc0e40962 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c94f1aee-9529-45a3-810f-8401b2c95947" status: 404 len: 194 microversion: 2.1 time: 0.620803 Oct 25 03:28:43.067998 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2526/5154] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:42 2022] DELETE /compute/v2.1/os-security-groups/c94f1aee-9529-45a3-810f-8401b2c95947 => generated 194 bytes in 622 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:43.091007 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-327407ec-0764-472a-b85f-96d45dd61200 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.015426 Oct 25 03:28:43.092276 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2527/5155] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Oct 25 03:28:43 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 25 03:28:43.107780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61444796-3dce-45c6-ad96-3ac5d377dc51 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Calling method '.version_select at 0x7efd32952af0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:43.660104 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-61444796-3dce-45c6-ad96-3ac5d377dc51 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.562809 Oct 25 03:28:43.661368 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2528/5156] 10.222.0.36 () {58 vars in 1158 bytes} [Tue Oct 25 03:28:43 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:43.676138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c92e820b-0048-4db7-9fe6-96c2a902d23b tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Calling method '.version_select at 0x7efd333d2550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:43.787203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:43.800432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:43.813874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:43.823315 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54bcb393-3acb-433c-a30e-4387d4b2bf72 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1745 microversion: 2.20 time: 1.330040 Oct 25 03:28:43.824192 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2629/5157] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:42 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1745 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:43.854929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-c92e820b-0048-4db7-9fe6-96c2a902d23b tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:28:43.855951 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c92e820b-0048-4db7-9fe6-96c2a902d23b tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 25 03:28:43.855951 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-58ec2692-0626-48b7-b5fb-1f5b2ae7f94e'] Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c92e820b-0048-4db7-9fe6-96c2a902d23b tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Request method failure captured: Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-security-groups/29d68ac4-5907-4e32-8683-b03945fa8d4e HTTP/1.1 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1fqkIGlb1vAXWdeCttNNWmSoXk0QssRhFhRCmnMuyuJH00YHehMag1FBlmbw2uDFj-aNlueCBw9R9mNQFBzbyOjppJxsh31HEz5slhfPkxEz_cOljNYbbedZYUM-b1Irt2iQwpyJZ0snMeuWZdKqx4ZW9ScxC9-FF5ZjsfkBru0t0o Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2e7f8a9bcf94b989e55a96e764b6a89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2e7f8a9bcf94b989e55a96e764b6a89"}]}] Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4b123ad3720e4d0fae610d9985c6c041 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: exception: Insufficient rights for removing default security group. Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-58ec2692-0626-48b7-b5fb-1f5b2ae7f94e'] Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '29d68ac4-5907-4e32-8683-b03945fa8d4e'} Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:28:43.858322 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58ec2692-0626-48b7-b5fb-1f5b2ae7f94e'] Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58ec2692-0626-48b7-b5fb-1f5b2ae7f94e'] Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58ec2692-0626-48b7-b5fb-1f5b2ae7f94e'] Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58ec2692-0626-48b7-b5fb-1f5b2ae7f94e'] Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c92e820b-0048-4db7-9fe6-96c2a902d23b tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-58ec2692-0626-48b7-b5fb-1f5b2ae7f94e'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c92e820b-0048-4db7-9fe6-96c2a902d23b tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/29d68ac4-5907-4e32-8683-b03945fa8d4e" status: 400 len: 182 microversion: 2.1 time: 0.187977 Oct 25 03:28:43.862529 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2529/5158] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:28:43 2022] DELETE /compute/v2.1/os-security-groups/29d68ac4-5907-4e32-8683-b03945fa8d4e => generated 182 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:28:43.872792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff8e6859-149f-43c7-aaab-f75c5676f8f6 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Calling method '.version_select at 0x7efd3b8ba8b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:43.944417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG neutronclient.v2_0.client [None req-ff8e6859-149f-43c7-aaab-f75c5676f8f6 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist", "detail": ""}} {{(pid=120562) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:28:43.945352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.security_group_api [None req-ff8e6859-149f-43c7-aaab-f75c5676f8f6 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Neutron security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e not found {{(pid=120562) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:28:43.946295 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-ff8e6859-149f-43c7-aaab-f75c5676f8f6 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] HTTP exception thrown: Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist Oct 25 03:28:43.946295 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-1d022e44-4861-470a-99e4-fc936c8e1ee6'] Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff8e6859-149f-43c7-aaab-f75c5676f8f6 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Request method failure captured: Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/os-security-groups/b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e HTTP/1.1 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1fqkIGlb1vAXWdeCttNNWmSoXk0QssRhFhRCmnMuyuJH00YHehMag1FBlmbw2uDFj-aNlueCBw9R9mNQFBzbyOjppJxsh31HEz5slhfPkxEz_cOljNYbbedZYUM-b1Irt2iQwpyJZ0snMeuWZdKqx4ZW9ScxC9-FF5ZjsfkBru0t0o Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2e7f8a9bcf94b989e55a96e764b6a89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2e7f8a9bcf94b989e55a96e764b6a89"}]}] Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 4b123ad3720e4d0fae610d9985c6c041 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: exception: Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-1d022e44-4861-470a-99e4-fc936c8e1ee6'] Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e'} Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:28:43.949763 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d022e44-4861-470a-99e4-fc936c8e1ee6'] Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d022e44-4861-470a-99e4-fc936c8e1ee6'] Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d022e44-4861-470a-99e4-fc936c8e1ee6'] Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d022e44-4861-470a-99e4-fc936c8e1ee6'] Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff8e6859-149f-43c7-aaab-f75c5676f8f6 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Returning 404 to user: Security group b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e does not exist Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: Neutron server returns request_ids: ['req-1d022e44-4861-470a-99e4-fc936c8e1ee6'] {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff8e6859-149f-43c7-aaab-f75c5676f8f6 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e" status: 404 len: 194 microversion: 2.1 time: 0.082456 Oct 25 03:28:43.953830 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2630/5159] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 03:28:43 2022] GET /compute/v2.1/os-security-groups/b4879264-c8e3-4b6b-9f9d-2c17dd49bd3e => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:43.961976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21358c7f-695c-4a21-b69c-2210601f6135 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Action: 'update', calling method: .version_select at 0x7efd33555940>, body: {"security_group": {"name": "tempest-sg-713505586", "description": "tempest-description-657793658"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:44.004649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG neutronclient.v2_0.client [None req-21358c7f-695c-4a21-b69c-2210601f6135 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist", "detail": ""}} {{(pid=120563) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 25 03:28:44.005265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.security_group_api [None req-21358c7f-695c-4a21-b69c-2210601f6135 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Neutron security group db030614-ce8e-4102-a1e0-1637c76bf829 not found {{(pid=120563) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 25 03:28:44.005842 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-21358c7f-695c-4a21-b69c-2210601f6135 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] HTTP exception thrown: Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist Oct 25 03:28:44.005842 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-c54cd740-10a4-4065-aa4b-3e7afe5ab08e'] Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21358c7f-695c-4a21-b69c-2210601f6135 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Request method failure captured: Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: request: PUT /compute/v2.1/os-security-groups/db030614-ce8e-4102-a1e0-1637c76bf829 HTTP/1.1 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 100 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1fqkIGlb1vAXWdeCttNNWmSoXk0QssRhFhRCmnMuyuJH00YHehMag1FBlmbw2uDFj-aNlueCBw9R9mNQFBzbyOjppJxsh31HEz5slhfPkxEz_cOljNYbbedZYUM-b1Irt2iQwpyJZ0snMeuWZdKqx4ZW9ScxC9-FF5ZjsfkBru0t0o Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2e7f8a9bcf94b989e55a96e764b6a89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2e7f8a9bcf94b989e55a96e764b6a89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2e7f8a9bcf94b989e55a96e764b6a89"}]}] Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: c2e7f8a9bcf94b989e55a96e764b6a89 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-463656436 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4b123ad3720e4d0fae610d9985c6c041 Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-463656436-project Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: {"security_group": {"name": "tempest-sg-713505586", "description": "tempest-description-657793658"}} Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: exception: Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-c54cd740-10a4-4065-aa4b-3e7afe5ab08e'] Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'db030614-ce8e-4102-a1e0-1637c76bf829', 'body': {'security_group': {'name': 'tempest-sg-713505586', 'description': 'tempest-description-657793658'}}} Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 25 03:28:44.007832 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54cd740-10a4-4065-aa4b-3e7afe5ab08e'] Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54cd740-10a4-4065-aa4b-3e7afe5ab08e'] Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54cd740-10a4-4065-aa4b-3e7afe5ab08e'] Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54cd740-10a4-4065-aa4b-3e7afe5ab08e'] Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21358c7f-695c-4a21-b69c-2210601f6135 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] Returning 404 to user: Security group db030614-ce8e-4102-a1e0-1637c76bf829 does not exist Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: Neutron server returns request_ids: ['req-c54cd740-10a4-4065-aa4b-3e7afe5ab08e'] {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21358c7f-695c-4a21-b69c-2210601f6135 tempest-SecurityGroupsNegativeTestJSON-463656436 tempest-SecurityGroupsNegativeTestJSON-463656436-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/db030614-ce8e-4102-a1e0-1637c76bf829" status: 404 len: 194 microversion: 2.1 time: 0.051182 Oct 25 03:28:44.011511 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2530/5160] 10.222.0.36 () {60 vars in 1290 bytes} [Tue Oct 25 03:28:43 2022] PUT /compute/v2.1/os-security-groups/db030614-ce8e-4102-a1e0-1637c76bf829 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:28:44.863777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:44.865380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:44.877175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:44.877749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:44.878203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:44.879045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:44.879556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:44.880236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:45.447959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:45.461600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:45.466488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:45.470973 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d4bd6b42-a6a9-4bad-bd42-34f5aa9afc32 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1745 microversion: 2.20 time: 0.619058 Oct 25 03:28:45.474965 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2631/5161] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:44 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1745 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:46.508687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:46.509304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:46.528486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:46.529068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:46.535158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:46.535937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:46.536425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:46.536869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:47.211366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:47.230922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:47.236053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:47.240378 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-61a24de3-2616-4095-a4fd-4d5fef5743fa tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.735387 Oct 25 03:28:47.256755 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2531/5162] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:46 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:47.409661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-10ae6740-1c91-4bd3-a181-6bd2ef378ef4 req-0d43cf29-1f6b-4126-a611-3d8f386eb3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607eba3e-2e4d-4aad-9dcd-a91d25ed665d", "name": "network-vif-plugged", "status": "completed", "tag": "892d2ec9-9480-448e-9f12-bdc878a287e5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:47.444526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-10ae6740-1c91-4bd3-a181-6bd2ef378ef4 req-0d43cf29-1f6b-4126-a611-3d8f386eb3a8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:47.448308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-10ae6740-1c91-4bd3-a181-6bd2ef378ef4 req-0d43cf29-1f6b-4126-a611-3d8f386eb3a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:47.449406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-10ae6740-1c91-4bd3-a181-6bd2ef378ef4 req-0d43cf29-1f6b-4126-a611-3d8f386eb3a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:47.482957 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-10ae6740-1c91-4bd3-a181-6bd2ef378ef4 req-0d43cf29-1f6b-4126-a611-3d8f386eb3a8 service nova] Creating event network-vif-plugged:892d2ec9-9480-448e-9f12-bdc878a287e5 for instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d on n-h2-862355-1 Oct 25 03:28:47.503102 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-10ae6740-1c91-4bd3-a181-6bd2ef378ef4 req-0d43cf29-1f6b-4126-a611-3d8f386eb3a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098389 Oct 25 03:28:47.511699 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2632/5163] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:28:48.273271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:48.274119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:48.291000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:48.292836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:48.297375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:48.302583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:48.303662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:48.306399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:50.082506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:50.101580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:50.107836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:50.123261 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d1e6d44f-c4c0-498d-8495-13fb7d8f86e5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 1.854603 Oct 25 03:28:50.125757 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2532/5164] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:48 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:51.154083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:51.154701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:51.172954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:51.173793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:51.174237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:51.174962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:51.175422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:51.175849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:51.589770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-508144027", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:28:51.720566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:51.735540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:51.738722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:51.742891 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66f8bfab-93b8-4d44-8a75-70c7433531d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.593004 Oct 25 03:28:51.758409 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2533/5165] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:51 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:51.775442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] validate_networks() for [('6f80c522-d29c-44d4-ab73-fc89ae209e26', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:28:52.775122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:52.776414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:52.795805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:52.810314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:52.812481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:52.813764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:52.814487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:52.815126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:53.126332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:53.136521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:53.138686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:53.140167 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-59522f00-5c02-4c8c-97ef-6e746992171a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.370068 Oct 25 03:28:53.141255 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2534/5166] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:52 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:53.435569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:28:53.436756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:28:53.437401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:28:53.438140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:28:53.438714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:28:53.460664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:53.469218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:53.469752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:53.470537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:53.471003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:53.477899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:53.586414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Getting quotas for project b07b099f24e6465392d00308ceba0903. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:28:53.630502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Getting quotas for user 94980eb9110a4dc3bc6a3026124440ca and project b07b099f24e6465392d00308ceba0903. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:28:53.682386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:28:53.693877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:28:53.830865 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18d30c69-0f82-426c-b502-5d00eb99a651 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.125904 Oct 25 03:28:53.835281 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2633/5167] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:28:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:28:53.846119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5040a880-20f2-40aa-879c-b53eda6f0404 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:53.846923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5040a880-20f2-40aa-879c-b53eda6f0404 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:54.066646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5040a880-20f2-40aa-879c-b53eda6f0404 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:54.080251 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5040a880-20f2-40aa-879c-b53eda6f0404 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1223 microversion: 2.1 time: 0.238074 Oct 25 03:28:54.094851 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2535/5168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:53 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1223 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:54.172387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:54.172946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:54.204183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:54.206570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:54.211140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:54.214697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:54.218045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:54.218527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:55.050085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:55.071637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:55.075931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:55.086660 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-edd2205b-23e1-4a85-ad12-bbeccf68cada tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.917153 Oct 25 03:28:55.091799 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2634/5169] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:54 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:55.108328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37b3fe6a-83a4-4023-bbeb-266bf75f9ad6 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:55.112808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-37b3fe6a-83a4-4023-bbeb-266bf75f9ad6 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:55.341660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37b3fe6a-83a4-4023-bbeb-266bf75f9ad6 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:55.357055 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37b3fe6a-83a4-4023-bbeb-266bf75f9ad6 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1223 microversion: 2.1 time: 0.248813 Oct 25 03:28:55.364196 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2536/5170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:55 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1223 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:56.127111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:56.128465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:56.141283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:56.142393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:56.144920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:56.145868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:56.148175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:56.149061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:56.386992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:56.388147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:56.406090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:56.406684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:56.407741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:56.410238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:56.410780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:56.414383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:56.421092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:56.429716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=54 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:56.432417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:56.434539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:56.436491 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6155529c-3323-4602-b164-875d438f002f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.313884 Oct 25 03:28:56.437644 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2635/5171] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:56 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:56.622265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:56.630713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4bbac86-82c5-4224-b011-c9fcb994a57c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1275 microversion: 2.1 time: 0.250232 Oct 25 03:28:56.635646 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2537/5172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:56 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:57.479032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:57.483889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:57.498205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:57.499109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:57.500315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:57.501233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:57.503363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:57.503984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:57.664362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:57.666084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:57.686117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:57.695193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:57.696171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:57.697014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:57.697603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:57.698076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:58.046121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:58.061879 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cdb5605d-b24b-417c-bfff-7edc34b54035 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1281 microversion: 2.1 time: 0.404708 Oct 25 03:28:58.063096 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2538/5173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:57 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1281 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:28:58.361751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:58.382066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:58.384073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:28:58.386512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c016316-7e0d-433b-8c81-97ec0b0cf40f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.918036 Oct 25 03:28:58.389816 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2636/5174] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:57 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:28:59.092387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:59.093847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:59.108540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=28 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:28:59.129889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:59.130684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:59.134592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:59.138330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:59.138938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:59.139496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:59.426338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:28:59.428571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:28:59.489965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:59.491188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:59.491922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:28:59.498346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:28:59.499207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:28:59.504543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:00.281265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:00.344379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:00.347341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:00.349601 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f51b997-e34d-45c9-8994-ad0a51463423 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.930868 Oct 25 03:29:00.367503 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2637/5175] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:28:59 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:00.909054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:00.936555 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43437c9a-8d71-471a-83a6-86e6678db47d tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1323 microversion: 2.1 time: 1.848023 Oct 25 03:29:00.942522 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2539/5176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:28:59 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1323 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:01.407175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:01.408977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:01.444681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:01.448714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:01.455730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:01.457949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:01.459029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:01.463959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:01.561174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e754bd99-812f-43d7-9550-eae6f2f6c80f req-277a9942-6036-4074-bec3-1a46cd4252e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ff1fb7-92d4-4989-99a7-34debccb19ef", "tag": "c66356f7-d4c8-4598-8993-481b61fd71ca"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:01.583912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e754bd99-812f-43d7-9550-eae6f2f6c80f req-277a9942-6036-4074-bec3-1a46cd4252e5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:01.586021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e754bd99-812f-43d7-9550-eae6f2f6c80f req-277a9942-6036-4074-bec3-1a46cd4252e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:01.588164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e754bd99-812f-43d7-9550-eae6f2f6c80f req-277a9942-6036-4074-bec3-1a46cd4252e5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:01.618284 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e754bd99-812f-43d7-9550-eae6f2f6c80f req-277a9942-6036-4074-bec3-1a46cd4252e5 service nova] Creating event network-changed:c66356f7-d4c8-4598-8993-481b61fd71ca for instance 64ff1fb7-92d4-4989-99a7-34debccb19ef on n-h1-862355-1 Oct 25 03:29:01.633045 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e754bd99-812f-43d7-9550-eae6f2f6c80f req-277a9942-6036-4074-bec3-1a46cd4252e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077794 Oct 25 03:29:01.635531 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2540/5177] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:01.966887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:01.968072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:01.988505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:01.991028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:01.993800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:02.025442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:02.026265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:02.026681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:02.041479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:02.069595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:02.082815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:02.098761 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c829993c-a2d1-46a1-ad37-c4232ec726b7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.704808 Oct 25 03:29:02.104180 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2638/5178] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:01 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:02.846093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:02.864109 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a445cc1a-cca3-4c91-8380-9a0aa9c1223b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1323 microversion: 2.1 time: 0.899902 Oct 25 03:29:02.879219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2541/5179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:01 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1323 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:03.137507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:03.138437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:03.170356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:03.171776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:03.180458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:03.186175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:03.190478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:03.191085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:03.488513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:03.653466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:03.689139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:03.718159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:03.719753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:03.721006 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b6d27cd-e675-4dbb-b23b-a0bd9e887876 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.592171 Oct 25 03:29:03.721588 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2639/5180] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:03 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:03.903002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:03.903797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:03.916514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:03.946664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:03.947409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:03.951475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:03.951979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:03.968615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:04.465279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:04.476040 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf9d7e51-6788-4223-afd9-9f6f59236ea5 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1323 microversion: 2.1 time: 0.578414 Oct 25 03:29:04.482124 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2542/5181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:03 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1323 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:04.753955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:04.755415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:04.779392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:04.782446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:04.786399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:04.793392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:04.794642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:04.795843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:05.508178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:05.509088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:05.531480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:05.539066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:05.539565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:05.540007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:05.548552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:05.550654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:05.555211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:05.832487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:05.849479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:05.851430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:05.852682 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d32e441-d638-4c25-810e-934e83aa59c4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 1.104134 Oct 25 03:29:05.865046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2640/5182] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:04 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:06.884352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:06.885659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:06.894020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:06.905634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:06.906254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:06.906698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:06.907433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:06.907842 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d65a8737-b90a-410b-a273-8377d562435a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1323 microversion: 2.1 time: 1.404479 Oct 25 03:29:06.907966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:06.913431 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2543/5183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:05 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1323 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:06.914001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:07.937786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:07.940041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:07.956778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:07.958603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:07.959499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:07.960969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:07.962569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:07.963227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:08.275331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:08.289489 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a1b4b16e-997a-4cde-a3d7-84ea14e0ee9b tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1323 microversion: 2.1 time: 0.356778 Oct 25 03:29:08.317392 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2544/5184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:07 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:08.368836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:08.400962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:08.410499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:08.415687 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e17bed4-3aa3-41ea-bef2-d75ccab6e06c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 1.535598 Oct 25 03:29:08.420415 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2641/5185] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:06 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:09.323576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:09.324751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:09.337972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:09.338770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:09.343507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:09.345288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:09.345995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:09.346632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:09.449504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:09.450324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:09.470771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:09.472139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:09.475871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:09.476672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:09.477154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:09.477591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:09.710166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:09.727114 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34c40bce-273d-4b06-b61c-f98de26858b7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1323 microversion: 2.1 time: 0.408431 Oct 25 03:29:09.728455 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2545/5186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:09 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:10.133288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:10.157215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:10.168403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:10.173527 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a79b986-0472-4140-84ed-944eea0b4015 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.727708 Oct 25 03:29:10.193426 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2642/5187] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:09 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:10.304212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d6cec4f9-90cd-4a39-ad94-5b38c7080e36 req-5f7bc49f-324b-4e53-bac1-44ace3cf48d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ff1fb7-92d4-4989-99a7-34debccb19ef", "name": "network-vif-plugged", "status": "completed", "tag": "c66356f7-d4c8-4598-8993-481b61fd71ca"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:10.332444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6cec4f9-90cd-4a39-ad94-5b38c7080e36 req-5f7bc49f-324b-4e53-bac1-44ace3cf48d0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:10.333129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6cec4f9-90cd-4a39-ad94-5b38c7080e36 req-5f7bc49f-324b-4e53-bac1-44ace3cf48d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:10.333386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d6cec4f9-90cd-4a39-ad94-5b38c7080e36 req-5f7bc49f-324b-4e53-bac1-44ace3cf48d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:10.361194 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d6cec4f9-90cd-4a39-ad94-5b38c7080e36 req-5f7bc49f-324b-4e53-bac1-44ace3cf48d0 service nova] Creating event network-vif-plugged:c66356f7-d4c8-4598-8993-481b61fd71ca for instance 64ff1fb7-92d4-4989-99a7-34debccb19ef on n-h1-862355-1 Oct 25 03:29:10.381180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d6cec4f9-90cd-4a39-ad94-5b38c7080e36 req-5f7bc49f-324b-4e53-bac1-44ace3cf48d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081856 Oct 25 03:29:10.381739 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2546/5188] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:10.758009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:10.759311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:10.764041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:10.784167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:10.784853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:10.786773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:10.789863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:10.790501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:10.792500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:10.900036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=78 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:11.210731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:11.211685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:11.228167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:11.230244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:11.231686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:11.233296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:11.234517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:11.235556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:11.354083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:11.364658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21663096-8444-4460-9f60-ee4a230eff0e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1323 microversion: 2.1 time: 0.610965 Oct 25 03:29:11.367000 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2643/5189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:10 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:11.374789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:11.376239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:11.383372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:11.384698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:11.385464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:11.387526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:11.388306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:11.388966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:11.533849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lazy-loading 'services' on Instance uuid eadbb6f2-47c6-4821-8699-2564f9f02c92 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:29:11.701620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2fde9704-3311-4132-a89b-3a55f0f16a3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92/os-volume_attachments/89344396-0fcf-4201-837a-5a4cdeb28eea" status: 202 len: 0 microversion: 2.1 time: 0.331086 Oct 25 03:29:11.704559 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2644/5190] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:29:11 2022] DELETE /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92/os-volume_attachments/89344396-0fcf-4201-837a-5a4cdeb28eea => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:29:12.150697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:12.172554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:12.174404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:12.175698 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-94224c38-6a8d-4a1f-921d-719b6969ff63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.971369 Oct 25 03:29:12.180166 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2547/5191] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:11 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:12.393848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:12.395780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:12.420741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:12.423264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:12.424796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:12.428754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:12.439711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:12.440460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:12.894558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:12.906105 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a18dca2-7b5c-4965-a58d-1fe4d24a78d2 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1518 microversion: 2.1 time: 0.516512 Oct 25 03:29:12.907080 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2645/5192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:12 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1518 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:13.214218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:13.215925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:13.232084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:13.234824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:13.235779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:13.245147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05bfba41-190b-410c-8058-1e49e3362d0a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-111371244", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:13.252165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:13.255156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:13.256574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05bfba41-190b-410c-8058-1e49e3362d0a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 242 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-111371244", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-111371244', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '6f80c522-d29c-44d4-ab73-fc89ae209e26'}]}}} Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:13.260386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.266465 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.271121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05bfba41-190b-410c-8058-1e49e3362d0a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:13.274340 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05bfba41-190b-410c-8058-1e49e3362d0a tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.034032 Oct 25 03:29:13.275959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2646/5193] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:29:13 2022] POST /compute/v2.1/servers => generated 175 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:29:13.286679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f892607-4828-4192-8006-aeb31671da78 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:13.291600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f892607-4828-4192-8006-aeb31671da78 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 20f471fe-a722-4766-803a-15afa940d90b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:13.318009 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6f892607-4828-4192-8006-aeb31671da78 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] HTTP exception thrown: Instance 20f471fe-a722-4766-803a-15afa940d90b could not be found. Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f892607-4828-4192-8006-aeb31671da78 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/20f471fe-a722-4766-803a-15afa940d90b/metadata HTTP/1.1 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 20f471fe-a722-4766-803a-15afa940d90b could not be found. Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '20f471fe-a722-4766-803a-15afa940d90b'} Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f471fe-a722-4766-803a-15afa940d90b could not be found. Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f471fe-a722-4766-803a-15afa940d90b could not be found. Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.329523 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.333642 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:29:13.333642 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:29:13.333642 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f471fe-a722-4766-803a-15afa940d90b could not be found. Oct 25 03:29:13.333642 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.336054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f892607-4828-4192-8006-aeb31671da78 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 404 to user: Instance 20f471fe-a722-4766-803a-15afa940d90b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:13.338682 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f892607-4828-4192-8006-aeb31671da78 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/20f471fe-a722-4766-803a-15afa940d90b/metadata" status: 404 len: 111 microversion: 2.1 time: 0.055954 Oct 25 03:29:13.342945 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2647/5194] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:29:13 2022] GET /compute/v2.1/servers/20f471fe-a722-4766-803a-15afa940d90b/metadata => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:29:13.610733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:13.620216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8085dbc9-c2bf-4c96-a368-8d2640e5835c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-303646718", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8085dbc9-c2bf-4c96-a368-8d2640e5835c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 498 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-303646718", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-303646718', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f80c522-d29c-44d4-ab73-fc89ae209e26'}]}}} Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:29:13.639134 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.643371 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.654373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:13.655119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8085dbc9-c2bf-4c96-a368-8d2640e5835c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:13.655119 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8085dbc9-c2bf-4c96-a368-8d2640e5835c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.032224 Oct 25 03:29:13.655119 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2648/5195] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:29:13 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:29:13.659119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:13.660413 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d399c48-ac22-49dc-8298-80537caea425 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.452656 Oct 25 03:29:13.674531 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2548/5196] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:13 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:13.900727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddd6292d-ff30-4c20-87c8-71a6363799e1 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1527488364", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddd6292d-ff30-4c20-87c8-71a6363799e1 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 500 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1527488364", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1527488364', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f80c522-d29c-44d4-ab73-fc89ae209e26'}]}}} Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:29:13.905513 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddd6292d-ff30-4c20-87c8-71a6363799e1 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ddd6292d-ff30-4c20-87c8-71a6363799e1 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010323 Oct 25 03:29:13.908496 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2649/5197] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:29:13 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:29:14.017159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5351a91a-f75a-4c63-a587-fd17d5b157a7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-828023362", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5351a91a-f75a-4c63-a587-fd17d5b157a7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 753 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-828023362", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-828023362', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f80c522-d29c-44d4-ab73-fc89ae209e26'}]}}} Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:29:14.029626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:29:14.032068 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:29:14.039271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.039271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.039271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5351a91a-f75a-4c63-a587-fd17d5b157a7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:14.039271 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5351a91a-f75a-4c63-a587-fd17d5b157a7 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.027849 Oct 25 03:29:14.039271 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2549/5198] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:29:13 2022] POST /compute/v2.1/servers => generated 1197 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 25 03:29:14.119634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e992d290-3ab8-4712-b550-4b7eff32b138 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-417213172", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e992d290-3ab8-4712-b550-4b7eff32b138 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 1265 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-417213172", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6f80c522-d29c-44d4-ab73-fc89ae209e26"}]}} Oct 25 03:29:14.133593 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-417213172', 'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6f80c522-d29c-44d4-ab73-fc89ae209e26'}]}}} Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.135730 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:29:14.136843 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:29:14.138546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 25 03:29:14.138546 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.138546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e992d290-3ab8-4712-b550-4b7eff32b138 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:14.138546 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e992d290-3ab8-4712-b550-4b7eff32b138 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021408 Oct 25 03:29:14.144046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2650/5199] 10.222.0.36 () {60 vars in 1148 bytes} [Tue Oct 25 03:29:14 2022] POST /compute/v2.1/servers => generated 2221 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 25 03:29:14.153262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6b5f096-4909-4370-a029-07695d43c33c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:14.159495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6b5f096-4909-4370-a029-07695d43c33c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 18bb778b-1110-4fa3-86c9-5cbed104216c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:14.174814 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a6b5f096-4909-4370-a029-07695d43c33c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] HTTP exception thrown: Instance 18bb778b-1110-4fa3-86c9-5cbed104216c could not be found. Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6b5f096-4909-4370-a029-07695d43c33c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/18bb778b-1110-4fa3-86c9-5cbed104216c/metadata/test2 HTTP/1.1 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 18bb778b-1110-4fa3-86c9-5cbed104216c could not be found. Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'server_id': '18bb778b-1110-4fa3-86c9-5cbed104216c', 'id': 'test2'} Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18bb778b-1110-4fa3-86c9-5cbed104216c could not be found. Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18bb778b-1110-4fa3-86c9-5cbed104216c could not be found. Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:14.181257 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:14.185910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:29:14.185910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:29:14.185910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18bb778b-1110-4fa3-86c9-5cbed104216c could not be found. Oct 25 03:29:14.185910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:14.185910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6b5f096-4909-4370-a029-07695d43c33c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 404 to user: Instance 18bb778b-1110-4fa3-86c9-5cbed104216c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:14.186977 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6b5f096-4909-4370-a029-07695d43c33c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/18bb778b-1110-4fa3-86c9-5cbed104216c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.039422 Oct 25 03:29:14.187950 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2550/5200] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 25 03:29:14 2022] GET /compute/v2.1/servers/18bb778b-1110-4fa3-86c9-5cbed104216c/metadata/test2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:29:14.211732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:14.212412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:14.228425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:14.229025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:14.229487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:14.230475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:14.231014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:14.231363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:14.277823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:29:14.455214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e53112d1-f421-41c5-8a57-22f7029e383c tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "DELETE /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 204 len: 0 microversion: 2.1 time: 0.249804 Oct 25 03:29:14.456679 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2651/5201] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:29:14 2022] DELETE /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:29:14.465523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:14.466938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:14.478431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:14.481271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:14.482301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:14.485261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:14.487313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:14.488352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:14.691335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:14.692086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:14.704809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:14.705311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:14.705779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:14.722055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:14.722560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:14.723015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:14.780816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:14.790841 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7a55585b-3c00-49e7-9083-1b712f81740e tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1524 microversion: 2.1 time: 0.329576 Oct 25 03:29:14.807279 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2551/5202] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:14 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1524 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:15.136311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:15.152514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:15.156281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:15.158620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33835eff-f43e-4874-add0-b10d4825f848 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.472162 Oct 25 03:29:15.159396 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2652/5203] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:14 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:15.825743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:15.826723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:15.846155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4b36d41-8fa3-4186-9ba8-d92fb714f0e9 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Action: 'create', calling method: .version_select at 0x7efd333d2af0>, body: {"keypair": {"name": "tempest-keypair-1976414402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7buC6xzyZtgnuwpp5cSz8p8xNPGYA0rGb5EoYaZE4NP8FltkBbaLw1GJJtSna8IJ3x+cMEwvJ64ckZkhJkh4j6GwZzcjDps6j/hnqA6Yrdcg6zh/SghnEvBxMNlvGfLw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:15.856840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:15.857331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:15.857795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:15.858515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:15.871323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:15.871780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:15.879764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e4b36d41-8fa3-4186-9ba8-d92fb714f0e9 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Getting quotas for project e67af58b047c4bfaa8b88a201f8a8977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:29:15.893179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e4b36d41-8fa3-4186-9ba8-d92fb714f0e9 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Getting quotas for user 256a0798fd9d41248f28e18995674d40 and project e67af58b047c4bfaa8b88a201f8a8977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:29:15.960524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4b36d41-8fa3-4186-9ba8-d92fb714f0e9 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.915672 Oct 25 03:29:15.962681 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2552/5204] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:29:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:16.189083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:16.189480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:16.200470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:16.201804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:16.202280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:16.203004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:16.203477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:16.207496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:16.383659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:16.405913 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a61e5c74-533e-481f-b38a-2e0e7d6869a8 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1524 microversion: 2.1 time: 0.591693 Oct 25 03:29:16.414101 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2653/5205] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:15 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1524 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:16.816277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:16.825654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:16.836204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:16.837466 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e26fb0c-8dce-4bfc-aa89-719870a8660f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.653557 Oct 25 03:29:16.848670 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2553/5206] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:16 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:17.426669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2476fb3a-2484-4799-bd97-4045f0a20cfc req-5725f859-ea4a-48e3-b3bb-706bd3a48ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ff1fb7-92d4-4989-99a7-34debccb19ef", "name": "network-vif-deleted", "tag": "c66356f7-d4c8-4598-8993-481b61fd71ca"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:17.444132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:17.445122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:17.454997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:17.458499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:17.459340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:17.461427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:17.462525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:17.464521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:17.467825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2476fb3a-2484-4799-bd97-4045f0a20cfc req-5725f859-ea4a-48e3-b3bb-706bd3a48ee1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:17.468399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2476fb3a-2484-4799-bd97-4045f0a20cfc req-5725f859-ea4a-48e3-b3bb-706bd3a48ee1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:17.468838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2476fb3a-2484-4799-bd97-4045f0a20cfc req-5725f859-ea4a-48e3-b3bb-706bd3a48ee1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:17.567645 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2476fb3a-2484-4799-bd97-4045f0a20cfc req-5725f859-ea4a-48e3-b3bb-706bd3a48ee1 service nova] Creating event network-vif-deleted:c66356f7-d4c8-4598-8993-481b61fd71ca for instance 64ff1fb7-92d4-4989-99a7-34debccb19ef on n-h1-862355-1 Oct 25 03:29:17.601399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94980eb9110a4dc3bc6a3026124440ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07b099f24e6465392d00308ceba0903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:17.615749 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0bead200-f006-41b1-83c2-0835054256ce tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 200 len: 1482 microversion: 2.1 time: 0.175971 Oct 25 03:29:17.616230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2476fb3a-2484-4799-bd97-4045f0a20cfc req-5725f859-ea4a-48e3-b3bb-706bd3a48ee1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173996 Oct 25 03:29:17.619627 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2654/5207] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:17.620957 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2554/5208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:17 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 1482 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:17.871004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:17.871863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:17.884582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:17.892565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:17.893254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:17.899226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:17.900228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:17.901435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:18.216823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:18.228136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:18.230326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:18.232041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa406454-58f7-4d7d-b0a2-1e7080a3b40a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1740 microversion: 2.20 time: 0.366833 Oct 25 03:29:18.232846 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2655/5209] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:17 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:18.648771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:18.650085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] [instance: 64ff1fb7-92d4-4989-99a7-34debccb19ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:18.658265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:18.659028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:18.659970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:18.660953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:18.661622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:18.662656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:18.682471 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] HTTP exception thrown: Instance 64ff1fb7-92d4-4989-99a7-34debccb19ef could not be found. Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Request method failure captured: Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef HTTP/1.1 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1fyvSX9YIdZ1r3PGWUa_m1PH_G6vq3ogTyzasMcFymWzySz8bw50Sq_AqAsgaZUw_R5iB_qazmQwZb0QC4Gp62vhn3fKP4B414IZISpyAiRpNpndinPgwg3rpL3chEO1fEkQRBEEq8t0i-NK5bdGgirRbR05YpjAPZ6E0dHvEE9TP4 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b07b099f24e6465392d00308ceba0903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b07b099f24e6465392d00308ceba0903", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b07b099f24e6465392d00308ceba0903"}]}] Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b07b099f24e6465392d00308ceba0903 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1616724394 Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 94980eb9110a4dc3bc6a3026124440ca Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1616724394-project Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 64ff1fb7-92d4-4989-99a7-34debccb19ef could not be found. Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '64ff1fb7-92d4-4989-99a7-34debccb19ef'} Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ff1fb7-92d4-4989-99a7-34debccb19ef could not be found. Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ff1fb7-92d4-4989-99a7-34debccb19ef could not be found. Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:18.686294 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ff1fb7-92d4-4989-99a7-34debccb19ef could not be found. Oct 25 03:29:18.690829 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:18.692507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] Returning 404 to user: Instance 64ff1fb7-92d4-4989-99a7-34debccb19ef could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:18.694162 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2481ff0c-2d39-4295-9d42-82bc87d6de86 tempest-ServerMetadataNegativeTestJSON-1616724394 tempest-ServerMetadataNegativeTestJSON-1616724394-project] 10.222.0.36 "GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef" status: 404 len: 111 microversion: 2.1 time: 0.050875 Oct 25 03:29:18.698915 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2555/5210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:18 2022] GET /compute/v2.1/servers/64ff1fb7-92d4-4989-99a7-34debccb19ef => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:29:19.261041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:19.262434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:19.271419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:19.272763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:19.273450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:19.274422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:19.275099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:19.275788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:19.683027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:19.699828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:19.705645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:19.707162 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-efd8aee4-677e-4c2b-afac-5f8ab074b900 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1722 microversion: 2.20 time: 0.451209 Oct 25 03:29:19.710527 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2656/5211] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:19 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:19.769380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "7c05f748-e1e1-48cd-8eed-a06870ffa3f5"}], "security_groups": [{"name": "tempest-securitygroup--471397041"}], "key_name": "tempest-keypair-1976414402", "user_data": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:20.132369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] validate_networks() for [('7c05f748-e1e1-48cd-8eed-a06870ffa3f5', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:29:20.743900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:20.745041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:20.761172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:20.761666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:20.762128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:20.773082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:20.773594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:20.777474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:21.262643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:21.273821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:21.286074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:21.292071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7988ed9-fa02-4ca5-b35b-e99a3a09a5ac tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1722 microversion: 2.20 time: 0.552560 Oct 25 03:29:21.294787 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2657/5212] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:20 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1722 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:21.639145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:29:21.640291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:29:21.640852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:29:21.641277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:29:21.642412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:29:21.670736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:21.672730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:21.673216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:21.680791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:21.681353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:21.684106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:21.730143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Getting quotas for project e67af58b047c4bfaa8b88a201f8a8977. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:29:21.741798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Getting quotas for user 256a0798fd9d41248f28e18995674d40 and project e67af58b047c4bfaa8b88a201f8a8977. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:29:21.777874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:29:21.784015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:29:21.898262 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-588c243a-442b-4b90-8cbb-13ae38cddba1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.133203 Oct 25 03:29:21.899772 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2556/5213] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:29:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:29:21.911377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-914e00b0-f796-4bb6-8f89-10156a8426b0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:21.912940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-914e00b0-f796-4bb6-8f89-10156a8426b0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:22.096442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:22.097016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:22.110408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.113845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.114424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:22.116762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.118169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.119597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:22.254803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:29:22.299380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-914e00b0-f796-4bb6-8f89-10156a8426b0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:22.308172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-914e00b0-f796-4bb6-8f89-10156a8426b0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1226 microversion: 2.1 time: 0.401200 Oct 25 03:29:22.310707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2658/5214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:21 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1226 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:22.333167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:22.334987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:22.343329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.344011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.356535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:22.358376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.361700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.362502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:22.392008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:22.503254 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-18e3c4aa-2c0d-4345-b17c-24a773319ce5 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 204 len: 0 microversion: 2.1 time: 0.411844 Oct 25 03:29:22.505985 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2557/5215] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:29:22 2022] DELETE /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:29:22.516894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:22.517629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:22.527620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.528354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.528975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:22.530518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.531558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.532135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:22.837302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:22.852705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:22.854198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:22.855421 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-996d6389-f8d6-4a7e-a4fc-0e92ca048bee tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1725 microversion: 2.20 time: 0.527515 Oct 25 03:29:22.855993 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2659/5216] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:22 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1725 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:22.886575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f9111f8-edc4-4137-a6a7-88bf42a369bd"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:22.889110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:22.900240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.900736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.901177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:22.910102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:22.910685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:22.911134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.080783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:23.105991 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7adc010a-fab1-414e-a895-ab7710b4ecf4 tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1469 microversion: 2.1 time: 0.596236 Oct 25 03:29:23.109044 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2558/5217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:22 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1469 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:23.338735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:23.340089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:23.353646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:23.355227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:23.358848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.360833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:23.363968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:23.366279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.490265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5601fdf6-0258-4dcb-aaae-bf848f231400 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.607852 Oct 25 03:29:23.492340 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2660/5218] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Oct 25 03:29:22 2022] POST /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 188 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:29:23.520399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-caaf9ea6-2b3c-428e-83db-5e10e9c98901 req-b754a1d5-a432-44d9-b39a-42a7d90438a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607eba3e-2e4d-4aad-9dcd-a91d25ed665d", "name": "network-vif-unplugged", "status": "completed", "tag": "892d2ec9-9480-448e-9f12-bdc878a287e5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:23.529063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:23.543267 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-62add421-0de2-40b8-8e8a-06e031b665c5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1278 microversion: 2.1 time: 0.208707 Oct 25 03:29:23.549947 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2559/5219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:23 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:23.552515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-caaf9ea6-2b3c-428e-83db-5e10e9c98901 req-b754a1d5-a432-44d9-b39a-42a7d90438a0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:23.552956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-caaf9ea6-2b3c-428e-83db-5e10e9c98901 req-b754a1d5-a432-44d9-b39a-42a7d90438a0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:23.555400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-caaf9ea6-2b3c-428e-83db-5e10e9c98901 req-b754a1d5-a432-44d9-b39a-42a7d90438a0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.582170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_external_events [req-caaf9ea6-2b3c-428e-83db-5e10e9c98901 req-b754a1d5-a432-44d9-b39a-42a7d90438a0 service nova] Unable to find a host for instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d. Dropping event network-vif-unplugged {{(pid=120562) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 25 03:29:23.588919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-caaf9ea6-2b3c-428e-83db-5e10e9c98901 req-b754a1d5-a432-44d9-b39a-42a7d90438a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072603 Oct 25 03:29:23.590677 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2661/5220] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 25 03:29:23.679228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:23.680060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:23.689800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:23.690489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:23.691041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.691871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:23.692445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:23.693417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.750542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120563) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 25 03:29:23.872610 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f402d9dd-c94c-40be-914a-a16c835f2cad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/action" status: 202 len: 0 microversion: 2.20 time: 0.199659 Oct 25 03:29:23.873657 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2560/5221] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:29:23 2022] POST /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:29:23.882051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:23.882811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:23.890135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:23.891003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:23.891719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.892904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:23.894111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:23.894726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:23.900071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:24.141524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:24.143369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:24.161100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:24.163476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:24.164625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:24.171183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:24.179325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:24.181492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:24.556867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:24.574346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:24.575804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:24.577012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aaedef86-dcb7-4311-8bf6-01a93ce5bda9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1751 microversion: 2.20 time: 0.699367 Oct 25 03:29:24.577593 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2662/5222] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:23 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1751 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:24.600855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:24.608773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:24.620452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:24.621164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:24.622589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:24.623522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:24.624178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:24.624790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:24.903810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:24.922897 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a6bb69f-0ec5-4f89-a685-81d2222cbc6f tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1284 microversion: 2.1 time: 0.331093 Oct 25 03:29:24.930390 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2663/5223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:24 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1284 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:25.267954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb5f02ac0914b8aab71589dd0ea0f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40263784b9b443fc8ee18b3a5aef384d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:25.294819 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-86fe780b-58ff-4819-a96f-5598e035a90d tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 200 len: 1469 microversion: 2.1 time: 1.160932 Oct 25 03:29:25.306665 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2561/5224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:24 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 1469 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:25.511094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2a9888e5-82d9-41c1-ad44-d933e4ee2282 req-b6854c58-5b4c-4c94-a73a-89874690fc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadbb6f2-47c6-4821-8699-2564f9f02c92", "name": "network-vif-deleted", "tag": "69ceefe2-e00e-4216-bab5-5c7bbd3970ea"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:25.528007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2a9888e5-82d9-41c1-ad44-d933e4ee2282 req-b6854c58-5b4c-4c94-a73a-89874690fc4f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:25.528746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2a9888e5-82d9-41c1-ad44-d933e4ee2282 req-b6854c58-5b4c-4c94-a73a-89874690fc4f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:25.529420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2a9888e5-82d9-41c1-ad44-d933e4ee2282 req-b6854c58-5b4c-4c94-a73a-89874690fc4f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:25.548337 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2a9888e5-82d9-41c1-ad44-d933e4ee2282 req-b6854c58-5b4c-4c94-a73a-89874690fc4f service nova] Creating event network-vif-deleted:69ceefe2-e00e-4216-bab5-5c7bbd3970ea for instance eadbb6f2-47c6-4821-8699-2564f9f02c92 on n-h2-862355-1 Oct 25 03:29:25.556858 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2a9888e5-82d9-41c1-ad44-d933e4ee2282 req-b6854c58-5b4c-4c94-a73a-89874690fc4f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133840 Oct 25 03:29:25.560580 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2664/5225] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:25.611864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:25.612483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:25.626382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:25.626882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:25.629227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:25.631586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:25.632590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:25.634947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:25.964540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:25.970210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:25.993066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:25.993872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:25.994524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:25.995428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:25.996079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:25.996685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:26.084881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:26.103801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:26.108004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:26.117180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14be640b-7fd3-4c46-b7eb-3c2965591658 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1751 microversion: 2.20 time: 0.504667 Oct 25 03:29:26.122676 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2562/5226] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:25 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1751 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:26.292132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:26.322333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65dedad1-10fa-4baf-932d-d7713400c3d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1284 microversion: 2.1 time: 0.368538 Oct 25 03:29:26.326327 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2665/5227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:25 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1284 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:26.327180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:26.328315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] [instance: eadbb6f2-47c6-4821-8699-2564f9f02c92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:26.341313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:26.342694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:26.343858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:26.345536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:26.347314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:26.348036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:26.384814 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] HTTP exception thrown: Instance eadbb6f2-47c6-4821-8699-2564f9f02c92 could not be found. Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Request method failure captured: Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 HTTP/1.1 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1ds1vlvSIqhwRIXRQXbrbk3_4LIAM9AO0GV3zKiWTLqvQUL4zeKBsQkX5vVY-b5Viftmvj_AvgC4xbsEjBuCI7BjOGK00Tsv3HtnMXOovqaw-8Xigqx3n9E5UyQsPUBBnumjae_wFfBwVqfZt3EP5sZj5bU1jp68o-7PhkJtLU0V-8 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 40263784b9b443fc8ee18b3a5aef384d Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-VolumesBackupsTest-376823211 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40263784b9b443fc8ee18b3a5aef384d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40263784b9b443fc8ee18b3a5aef384d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_40263784b9b443fc8ee18b3a5aef384d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/40263784b9b443fc8ee18b3a5aef384d"}]}] Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-VolumesBackupsTest-376823211 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 40263784b9b443fc8ee18b3a5aef384d Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-VolumesBackupsTest-376823211 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-VolumesBackupsTest-376823211-project Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0eb5f02ac0914b8aab71589dd0ea0f68 Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-VolumesBackupsTest-376823211-project Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance eadbb6f2-47c6-4821-8699-2564f9f02c92 could not be found. Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'eadbb6f2-47c6-4821-8699-2564f9f02c92'} Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadbb6f2-47c6-4821-8699-2564f9f02c92 could not be found. Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadbb6f2-47c6-4821-8699-2564f9f02c92 could not be found. Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:29:26.389335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:26.393918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:29:26.393918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:29:26.393918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:29:26.393918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:29:26.393918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:29:26.393918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadbb6f2-47c6-4821-8699-2564f9f02c92 could not be found. Oct 25 03:29:26.393918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:29:26.397572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] Returning 404 to user: Instance eadbb6f2-47c6-4821-8699-2564f9f02c92 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:29:26.401754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9cb23519-2d12-41b1-b2f5-c9be3c40bf3b tempest-VolumesBackupsTest-376823211 tempest-VolumesBackupsTest-376823211-project] 10.222.0.36 "GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92" status: 404 len: 111 microversion: 2.1 time: 0.080226 Oct 25 03:29:26.402908 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2563/5228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:26 2022] GET /compute/v2.1/servers/eadbb6f2-47c6-4821-8699-2564f9f02c92 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:29:27.155537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:27.156883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:27.169383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:27.172376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:27.173051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:27.177195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:27.178395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:27.179180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:27.351227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:27.352020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:27.358971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:27.366382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:27.366972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:27.368769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:27.370966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:27.371520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:27.500489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:27.514241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:27.517543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:27.522510 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f40b5dfb-456c-4828-9f6e-0028aa6b8e3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 0.371097 Oct 25 03:29:27.524866 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2666/5229] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:27 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:28.067195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:28.077625 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-842d2580-7bb4-471f-bfa5-427e995574c4 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 0.730469 Oct 25 03:29:28.082438 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2564/5230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:27 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:28.556204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:28.557426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:28.569649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:28.575777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:28.576577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:28.578896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:28.585475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:28.587005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:28.947892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:28.971762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:28.973926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:28.975985 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8f8af8e-dd62-4bed-a460-804a4969419a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 0.424902 Oct 25 03:29:28.977042 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2667/5231] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:28 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:29.116378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:29.121004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:29.148099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:29.158886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:29.159603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:29.164497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:29.165272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:29.167076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:30.004767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:30.005429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:30.028367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:30.028870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:30.029312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:30.030070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:30.030526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:30.030955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:30.045762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:30.058929 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bd101503-f51e-4626-8278-6bb6268f7d99 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 0.945157 Oct 25 03:29:30.059602 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2565/5232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:29 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:30.395868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:30.419020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:30.423409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:30.426844 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37b8e740-0bb7-4005-b408-f1c9b68c3a93 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 0.425730 Oct 25 03:29:30.430228 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2668/5233] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:29 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:31.088839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:31.090015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:31.111084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:31.116800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:31.117339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:31.119328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:31.120757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:31.122444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:31.124077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:31.462911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:31.464152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:31.486594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:31.495546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:31.498509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:31.499640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:31.500276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:31.504015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:31.651386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:31.665026 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77c57144-92bd-4da8-b336-214b9229e724 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 0.576777 Oct 25 03:29:31.669779 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2566/5234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:31 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:31.681791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-910137dd-cdda-4325-832a-297df291c127 req-17718407-7258-42d5-b2d9-43ff4df4988b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c561cc-b74d-4edb-ab67-5758c6cf58ae", "tag": "f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:31.705106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:31.717548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-910137dd-cdda-4325-832a-297df291c127 req-17718407-7258-42d5-b2d9-43ff4df4988b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:31.718361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-910137dd-cdda-4325-832a-297df291c127 req-17718407-7258-42d5-b2d9-43ff4df4988b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:31.721326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-910137dd-cdda-4325-832a-297df291c127 req-17718407-7258-42d5-b2d9-43ff4df4988b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:31.761645 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-910137dd-cdda-4325-832a-297df291c127 req-17718407-7258-42d5-b2d9-43ff4df4988b service nova] Creating event network-changed:f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91 for instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae on n-h1-862355-1 Oct 25 03:29:31.776223 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-910137dd-cdda-4325-832a-297df291c127 req-17718407-7258-42d5-b2d9-43ff4df4988b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103725 Oct 25 03:29:31.777656 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2567/5235] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:31.913011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:31.925420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:31.931606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:31.943951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46708dd7-1449-44c6-9b34-656092286147 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 0.487488 Oct 25 03:29:31.954296 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2669/5236] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:31 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:32.699860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:32.700486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:32.703070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:32.722585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:32.726563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:32.727921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:32.729780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:32.731038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:32.733060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:32.982813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:32.983610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:32.986791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:33.000283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:33.005972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:33.006924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:33.007908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:33.008617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:33.011588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:33.247557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:33.257121 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2560dd92-e570-4993-9e37-f541bd403c24 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 0.565582 Oct 25 03:29:33.259580 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2568/5237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:32 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:33.399533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:33.415991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:33.419305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:33.423067 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-255dd2e9-c0ce-4c0f-8aeb-1597c0daa10d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 0.445273 Oct 25 03:29:33.425471 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2670/5238] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:32 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:34.290361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:34.292258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:34.314005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:34.315100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:34.315721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:34.317770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:34.320116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:34.320974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:34.461651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:34.462311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:34.486347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:34.489015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:34.490432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:34.495023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:34.495735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:34.496837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:34.924443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:34.953553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:34.962361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:34.966074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-135ee423-7795-40c6-a285-225972493a26 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 0.510860 Oct 25 03:29:34.972455 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2671/5239] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:34 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:35.265504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:35.288084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7a76d75c-3b39-4750-85fd-ed6b070c52d0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 0.994861 Oct 25 03:29:35.308640 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2569/5240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:34 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:36.000626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:36.001239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:36.020422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:36.021580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:36.022057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:36.022776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:36.023231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:36.023659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:36.318022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:36.319874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:36.336864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:36.337619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:36.338396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:36.339529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:36.340142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:36.342258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:36.973521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:37.007692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:37.012207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:37.017249 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fcd5c054-a5af-4469-a0b6-77f65285d94f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 1.018293 Oct 25 03:29:37.034786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2672/5241] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:35 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:37.331750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:37.344995 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bfae608f-8c9b-4521-96e7-ddb705298ca3 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 1.032843 Oct 25 03:29:37.350937 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2570/5242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:36 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:38.053786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:38.055211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:38.069741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:38.078545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:38.079385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:38.080365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:38.081021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:38.082924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:38.377783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:38.379207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:38.395159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:38.396764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:38.397509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:38.398572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:38.399498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:38.402692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:38.770106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:38.795151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:38.802164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:38.807488 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6eaa08e7-8fe5-4d7c-85b1-455e69326cef tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1753 microversion: 2.20 time: 0.760234 Oct 25 03:29:38.813228 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2673/5243] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:38 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1753 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:38.966564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:38.986019 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e5c5f55-3475-4a40-b866-9fea1316aaee tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 0.608466 Oct 25 03:29:38.989351 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2571/5244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:38 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:39.850936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:39.851568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:39.866927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:39.879518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:39.882232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:39.885781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:39.887695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:39.889430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:40.023666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:40.024908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:40.039677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:40.042433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:40.046267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:40.047237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:40.048038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:40.048691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:40.889893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:40.913502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:40.922128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:40.929255 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01a54182-5c82-484a-94a8-5b4513e14581 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 1.081764 Oct 25 03:29:40.933658 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2674/5245] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:39 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:41.005937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:41.020710 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08be1bee-e093-414d-93fb-46073970e103 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 1.005013 Oct 25 03:29:41.026050 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2572/5246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:40 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:29:41.061646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e3838fa6-ffdb-4bbd-9981-93ee8d85886d req-a981c6e3-aec6-48d0-92c8-c1ede1ca94ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c561cc-b74d-4edb-ab67-5758c6cf58ae", "name": "network-vif-plugged", "status": "completed", "tag": "f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:41.085181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:41.094508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e3838fa6-ffdb-4bbd-9981-93ee8d85886d req-a981c6e3-aec6-48d0-92c8-c1ede1ca94ab service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:41.101169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e3838fa6-ffdb-4bbd-9981-93ee8d85886d req-a981c6e3-aec6-48d0-92c8-c1ede1ca94ab service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:41.101647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e3838fa6-ffdb-4bbd-9981-93ee8d85886d req-a981c6e3-aec6-48d0-92c8-c1ede1ca94ab service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:41.149812 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e3838fa6-ffdb-4bbd-9981-93ee8d85886d req-a981c6e3-aec6-48d0-92c8-c1ede1ca94ab service nova] Creating event network-vif-plugged:f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91 for instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae on n-h1-862355-1 Oct 25 03:29:41.161395 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e3838fa6-ffdb-4bbd-9981-93ee8d85886d req-a981c6e3-aec6-48d0-92c8-c1ede1ca94ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101291 Oct 25 03:29:41.166377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2675/5247] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:41.963926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:41.964723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:41.987332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:41.988168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:41.998479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:41.999494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:42.000136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:42.000759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:42.047853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:42.049188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:42.072010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:42.076122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:42.077209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:42.086280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:42.086977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:42.087425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:42.604707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:42.618067 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ddbc32ce-4aec-4fda-8a6b-2fefd65a7f52 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1351 microversion: 2.1 time: 0.575000 Oct 25 03:29:42.622586 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2676/5248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:42 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1351 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:42.648172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:42.685892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:42.692183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:42.693987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ff9f6df-5ec2-49c4-a228-35d4d821db61 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.734815 Oct 25 03:29:42.694573 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2573/5249] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:41 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:43.650831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:43.651455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:43.689020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:43.690199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:43.697382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:43.698727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:43.701266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:43.709549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:43.725871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:43.727051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:43.746560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:43.750904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:43.768469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:43.788129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:43.790703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:43.792606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:44.321255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:44.343524 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d62c940-93a2-49b4-97d5-35041259f3ab tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1542 microversion: 2.1 time: 0.696291 Oct 25 03:29:44.345785 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2677/5250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:43 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1542 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:44.374476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:44.376290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:44.398171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:44.399105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:44.399715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:44.400697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:44.401582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:44.402226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:44.792098 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-141f2b99-ccbc-4397-a9a4-e70838ebae97 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.423042 Oct 25 03:29:44.794756 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2678/5251] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:29:44 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae/os-interface => generated 285 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:29:44.995696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:45.004279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:45.034281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:45.045521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:45.076051 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef4deee0-dd1f-45ff-8879-c8954f2b85d7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 1.329951 Oct 25 03:29:45.079985 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2574/5252] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:43 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:46.108998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:46.109829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:46.132163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:46.134196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:46.134829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:46.137982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:46.140754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:46.144430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:46.515470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1349396476", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:46.893900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:46.918323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:46.920205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:46.921854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6534565-23a6-4a0a-afb3-07325d0cc499 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.818707 Oct 25 03:29:46.923010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2679/5253] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:46 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:47.956687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:47.957560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:47.980863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:47.984727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:47.987775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:47.990709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:47.995320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:47.996810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:48.072833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:49.102633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:49.127832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:49.153907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:49.156782 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d7a9ea4e-e95a-41fd-b4a9-52bcf00a248f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 1.206009 Oct 25 03:29:49.160214 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2680/5254] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:47 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:49.244762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-cc491c13-021d-437e-957d-d21fe9ff397e req-f050b456-9659-4319-ac07-9969412c1c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c561cc-b74d-4edb-ab67-5758c6cf58ae", "tag": "f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:29:49.269910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cc491c13-021d-437e-957d-d21fe9ff397e req-f050b456-9659-4319-ac07-9969412c1c2c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:49.278703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cc491c13-021d-437e-957d-d21fe9ff397e req-f050b456-9659-4319-ac07-9969412c1c2c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:49.282336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cc491c13-021d-437e-957d-d21fe9ff397e req-f050b456-9659-4319-ac07-9969412c1c2c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:49.334893 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-cc491c13-021d-437e-957d-d21fe9ff397e req-f050b456-9659-4319-ac07-9969412c1c2c service nova] Creating event network-changed:f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91 for instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae on n-h1-862355-1 Oct 25 03:29:49.347345 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-cc491c13-021d-437e-957d-d21fe9ff397e req-f050b456-9659-4319-ac07-9969412c1c2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112240 Oct 25 03:29:49.353759 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2681/5255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:29:50.191915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:50.193449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:50.219725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:50.222575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:50.226693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:50.227984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:50.228902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:50.229614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:50.959935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:50.989182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:50.991877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:51.002499 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c086bd75-b43a-4cab-9d40-96fce692f858 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.814957 Oct 25 03:29:51.010167 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2682/5256] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:50 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:52.043821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:52.044920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:52.065082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:52.065930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:52.066487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:52.071462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:52.072115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:52.073723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:52.456297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:52.476219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:52.490287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:52.494014 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-41c5435c-3d72-4423-adb8-ac5c025588cf tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.457844 Oct 25 03:29:52.513841 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2683/5257] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:52 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:53.546696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:53.548177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:53.563492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:53.564388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:53.565400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:53.570738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:53.571793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:53.572723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:54.508512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:54.537766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:54.553481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:54.554958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27f725c9-22bb-458e-961c-2548f64df693 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 1.022006 Oct 25 03:29:54.556200 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2684/5258] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:53 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:55.586514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:55.588170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:55.600659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:55.609192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:55.610858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:55.611940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:55.612596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:55.615543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:56.087661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:56.109451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:56.128492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:56.142080 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27bc3bed-07d9-4886-9e93-2e33cb748d76 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.557231 Oct 25 03:29:56.145557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2685/5259] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:55 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:29:56.179777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:56.620801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=19 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:29:57.178257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:57.180442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:57.204371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:57.205160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:57.205834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:57.206742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:57.207517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:57.214583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:57.815014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:57.844044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:57.871218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:57.872489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46851fff-898d-4a11-93a4-69191890b30b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.702911 Oct 25 03:29:57.874077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2686/5260] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:57 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:58.236758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] validate_networks() for [('e73e30e4-e8c5-450a-88be-9e18c4916dad', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:29:58.914843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:29:58.915298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:29:58.915779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:29:58.916194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:29:58.916759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:29:58.921421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:58.921969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:58.927611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:58.928457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:58.929079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:58.930028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:58.930686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:58.931473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:58.938597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:58.939876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:58.941183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:58.945760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:29:58.946468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:29:58.947095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:29:58.981261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for project bea59242063e4d0599459a00b01770ee. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:29:59.030003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for user 0961d97e347042a190549c04dd3f386d and project bea59242063e4d0599459a00b01770ee. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:29:59.070697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:29:59.076170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:29:59.203077 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1860cab7-5173-48ec-945a-eea9771d00d8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 13.060866 Oct 25 03:29:59.206729 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2575/5261] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:29:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 13067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:29:59.223148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d60eeb44-bfe3-4bce-8f1b-b5b5eafb81fc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:29:59.223788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d60eeb44-bfe3-4bce-8f1b-b5b5eafb81fc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:29:59.266306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:59.288662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:59.290931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:59.294496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec8ea810-705e-469b-bb06-2f25846ce543 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.393596 Oct 25 03:29:59.305450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2687/5262] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:29:58 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:29:59.842932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d60eeb44-bfe3-4bce-8f1b-b5b5eafb81fc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:29:59.855629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d60eeb44-bfe3-4bce-8f1b-b5b5eafb81fc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1222 microversion: 2.1 time: 0.638230 Oct 25 03:29:59.862487 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2576/5263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:29:59 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1222 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:29:59.966964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-241219129", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:00.057100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] validate_networks() for [('e73e30e4-e8c5-450a-88be-9e18c4916dad', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:30:00.331219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:00.331751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:00.350658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:00.351738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:00.352410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:00.356501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:00.357328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:00.358083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:00.658940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:00.673302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:00.678733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:00.680269 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d09dca8-9078-463c-ae3a-e35f7e36855c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.353278 Oct 25 03:30:00.702174 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2577/5264] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:00 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:30:00.959346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:30:00.960134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:30:00.960865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:30:00.961495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:30:00.962156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:30:00.976654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:00.980028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:00.980665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:00.984542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:00.985761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:00.987316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:01.015783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for project bea59242063e4d0599459a00b01770ee. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:30:01.022120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for user 0961d97e347042a190549c04dd3f386d and project bea59242063e4d0599459a00b01770ee. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:30:01.036915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:30:01.039690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:30:01.162628 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2993e6ba-97b8-40fa-8b56-502da72fdfce tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.198821 Oct 25 03:30:01.170342 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2688/5265] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:29:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:30:01.178827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7604278-cd33-41d0-b58e-3a3f7597c830 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:01.180808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7604278-cd33-41d0-b58e-3a3f7597c830 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:01.285527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7604278-cd33-41d0-b58e-3a3f7597c830 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:01.302923 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7604278-cd33-41d0-b58e-3a3f7597c830 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1221 microversion: 2.1 time: 0.128415 Oct 25 03:30:01.308382 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2578/5266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:01 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:01.721410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:01.722468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:01.744631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:01.754538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:01.755821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:01.756831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:01.769268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:01.770177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:02.332872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:02.334130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:02.372767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:02.382511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:02.382979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:02.383745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:02.384213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:02.384644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:02.452464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:02.463071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:02.471448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:02.472905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b9424e9-18cb-417e-8f02-c8ad17cd9f78 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.760811 Oct 25 03:30:02.476229 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2689/5267] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:01 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:30:02.543528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:02.559422 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c82f4c1-7c60-44f5-9b0e-e9658dc1ff34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1225 microversion: 2.1 time: 0.231551 Oct 25 03:30:02.560626 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2579/5268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:02 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1225 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:03.505421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:03.509349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:03.547333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:03.548287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:03.563029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:03.565022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:03.572188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:03.576352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:03.589928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:03.590692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:03.603349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:03.604119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:03.604721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:03.605794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:03.608186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:03.608819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:03.716742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:03.727630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-056365cc-cb55-4001-b4c4-7cb932b06def tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1281 microversion: 2.1 time: 0.141552 Oct 25 03:30:03.728239 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2580/5269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:03 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:04.133542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:04.155315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:04.164247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:04.167181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f21fde9b-f6b8-4c38-90aa-ec171f942957 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.665995 Oct 25 03:30:04.169079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2690/5270] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:03 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:30:04.758040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:04.758680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:04.770578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:04.778395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:04.778727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:04.779488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:04.779953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:04.780394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:04.913402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:04.926830 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb7a1a71-3e58-4414-b665-6536d7ab2a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1279 microversion: 2.1 time: 0.173312 Oct 25 03:30:04.936262 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2581/5271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:04 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:05.233910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:05.234552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:05.258436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:05.258948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:05.265305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:05.266263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:05.266661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:05.267124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:05.961377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:05.962066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:05.981319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:05.981854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:05.982299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:05.983497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:05.983975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:05.984410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:06.363517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:06.381724 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81bed202-c1c5-4b1e-a192-3328409c0a44 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.427273 Oct 25 03:30:06.399411 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2582/5272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:05 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:07.103951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:07.124702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:07.133505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:07.135122 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50a5340c-ecdf-4c3f-8763-6f884d1c6cd1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 1.906260 Oct 25 03:30:07.135874 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2691/5273] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:05 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:30:07.430051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:07.430596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:07.445622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:07.446603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:07.448173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:07.449292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:07.450079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:07.450728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:08.157649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:08.170035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:08.171738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:08.177402 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf68e1f1-eaf8-403c-91a1-fada2ab65f27 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.754747 Oct 25 03:30:08.179832 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2583/5274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:07 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:08.209374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:08.212706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:08.215507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:08.225653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:08.227132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:08.230377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:08.804374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:08.828834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:08.830337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:08.831576 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1aea34e-086e-41c2-9d27-e65f900ee865 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.667229 Oct 25 03:30:08.832169 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2692/5275] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:08 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:30:09.204938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:09.206279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:09.221068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:09.223014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:09.223513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:09.225037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:09.225271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:09.237921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:09.238593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:09.548776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d8504996-6c3b-4468-af59-2ceb41ca688a req-14221f45-ebaf-4e50-a4cd-385f68e69c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9930048d-9d62-4f8f-a57b-2b232b15dc2c", "tag": "7c253ff3-adba-4fe4-ae41-3e275c1f0231"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:09.582230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:09.587414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d8504996-6c3b-4468-af59-2ceb41ca688a req-14221f45-ebaf-4e50-a4cd-385f68e69c04 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:09.587899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d8504996-6c3b-4468-af59-2ceb41ca688a req-14221f45-ebaf-4e50-a4cd-385f68e69c04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:09.588331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d8504996-6c3b-4468-af59-2ceb41ca688a req-14221f45-ebaf-4e50-a4cd-385f68e69c04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:09.594594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2849e6a1-9874-4a35-bc97-419a79b5cf77 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.393510 Oct 25 03:30:09.606499 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2584/5276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:09 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:09.628851 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d8504996-6c3b-4468-af59-2ceb41ca688a req-14221f45-ebaf-4e50-a4cd-385f68e69c04 service nova] Creating event network-changed:7c253ff3-adba-4fe4-ae41-3e275c1f0231 for instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c on n-h2-862355-1 Oct 25 03:30:09.643276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d8504996-6c3b-4468-af59-2ceb41ca688a req-14221f45-ebaf-4e50-a4cd-385f68e69c04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098188 Oct 25 03:30:09.644228 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2693/5277] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:30:09.863864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:09.864769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:09.875942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:09.876581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:09.877083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:09.879740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:09.880583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:09.882400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:10.288704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:10.299072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:10.300849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:10.302390 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0bcaf02d-4fe7-4f79-9615-efc5a125b9c8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.442975 Oct 25 03:30:10.303155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2585/5278] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:09 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:30:10.631855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:10.633961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:10.647610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:10.652228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:10.652949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:10.653975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:10.662682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:10.663698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:11.005164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:11.031522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:11.334363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:11.335292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:11.353453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:11.355410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:11.356168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:11.356845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:11.358423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:11.360476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:11.361184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:11.374266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:11.386170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ba15af7-20b7-4e29-98a7-752b8fa007e2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.760472 Oct 25 03:30:11.390252 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2694/5279] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:10 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:11.664280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-deb2e298-32bb-4a4e-88e8-91d00e168aff req-dcc052a9-ad87-4548-91d5-b09056a9c8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae48ec9-a744-4b6d-b1ce-b945e18331aa", "tag": "f62db723-ec1f-4679-94e4-684a40afeca4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:11.686163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-deb2e298-32bb-4a4e-88e8-91d00e168aff req-dcc052a9-ad87-4548-91d5-b09056a9c8fa service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:11.686810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-deb2e298-32bb-4a4e-88e8-91d00e168aff req-dcc052a9-ad87-4548-91d5-b09056a9c8fa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:11.687343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-deb2e298-32bb-4a4e-88e8-91d00e168aff req-dcc052a9-ad87-4548-91d5-b09056a9c8fa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:11.709563 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-deb2e298-32bb-4a4e-88e8-91d00e168aff req-dcc052a9-ad87-4548-91d5-b09056a9c8fa service nova] Creating event network-changed:f62db723-ec1f-4679-94e4-684a40afeca4 for instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa on n-h2-862355-1 Oct 25 03:30:11.719782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:11.725554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-deb2e298-32bb-4a4e-88e8-91d00e168aff req-dcc052a9-ad87-4548-91d5-b09056a9c8fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064910 Oct 25 03:30:11.726299 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2695/5280] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:30:11.731413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:11.732895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:11.742507 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4efffdd-8baf-49b3-94f3-d66274a26dd6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.412693 Oct 25 03:30:11.743526 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2586/5281] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:11 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:30:11.988608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d34eaa09-476f-4723-a982-5e690e5db53f req-27801a04-0b8f-480c-93df-a6199710ed91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607eba3e-2e4d-4aad-9dcd-a91d25ed665d", "name": "network-vif-plugged", "status": "completed", "tag": "892d2ec9-9480-448e-9f12-bdc878a287e5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:12.011009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d34eaa09-476f-4723-a982-5e690e5db53f req-27801a04-0b8f-480c-93df-a6199710ed91 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:12.012865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d34eaa09-476f-4723-a982-5e690e5db53f req-27801a04-0b8f-480c-93df-a6199710ed91 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:12.014811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d34eaa09-476f-4723-a982-5e690e5db53f req-27801a04-0b8f-480c-93df-a6199710ed91 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:12.044802 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d34eaa09-476f-4723-a982-5e690e5db53f req-27801a04-0b8f-480c-93df-a6199710ed91 service nova] Creating event network-vif-plugged:892d2ec9-9480-448e-9f12-bdc878a287e5 for instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d on n-h2-862355-1 Oct 25 03:30:12.057394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d34eaa09-476f-4723-a982-5e690e5db53f req-27801a04-0b8f-480c-93df-a6199710ed91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072906 Oct 25 03:30:12.060020 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2696/5282] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:12.419100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:12.419724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:12.447030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:12.447529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:12.447980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:12.448837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:12.449326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:12.451154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:12.775249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:12.776799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:12.782756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:12.807981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:12.811164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:12.811894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:12.814519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:12.815870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:12.817009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:12.945457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:12.959578 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-253b3ebb-5dab-4b1b-9b2d-3920e6e36c10 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.551754 Oct 25 03:30:12.966600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2587/5283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:12 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:13.359434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:13.377168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:13.380762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:13.385443 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe8c50d3-987c-4cdc-b127-258cb7566a66 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.615132 Oct 25 03:30:13.399676 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2697/5284] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:12 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:30:13.990911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:13.992099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:14.018481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:14.018986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:14.019437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:14.020161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:14.020693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:14.028500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:14.429315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:14.430730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:14.446425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:14.446922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:14.457811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:14.458837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:14.459333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:14.459982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:14.664047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:14.686139 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d8b1fcd-674e-4339-81a9-b07c1aacff5a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.694634 Oct 25 03:30:14.689190 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2588/5285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:13 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:14.752501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:14.768071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:14.789455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:14.791040 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9839de1b-7542-4857-8505-380cf2b7fbdc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.366450 Oct 25 03:30:14.791649 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2698/5286] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:14 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:30:15.711115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:15.712671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:15.722351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:15.723384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:15.725368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:15.726422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:15.727168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:15.727801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:15.827748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:15.828380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:15.848296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:15.849358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:15.849848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:15.850555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:15.851017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:15.851447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:16.256119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:16.267394 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-060f274e-71a9-4c5b-87aa-8292cc6f226c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.562524 Oct 25 03:30:16.268613 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2589/5287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:15 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:16.407291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:16.422096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:16.425449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:16.432768 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d8f106b7-36c8-4da6-b4c1-3e5bfbc50855 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.616765 Oct 25 03:30:16.451401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2699/5288] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:15 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:30:17.295229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:17.295855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:17.311233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:17.315582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:17.316249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:17.317185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:17.317894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:17.318520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:17.466106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:17.467419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:17.480513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:17.484185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:17.484953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:17.486229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:17.486653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:17.487881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:17.548851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:17.715763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:17.733149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fd962e54-e336-4595-9730-64044d4d3d08 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.440395 Oct 25 03:30:17.736430 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2590/5289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:17 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:17.847372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:17.858639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:17.862028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:17.862028 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-590ae5c1-f233-4748-b02c-8d50da61a389 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1809 microversion: 2.20 time: 0.400537 Oct 25 03:30:17.872427 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2700/5290] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:17 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1809 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:30:18.761254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:18.762689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:18.775407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:18.775901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:18.776341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:18.777059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:18.777519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:18.777970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:18.901450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:18.902155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:18.918301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:18.918840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:18.920538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:18.921299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:18.923128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:18.923566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:19.210243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:19.223205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:19.227996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:19.229570 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-532e516f-d207-4463-af1c-aa95072c7c2b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1796 microversion: 2.20 time: 0.332303 Oct 25 03:30:19.231188 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2701/5291] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:30:18 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1796 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:30:19.243948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:19.263881 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99f84387-5578-4a9c-b582-e8c8230dba36 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.498225 Oct 25 03:30:19.265408 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2591/5292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:18 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:19.500378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ca97c375-964a-4837-93ae-ba11d3db5d84 req-164e8896-75e5-4a77-b4e2-ce7b47098c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9930048d-9d62-4f8f-a57b-2b232b15dc2c", "name": "network-vif-plugged", "status": "completed", "tag": "7c253ff3-adba-4fe4-ae41-3e275c1f0231"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:19.523351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ca97c375-964a-4837-93ae-ba11d3db5d84 req-164e8896-75e5-4a77-b4e2-ce7b47098c87 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:19.523840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ca97c375-964a-4837-93ae-ba11d3db5d84 req-164e8896-75e5-4a77-b4e2-ce7b47098c87 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:19.524279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ca97c375-964a-4837-93ae-ba11d3db5d84 req-164e8896-75e5-4a77-b4e2-ce7b47098c87 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:19.537414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ca97c375-964a-4837-93ae-ba11d3db5d84 req-164e8896-75e5-4a77-b4e2-ce7b47098c87 service nova] Creating event network-vif-plugged:7c253ff3-adba-4fe4-ae41-3e275c1f0231 for instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c on n-h2-862355-1 Oct 25 03:30:19.543738 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ca97c375-964a-4837-93ae-ba11d3db5d84 req-164e8896-75e5-4a77-b4e2-ce7b47098c87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046959 Oct 25 03:30:19.544369 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2702/5293] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:20.292723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:20.293407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:20.305965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:20.310134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:20.310894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:20.311880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:20.312549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:20.313194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:20.655696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:20.664713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a641f6c8-e50a-400b-82db-c75f67fdc691 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.376628 Oct 25 03:30:20.668360 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2592/5294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:20 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:21.592647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5ecd422c-a763-40b0-99b6-37cd2a1b00c3 req-55e3382a-f075-4b96-831e-88cbefb7e767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae48ec9-a744-4b6d-b1ce-b945e18331aa", "name": "network-vif-plugged", "status": "completed", "tag": "f62db723-ec1f-4679-94e4-684a40afeca4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:21.613120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ecd422c-a763-40b0-99b6-37cd2a1b00c3 req-55e3382a-f075-4b96-831e-88cbefb7e767 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:21.613869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ecd422c-a763-40b0-99b6-37cd2a1b00c3 req-55e3382a-f075-4b96-831e-88cbefb7e767 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:21.617097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ecd422c-a763-40b0-99b6-37cd2a1b00c3 req-55e3382a-f075-4b96-831e-88cbefb7e767 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:21.631448 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5ecd422c-a763-40b0-99b6-37cd2a1b00c3 req-55e3382a-f075-4b96-831e-88cbefb7e767 service nova] Creating event network-vif-plugged:f62db723-ec1f-4679-94e4-684a40afeca4 for instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa on n-h2-862355-1 Oct 25 03:30:21.636729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5ecd422c-a763-40b0-99b6-37cd2a1b00c3 req-55e3382a-f075-4b96-831e-88cbefb7e767 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049051 Oct 25 03:30:21.637539 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2703/5295] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:30:21.692652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:21.693913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:21.711054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:21.714086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:21.714724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:21.715683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:21.718127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:21.719564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:22.148860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:22.149451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:22.177708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:22.178200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:22.178643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:22.179383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:22.179818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:22.191810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:22.215013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:22.228026 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca97ebfb-e2f6-41fa-9bd8-e2770f916a03 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1321 microversion: 2.1 time: 0.539336 Oct 25 03:30:22.236202 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2593/5296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:21 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:22.281562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:30:22.435947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-461a913a-64a7-4730-b000-2caff70d2513 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 204 len: 0 microversion: 2.1 time: 0.292716 Oct 25 03:30:22.442348 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2704/5297] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:30:22 2022] DELETE /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:30:22.448564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:22.449567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:22.460477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:22.461012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:22.461430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:22.462178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:22.462856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:22.463453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:22.485038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:22.767084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:22.778980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06d934cb-3ed2-4040-b488-6eb513d7bbc5 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1667 microversion: 2.1 time: 0.335199 Oct 25 03:30:22.782682 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2594/5298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:22 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1667 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:23.253808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:23.254846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:23.271388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.272276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.273708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.275750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.276554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.277214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.402656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-311478340", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:23.474797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] validate_networks() for None {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:30:23.479439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:23.490385 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f7fa088-1298-4548-9fd2-b1d8b73a1ff3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1516 microversion: 2.1 time: 0.241255 Oct 25 03:30:23.491283 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2705/5299] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:23 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:23.513123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:23.515996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:23.522753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.523243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.523881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.524583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.525036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.525458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.549455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lazy-loading 'flavor' on Instance uuid 9ae48ec9-a744-4b6d-b1ce-b945e18331aa {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:30:23.637424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b863898f-bf09-4dcf-a64b-b7ca480180b5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action" status: 200 len: 32 microversion: 2.1 time: 0.128234 Oct 25 03:30:23.638161 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2706/5300] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:30:23 2022] POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:30:23.651609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:23.652498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:23.663765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.664278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.664731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.665891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.667513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.668162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.915170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:30:23.915677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:30:23.916255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:30:23.916780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:30:23.917296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:30:23.927565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.928313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.928848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.929886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.930726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.930854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:23.931575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.943045 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81e89ab1-6b5c-47e8-8617-55c6a3a95d75 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.295255 Oct 25 03:30:23.943654 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2707/5301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:23 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:23.953526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Getting quotas for project 9ca8335954e54d2c8047612ed240c288. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:30:23.963673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Getting quotas for user f225f0f2aec14e0a8930431e94055eb4 and project 9ca8335954e54d2c8047612ed240c288. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:30:23.968423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:23.968742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:23.984263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.984965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.985570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:23.986467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:23.990644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:23.991320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:24.000749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:30:24.003672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:30:24.086198 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bb37f37b-1009-443f-a2ee-5b4b8a4aee3f tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690971 Oct 25 03:30:24.087633 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2595/5302] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:30:24.107498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ba3df06-e0da-4f69-9695-7efbc43dd538 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:24.108489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ba3df06-e0da-4f69-9695-7efbc43dd538 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:24.210310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ba3df06-e0da-4f69-9695-7efbc43dd538 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:24.219618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ba3df06-e0da-4f69-9695-7efbc43dd538 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1214 microversion: 2.1 time: 0.118068 Oct 25 03:30:24.227273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2596/5303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:24 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:24.526285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:24.535278 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47adf637-d332-466a-901d-28f4dc4a26ae tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1667 microversion: 2.1 time: 0.576043 Oct 25 03:30:24.543039 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2708/5304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:23 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1667 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:24.971800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:24.973057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:25.013751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:25.022451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:25.025380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:25.026871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:25.030647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:25.031365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:25.250703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:25.251779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:25.258843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:25.260303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:25.260527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:25.261485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:25.262073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:25.263790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:25.391403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:25.401903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bafad57f-1f28-45d5-be3e-54c4a7f1fa60 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1210 microversion: 2.1 time: 0.155530 Oct 25 03:30:25.402804 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2709/5305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:25 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:25.569756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:25.570363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:25.579369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:25.579877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:25.580319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:25.581032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:25.585962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:25.586683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:25.778306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:25.787547 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf3de513-8910-446c-ac36-e47559cb5ecc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1667 microversion: 2.1 time: 0.222863 Oct 25 03:30:25.788740 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2710/5306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:25 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1667 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:25.821046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:25.831223 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8abbb8c3-cf7f-4032-976c-c5db1537e3b9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.864929 Oct 25 03:30:25.840395 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2597/5307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:24 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:26.446686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:26.447476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:26.467395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:26.468081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:26.478432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:26.479590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:26.480183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:26.484712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:26.738980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:26.767145 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fe1029e-278a-4b0a-a8fe-b59aabb70025 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1272 microversion: 2.1 time: 0.334726 Oct 25 03:30:26.769230 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2711/5308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:26 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:26.789326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-512b8422-adb7-4369-99c4-31122c718823 req-3a6612c5-2d19-4f2e-85c9-259b1b2cbd97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c561cc-b74d-4edb-ab67-5758c6cf58ae", "name": "network-vif-deleted", "tag": "f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:26.818997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:26.819954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:26.829494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:26.846913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:26.852821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:26.853300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:26.861145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:26.863457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-512b8422-adb7-4369-99c4-31122c718823 req-3a6612c5-2d19-4f2e-85c9-259b1b2cbd97 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:26.865018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:26.885136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:26.885702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-512b8422-adb7-4369-99c4-31122c718823 req-3a6612c5-2d19-4f2e-85c9-259b1b2cbd97 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:26.886657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-512b8422-adb7-4369-99c4-31122c718823 req-3a6612c5-2d19-4f2e-85c9-259b1b2cbd97 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:26.936305 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-512b8422-adb7-4369-99c4-31122c718823 req-3a6612c5-2d19-4f2e-85c9-259b1b2cbd97 service nova] Creating event network-vif-deleted:f3b0bc0f-8f17-49a6-aaed-fc80a6d2da91 for instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae on n-h1-862355-1 Oct 25 03:30:26.956970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-512b8422-adb7-4369-99c4-31122c718823 req-3a6612c5-2d19-4f2e-85c9-259b1b2cbd97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173242 Oct 25 03:30:26.960990 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2598/5309] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:26.986250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:26.990448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:27.041273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:27.042379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:27.043074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:27.044221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:27.044907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:27.045569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:27.128236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256a0798fd9d41248f28e18995674d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67af58b047c4bfaa8b88a201f8a8977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:27.146709 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c7fa14f-e4f0-4b73-b2ab-63b3bccc43dc tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 200 len: 1311 microversion: 2.1 time: 0.334360 Oct 25 03:30:27.151024 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2712/5310] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:26 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 1311 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:27.693231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:27.703146 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91d204fb-fae7-4761-8bd2-1da405c784ba tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.740728 Oct 25 03:30:27.711093 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2599/5311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:26 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:27.798876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:27.799508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:27.820756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:27.830219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:27.830739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:27.831506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:27.837533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:27.839007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:27.965073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:27.973997 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79028018-145b-4d61-b66b-d6ef84643ec7 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1272 microversion: 2.1 time: 0.179357 Oct 25 03:30:27.974713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2713/5312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:27 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:28.175656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:28.176430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] [instance: e6c561cc-b74d-4edb-ab67-5758c6cf58ae] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:28.192209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:28.194450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:28.199206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:28.200255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:28.200998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:28.201586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:28.220854 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] HTTP exception thrown: Instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae could not be found. Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Request method failure captured: Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae HTTP/1.1 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1gKyVVSQnBFCrjbzYEL4rmkq4zKWFM14Q9DIZ55GQUkmZTczgW45t1l_FMVEq_LkifM-gE5uA-754MRx3zvEbKI8Glo3zQJuNTTV0-izCKnvcNAVf5CMeAA_GHp8inO6lxNelCTQKcDdWOoOSt1QG1H2bkePmEVf5JXW-zm9P9jdS4 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: e67af58b047c4bfaa8b88a201f8a8977 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestFqdnHostnames-1810505770 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e67af58b047c4bfaa8b88a201f8a8977"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e67af58b047c4bfaa8b88a201f8a8977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e67af58b047c4bfaa8b88a201f8a8977", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e67af58b047c4bfaa8b88a201f8a8977"}]}] Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestFqdnHostnames-1810505770 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: e67af58b047c4bfaa8b88a201f8a8977 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1810505770 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestFqdnHostnames-1810505770-project Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 256a0798fd9d41248f28e18995674d40 Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestFqdnHostnames-1810505770-project Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae could not be found. Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e6c561cc-b74d-4edb-ab67-5758c6cf58ae'} Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae could not be found. Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae could not be found. Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:30:28.223080 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:30:28.228659 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:28.228659 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:30:28.228659 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:30:28.228659 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:30:28.228659 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:30:28.228659 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae could not be found. Oct 25 03:30:28.228659 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:30:28.230459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Returning 404 to user: Instance e6c561cc-b74d-4edb-ab67-5758c6cf58ae could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:30:28.231503 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c16ad461-765f-4a7b-9259-447b79fc7ca0 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae" status: 404 len: 111 microversion: 2.1 time: 0.061286 Oct 25 03:30:28.232994 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2600/5313] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:28 2022] GET /compute/v2.1/servers/e6c561cc-b74d-4edb-ab67-5758c6cf58ae => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:30:28.242967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7592ae4b-ca27-4302-b374-2facaf2be7d1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] Calling method '.version_select at 0x7efd33c28160>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:28.288482 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7592ae4b-ca27-4302-b374-2facaf2be7d1 tempest-ServersTestFqdnHostnames-1810505770 tempest-ServersTestFqdnHostnames-1810505770-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1976414402" status: 202 len: 0 microversion: 2.1 time: 0.051272 Oct 25 03:30:28.289577 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2714/5314] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:30:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1976414402 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:30:28.734300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:28.734928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:28.754791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:28.756215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:28.756826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:28.758035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:28.758671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:28.759265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:29.004773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:29.005552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:29.022909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:29.023404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:29.023844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:29.024605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:29.025008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:29.025476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:29.260452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:29.282903 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f9bfdcff-c05c-468b-b8b3-242ab9603298 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.552339 Oct 25 03:30:29.290673 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2601/5315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:28 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:29.407719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:29.423535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:29.469333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9bc15143-5296-4125-a84d-2df700661f61 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1314 microversion: 2.1 time: 0.468415 Oct 25 03:30:29.472617 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2715/5316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:28 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:30.307729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e7e8fc42-882f-40be-84a6-39c63d5c8318 req-ac9fc276-6c33-4734-b9b1-642f3b8c7a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a672fb-2f50-4a61-a53e-422be0f0bb56", "tag": "aa9c3dd8-2072-423d-a9a6-81a5a3fde6ea"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:30.319311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:30.319758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:30.356834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:30.357397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:30.357927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:30.358679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:30.370157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:30.372108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e7e8fc42-882f-40be-84a6-39c63d5c8318 req-ac9fc276-6c33-4734-b9b1-642f3b8c7a8c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:30.372515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:30.376060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e7e8fc42-882f-40be-84a6-39c63d5c8318 req-ac9fc276-6c33-4734-b9b1-642f3b8c7a8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:30.384483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e7e8fc42-882f-40be-84a6-39c63d5c8318 req-ac9fc276-6c33-4734-b9b1-642f3b8c7a8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:30.434981 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e7e8fc42-882f-40be-84a6-39c63d5c8318 req-ac9fc276-6c33-4734-b9b1-642f3b8c7a8c service nova] Creating event network-changed:aa9c3dd8-2072-423d-a9a6-81a5a3fde6ea for instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 on n-h1-862355-1 Oct 25 03:30:30.446220 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e7e8fc42-882f-40be-84a6-39c63d5c8318 req-ac9fc276-6c33-4734-b9b1-642f3b8c7a8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142357 Oct 25 03:30:30.447457 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2602/5317] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:30.502613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:30.503273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:30.534542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:30.550520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:30.551248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:30.553745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:30.554784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:30.555476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:30.808175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:30.845333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-303b0b92-37bc-4d81-a2de-54e341579969 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.531222 Oct 25 03:30:30.850275 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2716/5318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:30 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:31.034986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:31.062443 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d872a0da-ed60-4c79-90b8-a43eec47d81e tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1314 microversion: 2.1 time: 0.570685 Oct 25 03:30:31.063931 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2603/5319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:30 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:31.876416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:31.877843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:31.890101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:31.891108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:31.891982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:31.893355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:31.894239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:31.894962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:32.095825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:32.097105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:32.120299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:32.122666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:32.123488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:32.125037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:32.125709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:32.126408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:32.147361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:32.164040 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c4f3b3a-39a1-4431-a2d5-0a320b2ce02d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.294350 Oct 25 03:30:32.165278 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2717/5320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:31 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:32.569534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:32.592254 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c748d97a-60b6-4e6b-8124-44c58dc8cdba tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1314 microversion: 2.1 time: 0.502545 Oct 25 03:30:32.593450 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2604/5321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:32 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:33.189304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:33.190736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:33.203761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:33.204588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:33.205280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:33.206255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:33.206913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:33.207547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:33.500713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:33.514041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c729316-2c92-456d-a278-1375399f2d98 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.326846 Oct 25 03:30:33.519935 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2718/5322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:33 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:33.621390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:33.623773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:33.650952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:33.651759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:33.652424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:33.653946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:33.655126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:33.655836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:33.947413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:34.215630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:34.541072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:34.542298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:34.554930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:34.555440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:34.555889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:34.557093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:34.557525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:34.557994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:34.586292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:34.598535 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-24d4d9e0-0a92-41a6-8ce2-de5e4355b52c tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1314 microversion: 2.1 time: 0.981605 Oct 25 03:30:34.599763 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2605/5323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:33 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:35.094722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:35.112959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf187c26-b77c-45b0-9450-a0976c0fbaa3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.575058 Oct 25 03:30:35.114741 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2719/5324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:34 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:35.625633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:35.628110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:35.652949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:35.661611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:35.663305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:35.667141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:35.667968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:35.668761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:36.141376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:36.141991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:36.181751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:36.186307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:36.189729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:36.192331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:36.194314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:36.196430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:37.216751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:37.244873 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-704aaccd-455a-4798-949f-a8dbc2aed1e5 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1314 microversion: 2.1 time: 1.622990 Oct 25 03:30:37.246086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2606/5325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:35 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1314 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:37.342818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:37.359881 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6bdbe968-bc45-4d4b-b472-0196acd6dad3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 1.222759 Oct 25 03:30:37.361885 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2720/5326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:36 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:38.272486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:38.273812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:38.291953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:38.292769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:38.293604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:38.294869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:38.295494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:38.296082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:38.385816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:38.387265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:38.402325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:38.403110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:38.404064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:38.406131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:38.406775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:38.408244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:38.681355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:38.727715 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c86115e-5c57-48da-bf6c-c92de82e6374 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1314 microversion: 2.1 time: 0.459059 Oct 25 03:30:38.728672 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2607/5327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:38 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:39.019621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-71c36a24-4ff4-4b90-b700-25b0daef8612 req-9a2826a0-8e55-41fb-8707-3f27f5d5827c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a672fb-2f50-4a61-a53e-422be0f0bb56", "name": "network-vif-plugged", "status": "completed", "tag": "aa9c3dd8-2072-423d-a9a6-81a5a3fde6ea"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:39.047529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-71c36a24-4ff4-4b90-b700-25b0daef8612 req-9a2826a0-8e55-41fb-8707-3f27f5d5827c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:39.048248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-71c36a24-4ff4-4b90-b700-25b0daef8612 req-9a2826a0-8e55-41fb-8707-3f27f5d5827c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:39.049259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-71c36a24-4ff4-4b90-b700-25b0daef8612 req-9a2826a0-8e55-41fb-8707-3f27f5d5827c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:39.051837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:39.061382 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28a27906-7aae-4712-8357-b88d924da6c6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.680059 Oct 25 03:30:39.066563 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2721/5328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:38 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:39.106633 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-71c36a24-4ff4-4b90-b700-25b0daef8612 req-9a2826a0-8e55-41fb-8707-3f27f5d5827c service nova] Creating event network-vif-plugged:aa9c3dd8-2072-423d-a9a6-81a5a3fde6ea for instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 on n-h1-862355-1 Oct 25 03:30:39.117003 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-71c36a24-4ff4-4b90-b700-25b0daef8612 req-9a2826a0-8e55-41fb-8707-3f27f5d5827c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121284 Oct 25 03:30:39.118274 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2608/5329] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:39.752784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:39.753721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:39.774110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:39.776439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:39.777235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:39.778882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:39.779627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:39.780352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:40.091042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:40.091733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:40.112480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:40.112988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:40.113437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:40.119042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:40.119530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:40.122572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:40.221038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:40.239210 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d086d5b4-ad99-42f4-a7bd-30a297f7ef5d tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1314 microversion: 2.1 time: 0.489021 Oct 25 03:30:40.244009 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2722/5330] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:39 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:40.469048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:40.479979 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d334dc8-6344-4ae8-8d21-deff2c4e339a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.394860 Oct 25 03:30:40.487620 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2609/5331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:40 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:41.264557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:41.266098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:41.278329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:41.281760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:41.286656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:41.287841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:41.288675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:41.289360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:41.514587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:41.515446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:41.535110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:41.540739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:41.541529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:41.543097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:41.551314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:41.552237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:41.688351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:41.698665 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0114fe79-edfb-44ad-b748-b4ee6cdc0608 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1464 microversion: 2.1 time: 0.439154 Oct 25 03:30:41.708723 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2723/5332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:41 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1464 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:41.806272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:41.806848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:41.813433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:41.813954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:41.814545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:41.815701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:41.816311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:41.817763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:41.860254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:30:42.047925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:42.064892 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9787408a-2266-4c22-ba8a-24688cc075ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.557076 Oct 25 03:30:42.083607 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2610/5333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:41 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:42.095574 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-344c305b-d67b-4afa-9930-746b06433847 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "DELETE /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 204 len: 0 microversion: 2.1 time: 0.298769 Oct 25 03:30:42.096875 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2724/5334] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:30:41 2022] DELETE /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:30:42.116045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:42.120734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:42.151715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:42.152620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:42.153169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:42.156188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:42.156188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:42.156188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:42.533436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:42.548457 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42781617-4b23-4dfd-9d1a-8a82aff30a45 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1470 microversion: 2.1 time: 0.445694 Oct 25 03:30:42.549128 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2611/5335] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:42 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:43.090748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:43.091471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:43.105067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:43.107429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:43.108137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:43.109923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:43.110905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:43.111646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:43.113155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:43.406584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:43.416557 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2102c044-d72d-400f-ae0b-ac3c07723e43 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.330887 Oct 25 03:30:43.425666 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2725/5336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:43 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:43.576667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:43.577450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:43.596253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:43.597042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:43.597769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:43.599582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:43.600328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:43.601650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:43.996182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:44.010279 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-feaeaab8-3262-42ff-86ad-bf3f8c2650fb tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1470 microversion: 2.1 time: 0.433201 Oct 25 03:30:44.013899 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2612/5337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:43 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1470 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:44.441285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:44.441879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-53e8ff77-c1ab-4092-ae90-575408d36bec req-93201d2f-d823-4274-8e27-7c053b0aee89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a672fb-2f50-4a61-a53e-422be0f0bb56", "name": "network-vif-deleted", "tag": "aa9c3dd8-2072-423d-a9a6-81a5a3fde6ea"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:44.446072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:44.452344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53e8ff77-c1ab-4092-ae90-575408d36bec req-93201d2f-d823-4274-8e27-7c053b0aee89 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:44.453084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53e8ff77-c1ab-4092-ae90-575408d36bec req-93201d2f-d823-4274-8e27-7c053b0aee89 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:44.453760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53e8ff77-c1ab-4092-ae90-575408d36bec req-93201d2f-d823-4274-8e27-7c053b0aee89 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:44.459164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:44.459674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:44.460119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:44.460860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:44.461410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:44.469502 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-53e8ff77-c1ab-4092-ae90-575408d36bec req-93201d2f-d823-4274-8e27-7c053b0aee89 service nova] Creating event network-vif-deleted:aa9c3dd8-2072-423d-a9a6-81a5a3fde6ea for instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 on n-h1-862355-1 Oct 25 03:30:44.476403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:44.478148 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-53e8ff77-c1ab-4092-ae90-575408d36bec req-93201d2f-d823-4274-8e27-7c053b0aee89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040148 Oct 25 03:30:44.479795 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2613/5338] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:44.925308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:44.951054 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94231b68-2bc0-45ad-89e4-36109872ba11 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.513544 Oct 25 03:30:44.954743 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2726/5339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:44 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:45.042166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:45.043589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:45.056503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:45.057403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:45.058054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:45.059092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:45.063340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:45.065747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:45.116799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:45.117653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:45.118753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:45.119716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lazy-loading 'fault' on Instance uuid 86a672fb-2f50-4a61-a53e-422be0f0bb56 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:30:45.227849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f225f0f2aec14e0a8930431e94055eb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca8335954e54d2c8047612ed240c288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:45.241640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d80f0a4-4157-4e0d-858b-b5d560b79de9 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 200 len: 1304 microversion: 2.1 time: 0.206223 Oct 25 03:30:45.243025 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2614/5340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:45 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:45.505088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1114002212", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "aea76b3b-6791-4c83-bcfa-cc40048c60c8"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:45.575097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] validate_networks() for [('aea76b3b-6791-4c83-bcfa-cc40048c60c8', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:30:45.980100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:45.981056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:45.996694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:46.002049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:46.002967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:46.003964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:46.006643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:46.007366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:46.056510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:46.125926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:30:46.126462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:30:46.127403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:30:46.127910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:30:46.128562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:30:46.145285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:46.146142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:46.146972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:46.148479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:46.149200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:46.150074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:46.189294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Getting quotas for project 529a4dcb4f794e86981f3ec07459d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:30:46.196915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Getting quotas for user fa3df586d8a941ec87641754a8610b05 and project 529a4dcb4f794e86981f3ec07459d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:30:46.212140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:30:46.215437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:30:46.289297 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-75786343-58ee-440b-9faa-3023b4d82cb5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972555 Oct 25 03:30:46.324068 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2727/5341] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:30:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:30:46.357621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:46.358480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] [instance: 86a672fb-2f50-4a61-a53e-422be0f0bb56] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:46.367346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:46.367893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:46.368333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:46.369043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:46.369786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:46.371781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:46.416411 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] HTTP exception thrown: Instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 could not be found. Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Request method failure captured: Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 HTTP/1.1 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1hMKLaCsl8FDgOUewCmkIqZa9YH93tYPAB2W5BxkE6jWZv607meb6TWQ07CKg_qnwWwQR5BwH_34UDEse8w1pZhY-FATwoG_7bMpgnyrurT1s4aMmo4MQXFClsPL3RFrjebC781uLihoxuYgjJEDbjFnV1S3x_sOV3NffvfF24pT-Y Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 9ca8335954e54d2c8047612ed240c288 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesNegativeTest-958902501 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9ca8335954e54d2c8047612ed240c288"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9ca8335954e54d2c8047612ed240c288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9ca8335954e54d2c8047612ed240c288", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9ca8335954e54d2c8047612ed240c288"}]}] Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesNegativeTest-958902501 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 9ca8335954e54d2c8047612ed240c288 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesNegativeTest-958902501 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesNegativeTest-958902501-project Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: f225f0f2aec14e0a8930431e94055eb4 Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesNegativeTest-958902501-project Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 could not be found. Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '86a672fb-2f50-4a61-a53e-422be0f0bb56'} Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 could not be found. Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 could not be found. Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:30:46.418232 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 could not be found. Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] Returning 404 to user: Instance 86a672fb-2f50-4a61-a53e-422be0f0bb56 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f20f1595-3d02-4795-8895-ed32071cdee4 tempest-VolumesNegativeTest-958902501 tempest-VolumesNegativeTest-958902501-project] 10.222.0.36 "GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56" status: 404 len: 111 microversion: 2.1 time: 0.079143 Oct 25 03:30:46.422417 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2728/5342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:46 2022] GET /compute/v2.1/servers/86a672fb-2f50-4a61-a53e-422be0f0bb56 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:30:46.434657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1533158631", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "aea76b3b-6791-4c83-bcfa-cc40048c60c8"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:46.525736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:46.546078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbd206c9-845f-4380-9f32-faf47aae3f99 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.570951 Oct 25 03:30:46.550768 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2615/5343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:45 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:46.564124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] validate_networks() for [('aea76b3b-6791-4c83-bcfa-cc40048c60c8', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:30:47.576821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:47.577445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:47.591582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:47.592088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:47.592536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:47.593254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:47.593741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:47.594180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:47.780904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:30:47.781413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:30:47.784191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:30:47.786330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:30:47.787145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:30:47.808592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:47.810978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:47.811879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:47.814852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:47.816079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:47.827480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:47.868032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Getting quotas for project 529a4dcb4f794e86981f3ec07459d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:30:47.883224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Getting quotas for user fa3df586d8a941ec87641754a8610b05 and project 529a4dcb4f794e86981f3ec07459d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:30:47.916551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:30:47.920194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:30:47.982773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:47.994761 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b5834a0-15ad-4ffc-a8ff-f32051b5b6d0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.420023 Oct 25 03:30:47.995931 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2616/5344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:47 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:48.056205 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08b94024-0d26-458d-b7a4-430793c7ffa3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625186 Oct 25 03:30:48.057265 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2729/5345] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:30:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:30:48.149083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-705997378", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "451", "networks": [{"uuid": "aea76b3b-6791-4c83-bcfa-cc40048c60c8"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:48.253313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] validate_networks() for [('aea76b3b-6791-4c83-bcfa-cc40048c60c8', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:30:49.022579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:49.023383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:49.045230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:49.046001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:49.046597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:49.047350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:49.047818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:49.048248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:49.376204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:49.389459 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a905c996-f23b-4495-96c6-839b533004f9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.372399 Oct 25 03:30:49.391300 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2730/5346] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:49 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:50.425074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:50.428150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:50.439838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:50.441802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:50.442707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:50.445285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:50.446740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:50.450942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:50.654994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:50.676307 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-942a89ca-34ba-4880-84fa-0986b53d0c1f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.255403 Oct 25 03:30:50.676945 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2731/5347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:50 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:50.741770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:30:50.742927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:30:50.743649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:30:50.744274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:30:50.744942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:30:50.778654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:50.779360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:50.781301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:50.782373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:50.784595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:50.786596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:50.859658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Getting quotas for project 529a4dcb4f794e86981f3ec07459d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:30:50.867975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Getting quotas for user fa3df586d8a941ec87641754a8610b05 and project 529a4dcb4f794e86981f3ec07459d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:30:50.906633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:30:50.910286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:30:51.049697 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-339df0c0-dbe0-4cb6-9038-de36f61e9f9d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.905704 Oct 25 03:30:51.054797 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2617/5348] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:30:51.061933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4bddb7d-5e26-4fde-94e6-3fd6b6bad838 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:51.062871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e4bddb7d-5e26-4fde-94e6-3fd6b6bad838 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:51.704748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:51.705747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:51.730189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:51.732384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:51.733331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:51.737605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:51.741025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:51.743063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:52.249667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4bddb7d-5e26-4fde-94e6-3fd6b6bad838 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:52.269150 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4bddb7d-5e26-4fde-94e6-3fd6b6bad838 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1220 microversion: 2.1 time: 1.211405 Oct 25 03:30:52.273786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2732/5349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:51 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1220 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:52.751265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:52.762337 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf72a5bd-ec3e-4018-bb37-561b78a3db4c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 1.061695 Oct 25 03:30:52.771907 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2618/5350] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:51 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:53.301373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:53.302625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:53.322830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:53.323506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:53.324194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:53.327762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:53.329031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:53.330861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:53.527819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:53.530759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:53.543234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-41285336-2107-420e-a970-1e23a057597a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1280 microversion: 2.1 time: 0.247600 Oct 25 03:30:53.544933 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2733/5351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:53 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:53.795432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:53.796126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:53.811241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:53.811743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:53.812187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:53.812895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:53.822503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:53.825755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:54.398577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:54.410691 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d63ea151-ab75-418e-b990-5f78035bc130 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.626786 Oct 25 03:30:54.411949 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2619/5352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:53 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:54.571143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:54.572446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:54.600857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:54.601366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:54.601848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:54.602579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:54.603042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:54.603480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:54.824313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:54.847246 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30e7f024-7264-44ab-9956-6d22f0ece83b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1278 microversion: 2.1 time: 0.277717 Oct 25 03:30:54.862027 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2734/5353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:54 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:55.224568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c8c5ec86-2c9d-4b51-bc02-0abe69f5c4d8 req-b320d227-86b7-4dca-95c9-a2957642ba92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0", "tag": "4446351a-4c2c-48fe-bbad-bdf76d65a6de"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:55.257799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c8c5ec86-2c9d-4b51-bc02-0abe69f5c4d8 req-b320d227-86b7-4dca-95c9-a2957642ba92 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:55.259653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c8c5ec86-2c9d-4b51-bc02-0abe69f5c4d8 req-b320d227-86b7-4dca-95c9-a2957642ba92 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:55.263102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c8c5ec86-2c9d-4b51-bc02-0abe69f5c4d8 req-b320d227-86b7-4dca-95c9-a2957642ba92 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:55.301856 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c8c5ec86-2c9d-4b51-bc02-0abe69f5c4d8 req-b320d227-86b7-4dca-95c9-a2957642ba92 service nova] Creating event network-changed:4446351a-4c2c-48fe-bbad-bdf76d65a6de for instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 on n-h1-862355-1 Oct 25 03:30:55.319875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c8c5ec86-2c9d-4b51-bc02-0abe69f5c4d8 req-b320d227-86b7-4dca-95c9-a2957642ba92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099194 Oct 25 03:30:55.321515 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2620/5354] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:55.440341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:55.441607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:55.464028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:55.469194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:55.469761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:55.474286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:55.474780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:55.475229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:55.756722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:55.786803 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21892f6b-be91-4190-bc6f-88a142e0b40e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.351166 Oct 25 03:30:55.787439 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2735/5355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:55 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:55.879104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:55.880521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:55.898215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:55.900488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:55.901982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:55.903030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:55.913966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:55.914516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:56.816411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:56.819714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:56.832214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:56.838994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:56.839974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:56.840960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:56.843185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:56.844544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:57.131493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:57.147715 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd4466a2-4f79-48b2-b208-ae98c440316e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 1.274623 Oct 25 03:30:57.150789 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2621/5356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:55 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:57.588583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:57.597459 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a29dab85-a592-4b87-bf19-c3cd18048138 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1522 microversion: 2.1 time: 0.785976 Oct 25 03:30:57.604979 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2736/5357] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:56 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1522 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:58.066973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-30dd0fdf-77fb-4f67-bb19-74e5a52d2e83 req-98fe0864-b74f-4924-a9de-f045684e6352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7c6947-0660-437b-bcf7-f16b0fabb83d", "tag": "49f45cd5-3200-4782-bb85-15fb4526cbfa"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:58.075683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:58.100243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30dd0fdf-77fb-4f67-bb19-74e5a52d2e83 req-98fe0864-b74f-4924-a9de-f045684e6352 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:58.101186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30dd0fdf-77fb-4f67-bb19-74e5a52d2e83 req-98fe0864-b74f-4924-a9de-f045684e6352 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:58.101860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30dd0fdf-77fb-4f67-bb19-74e5a52d2e83 req-98fe0864-b74f-4924-a9de-f045684e6352 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:58.144526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-30dd0fdf-77fb-4f67-bb19-74e5a52d2e83 req-98fe0864-b74f-4924-a9de-f045684e6352 service nova] Creating event network-changed:49f45cd5-3200-4782-bb85-15fb4526cbfa for instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d on n-h1-862355-1 Oct 25 03:30:58.174461 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-30dd0fdf-77fb-4f67-bb19-74e5a52d2e83 req-98fe0864-b74f-4924-a9de-f045684e6352 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111900 Oct 25 03:30:58.179003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:58.180071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:58.180286 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2622/5358] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:58.190835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:30:58.197369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:58.197963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:58.198592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:58.199473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:58.200088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:58.201016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:58.531589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:58.560372 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92cdeffb-49f2-4513-a0d0-8ebe02596d97 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 0.386264 Oct 25 03:30:58.567021 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2737/5359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:58 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:30:58.635151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:58.635914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:58.656532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:58.656946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:58.657457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:58.658214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:58.658696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:58.659110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:58.876289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f92226dd-2c49-43b1-b4c3-42de4a43b943 req-3a5526d0-62c3-449f-b5ce-af9581ae5142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd00c943-ff4d-409d-9186-924a70880be3", "tag": "7c5129aa-89b9-4935-b914-d8bb891648f9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:58.901012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f92226dd-2c49-43b1-b4c3-42de4a43b943 req-3a5526d0-62c3-449f-b5ce-af9581ae5142 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:58.905650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f92226dd-2c49-43b1-b4c3-42de4a43b943 req-3a5526d0-62c3-449f-b5ce-af9581ae5142 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:58.907940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f92226dd-2c49-43b1-b4c3-42de4a43b943 req-3a5526d0-62c3-449f-b5ce-af9581ae5142 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:58.935757 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f92226dd-2c49-43b1-b4c3-42de4a43b943 req-3a5526d0-62c3-449f-b5ce-af9581ae5142 service nova] Creating event network-changed:7c5129aa-89b9-4935-b914-d8bb891648f9 for instance dd00c943-ff4d-409d-9186-924a70880be3 on n-h2-862355-1 Oct 25 03:30:58.944240 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f92226dd-2c49-43b1-b4c3-42de4a43b943 req-3a5526d0-62c3-449f-b5ce-af9581ae5142 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075581 Oct 25 03:30:58.945786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2738/5360] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:30:59.327679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:59.354355 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1685e5e9-ef66-4994-a11e-71e702a6c01c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1502 microversion: 2.1 time: 0.722502 Oct 25 03:30:59.361343 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2623/5361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:58 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1502 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:59.388538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:59.391560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:59.419309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:59.421832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:59.423022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:59.427052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:59.434837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:59.435420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:59.590292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:30:59.591148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:59.603292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:59.605617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:59.606259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:59.607139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:59.608576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:59.610187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:59.872873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:30:59.889532 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5222262f-edff-448d-95e1-67ca5a0af1a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1516 microversion: 2.1 time: 0.510650 Oct 25 03:30:59.890635 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2739/5362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:59 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1516 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:30:59.919027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6cd562a-2f40-41c8-8384-e42c78131c12 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:59.924598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6cd562a-2f40-41c8-8384-e42c78131c12 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: f9e89b63-e460-45f9-82ed-c7f8d785d69d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:59.940833 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e6cd562a-2f40-41c8-8384-e42c78131c12 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Instance f9e89b63-e460-45f9-82ed-c7f8d785d69d could not be found. Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6cd562a-2f40-41c8-8384-e42c78131c12 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/f9e89b63-e460-45f9-82ed-c7f8d785d69d/action HTTP/1.1 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 14 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: {"rescue": {}} Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f9e89b63-e460-45f9-82ed-c7f8d785d69d could not be found. Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f9e89b63-e460-45f9-82ed-c7f8d785d69d', 'body': {'rescue': {}}} Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e89b63-e460-45f9-82ed-c7f8d785d69d could not be found. Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e89b63-e460-45f9-82ed-c7f8d785d69d could not be found. Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:59.960461 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e89b63-e460-45f9-82ed-c7f8d785d69d could not be found. Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6cd562a-2f40-41c8-8384-e42c78131c12 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 404 to user: Instance f9e89b63-e460-45f9-82ed-c7f8d785d69d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6cd562a-2f40-41c8-8384-e42c78131c12 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/f9e89b63-e460-45f9-82ed-c7f8d785d69d/action" status: 404 len: 111 microversion: 2.1 time: 0.048678 Oct 25 03:30:59.965831 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2740/5363] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:30:59 2022] POST /compute/v2.1/servers/f9e89b63-e460-45f9-82ed-c7f8d785d69d/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:30:59.975538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:30:59.976088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:30:59.991607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:59.992123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:59.992570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:30:59.993340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:30:59.995427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:30:59.996099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:00.145297 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b90e6fc7-8d66-4c24-8010-48f8193590a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.174513 Oct 25 03:31:00.148899 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2741/5364] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:30:59 2022] POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:31:00.155294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:00.156239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:00.164351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:00.165030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:00.166081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:00.167694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:00.168313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:00.168903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:00.470515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:00.492814 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20dd9c19-21f5-4868-b918-7208592b8a97 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1521 microversion: 2.1 time: 0.342427 Oct 25 03:31:00.494032 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2742/5365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:00 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:00.779387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:00.802325 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6ef4ae22-0af9-48d5-9b80-61fab3198895 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 1.215459 Oct 25 03:31:00.803394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2624/5366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:30:59 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:01.527192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:01.529018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:01.555542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:01.556046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:01.556491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:01.557207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:01.557664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:01.558154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:01.821326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:01.830491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:01.831830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:01.840631 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88d44d60-87ba-4ff9-9986-86c7f4d23ed0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1521 microversion: 2.1 time: 0.319906 Oct 25 03:31:01.846525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:01.847450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2743/5367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:01 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:01.848871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:01.855003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:01.857985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:01.858791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:01.859795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:01.860466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:01.865450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:02.250910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:02.261203 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c637c7f-3d64-493a-8d90-9062cc589de0 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 0.437872 Oct 25 03:31:02.261856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2625/5368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:01 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:02.790680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:02.796901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1e0941f1-49c5-4a9c-ac23-81f5c3e36b4b req-d7014b2c-ff01-480a-bd95-16dd241d01ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0", "name": "network-vif-plugged", "status": "completed", "tag": "4446351a-4c2c-48fe-bbad-bdf76d65a6de"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:02.817903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e0941f1-49c5-4a9c-ac23-81f5c3e36b4b req-d7014b2c-ff01-480a-bd95-16dd241d01ef service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:02.821244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e0941f1-49c5-4a9c-ac23-81f5c3e36b4b req-d7014b2c-ff01-480a-bd95-16dd241d01ef service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:02.822985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e0941f1-49c5-4a9c-ac23-81f5c3e36b4b req-d7014b2c-ff01-480a-bd95-16dd241d01ef service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:02.855594 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1e0941f1-49c5-4a9c-ac23-81f5c3e36b4b req-d7014b2c-ff01-480a-bd95-16dd241d01ef service nova] Creating event network-vif-plugged:4446351a-4c2c-48fe-bbad-bdf76d65a6de for instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 on n-h1-862355-1 Oct 25 03:31:02.875914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:02.877364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:02.889513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:02.890326 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1e0941f1-49c5-4a9c-ac23-81f5c3e36b4b req-d7014b2c-ff01-480a-bd95-16dd241d01ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097570 Oct 25 03:31:02.891540 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2744/5369] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:02.894228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:02.894888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:02.900300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:02.902036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:02.902856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.284978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:03.285785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:03.343304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:03.352437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.352947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.353396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.354149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.354615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.355049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.409246 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-251e5804-7387-44ed-9dc6-df653abbbc30 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1501 microversion: 2.1 time: 0.535617 Oct 25 03:31:03.411232 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2626/5370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:02 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1501 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:03.442770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:03.445641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:03.458163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.464637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.465226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.466200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.470766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.472276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.542097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lazy-loading 'flavor' on Instance uuid 9930048d-9d62-4f8f-a57b-2b232b15dc2c {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:31:03.558213 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Cannot 'rescue' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state paused Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action HTTP/1.1 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 14 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: {"rescue": {}} Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: exception: Cannot 'rescue' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state paused Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9930048d-9d62-4f8f-a57b-2b232b15dc2c', 'body': {'rescue': {}}} Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c in vm_state paused. Cannot rescue while the instance is in this state. Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state paused Oct 25 03:31:03.562562 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state paused Oct 25 03:31:03.566523 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:03.568823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 409 to user: Cannot 'rescue' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state paused {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:31:03.569944 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-80277367-be47-4607-a046-4722ea1ec3da tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action" status: 409 len: 144 microversion: 2.1 time: 0.133526 Oct 25 03:31:03.570763 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2627/5371] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:31:03 2022] POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action => generated 144 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:31:03.594703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:03.595506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:03.606363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.607432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.607882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.608611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.610698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.611172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.748525 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b7e8e252-24f5-4e25-b2b7-89838802a83c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.165249 Oct 25 03:31:03.749725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2628/5372] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:31:03 2022] POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:31:03.758984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:03.762289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:03.783707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.788263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.789343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:03.791928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:03.792646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:03.794151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:04.031976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:04.044053 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-41781241-9d64-499d-bd02-f17383b943aa tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 0.761950 Oct 25 03:31:04.064738 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2745/5373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:03 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:04.200773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:04.211267 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f94301d2-9c8b-4c2c-8e57-21f8a1ae6156 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1508 microversion: 2.1 time: 0.456962 Oct 25 03:31:04.212204 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2629/5374] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:03 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1508 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:05.075293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:05.076872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:05.086590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:05.088609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:05.090568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:05.092232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:05.093469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:05.094180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:05.239812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:05.242948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:05.254474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:05.258517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:05.259244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:05.260283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:05.261581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:05.262928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:05.528395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:05.537307 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-34d6fe68-258f-4043-b26e-eba84f5caa9e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1516 microversion: 2.1 time: 0.302294 Oct 25 03:31:05.537927 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2630/5375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:05 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1516 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:05.640322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:05.652872 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-697a5a9e-bac5-4baa-bc48-361bd1580afc tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 0.585213 Oct 25 03:31:05.658447 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2746/5376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:05 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:06.688244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:06.690985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:06.707051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:06.707940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:06.710218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:06.711502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:06.714033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:06.714676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:07.016534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:07.025451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07f4c472-c057-4680-9903-f010cdc89691 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 0.342985 Oct 25 03:31:07.038144 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2631/5377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:06 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:07.714872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a8b257aa-3ab3-4d3c-b8da-3add5e691690 req-342b8a96-bf48-4a6f-8881-5637491078ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd00c943-ff4d-409d-9186-924a70880be3", "name": "network-vif-plugged", "status": "completed", "tag": "7c5129aa-89b9-4935-b914-d8bb891648f9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:07.733669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a8b257aa-3ab3-4d3c-b8da-3add5e691690 req-342b8a96-bf48-4a6f-8881-5637491078ec service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:07.747812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a8b257aa-3ab3-4d3c-b8da-3add5e691690 req-342b8a96-bf48-4a6f-8881-5637491078ec service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:07.748547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a8b257aa-3ab3-4d3c-b8da-3add5e691690 req-342b8a96-bf48-4a6f-8881-5637491078ec service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:07.768883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a8b257aa-3ab3-4d3c-b8da-3add5e691690 req-342b8a96-bf48-4a6f-8881-5637491078ec service nova] Creating event network-vif-plugged:7c5129aa-89b9-4935-b914-d8bb891648f9 for instance dd00c943-ff4d-409d-9186-924a70880be3 on n-h2-862355-1 Oct 25 03:31:07.780608 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a8b257aa-3ab3-4d3c-b8da-3add5e691690 req-342b8a96-bf48-4a6f-8881-5637491078ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069048 Oct 25 03:31:07.783472 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2747/5378] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:08.050292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:08.051174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:08.072496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:08.072834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:08.073192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:08.073972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:08.074470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:08.076146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:08.364122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:08.377935 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48da2296-9873-4620-b21d-25c0a1d7c067 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 0.327803 Oct 25 03:31:08.383584 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2632/5379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:08 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:08.499796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:08.502486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:08.520937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:08.522596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:08.532281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:08.533932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:08.536796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:08.538377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:08.580621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lazy-loading 'flavor' on Instance uuid 9930048d-9d62-4f8f-a57b-2b232b15dc2c {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:31:08.702202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-82203f6f-6820-4656-bb78-210c32aa8917 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action" status: 200 len: 32 microversion: 2.1 time: 0.208097 Oct 25 03:31:08.707096 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2748/5380] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:31:08 2022] POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:31:08.713349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:08.721002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:08.738487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:08.743122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:08.743814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:08.749110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:08.750765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:08.751489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:08.765923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:09.411121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:09.416188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:09.416907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:09.444677 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f83c675b-f975-410d-9d67-a6b0da459960 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.735672 Oct 25 03:31:09.452357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2633/5381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:08 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:09.458913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:09.459427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:09.460933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:09.461880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:09.462643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:09.463317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:09.860895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-93b3cb79-68a5-48c4-a8f3-1830d412caa0 req-8cadd7e1-ec3e-4952-8168-16e519b0c48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7c6947-0660-437b-bcf7-f16b0fabb83d", "name": "network-vif-plugged", "status": "completed", "tag": "49f45cd5-3200-4782-bb85-15fb4526cbfa"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:09.887382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-93b3cb79-68a5-48c4-a8f3-1830d412caa0 req-8cadd7e1-ec3e-4952-8168-16e519b0c48e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:09.889339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-93b3cb79-68a5-48c4-a8f3-1830d412caa0 req-8cadd7e1-ec3e-4952-8168-16e519b0c48e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:09.890028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-93b3cb79-68a5-48c4-a8f3-1830d412caa0 req-8cadd7e1-ec3e-4952-8168-16e519b0c48e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:09.892431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:09.904472 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f60a8f87-7e5b-49e4-9e7b-4d226e364d8c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1320 microversion: 2.1 time: 0.503399 Oct 25 03:31:09.907519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2749/5382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:09 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:09.936205 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-93b3cb79-68a5-48c4-a8f3-1830d412caa0 req-8cadd7e1-ec3e-4952-8168-16e519b0c48e service nova] Creating event network-vif-plugged:49f45cd5-3200-4782-bb85-15fb4526cbfa for instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d on n-h1-862355-1 Oct 25 03:31:09.975838 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-93b3cb79-68a5-48c4-a8f3-1830d412caa0 req-8cadd7e1-ec3e-4952-8168-16e519b0c48e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119158 Oct 25 03:31:09.978241 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2634/5383] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:31:10.480633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:10.481432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:10.492017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:10.494296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:10.498066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:10.499412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:10.500134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:10.500800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:10.570216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:10.913892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:10.923390 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb501374-b5e8-4516-af1f-ca06c3da2be7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.447536 Oct 25 03:31:10.923966 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2750/5384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:10 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:10.945278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:10.946598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:10.970627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:10.971365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:10.971969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:10.973443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:10.974093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:10.974755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:11.417898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:11.455795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6ffa5e96-3ddc-4dee-b23c-475c68bcf8b8 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1512 microversion: 2.1 time: 0.514719 Oct 25 03:31:11.482074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:11.483333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:11.488042 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2635/5385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:10 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:11.492995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:11.501091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:11.501836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:11.502760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:11.503375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:11.503983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:11.954733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:11.956108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:11.976352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:11.977020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:11.977397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:11.978687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:11.980995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:11.982344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:12.295730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:12.304620 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2280c23b-f0f8-431f-b846-835aed266e42 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.355916 Oct 25 03:31:12.310292 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2636/5386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:11 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:12.603608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:12.623563 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-96814d04-c80d-43fd-bd3a-3733b19585b4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1513 microversion: 2.1 time: 1.145161 Oct 25 03:31:12.626291 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2751/5387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:11 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1513 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:12.652138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:12.653515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:12.674108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:12.678346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:12.679256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:12.680198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:12.682229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:12.683201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:13.335678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:13.336392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:13.340939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:13.354915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:13.355519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:13.356020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:13.356850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:13.359343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:13.359855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:13.579687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:13.592719 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-df11bba0-6feb-46b1-b986-bc51d254bd85 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 200 len: 1512 microversion: 2.1 time: 0.944449 Oct 25 03:31:13.604680 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2637/5388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:12 2022] GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 1512 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:13.622699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:13.633173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:13.650702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:13.685287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:13.686926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:13.687635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:13.688708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:13.689692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:13.690479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:13.853476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:14.006378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:14.017352 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-baefe1e0-4dc0-4c14-a792-6db6db27d105 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.686909 Oct 25 03:31:14.017791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:14.023954 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2752/5389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:13 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:14.029629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:14.030297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:14.030866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:14.294928 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73288c7e-1eb1-4180-bd88-97bacffcfe67 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.681116 Oct 25 03:31:14.296627 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2638/5390] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 25 03:31:13 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:14.323195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:14.337947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:14.339244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1114002212', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:14.345626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:14.346563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:14.347288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:14.348345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:14.349246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:14.349935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:14.560554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:14.742695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:14.751168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:14.752197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:14.752903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:15.046297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:15.046907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:15.066004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:15.067282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:15.068067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:15.071196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:15.071650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:15.074453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:15.119203 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f6fa662-603a-4fdc-a295-ff770747cf78 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1114002212" status: 200 len: 1516 microversion: 2.1 time: 0.800747 Oct 25 03:31:15.121654 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2753/5391] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:31:14 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1114002212 => generated 1516 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:15.150705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:15.160072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:15.165925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:15.185137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:15.186340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:15.188481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:15.190669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:15.191411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:15.192926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:15.357211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:15.483298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:15.515671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:15.516224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:15.517249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:15.598856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:15.610894 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-92005b7e-ef58-4a99-a13f-11475304f501 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.570191 Oct 25 03:31:15.615132 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2639/5392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:15 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:15.812026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f90c8bf3-fd4d-42bb-b491-a8ba279e925c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.665692 Oct 25 03:31:15.812942 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2754/5393] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Oct 25 03:31:15 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:15.843851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:15.849567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:15.868729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.servers [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Removing options 'limit' from query {{(pid=120563) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 25 03:31:15.869768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:15.890223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:15.890927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:15.891375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:15.892111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:15.892569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:15.894598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:16.015832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:16.033886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:16.034553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:16.035099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:16.474522 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d456533c-15b9-43c4-8e4f-4e125d57e63d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.634323 Oct 25 03:31:16.476038 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2640/5394] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:31:15 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:16.504157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:16.515976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:16.517715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:16.526506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:16.527238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:16.527859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:16.528757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:16.529469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:16.531774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:16.636397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:16.637022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:16.653770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:16.658398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:16.661655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:16.665241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:16.668963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:16.675146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:16.824544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:17.227788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:17.239824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bdc56ce0-6fff-43a9-91c5-4bad6fdc0979 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.607749 Oct 25 03:31:17.245135 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2641/5395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:16 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:17.596440 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c76dc40-6f4f-4c9e-a9a0-526237c4b45b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 1.098067 Oct 25 03:31:17.598553 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2755/5396] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:31:16 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:17.620211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:17.634868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:17.635335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.servers [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Removing options 'limit' from query {{(pid=120563) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 25 03:31:17.636025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:17.658495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:17.662425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:17.666632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:17.667657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:17.668265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:17.668663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:17.814083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:17.896558 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-213bfd87-03c1-4783-952c-4441c58dc322 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.280156 Oct 25 03:31:17.904509 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2642/5397] 10.222.0.36 () {58 vars in 1150 bytes} [Tue Oct 25 03:31:17 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:17.907277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:17.912040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:17.912711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:17.932191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:17.932774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:17.933503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:17.933963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:17.934448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:17.934878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:17.993257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:18.087000 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ba62e32-1ff0-4cff-83e5-000f1f379a45 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.178926 Oct 25 03:31:18.087866 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2756/5398] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 03:31:17 2022] GET /compute/v2.1/servers => generated 1011 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:18.101554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:18.106911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:18.108839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:18.123334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.123839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.124314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.125088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.125546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.126224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.223380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:18.271468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:18.272757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:18.282377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.282377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.290358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.291414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.291901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.292341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.345072 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3678c3ca-d897-49e7-9ff8-dc4618c23058 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.247784 Oct 25 03:31:18.355440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2643/5399] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:31:18 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:18.366345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:18.376774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:18.378636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.servers [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Removing options 'limit' from query {{(pid=120563) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 25 03:31:18.379968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:18.385547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.386301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.386896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.387822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.388496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.389132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.419720 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-062dbc1e-e475-4b64-adfb-55635399f7e3 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.063050 Oct 25 03:31:18.441126 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2644/5400] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 25 03:31:18 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:18.452655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:18.460393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:18.461383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1114002212', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:18.468163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.468955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.469647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.470943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.472235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.472982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.604145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:18.659221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:18.669788 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d7b79d10-aae5-42d0-9ef1-55c4d6b61b5b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.403650 Oct 25 03:31:18.671163 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2757/5401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:18 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:18.730626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e8afa51-1c49-44d0-a866-8174b6efae11 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1114002212" status: 200 len: 346 microversion: 2.1 time: 0.285989 Oct 25 03:31:18.731772 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2645/5402] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:31:18 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1114002212 => generated 346 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:18.744961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1adc1c74-c638-43d7-917f-1b1f8777fc33 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:18.758263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1adc1c74-c638-43d7-917f-1b1f8777fc33 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.758766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1adc1c74-c638-43d7-917f-1b1f8777fc33 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.759409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1adc1c74-c638-43d7-917f-1b1f8777fc33 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.840526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1adc1c74-c638-43d7-917f-1b1f8777fc33 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:31:18.939225 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1adc1c74-c638-43d7-917f-1b1f8777fc33 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "POST /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0/action" status: 202 len: 0 microversion: 2.1 time: 0.198034 Oct 25 03:31:18.940404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2758/5403] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:31:18 2022] POST /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:31:18.949319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:18.950123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:18.961435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.969429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.969983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:18.970922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:18.971397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:18.976779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:19.234807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:19.250659 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6aeb9fa3-02fc-4d34-a797-a7fc7e1dcac9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 0.305495 Oct 25 03:31:19.251778 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2646/5404] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:18 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:19.523390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f94795f-ba18-4254-a5dc-5a0d54cf65aa tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1191493519", "availability_zone": "foo_zone"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:19.528622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.aggregate [None req-6f94795f-ba18-4254-a5dc-5a0d54cf65aa tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Generated uuid fc1b6aea-39d0-4e5c-a634-623874b6dc3e for aggregate {{(pid=120562) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 25 03:31:19.578981 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f94795f-ba18-4254-a5dc-5a0d54cf65aa tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.208142 Oct 25 03:31:19.590264 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2759/5405] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Oct 25 03:31:19 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:19.593732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8326f502-a068-42de-b4d3-aba72e71c669 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:19.632221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8326f502-a068-42de-b4d3-aba72e71c669 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.041440 Oct 25 03:31:19.635089 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2647/5406] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:31:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:19.647163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:19.651255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:19.651993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:19.653298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:19.654624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:19.655315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:19.655999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:19.690394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e283f2e-e214-49ba-80ec-8fa7b4153e42 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048054 Oct 25 03:31:19.698910 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2760/5407] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Oct 25 03:31:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:19.699108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:19.699108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:19.704819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89cd8164-558a-46ae-bccb-c4a190a2c86c tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:19.713649 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89cd8164-558a-46ae-bccb-c4a190a2c86c tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.012479 Oct 25 03:31:19.717164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:19.717964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:19.718678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:19.719617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:19.720311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:19.720959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:19.722293 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2761/5408] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Oct 25 03:31:19 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:19.727771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1458ce01-34b6-4751-a7d3-eb7fba97c208 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:19.740447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1458ce01-34b6-4751-a7d3-eb7fba97c208 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:19.741239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1458ce01-34b6-4751-a7d3-eb7fba97c208 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:19.742691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1458ce01-34b6-4751-a7d3-eb7fba97c208 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:19.957704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:19.966856 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19d9cdc1-45f4-4e52-ba78-c320418cb435 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.273474 Oct 25 03:31:19.982121 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2648/5409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:19 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:20.121940 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1458ce01-34b6-4751-a7d3-eb7fba97c208 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.397501 Oct 25 03:31:20.123332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2762/5410] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:31:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:20.135251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7230847c-4925-447b-90a8-2ff3afa59f86 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:20.148884 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7230847c-4925-447b-90a8-2ff3afa59f86 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.017268 Oct 25 03:31:20.156109 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2649/5411] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:31:20 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:20.161720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61c7ba09-5919-4f52-b124-3d4d12f8c426 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-851739375", "availability_zone": "foo_zone"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:20.279856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:20.281031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:20.293760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:20.300655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:20.302518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:20.305270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:20.306141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:20.308064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:20.350180 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61c7ba09-5919-4f52-b124-3d4d12f8c426 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.191234 Oct 25 03:31:20.357219 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2763/5412] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Oct 25 03:31:20 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:20.367690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-87d49b8d-0a15-440e-b96c-d74232a39cd7 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:20.419529 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-87d49b8d-0a15-440e-b96c-d74232a39cd7 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.059972 Oct 25 03:31:20.429500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2764/5413] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:31:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:20.434648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f4730a97-5122-4412-884f-bd75b8d57d04 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:20.446268 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f4730a97-5122-4412-884f-bd75b8d57d04 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.015179 Oct 25 03:31:20.453849 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2765/5414] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Oct 25 03:31:20 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:20.464172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0eba7eff-3f65-4c64-9d54-0a0b29f87001 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862355-1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:20.476856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0eba7eff-3f65-4c64-9d54-0a0b29f87001 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:20.477524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0eba7eff-3f65-4c64-9d54-0a0b29f87001 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:20.478171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0eba7eff-3f65-4c64-9d54-0a0b29f87001 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:20.656479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:20.666042 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-acb94201-38e3-40bf-8f99-d2f3c9de8658 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1527 microversion: 2.1 time: 0.393191 Oct 25 03:31:20.668676 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0eba7eff-3f65-4c64-9d54-0a0b29f87001 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.213649 Oct 25 03:31:20.670980 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2766/5415] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Oct 25 03:31:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:20.681458 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2650/5416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:20 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1527 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:20.683324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45f9c8b1-efdf-4cac-a0d5-108a52812e81 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:20.734224 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45f9c8b1-efdf-4cac-a0d5-108a52812e81 tempest-TestAggregatesBasicOps-1222231980 tempest-TestAggregatesBasicOps-1222231980-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.054554 Oct 25 03:31:20.745397 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2767/5417] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:31:20 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 25 03:31:20.990599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:20.991513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:21.002843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:21.003342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:21.010403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:21.011409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:21.013069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:21.013536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:21.070785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:21.325027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:21.345890 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c5dad7a0-951d-41f4-9c47-6850c162d84d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.355726 Oct 25 03:31:21.347204 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2651/5418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:20 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:21.710256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:21.711042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:21.725142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:21.727582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:21.728467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:21.731143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:21.731814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:21.732601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:22.372581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:22.374036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:22.393202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:22.394018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:22.395553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:22.396515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:22.397207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:22.397893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:22.662105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:22.674616 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f8a05dd-7773-4ac9-9209-2f4abf016689 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.305781 Oct 25 03:31:22.675497 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2652/5419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:22 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:23.297133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:23.313460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8dfda15b-47c8-4bca-a9a1-a3d5c66ae5c6 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 1.608078 Oct 25 03:31:23.315164 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2768/5420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:21 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:23.698790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:23.699403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:23.710738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:23.713576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:23.714366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:23.715288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:23.715969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:23.720759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:23.975678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:23.983844 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4fa05e9-bfba-409f-97f6-0cc8a58bab0e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.289038 Oct 25 03:31:23.984436 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2653/5421] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:23 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:24.338164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:24.343326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:24.362914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:24.365964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:24.366731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:24.369114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:24.369822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:24.371301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:24.814064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:24.826231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1203c9c4-ec33-47a3-b3e5-4e4a76daa234 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 0.492148 Oct 25 03:31:24.830290 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2769/5422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:24 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:25.029509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:25.031490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:25.043860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.045765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.046445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.047435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.048054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.049340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.337747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:25.347804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-00237cc3-d103-47d2-a152-dfc53dcef8af tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1502 microversion: 2.1 time: 0.330895 Oct 25 03:31:25.371517 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2654/5423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:25 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1502 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:25.377914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c0f084c-5301-47b3-9247-99068723aa22"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:25.381634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:25.391246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.392208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.393427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.418746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.422427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.424961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.470383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:25.491925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Cannot 'attach_volume' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state rescued Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/os-volume_attachments HTTP/1.1 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 74 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: {"volumeAttachment": {"volumeId": "9c0f084c-5301-47b3-9247-99068723aa22"}} Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'attach_volume' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state rescued Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '9930048d-9d62-4f8f-a57b-2b232b15dc2c', 'body': {'volumeAttachment': {'volumeId': '9c0f084c-5301-47b3-9247-99068723aa22'}}} Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 25 03:31:25.493954 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state rescued Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state rescued Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 409 to user: Cannot 'attach_volume' instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c while it is in vm_state rescued {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:31:25.499895 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f3d2347-f957-48ce-b3b1-aa2d830ebead tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.123344 Oct 25 03:31:25.510630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:25.511386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:25.514520 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2770/5424] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:31:25 2022] POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/os-volume_attachments => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 25 03:31:25.525236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.526249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.527036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.528338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.529148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.530009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.701347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe8329b1-92d7-421a-816e-254589e966f0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.198375 Oct 25 03:31:25.703171 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2655/5425] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:31:25 2022] POST /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:31:25.718349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:25.719093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:25.730763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.733748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.734668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.735851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.738945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.741018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.854314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:25.855405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:25.868435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.869489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.870200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:25.872093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:25.873918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:25.874571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:26.014270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:26.556206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:26.570169 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a26f06f4-dedf-4dd1-a870-b56de794a12e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 0.720896 Oct 25 03:31:26.571062 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2656/5426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:25 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:26.577356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:26.582632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:26.607119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:26.607805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:26.608807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:26.609671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:26.610307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:26.611054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:26.642764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:26.646302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:26.663506 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c8868f9-6c6e-4b59-805b-d574c67bc758 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments/5f9111f8-edc4-4137-a6a7-88bf42a369bd" status: 200 len: 194 microversion: 2.20 time: 0.091167 Oct 25 03:31:26.664291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2657/5427] 10.222.0.36 () {60 vars in 1454 bytes} [Tue Oct 25 03:31:26 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments/5f9111f8-edc4-4137-a6a7-88bf42a369bd => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:31:26.666409 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2bbcb733-fef0-46b4-8a65-ba8ac078da7c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1510 microversion: 2.1 time: 0.958854 Oct 25 03:31:26.667019 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2771/5428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:25 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1510 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:26.792778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:26.793381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:26.802549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:26.810370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:26.811057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:26.812047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:26.812743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:26.813407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:27.029170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lazy-loading 'services' on Instance uuid 607eba3e-2e4d-4aad-9dcd-a91d25ed665d {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:31:27.139523 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01e99e4b-f7ca-4e1e-8e60-52381b344117 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments/5f9111f8-edc4-4137-a6a7-88bf42a369bd" status: 202 len: 0 microversion: 2.20 time: 0.350654 Oct 25 03:31:27.141047 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2658/5429] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Oct 25 03:31:26 2022] DELETE /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments/5f9111f8-edc4-4137-a6a7-88bf42a369bd => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:31:27.152440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:27.156655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:27.167708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:27.169173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:27.169958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:27.171086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:27.171728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:27.174338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:27.240951 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03c378ed-b19d-436a-8c50-9006979fb3c5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095195 Oct 25 03:31:27.241935 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2772/5430] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:27 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:31:27.601055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:27.602083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:27.619004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:27.621213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:27.622150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:27.625200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:27.626103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:27.628297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:27.695823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:27.697033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:27.706719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:27.712770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:27.713421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:27.718911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:27.721522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:27.725115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:28.281654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:28.298078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cedf5ef6-076d-496a-acee-d119438ec841 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 0.702777 Oct 25 03:31:28.302286 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2659/5431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:27 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:28.330022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:28.335461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:28.355277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:28.356043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:28.356670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:28.357559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:28.363944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:28.364989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:28.467729 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d09ff365-6436-4df0-b517-2d215d9b065b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163776 Oct 25 03:31:28.470665 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2660/5432] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:28 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:31:28.473307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:28.482043 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-84a6ba29-75a6-4508-9a0e-6077bf1b71e5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1510 microversion: 2.1 time: 0.790602 Oct 25 03:31:28.491283 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2773/5433] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:27 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1510 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:29.324329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:29.325066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:29.327240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:29.331762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:29.343936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:29.345511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:29.348992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:29.350103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:29.350924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:29.351527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:29.482882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:29.485054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:29.508123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:29.513357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:29.514323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:29.515381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:29.516055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:29.516673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:29.576972 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f581475c-499a-43d0-9d12-3b86b2019eb7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098033 Oct 25 03:31:29.578166 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2774/5434] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:29 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:31:29.583752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:29.584702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:29.591062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:29.592629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:29.593234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:29.594124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:29.594867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:29.595452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:29.620428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:29.632671 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d1c06fe-cb29-4120-b612-4ab10431f909 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 0.312641 Oct 25 03:31:29.634698 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2661/5435] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:29 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:29.668002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=10 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:30.591520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:30.593918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:30.611616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:30.612605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:30.613459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:30.615121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:30.617078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:30.619696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:30.744358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9a62d70f-53a9-4339-ab30-562faf929868 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157853 Oct 25 03:31:30.749903 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2662/5436] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:30 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:31:30.763335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:30.766671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:30.782308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:30.783141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:30.790078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:30.792467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:30.793118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:30.793743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:30.847312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:30.862911 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67073283-9ed1-4bab-bacf-23f7d70df04c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1510 microversion: 2.1 time: 1.283283 Oct 25 03:31:30.864771 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2775/5437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:29 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1510 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:31.463499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:31.478706 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-816d976b-bfb3-4fe4-81eb-f8952ba65bdf tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 0.726194 Oct 25 03:31:31.479577 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2663/5438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:30 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:31.898728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:31.900824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:31.931350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:31.938196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:31.938821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:31.941247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:31.942124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:31.945325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:32.125264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:32.128088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:32.144983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:32.150674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:32.151387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:32.152434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:32.153162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:32.154426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:32.232854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d7c57f2d-c667-43da-8ab1-78ccd7f86e7e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.476750 Oct 25 03:31:32.234094 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2776/5439] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:31 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:31:32.309664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:32.320168 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d522d6bd-0c1e-4084-9180-1b4370b93324 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1516 microversion: 2.1 time: 0.433939 Oct 25 03:31:32.342755 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2664/5440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:31 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1516 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:32.508762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:32.510224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:32.531181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:32.533499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:32.534809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:32.539399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:32.540130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:32.542824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:33.245740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:33.247945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:33.268376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:33.268898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:33.269346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:33.271338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:33.271798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:33.286609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:33.409043 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36ebbb97-c966-4668-9b3e-65dfea2dc80a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167119 Oct 25 03:31:33.418241 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2665/5441] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:33 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:31:33.558572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:33.572484 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f2af2a0-74d8-4117-9ed3-03faee67095d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1523 microversion: 2.1 time: 1.071383 Oct 25 03:31:33.575325 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2777/5442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:32 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1523 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:34.430262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:34.433910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:34.449274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:34.455390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:34.456121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:34.457583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:34.458511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:34.459126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:34.525473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:34.604628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:34.605548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:34.624175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a448653d-19bf-42a5-b82d-928a1c653b63 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198989 Oct 25 03:31:34.625552 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2666/5443] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:34 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:31:34.630343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:34.634490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:34.636642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:34.642809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:34.647029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:34.657868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.182651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da8e5ad5-619f-4002-bd28-9ba1aa2407a0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'create', calling method: .version_select at 0x7efd3308cf70>, body: {"keypair": {"name": "tempest-keypair-1738540917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8K4VCgAmhumwYZJ2dPfrzy+y7XMWL4crAfl2/276xo31nlMofX8oAmDNhoRdFKHsFbi+GYYiiRn2uire/kQWlJHlL0R/DhJ/ugcCMkoZDKiQW3jbM7dVvZxs19xxhj3Q=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:35.236746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-da8e5ad5-619f-4002-bd28-9ba1aa2407a0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for project bea59242063e4d0599459a00b01770ee. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:31:35.245149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:35.255851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-da8e5ad5-619f-4002-bd28-9ba1aa2407a0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for user 0961d97e347042a190549c04dd3f386d and project bea59242063e4d0599459a00b01770ee. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:31:35.268065 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7ea4549-b673-49c3-84ac-77ce717f8688 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1500 microversion: 2.1 time: 0.666935 Oct 25 03:31:35.281713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2778/5444] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:34 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1500 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:35.298755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:35.304607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:35.305343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:35.310912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:35.311646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:35.312246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.313160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:35.313800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:35.314407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.330957 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da8e5ad5-619f-4002-bd28-9ba1aa2407a0 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153771 Oct 25 03:31:35.334258 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2667/5445] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:31:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:31:35.346705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:35.408507 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fcfe4fd3-ede1-4f4c-b24f-d0971c6d1f75 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.113190 Oct 25 03:31:35.421236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2779/5446] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Oct 25 03:31:35 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:35.423053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1570b337-1b28-47e4-b2d9-a14d74a5f469 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:35.437130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1570b337-1b28-47e4-b2d9-a14d74a5f469 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:35.438505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1570b337-1b28-47e4-b2d9-a14d74a5f469 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:35.439240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1570b337-1b28-47e4-b2d9-a14d74a5f469 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.501187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1570b337-1b28-47e4-b2d9-a14d74a5f469 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Going to try to start instance {{(pid=120563) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 25 03:31:35.609632 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1570b337-1b28-47e4-b2d9-a14d74a5f469 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "POST /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0/action" status: 202 len: 0 microversion: 2.1 time: 0.190467 Oct 25 03:31:35.610504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2668/5447] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:31:35 2022] POST /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:31:35.631697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:35.632958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:35.640570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:35.643690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:35.654271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:35.657355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:35.658194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.660244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:35.664709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:35.665463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.674325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:35.674834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:35.675284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.681396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:35.686957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:35.688891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:35.784790 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a1ec79d-1038-4ffa-8a18-31728eccc915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151468 Oct 25 03:31:35.799791 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2669/5448] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:35 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:31:36.143438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:36.152334 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e7becfe-e41a-4861-a6b0-838d6b596f88 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1509 microversion: 2.1 time: 0.536309 Oct 25 03:31:36.153492 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2780/5449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:35 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:36.820018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:36.824238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:36.835858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:36.836644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:36.837154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:36.838242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:36.838901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:36.840383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:36.893797 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e669c27-f225-4bfe-9cbf-fd3648b8da16 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.084676 Oct 25 03:31:36.895034 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2670/5450] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:31:36 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:36.979720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:36.980788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:36.991460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:36.993137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:36.993756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:36.994528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:36.995578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:36.996520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:36.999093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:37.062174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:31:37.185189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:37.186521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:37.196088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5dca4b49-de31-420e-8749-25ad631e22f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 204 len: 0 microversion: 2.20 time: 0.220940 Oct 25 03:31:37.200502 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2781/5451] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:31:36 2022] DELETE /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:31:37.204457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:37.206267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:37.208996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:37.211088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:37.215118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:37.215825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:37.220992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:37.223995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:37.241941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:37.242632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:37.243074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:37.243772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:37.244394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:37.245078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:37.508694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:37.545431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:37.549775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:37.552289 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0427eb09-1918-4f37-b7f4-02f132e790b9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.344131 Oct 25 03:31:37.574765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2782/5452] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:37 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:37.815556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:37.827555 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4eda8084-75c6-49ba-b022-7188047de228 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1509 microversion: 2.1 time: 0.648824 Oct 25 03:31:37.829457 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2671/5453] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:37 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1509 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:38.589118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:38.589875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:38.602566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:38.603059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:38.603501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:38.604216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:38.604671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:38.605097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:38.853842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:38.855080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:38.863753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:38.865091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:38.865894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:38.866773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:38.870258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:38.870871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:39.060224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:39.084871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:39.091811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:39.096503 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-60ae773c-1b5a-4270-9f35-02d58dac7038 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1724 microversion: 2.20 time: 0.511225 Oct 25 03:31:39.101195 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2783/5454] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:38 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1724 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:40.080167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:40.096354 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1785165-606a-42f0-938f-f0fbb606a739 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1513 microversion: 2.1 time: 1.246689 Oct 25 03:31:40.099344 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2672/5455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:38 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1513 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:40.136876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:40.137073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:40.139866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:40.158150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:40.159818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.servers [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Removing options 'limit' from query {{(pid=120562) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 25 03:31:40.162771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.163212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:40.165442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.166976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.167251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.167855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.168450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.169487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.170440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.172099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.172378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.173517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.174132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.183453 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-85acca96-9320-41b3-992e-9f75d217ba65 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.059229 Oct 25 03:31:40.187378 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2784/5456] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 25 03:31:40 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:31:40.200742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:40.203380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:40.216560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.220142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.223659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.224627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.225262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.227466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.386133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:40.404243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:40.405977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:40.408202 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-76be4f12-9c8a-4e65-907d-37917804a590 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1656 microversion: 2.20 time: 0.283718 Oct 25 03:31:40.411849 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2673/5457] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:40 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1656 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:40.533182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:40.544124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51cccaed-60a2-4941-8858-11096443d126 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1513 microversion: 2.1 time: 0.348242 Oct 25 03:31:40.558088 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2785/5458] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:40 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:40.573743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:40.574592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:40.581260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.582598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.583350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.584255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:40.584872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:40.585461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:40.985387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:41.020171 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-765ce848-6300-458c-8fd5-bce5717fc29e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 200 len: 1512 microversion: 2.1 time: 0.454600 Oct 25 03:31:41.021404 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2674/5459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:40 2022] GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 1512 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:41.043756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:41.044600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:41.052530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:41.053340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:41.053961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:41.054840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:41.055732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:41.056318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:41.122813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-841647973", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e73e30e4-e8c5-450a-88be-9e18c4916dad"}], "security_groups": [{"name": "tempest-securitygroup--1177311573"}], "key_name": "tempest-keypair-1738540917", "user_data": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:41.343471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] validate_networks() for [('e73e30e4-e8c5-450a-88be-9e18c4916dad', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:31:41.425213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:41.438236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f853b66-8977-4a43-95e8-a763802037de tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1512 microversion: 2.1 time: 0.396355 Oct 25 03:31:41.456456 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2786/5460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:41 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:41.475722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-42cbd339-2c29-46c0-8d6f-c32377f4f58e req-77559897-40e6-42a4-a371-31b5d18c2a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "607eba3e-2e4d-4aad-9dcd-a91d25ed665d", "name": "network-vif-deleted", "tag": "892d2ec9-9480-448e-9f12-bdc878a287e5"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:41.491612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42cbd339-2c29-46c0-8d6f-c32377f4f58e req-77559897-40e6-42a4-a371-31b5d18c2a64 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:41.492493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42cbd339-2c29-46c0-8d6f-c32377f4f58e req-77559897-40e6-42a4-a371-31b5d18c2a64 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:41.493133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42cbd339-2c29-46c0-8d6f-c32377f4f58e req-77559897-40e6-42a4-a371-31b5d18c2a64 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:41.524974 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-42cbd339-2c29-46c0-8d6f-c32377f4f58e req-77559897-40e6-42a4-a371-31b5d18c2a64 service nova] Creating event network-vif-deleted:892d2ec9-9480-448e-9f12-bdc878a287e5 for instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d on n-h2-862355-1 Oct 25 03:31:41.537241 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-42cbd339-2c29-46c0-8d6f-c32377f4f58e req-77559897-40e6-42a4-a371-31b5d18c2a64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074138 Oct 25 03:31:41.537887 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2787/5461] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:41.550673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:41.551563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:41.572149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:41.572908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:41.573541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:41.574447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:41.575265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:41.575850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:41.582500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:41.650384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:41.651139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:41.651773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:41.652398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lazy-loading 'fault' on Instance uuid 607eba3e-2e4d-4aad-9dcd-a91d25ed665d {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:31:41.736602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:41.746863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:41.748412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:41.749508 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c6a28296-4111-4f09-b0f3-7d579b660d71 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 200 len: 1370 microversion: 2.20 time: 0.204979 Oct 25 03:31:41.770483 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2788/5462] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:41 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:41.787159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:41.792299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:41.793081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:42.159665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.160525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.161231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.162261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.162935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.163568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.281235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:42.361079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ee6e7cb-7e11-46a1-b8f2-c5fc6cfef168 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.589469 Oct 25 03:31:42.361921 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2789/5463] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Oct 25 03:31:41 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:42.377000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:42.377630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:42.388261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.389109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.389788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.392278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.394002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.396708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.552003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:31:42.556315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:31:42.558578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:31:42.559257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:31:42.560248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:31:42.586284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.588937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.590324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.592753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.594271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.595471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.653748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for project bea59242063e4d0599459a00b01770ee. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:31:42.662614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Getting quotas for user 0961d97e347042a190549c04dd3f386d and project bea59242063e4d0599459a00b01770ee. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:31:42.681554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:31:42.683953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:31:42.755223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:42.770713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46183da0-ca62-4d1c-852f-f5b3c1d824e4 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1513 microversion: 2.1 time: 0.395958 Oct 25 03:31:42.772241 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2790/5464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:42 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1513 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:42.785946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:42.789459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:42.793511 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a2878383-79dd-41f4-b0be-8e5166e08ba3 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.676836 Oct 25 03:31:42.799294 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2675/5465] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:31:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:31:42.807073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.809531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.810177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.813590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.814247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.815013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.819469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1cd7b98b-e684-4c04-867c-3bdfac1ef6ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:42.820099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1cd7b98b-e684-4c04-867c-3bdfac1ef6ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:42.848444 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] HTTP exception thrown: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Request method failure captured: Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d HTTP/1.1 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1dmtkkQB6PVFo_t8zHwRBr8jAJ-rE4gtdLNmmO8-b8w_2Kf-xxhILQ5N7hCveszZ-9llVUjfG7lbfRDcXwsAVG0PDen8NBz8fKNUUcrGSw50mQvEjdoV0zRJmoRpIekoYqhfgEsA0uqllTM4-FxC8p51yArK7hUA8SUwTc3edwZPY4 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.20 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82eb22a91945422f9fe1b9c5e85e0aed", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82eb22a91945422f9fe1b9c5e85e0aed"}]}] Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9b8a3ce5bebf4745b1f095653b010f5e Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '607eba3e-2e4d-4aad-9dcd-a91d25ed665d'} Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:42.851649 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:31:42.856626 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:31:42.869059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Returning 404 to user: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:31:42.872150 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-285cad1b-f123-41f8-8ecd-b9d6697fbf08 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 404 len: 111 microversion: 2.20 time: 0.091610 Oct 25 03:31:42.877104 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2791/5466] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:42 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:31:42.886974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:42.891233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:42.905110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.905618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.907822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:42.908548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:42.914193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:42.914756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:43.085006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1cd7b98b-e684-4c04-867c-3bdfac1ef6ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:43.105405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1cd7b98b-e684-4c04-867c-3bdfac1ef6ad tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1245 microversion: 2.1 time: 0.298108 Oct 25 03:31:43.107372 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2676/5467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:42 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1245 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:43.126531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb00c635-ae88-48e5-9a66-34350112c496 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '.version_select at 0x7efd3b744550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:43.175426 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb00c635-ae88-48e5-9a66-34350112c496 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-389177982" status: 204 len: 0 microversion: 2.20 time: 0.066531 Oct 25 03:31:43.178857 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2677/5468] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Oct 25 03:31:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-389177982 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:31:43.251641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:43.268406 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0e4b4185-5fcf-4b3c-afb2-8b253f3a5b53 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 200 len: 1512 microversion: 2.1 time: 0.388100 Oct 25 03:31:43.271995 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2792/5469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:42 2022] GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:43.300452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:43.301566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:43.312219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:43.315894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:43.316977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:43.318219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:43.321003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:43.321763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:43.871409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:43.906616 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4b16636-9c64-4088-8ff3-28300a91f637 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1512 microversion: 2.1 time: 0.607381 Oct 25 03:31:43.908404 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2678/5470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:43 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1512 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:43.940201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:43.951326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:43.960219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:43.974357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:43.975637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:43.978015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:43.979065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:43.980391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:43.981051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:44.083240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:44.136808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:44.138731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:44.149548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:44.151646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:44.152327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:44.154412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:44.156107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:44.157421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:44.164739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:44.192365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:44.197902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:44.198711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:44.370075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:44.381352 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b508f2c-e56e-4a6b-801e-0573dad44f94 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1297 microversion: 2.1 time: 0.249293 Oct 25 03:31:44.382628 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2679/5471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:44 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1297 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:44.530663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c61e14ab-6702-4e6e-837f-d738b4b24c60 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.594633 Oct 25 03:31:44.535255 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2793/5472] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:31:43 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:44.563353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:44.584604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:44.588811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:44.812765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:44.813875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:44.814769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:44.815938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:44.817785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:44.818640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.025254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:45.135225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c28ac3bf-d6e8-4309-9685-75d57a64554a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'create', calling method: .version_select at 0x7efd327d95e0>, body: {"keypair": {"name": "tempest-keypair-631483846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhzTO621zSdeB7pKvM3jXHFiKCWub6D3RV1GiwJkBJobWCq34qqeixDBOErtY4d8dUeRcLukb1EaPmufi3jtefwhrKMSDxTEP+1P+e0VniOYzkpaYstHsiLtyChuDtloQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:45.163198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c28ac3bf-d6e8-4309-9685-75d57a64554a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:31:45.167938 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-136f1768-f7e9-4d0a-b77a-32563df96c5d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.608356 Oct 25 03:31:45.168963 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2680/5473] 10.222.0.36 () {58 vars in 1150 bytes} [Tue Oct 25 03:31:44 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:45.172099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c28ac3bf-d6e8-4309-9685-75d57a64554a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for user 9b8a3ce5bebf4745b1f095653b010f5e and project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:31:45.188416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:45.209171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:45.212820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:45.227179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.228176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.228915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.230173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.230874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.231532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.235383 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c28ac3bf-d6e8-4309-9685-75d57a64554a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.109290 Oct 25 03:31:45.243076 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2794/5474] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:31:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 25 03:31:45.371886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:45.407584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:45.409096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:45.428858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.430388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.432355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.433314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.439275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.440050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.448140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b120b00-0cc4-47a9-a63f-c0a5e9a30785 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.264580 Oct 25 03:31:45.449419 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2681/5475] 10.222.0.36 () {58 vars in 1212 bytes} [Tue Oct 25 03:31:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:45.466718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:45.474595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:45.475417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:45.484766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.487266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.487984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.490011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.496992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.498523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.574676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:45.583328 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-afb8bdf3-f337-4fd1-a24d-82071e7aaa34 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1303 microversion: 2.1 time: 0.180520 Oct 25 03:31:45.584234 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2795/5476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:45 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1303 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:45.647465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:45.721455 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5efeecc-617f-4a86-89bd-82ce4f09b948 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.261497 Oct 25 03:31:45.725297 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2682/5477] 10.222.0.36 () {58 vars in 1196 bytes} [Tue Oct 25 03:31:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:45.736118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:45.741762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:45.742662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'name': '1114002212', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:45.748680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.749397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.750038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.750925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.751540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.752152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.853379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:45.938931 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73611f51-42f2-4b23-a2fa-f9910e7e42f5 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?name=1114002212" status: 200 len: 346 microversion: 2.1 time: 0.207033 Oct 25 03:31:45.939861 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2796/5478] 10.222.0.36 () {58 vars in 1156 bytes} [Tue Oct 25 03:31:45 2022] GET /compute/v2.1/servers?name=1114002212 => generated 346 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:31:45.953246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:45.965139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:45.965967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:45.975907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.982941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.983404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:45.984196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:45.984663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:45.985087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.163579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:46.283668 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-be10da1b-0323-4bf1-8279-646a39c1f490 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.334074 Oct 25 03:31:46.284558 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2683/5479] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Oct 25 03:31:45 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:46.304126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:46.310044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:46.311165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-111400221', 'deleted': False, 'project_id': '529a4dcb4f794e86981f3ec07459d93c'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 03:31:46.318235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.318985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.319668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.320646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.321343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.322653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.429299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 03:31:46.555211 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a833aab-adac-40c3-9c48-4a38206ac633 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111400221" status: 200 len: 346 microversion: 2.1 time: 0.260941 Oct 25 03:31:46.574826 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2797/5480] 10.222.0.36 () {58 vars in 1228 bytes} [Tue Oct 25 03:31:46 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111400221 => generated 346 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:46.583529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:46.584057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:46.594368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.594935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.595493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.596124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.596590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.597073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.612421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:46.613560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:46.626190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.627093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.627789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.629276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.631613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.632331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.662779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:46.678053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:31:46.846921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:46.869423 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f7cfea48-4a0d-4429-aa31-4d5d6b14840c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 204 len: 0 microversion: 2.1 time: 0.292844 Oct 25 03:31:46.875171 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b3d54a4-80e5-4b07-8b68-4b30b8ca8472 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1303 microversion: 2.1 time: 0.266465 Oct 25 03:31:46.875718 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2684/5481] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:31:46 2022] DELETE /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:31:46.876273 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2798/5482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:46 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1303 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:46.887702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:46.890928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:46.900769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.901271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.901823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:46.902547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:46.903009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:46.903441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:47.743863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:47.755183 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd795d1b-5646-4e10-b572-7178e2b37ce9 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1518 microversion: 2.1 time: 0.872495 Oct 25 03:31:47.767430 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2685/5483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:46 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1518 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:47.905588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:47.907750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:47.928585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:47.930823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:47.932104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:47.932954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:47.933427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:47.933905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:48.641923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:48.652540 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b32b59f-dcb8-461e-b2b9-f91c3bea32ca tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.753309 Oct 25 03:31:48.661980 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2799/5484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:47 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:48.755905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-038d8618-91b0-4d65-8fca-31a21329865a req-e7a5af6e-7ef6-4044-967d-121536c58a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe07e59f-3971-4cea-9692-e2d048677c49", "tag": "e3fcef15-2932-46ba-8733-c6b08e897c17"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:48.780478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:48.781128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:48.794709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:48.795744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:48.796356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:48.797256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:48.797921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:48.798514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:48.821067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-038d8618-91b0-4d65-8fca-31a21329865a req-e7a5af6e-7ef6-4044-967d-121536c58a23 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:48.821651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-038d8618-91b0-4d65-8fca-31a21329865a req-e7a5af6e-7ef6-4044-967d-121536c58a23 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:48.822325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-038d8618-91b0-4d65-8fca-31a21329865a req-e7a5af6e-7ef6-4044-967d-121536c58a23 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:48.841268 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-038d8618-91b0-4d65-8fca-31a21329865a req-e7a5af6e-7ef6-4044-967d-121536c58a23 service nova] Creating event network-changed:e3fcef15-2932-46ba-8733-c6b08e897c17 for instance fe07e59f-3971-4cea-9692-e2d048677c49 on n-h1-862355-1 Oct 25 03:31:48.866139 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-038d8618-91b0-4d65-8fca-31a21329865a req-e7a5af6e-7ef6-4044-967d-121536c58a23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119432 Oct 25 03:31:48.867428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2686/5485] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:49.409243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:49.426779 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9a93c145-704b-4b4f-a855-3adfd7353283 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1518 microversion: 2.1 time: 0.649111 Oct 25 03:31:49.427400 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2800/5486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:48 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1518 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:49.677958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:49.678666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:49.701461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:49.702161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:49.705051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:49.706129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:49.707478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:49.708259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:49.867475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2063212466", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39a6132f-d4fd-4e72-b376-0f3f0d2d7b0e"}], "security_groups": [{"name": "tempest-securitygroup--544775197"}], "key_name": "tempest-keypair-631483846", "user_data": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:49.949969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:49.960037 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da8d1c18-9de6-47d0-ba94-723d6f7834bb tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.286481 Oct 25 03:31:49.974465 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2687/5487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:49 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:50.453247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:50.453807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:50.464050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:50.464990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:50.466477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:50.467371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:50.468012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:50.469902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:50.514966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] validate_networks() for [('39a6132f-d4fd-4e72-b376-0f3f0d2d7b0e', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:31:50.657913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:50.673318 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9ae9482c-5790-4290-b383-3497a5c85dfd tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 200 len: 1476 microversion: 2.1 time: 0.223894 Oct 25 03:31:50.677448 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2688/5488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:50 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:50.837550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-69694a19-8e6c-4501-81e3-65d0765cb6a7 req-c60870a3-fc2c-4213-b129-a625b44b667c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd00c943-ff4d-409d-9186-924a70880be3", "name": "network-vif-deleted", "tag": "7c5129aa-89b9-4935-b914-d8bb891648f9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:50.863957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-69694a19-8e6c-4501-81e3-65d0765cb6a7 req-c60870a3-fc2c-4213-b129-a625b44b667c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:50.864877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-69694a19-8e6c-4501-81e3-65d0765cb6a7 req-c60870a3-fc2c-4213-b129-a625b44b667c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:50.865622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-69694a19-8e6c-4501-81e3-65d0765cb6a7 req-c60870a3-fc2c-4213-b129-a625b44b667c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:50.877545 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-69694a19-8e6c-4501-81e3-65d0765cb6a7 req-c60870a3-fc2c-4213-b129-a625b44b667c service nova] Creating event network-vif-deleted:7c5129aa-89b9-4935-b914-d8bb891648f9 for instance dd00c943-ff4d-409d-9186-924a70880be3 on n-h2-862355-1 Oct 25 03:31:50.895663 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-69694a19-8e6c-4501-81e3-65d0765cb6a7 req-c60870a3-fc2c-4213-b129-a625b44b667c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068527 Oct 25 03:31:50.896974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2689/5489] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:31:50.985001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:50.985800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:50.998046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.002513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.002989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.004967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.005451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.005924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.278893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:51.288805 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-552e24e9-e479-4943-a2f2-918cc8a687dd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.308054 Oct 25 03:31:51.293587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2690/5490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:50 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:51.703202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:51.703825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: dd00c943-ff4d-409d-9186-924a70880be3] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:51.710467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.710957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.711394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.712271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.712730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.713157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.727618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] HTTP exception thrown: Instance dd00c943-ff4d-409d-9186-924a70880be3 could not be found. Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Request method failure captured: Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 HTTP/1.1 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1hkTPsRIjiN8T-2Jq7WHGSnlEco6dcLmNC3mLwUmFwGvgYtkrc8VARqxdGhXM3obOHJ-zS6h-4IBd1zFaEnI9uQ7B6q8kUM2_P4fnYHzcimaJGvYLKO7X7stWUMpnHVI2b9OYiGbazmbFRVNvFHKmttOR8Grzv3zq-sWxCGVJ6ho6Q Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 529a4dcb4f794e86981f3ec07459d93c Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/529a4dcb4f794e86981f3ec07459d93c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/529a4dcb4f794e86981f3ec07459d93c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_529a4dcb4f794e86981f3ec07459d93c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/529a4dcb4f794e86981f3ec07459d93c"}]}] Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 529a4dcb4f794e86981f3ec07459d93c Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListServerFiltersTestJSON-133563996-project Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fa3df586d8a941ec87641754a8610b05 Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListServerFiltersTestJSON-133563996-project Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance dd00c943-ff4d-409d-9186-924a70880be3 could not be found. Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'dd00c943-ff4d-409d-9186-924a70880be3'} Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd00c943-ff4d-409d-9186-924a70880be3 could not be found. Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd00c943-ff4d-409d-9186-924a70880be3 could not be found. Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:51.730142 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd00c943-ff4d-409d-9186-924a70880be3 could not be found. Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Returning 404 to user: Instance dd00c943-ff4d-409d-9186-924a70880be3 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84d6c978-0537-40b7-8c71-98941dd20529 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3" status: 404 len: 111 microversion: 2.1 time: 0.032479 Oct 25 03:31:51.739094 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2691/5491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:51 2022] GET /compute/v2.1/servers/dd00c943-ff4d-409d-9186-924a70880be3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:31:51.744125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:51.744831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:51.751849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.752345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.752782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.754285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.754746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.755266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.783890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:31:51.785915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:31:51.786420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:31:51.786875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:31:51.787295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:31:51.787714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:31:51.809258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.810130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.810790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.811723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.812368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.814019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.833923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:31:51.839885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Getting quotas for user 9b8a3ce5bebf4745b1f095653b010f5e and project 82eb22a91945422f9fe1b9c5e85e0aed. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:31:51.853058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:31:51.856473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:31:51.917861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:51.924795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db0c76dc-7b91-41a9-a243-902c50b1764c tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 204 len: 0 microversion: 2.1 time: 0.187808 Oct 25 03:31:51.930789 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2692/5492] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:31:51 2022] DELETE /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:31:51.948483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:51.949700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:51.961723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.962952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.963618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.965061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:51.965615 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8cf5cd39-2708-4895-9e3b-934c57b7aa6f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.102689 Oct 25 03:31:51.966082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:51.966777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:51.968392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2801/5493] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:31:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:31:51.980998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-585d4f6a-7940-4e69-9444-e47ec1f58bbe tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:51.982215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-585d4f6a-7940-4e69-9444-e47ec1f58bbe tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:52.083445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-585d4f6a-7940-4e69-9444-e47ec1f58bbe tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:52.091039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-585d4f6a-7940-4e69-9444-e47ec1f58bbe tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:52.092478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-585d4f6a-7940-4e69-9444-e47ec1f58bbe tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:52.093636 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-585d4f6a-7940-4e69-9444-e47ec1f58bbe tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1281 microversion: 2.20 time: 0.117760 Oct 25 03:31:52.114105 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2802/5494] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:51 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:52.274080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:52.287907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4fd9aafe-b347-4933-9b8e-1175c2db7e5b tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 200 len: 1518 microversion: 2.1 time: 0.355200 Oct 25 03:31:52.291357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2693/5495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:51 2022] GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 1518 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:52.319680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:52.320544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:52.334008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:52.334525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:52.334974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:52.335697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:52.336165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:52.336594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:52.588177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:52.597833 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee14c216-7f88-4455-80fd-9e11ae389c91 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.282659 Oct 25 03:31:52.600022 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2803/5496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:52 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:53.124822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:53.125512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:53.133328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:53.135790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:53.136460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:53.137351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:53.138426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:53.139180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:53.139945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:53.254794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:53.266514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:53.268499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:53.269248 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b171999-b657-4093-914b-f6c9d896985f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1333 microversion: 2.20 time: 0.149714 Oct 25 03:31:53.270363 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2694/5497] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:53 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:53.312533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:53.313147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:53.320848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:53.321585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:53.322231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:53.323102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:53.323716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:53.324427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:53.508674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:53.524483 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0885650c-35e6-4296-bb02-87eb7b99deca tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 200 len: 1518 microversion: 2.1 time: 0.215710 Oct 25 03:31:53.527109 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2804/5498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:53 2022] GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:53.627938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:53.635529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:53.660352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:53.660964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:53.661431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:53.674065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:53.674581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:53.680636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:54.086504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:54.099880 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-227f6d07-f82c-4aab-8673-aa73a3f28178 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.476528 Oct 25 03:31:54.100470 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2695/5499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:53 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:54.296552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:54.297336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:54.311809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:54.312399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:54.313083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:54.314494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:54.315186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:54.315880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:54.514557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:54.533548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:54.544513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:54.550041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:54.551511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:54.559610 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b8ac4d1b-67b7-4de6-9dc1-11d319bac41b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1339 microversion: 2.20 time: 0.267915 Oct 25 03:31:54.564846 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2805/5500] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:54 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:54.589196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:54.597600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:54.598416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:54.599399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:54.604764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-32705875-0140-442a-9860-0898ed95ff8d req-518e5a5d-7360-4158-b4a7-2f818d10b821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7c6947-0660-437b-bcf7-f16b0fabb83d", "name": "network-vif-deleted", "tag": "49f45cd5-3200-4782-bb85-15fb4526cbfa"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:54.611112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:54.612043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:54.627450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-32705875-0140-442a-9860-0898ed95ff8d req-518e5a5d-7360-4158-b4a7-2f818d10b821 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:54.643742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-32705875-0140-442a-9860-0898ed95ff8d req-518e5a5d-7360-4158-b4a7-2f818d10b821 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:54.645054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-32705875-0140-442a-9860-0898ed95ff8d req-518e5a5d-7360-4158-b4a7-2f818d10b821 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:54.648639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:54.678759 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-32705875-0140-442a-9860-0898ed95ff8d req-518e5a5d-7360-4158-b4a7-2f818d10b821 service nova] Creating event network-vif-deleted:49f45cd5-3200-4782-bb85-15fb4526cbfa for instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d on n-h1-862355-1 Oct 25 03:31:54.685934 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-32705875-0140-442a-9860-0898ed95ff8d req-518e5a5d-7360-4158-b4a7-2f818d10b821 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084621 Oct 25 03:31:54.687293 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2806/5501] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:31:54.753225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:54.767702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fed1673a-dd10-4250-b883-885a6d24db7e tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 200 len: 1476 microversion: 2.1 time: 0.221627 Oct 25 03:31:54.769311 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2696/5502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:54 2022] GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:55.125853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:55.127398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:55.141877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.142712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.145757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.147077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.148276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.148935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.492833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:55.520409 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a331e3f-598b-4f3b-90d5-d9a76852d2fd tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.391619 Oct 25 03:31:55.531437 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2807/5503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:55 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:55.593357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:55.594129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:55.600565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-26602753-dd35-4677-8097-638bdb9330c3 req-82a5c4a4-531c-4204-9aec-c17bc0f69f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe07e59f-3971-4cea-9692-e2d048677c49", "name": "network-vif-plugged", "status": "completed", "tag": "e3fcef15-2932-46ba-8733-c6b08e897c17"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:55.621549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.622104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.622600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.623322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.623785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.624218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.627581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-26602753-dd35-4677-8097-638bdb9330c3 req-82a5c4a4-531c-4204-9aec-c17bc0f69f71 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.633913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-26602753-dd35-4677-8097-638bdb9330c3 req-82a5c4a4-531c-4204-9aec-c17bc0f69f71 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.634523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-26602753-dd35-4677-8097-638bdb9330c3 req-82a5c4a4-531c-4204-9aec-c17bc0f69f71 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.654892 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-26602753-dd35-4677-8097-638bdb9330c3 req-82a5c4a4-531c-4204-9aec-c17bc0f69f71 service nova] Creating event network-vif-plugged:e3fcef15-2932-46ba-8733-c6b08e897c17 for instance fe07e59f-3971-4cea-9692-e2d048677c49 on n-h1-862355-1 Oct 25 03:31:55.665059 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-26602753-dd35-4677-8097-638bdb9330c3 req-82a5c4a4-531c-4204-9aec-c17bc0f69f71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.389647 Oct 25 03:31:55.667009 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2697/5504] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:55.794544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:55.797376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: 3b7c6947-0660-437b-bcf7-f16b0fabb83d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:55.814519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.815031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.815475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.821182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.821747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.824902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.858317 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] HTTP exception thrown: Instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d could not be found. Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Request method failure captured: Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d HTTP/1.1 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1hkTPsRIjiN8T-2Jq7WHGSnlEco6dcLmNC3mLwUmFwGvgYtkrc8VARqxdGhXM3obOHJ-zS6h-4IBd1zFaEnI9uQ7B6q8kUM2_P4fnYHzcimaJGvYLKO7X7stWUMpnHVI2b9OYiGbazmbFRVNvFHKmttOR8Grzv3zq-sWxCGVJ6ho6Q Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 529a4dcb4f794e86981f3ec07459d93c Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/529a4dcb4f794e86981f3ec07459d93c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/529a4dcb4f794e86981f3ec07459d93c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_529a4dcb4f794e86981f3ec07459d93c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/529a4dcb4f794e86981f3ec07459d93c"}]}] Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 529a4dcb4f794e86981f3ec07459d93c Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ListServerFiltersTestJSON-133563996-project Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: fa3df586d8a941ec87641754a8610b05 Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ListServerFiltersTestJSON-133563996-project Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d could not be found. Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '3b7c6947-0660-437b-bcf7-f16b0fabb83d'} Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d could not be found. Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d could not be found. Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:31:55.860029 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d could not be found. Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Returning 404 to user: Instance 3b7c6947-0660-437b-bcf7-f16b0fabb83d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:31:55.865489 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dcc7a27a-9c1d-4ba3-a32f-dbf4feeab949 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d" status: 404 len: 111 microversion: 2.1 time: 0.073235 Oct 25 03:31:55.866750 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2698/5505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:55 2022] GET /compute/v2.1/servers/3b7c6947-0660-437b-bcf7-f16b0fabb83d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:31:55.873132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:55.873664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:55.881864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.882387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.882834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.883842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:55.884333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:55.884767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:55.921141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:55.935533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:55.938862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:55.986662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:31:55.986946 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2af0c7c4-35af-42c3-9480-1b5b04ba6c3f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1406 microversion: 2.20 time: 0.354469 Oct 25 03:31:55.986946 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2808/5506] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:55 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:56.067236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:56.081638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:56.172436 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-183503a1-1f62-4c8e-aa98-644e6f5a620a tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 204 len: 0 microversion: 2.1 time: 0.304144 Oct 25 03:31:56.173201 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2699/5507] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:31:55 2022] DELETE /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:31:56.190798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:56.192352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:56.204576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:56.208777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:56.209445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:56.212504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:56.213144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:56.214757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:56.547809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:56.548523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:56.564222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:56.564730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:56.565177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:56.565941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:56.567079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:56.567677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:56.599846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:56.613809 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2188e3a-9426-41be-969b-d3af490ab9d7 tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1519 microversion: 2.1 time: 0.434544 Oct 25 03:31:56.615235 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2809/5508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:56 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1519 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:56.886086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:56.899540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0f5a159-dd51-4721-a53b-bb03d53c64e4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.355602 Oct 25 03:31:56.902044 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2700/5509] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:56 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:56.951587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3de8a0f8-f2ae-434d-b093-bd736858b250 req-c314e656-664b-4474-ba40-16265c82066e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e876c67-75d1-4207-b711-1ec24fb64413", "tag": "88a235e2-bc90-41e5-8661-26311d3d2e96"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:56.975739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3de8a0f8-f2ae-434d-b093-bd736858b250 req-c314e656-664b-4474-ba40-16265c82066e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:56.977408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3de8a0f8-f2ae-434d-b093-bd736858b250 req-c314e656-664b-4474-ba40-16265c82066e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:56.981064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3de8a0f8-f2ae-434d-b093-bd736858b250 req-c314e656-664b-4474-ba40-16265c82066e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:56.985706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:56.986342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:57.009128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:57.009128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:57.009128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:57.011132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:57.011632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:57.018268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:57.026825 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3de8a0f8-f2ae-434d-b093-bd736858b250 req-c314e656-664b-4474-ba40-16265c82066e service nova] Creating event network-changed:88a235e2-bc90-41e5-8661-26311d3d2e96 for instance 6e876c67-75d1-4207-b711-1ec24fb64413 on n-h2-862355-1 Oct 25 03:31:57.036450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3de8a0f8-f2ae-434d-b093-bd736858b250 req-c314e656-664b-4474-ba40-16265c82066e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090170 Oct 25 03:31:57.044047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2810/5510] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:57.364597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:57.375818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:57.380211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:57.381594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8a1d958-f3f7-45d6-9448-5ae2e2ad80d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1406 microversion: 2.20 time: 0.401035 Oct 25 03:31:57.382378 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2701/5511] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:56 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:31:57.645975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:57.646679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:57.654598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:57.655075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:57.655512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:57.656212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:57.656669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:57.657095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:57.925235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:57.929897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:57.937460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:57.938319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:57.939516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:57.940581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:57.942029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:57.942672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:58.191548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:58.208130 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db370ea4-9f54-4322-a74b-6eaf7a4b847d tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1519 microversion: 2.1 time: 0.568086 Oct 25 03:31:58.208764 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2811/5512] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:57 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1519 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:58.263539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:58.278526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d2612e8d-5903-48c8-87ac-672c310895ac tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1371 microversion: 2.1 time: 0.357766 Oct 25 03:31:58.279483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2702/5513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:57 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:31:58.410800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:58.411776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:58.423631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:58.424376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:58.425006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:58.427236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:58.428516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:58.431921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:58.735249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:58.763119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:58.768132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:58.771016 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ceb31e19-27f6-46a1-86b9-1ef9b92c4f4a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1406 microversion: 2.20 time: 0.364534 Oct 25 03:31:58.771627 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2812/5514] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:58 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1406 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:31:58.944676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-6e613523-0122-45f6-b832-5492bacee47f req-e6650d31-d849-4f29-9eb5-8e9a6cb196a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0", "name": "network-vif-deleted", "tag": "4446351a-4c2c-48fe-bbad-bdf76d65a6de"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:31:58.959692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6e613523-0122-45f6-b832-5492bacee47f req-e6650d31-d849-4f29-9eb5-8e9a6cb196a1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:58.964930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6e613523-0122-45f6-b832-5492bacee47f req-e6650d31-d849-4f29-9eb5-8e9a6cb196a1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:58.965852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6e613523-0122-45f6-b832-5492bacee47f req-e6650d31-d849-4f29-9eb5-8e9a6cb196a1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:58.979886 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-6e613523-0122-45f6-b832-5492bacee47f req-e6650d31-d849-4f29-9eb5-8e9a6cb196a1 service nova] Creating event network-vif-deleted:4446351a-4c2c-48fe-bbad-bdf76d65a6de for instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 on n-h1-862355-1 Oct 25 03:31:58.991404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-6e613523-0122-45f6-b832-5492bacee47f req-e6650d31-d849-4f29-9eb5-8e9a6cb196a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052160 Oct 25 03:31:58.992030 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2703/5515] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:31:59.233505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:59.234483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:59.241848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.242690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.243205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.243987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.244521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.245028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.292587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:31:59.297386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.297764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.298237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.298825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lazy-loading 'fault' on Instance uuid a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:31:59.310633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:59.311974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:59.322541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.324075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.325276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.326512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.329743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.331696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.388592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3df586d8a941ec87641754a8610b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529a4dcb4f794e86981f3ec07459d93c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:59.400027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36819083-0eda-4fd0-a3a5-915e5d677bee tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 200 len: 1311 microversion: 2.1 time: 0.171873 Oct 25 03:31:59.401772 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2813/5516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:59 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 1311 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:59.546955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:31:59.560105 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a53358b-e69a-4b69-9c72-bff635143e02 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1565 microversion: 2.1 time: 0.255532 Oct 25 03:31:59.560796 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2704/5517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:31:59 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:31:59.587410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:59.588905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:59.598849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.599440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.599975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.601064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.601749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.602382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.741034 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f95e66fd-5efe-405f-9311-f6a90468b181 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158537 Oct 25 03:31:59.741034 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2814/5518] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:31:59 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:31:59.801328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:31:59.802661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:31:59.822368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.824548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.825262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:31:59.828729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:31:59.829368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:31:59.830946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:00.429829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:00.430541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] [instance: a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:00.446850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:00.448161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:00.449923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:00.451615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:00.453002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:00.454218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:00.488964 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] HTTP exception thrown: Instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 could not be found. Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Request method failure captured: Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 HTTP/1.1 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1hkTPsRIjiN8T-2Jq7WHGSnlEco6dcLmNC3mLwUmFwGvgYtkrc8VARqxdGhXM3obOHJ-zS6h-4IBd1zFaEnI9uQ7B6q8kUM2_P4fnYHzcimaJGvYLKO7X7stWUMpnHVI2b9OYiGbazmbFRVNvFHKmttOR8Grzv3zq-sWxCGVJ6ho6Q Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 529a4dcb4f794e86981f3ec07459d93c Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/529a4dcb4f794e86981f3ec07459d93c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/529a4dcb4f794e86981f3ec07459d93c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_529a4dcb4f794e86981f3ec07459d93c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/529a4dcb4f794e86981f3ec07459d93c"}]}] Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 529a4dcb4f794e86981f3ec07459d93c Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-133563996 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ListServerFiltersTestJSON-133563996-project Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: fa3df586d8a941ec87641754a8610b05 Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ListServerFiltersTestJSON-133563996-project Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 could not be found. Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0'} Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 could not be found. Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 could not be found. Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:32:00.495360 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 could not be found. Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] Returning 404 to user: Instance a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:32:00.499842 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19316632-17f1-4505-9fb2-adaf46ec36af tempest-ListServerFiltersTestJSON-133563996 tempest-ListServerFiltersTestJSON-133563996-project] 10.222.0.36 "GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0" status: 404 len: 111 microversion: 2.1 time: 0.072584 Oct 25 03:32:00.504925 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2815/5519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:00 2022] GET /compute/v2.1/servers/a136e4fe-2ed4-4599-9bc3-b5d5a3fc94c0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:32:00.634804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:00.643210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:00.650466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:00.651927 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a03dfe6a-c3e2-49e9-948d-da40161b6f3b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1406 microversion: 2.20 time: 0.855306 Oct 25 03:32:00.652509 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2705/5520] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:31:59 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1406 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:32:01.678606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:01.679816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:01.688481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:01.689272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:01.689931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:01.690840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:01.692038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:01.696664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:01.823396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:02.049804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:02.066977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:02.073298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:02.075428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-310210be-9b57-4fcc-bf52-6524abca0a5a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1406 microversion: 2.20 time: 0.401420 Oct 25 03:32:02.076445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2816/5521] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:32:01 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:32:02.246045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-041d9daf-0ded-4e1b-ab54-b06b79dbaadb req-f42df2b8-0869-47b7-82ce-712220f5a4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe07e59f-3971-4cea-9692-e2d048677c49", "tag": "e3fcef15-2932-46ba-8733-c6b08e897c17"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:02.261892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-041d9daf-0ded-4e1b-ab54-b06b79dbaadb req-f42df2b8-0869-47b7-82ce-712220f5a4cd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:02.262654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-041d9daf-0ded-4e1b-ab54-b06b79dbaadb req-f42df2b8-0869-47b7-82ce-712220f5a4cd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:02.263497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-041d9daf-0ded-4e1b-ab54-b06b79dbaadb req-f42df2b8-0869-47b7-82ce-712220f5a4cd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:02.279844 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-041d9daf-0ded-4e1b-ab54-b06b79dbaadb req-f42df2b8-0869-47b7-82ce-712220f5a4cd service nova] Creating event network-changed:e3fcef15-2932-46ba-8733-c6b08e897c17 for instance fe07e59f-3971-4cea-9692-e2d048677c49 on n-h1-862355-1 Oct 25 03:32:02.286774 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-041d9daf-0ded-4e1b-ab54-b06b79dbaadb req-f42df2b8-0869-47b7-82ce-712220f5a4cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045992 Oct 25 03:32:02.288083 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2706/5522] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:32:02.880308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5ede1b2b-e6c5-412e-8923-46c85a554721 req-c85beec9-c4d9-4421-8a50-a0a9936a9244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e876c67-75d1-4207-b711-1ec24fb64413", "name": "network-vif-plugged", "status": "completed", "tag": "88a235e2-bc90-41e5-8661-26311d3d2e96"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:02.896660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:02.910939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ede1b2b-e6c5-412e-8923-46c85a554721 req-c85beec9-c4d9-4421-8a50-a0a9936a9244 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:02.921527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ede1b2b-e6c5-412e-8923-46c85a554721 req-c85beec9-c4d9-4421-8a50-a0a9936a9244 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:02.923495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5ede1b2b-e6c5-412e-8923-46c85a554721 req-c85beec9-c4d9-4421-8a50-a0a9936a9244 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:02.964478 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5ede1b2b-e6c5-412e-8923-46c85a554721 req-c85beec9-c4d9-4421-8a50-a0a9936a9244 service nova] Creating event network-vif-plugged:88a235e2-bc90-41e5-8661-26311d3d2e96 for instance 6e876c67-75d1-4207-b711-1ec24fb64413 on n-h2-862355-1 Oct 25 03:32:02.984045 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5ede1b2b-e6c5-412e-8923-46c85a554721 req-c85beec9-c4d9-4421-8a50-a0a9936a9244 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110505 Oct 25 03:32:02.985530 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2817/5523] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:32:03.104643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:03.105555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:03.112457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:03.123708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:03.124464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:03.125387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:03.126127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:03.126724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:03.591951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:03.609038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:03.612093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:03.616103 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2292396f-6c0b-4a16-a52e-87d5cf16f8bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1406 microversion: 2.20 time: 0.514630 Oct 25 03:32:03.619242 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2707/5524] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:32:03 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1406 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:32:04.652369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:04.653781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:04.674860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:04.675991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:04.676739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:04.677665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:04.678680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:04.679393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:05.046979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:05.060560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:05.062458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:05.064462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4880374-d598-4f1d-8279-8786215ce113 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1406 microversion: 2.20 time: 0.421048 Oct 25 03:32:05.082594 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2818/5525] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:32:04 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:32:06.090017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:06.090646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:06.103684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:06.104476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:06.105159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:06.110109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:06.110109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:06.110109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:06.333465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:06.343203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:06.344729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:06.346015 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b41323ca-c45c-486b-bc86-4b347a1bec90 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1599 microversion: 2.20 time: 0.259945 Oct 25 03:32:06.362494 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2708/5526] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:32:06 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1599 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:32:06.377145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:06.377733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:06.392355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:06.392850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:06.393288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:06.394606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:06.395083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:06.395511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:06.714435 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-928f23b8-6582-4c56-8f89-90d5ade9ccbc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.341225 Oct 25 03:32:06.716081 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2819/5527] 10.222.0.36 () {60 vars in 1316 bytes} [Tue Oct 25 03:32:06 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-interface => generated 285 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:32:10.744968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-75d7dd0e-636c-42af-b507-1685f7007bfe req-ff44dbaf-ec1a-469a-9d46-a853185ba60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e876c67-75d1-4207-b711-1ec24fb64413", "tag": "88a235e2-bc90-41e5-8661-26311d3d2e96"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:10.766507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-75d7dd0e-636c-42af-b507-1685f7007bfe req-ff44dbaf-ec1a-469a-9d46-a853185ba60a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:10.767050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-75d7dd0e-636c-42af-b507-1685f7007bfe req-ff44dbaf-ec1a-469a-9d46-a853185ba60a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:10.767503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-75d7dd0e-636c-42af-b507-1685f7007bfe req-ff44dbaf-ec1a-469a-9d46-a853185ba60a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:10.783692 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-75d7dd0e-636c-42af-b507-1685f7007bfe req-ff44dbaf-ec1a-469a-9d46-a853185ba60a service nova] Creating event network-changed:88a235e2-bc90-41e5-8661-26311d3d2e96 for instance 6e876c67-75d1-4207-b711-1ec24fb64413 on n-h2-862355-1 Oct 25 03:32:10.793215 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-75d7dd0e-636c-42af-b507-1685f7007bfe req-ff44dbaf-ec1a-469a-9d46-a853185ba60a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051843 Oct 25 03:32:10.794437 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2709/5528] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:32:14.261336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5fe84d9-1016-47c9-ac6e-72dd92bc9cb0 tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Action: 'create', calling method: .version_select at 0x7efd3b7da8b0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:14.287829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d5fe84d9-1016-47c9-ac6e-72dd92bc9cb0 tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Getting quotas for project ae4212cd37c441df800551340a2926d6. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:32:14.299573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d5fe84d9-1016-47c9-ac6e-72dd92bc9cb0 tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Getting quotas for user 053d3ac78d794f83bb7db5203c3f174d and project ae4212cd37c441df800551340a2926d6. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:32:14.358259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d5fe84d9-1016-47c9-ac6e-72dd92bc9cb0 tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Getting quotas for project ae4212cd37c441df800551340a2926d6. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:32:14.365439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d5fe84d9-1016-47c9-ac6e-72dd92bc9cb0 tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Getting quotas for user 053d3ac78d794f83bb7db5203c3f174d and project ae4212cd37c441df800551340a2926d6. Resources: {'server_groups'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:32:14.384070 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d5fe84d9-1016-47c9-ac6e-72dd92bc9cb0 tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.607052 Oct 25 03:32:14.385243 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2820/5529] 10.222.0.36 () {62 vars in 1214 bytes} [Tue Oct 25 03:32:13 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:32:14.622063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cfc71c15-908f-4878-abda-821cd91d237a tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:14.622063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cfc71c15-908f-4878-abda-821cd91d237a tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.057385 Oct 25 03:32:14.622063 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2710/5530] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Oct 25 03:32:14 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:32:14.630780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08e4ea77-5563-4c63-a49a-cb63d4fb639a tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:14.630780 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08e4ea77-5563-4c63-a49a-cb63d4fb639a tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/12e8af66-e574-406b-8f99-5d2fc6caf876" status: 200 len: 235 microversion: 2.64 time: 0.015264 Oct 25 03:32:14.630780 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2821/5531] 10.222.0.36 () {60 vars in 1304 bytes} [Tue Oct 25 03:32:14 2022] GET /compute/v2.1/os-server-groups/12e8af66-e574-406b-8f99-5d2fc6caf876 => generated 235 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:32:14.632424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9ffb54c0-8b4d-4df3-9791-09d603a8536c tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:14.632424 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9ffb54c0-8b4d-4df3-9791-09d603a8536c tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/12e8af66-e574-406b-8f99-5d2fc6caf876" status: 204 len: 0 microversion: 2.64 time: 0.060874 Oct 25 03:32:14.632424 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2711/5532] 10.222.0.36 () {60 vars in 1307 bytes} [Tue Oct 25 03:32:14 2022] DELETE /compute/v2.1/os-server-groups/12e8af66-e574-406b-8f99-5d2fc6caf876 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3ae860c-4b71-4ff1-afd6-c966b4a9250c tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-b3ae860c-4b71-4ff1-afd6-c966b4a9250c tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] HTTP exception thrown: Instance group 12e8af66-e574-406b-8f99-5d2fc6caf876 could not be found. Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3ae860c-4b71-4ff1-afd6-c966b4a9250c tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Request method failure captured: Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-server-groups/12e8af66-e574-406b-8f99-5d2fc6caf876 HTTP/1.1 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1i93SZBelpZ-GXC2stBhASpL1Hr0LF_Z_WzZq7E_ozTk84fEW2LoOXqJsJOcNQLSq8LPloh84Um8q3qWab8oJlow9gkOAMklYcQEtukRW5ufW9xAKadKP7iicjmQzutFhPtsE3S4P33x7FjMuZ8AmFfeCW78-aBMXI42ZX6jzHyKRg Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.64 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ae4212cd37c441df800551340a2926d6 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerGroup264TestJSON-1337435474 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae4212cd37c441df800551340a2926d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae4212cd37c441df800551340a2926d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae4212cd37c441df800551340a2926d6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae4212cd37c441df800551340a2926d6"}]}] Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerGroup264TestJSON-1337435474 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ae4212cd37c441df800551340a2926d6 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1337435474 Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerGroup264TestJSON-1337435474-project Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 053d3ac78d794f83bb7db5203c3f174d Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerGroup264TestJSON-1337435474-project Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance group 12e8af66-e574-406b-8f99-5d2fc6caf876 could not be found. Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '12e8af66-e574-406b-8f99-5d2fc6caf876'} Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 12e8af66-e574-406b-8f99-5d2fc6caf876 could not be found. Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:32:14.633261 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 12e8af66-e574-406b-8f99-5d2fc6caf876 could not be found. Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 12e8af66-e574-406b-8f99-5d2fc6caf876 could not be found. Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3ae860c-4b71-4ff1-afd6-c966b4a9250c tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] Returning 404 to user: Instance group 12e8af66-e574-406b-8f99-5d2fc6caf876 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3ae860c-4b71-4ff1-afd6-c966b4a9250c tempest-ServerGroup264TestJSON-1337435474 tempest-ServerGroup264TestJSON-1337435474-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/12e8af66-e574-406b-8f99-5d2fc6caf876" status: 404 len: 117 microversion: 2.64 time: 0.018472 Oct 25 03:32:14.641477 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2822/5533] 10.222.0.36 () {60 vars in 1307 bytes} [Tue Oct 25 03:32:14 2022] DELETE /compute/v2.1/os-server-groups/12e8af66-e574-406b-8f99-5d2fc6caf876 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:32:28.070460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:28.071854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:28.284141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-708728232", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:28.391262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] validate_networks() for [('af2bf74f-0286-419c-a2bc-0c278fb8c7aa', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:32:29.327885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:32:29.330033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:32:29.330727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:32:29.332401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:32:29.333164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:32:29.365831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:29.366424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:29.368130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:29.368941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:29.369926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:29.370641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:29.392686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Getting quotas for project 8bec6a866c7646a39532dc769ce28195. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:32:29.403053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Getting quotas for user 6b48769fd7aa414faf0ce3bd1bfb4b5e and project 8bec6a866c7646a39532dc769ce28195. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:32:29.425727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:32:29.429489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:32:29.510454 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84fb5f89-6d4f-47d5-bc88-51315060808e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.442819 Oct 25 03:32:29.518211 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2712/5534] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:32:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:32:29.525454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-174156ec-5ec5-4c63-bb40-9dde9e3188df tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:29.526192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-174156ec-5ec5-4c63-bb40-9dde9e3188df tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:29.531242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=65 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:29.535415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:29.536378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:29.646030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-174156ec-5ec5-4c63-bb40-9dde9e3188df tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:29.653930 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-174156ec-5ec5-4c63-bb40-9dde9e3188df tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1222 microversion: 2.1 time: 0.133679 Oct 25 03:32:29.655262 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2823/5535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:29 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:30.678276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:30.678894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:30.686724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:30.687458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:30.688195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:30.689228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:30.689916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:30.690645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:30.775815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:30.785964 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7a410bac-53b2-4502-a94b-d2d1e3ab5851 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1274 microversion: 2.1 time: 0.112412 Oct 25 03:32:30.787233 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2713/5536] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:30 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:31.819722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:31.820935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:31.847226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:31.848448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:31.849059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:31.850376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:31.850990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:31.851642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:32.035271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:32.047619 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80dc8dce-6d26-4e1f-becc-b8e740113e63 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1280 microversion: 2.1 time: 0.236544 Oct 25 03:32:32.052628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2824/5537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:31 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:33.072696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:33.073944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:33.088558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:33.091542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:33.092056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:33.092832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:33.093300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:33.093760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:33.311997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:33.324026 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd234d62-b2e2-41f2-b985-e1111c45d879 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1322 microversion: 2.1 time: 0.255288 Oct 25 03:32:33.325345 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2714/5538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:33 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:33.655758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1ab753ae-2db0-4fed-ad0a-e7bf861f5cca req-353841ac-0efc-402e-b478-c3afc4dbbe0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5", "tag": "36eefca6-cdd3-4ff1-9048-6ab345939543"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:33.668562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1ab753ae-2db0-4fed-ad0a-e7bf861f5cca req-353841ac-0efc-402e-b478-c3afc4dbbe0a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:33.669362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1ab753ae-2db0-4fed-ad0a-e7bf861f5cca req-353841ac-0efc-402e-b478-c3afc4dbbe0a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:33.670074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1ab753ae-2db0-4fed-ad0a-e7bf861f5cca req-353841ac-0efc-402e-b478-c3afc4dbbe0a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:33.687298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1ab753ae-2db0-4fed-ad0a-e7bf861f5cca req-353841ac-0efc-402e-b478-c3afc4dbbe0a service nova] Creating event network-changed:36eefca6-cdd3-4ff1-9048-6ab345939543 for instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 on n-h1-862355-1 Oct 25 03:32:33.702604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1ab753ae-2db0-4fed-ad0a-e7bf861f5cca req-353841ac-0efc-402e-b478-c3afc4dbbe0a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140211 Oct 25 03:32:33.705523 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2825/5539] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:32:34.353077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:34.353811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:34.369911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:34.370930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:34.381052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:34.382370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:34.383085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:34.384368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:34.615076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:34.625912 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0cd8fd8-a8fc-4600-b634-468f6fde62c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1322 microversion: 2.1 time: 0.277506 Oct 25 03:32:34.643266 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2715/5540] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:34 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:35.054691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a499820-18d9-41ea-8827-037d2d5561e6"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:35.058204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:35.065363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:35.067253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:35.067964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:35.069010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:35.069734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:35.070520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:35.500252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9403fc90-ae7f-48ce-8562-aae8c84ff56e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452185 Oct 25 03:32:35.500871 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2826/5541] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:32:35 2022] POST /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:32:35.651130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:35.651746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:35.666396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:35.672075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:35.672813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:35.674143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:35.676286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:35.676932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:35.987137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:35.998891 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-85ce1805-1971-4300-9a87-8b54cd307929 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1322 microversion: 2.1 time: 0.351711 Oct 25 03:32:36.013703 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2716/5542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:35 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:37.030122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:37.031408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:37.043704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:37.045284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:37.046240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:37.053466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:37.055882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:37.057113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:37.356580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:37.366770 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d333abb-a03c-404c-9c30-9e0cdb6e9f4e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1322 microversion: 2.1 time: 0.343750 Oct 25 03:32:37.368098 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2827/5543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:37 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:38.391446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:38.392449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:38.400618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:38.401247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:38.401947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:38.402694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:38.403156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:38.403589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:38.635258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:38.653734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d371dce-6df2-468e-b099-d63d3171d73c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1322 microversion: 2.1 time: 0.266460 Oct 25 03:32:38.654706 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2717/5544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:38 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:39.072246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c6a81966-eb6b-43e0-bd46-ae187cd9e282 req-ea6422fd-89e8-457b-b322-9af1c37d266f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5", "name": "network-vif-plugged", "status": "completed", "tag": "36eefca6-cdd3-4ff1-9048-6ab345939543"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:39.085374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c6a81966-eb6b-43e0-bd46-ae187cd9e282 req-ea6422fd-89e8-457b-b322-9af1c37d266f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:39.085987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c6a81966-eb6b-43e0-bd46-ae187cd9e282 req-ea6422fd-89e8-457b-b322-9af1c37d266f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:39.086501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c6a81966-eb6b-43e0-bd46-ae187cd9e282 req-ea6422fd-89e8-457b-b322-9af1c37d266f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:39.102771 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c6a81966-eb6b-43e0-bd46-ae187cd9e282 req-ea6422fd-89e8-457b-b322-9af1c37d266f service nova] Creating event network-vif-plugged:36eefca6-cdd3-4ff1-9048-6ab345939543 for instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 on n-h1-862355-1 Oct 25 03:32:39.110063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c6a81966-eb6b-43e0-bd46-ae187cd9e282 req-ea6422fd-89e8-457b-b322-9af1c37d266f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042409 Oct 25 03:32:39.113522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2828/5545] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:32:39.677886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:39.678586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:39.680709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:39.682410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:39.688837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:39.689419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:39.689956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:39.691498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:39.691901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:39.692334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:39.847911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:39.860485 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b13021cc-29c9-4c87-b737-0be2fb63bbb2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1322 microversion: 2.1 time: 0.186280 Oct 25 03:32:39.861415 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2718/5546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:39 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:40.887395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:40.888954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:40.891835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:40.902320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:40.903062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:40.904803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:40.905922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:40.907364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:40.908018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:41.213009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:41.223778 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aab4d7d6-8230-4520-b75a-0183c0d23d4a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1516 microversion: 2.1 time: 0.343262 Oct 25 03:32:41.227160 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2829/5547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:40 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:41.249921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:41.252254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:41.264507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:41.265070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:41.265468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:41.272053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:41.272560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:41.273012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:41.314118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lazy-loading 'flavor' on Instance uuid fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:32:41.425814 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3544e9af-3183-4f49-9b24-eaf320a53cd6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action" status: 200 len: 32 microversion: 2.1 time: 0.179826 Oct 25 03:32:41.427548 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2719/5548] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:32:41 2022] POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:32:41.436062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:41.437121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:41.444849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:41.445361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:41.445822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:41.457833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:41.458621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:41.459274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:41.712686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:41.726792 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b269670-6f04-4336-b949-4073bfb437c2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.294452 Oct 25 03:32:41.727776 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2830/5549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:41 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:42.756096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:42.757479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:42.765489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:42.766217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:42.767867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:42.769543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:42.770288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:42.770910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:43.018870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:43.031086 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8d05c47-00d6-491f-aa32-217734cfbd24 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.283083 Oct 25 03:32:43.049117 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2720/5550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:42 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:44.055146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:44.055765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:44.065274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:44.066872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:44.070945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:44.072389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:44.073035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:44.073780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:44.334878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:44.344702 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-785f9654-4c22-46e2-ab51-3a7d86208406 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.293137 Oct 25 03:32:44.345882 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2831/5551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:44 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:45.369355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:45.370091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:45.389300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:45.389846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:45.390312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:45.391062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:45.391530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:45.391972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:45.573066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:45.583044 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e01f884-f1f8-4d44-afc2-bb6e951e3c8e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.217612 Oct 25 03:32:45.584519 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2721/5552] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:45 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:46.609128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:46.610329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:46.626418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:46.627089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:46.627603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:46.629355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:46.629988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:46.630664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:46.859717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:46.869267 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0608628f-3f2c-4adb-ae42-95995a93176c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.264863 Oct 25 03:32:46.870267 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2832/5553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:46 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:47.899938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:47.900713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:47.913265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:47.913931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:47.914776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:47.916526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:47.917360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:47.917903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:48.219838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:48.233404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ec17e83-b5d2-45f8-936b-760dc452dc50 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.343266 Oct 25 03:32:48.234517 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2722/5554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:47 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:49.263649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:49.264435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:49.273113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:49.273818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:49.274341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:49.275111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:49.275632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:49.276393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:49.473042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:49.482622 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d464fa42-5b0c-4fce-b87f-9cf29bc70fb7 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.225942 Oct 25 03:32:49.497704 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2833/5555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:49 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:50.508221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:50.508836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:50.514832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:50.515316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:50.515752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:50.516443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:50.516901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:50.517326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:50.662158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:50.670143 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46375872-e686-408f-845f-f10fc54da591 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.167304 Oct 25 03:32:50.670751 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2723/5556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:50 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:50.953789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:32:50.956121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:50.963768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:50.964270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:50.964712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:50.965720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:50.966150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:50.966570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:50.993732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lazy-loading 'flavor' on Instance uuid fe07e59f-3971-4cea-9692-e2d048677c49 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:32:51.132765 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af5353b5-74a7-4502-bf87-789c578d1ae4 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/action" status: 200 len: 32 microversion: 2.1 time: 0.183178 Oct 25 03:32:51.133393 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2834/5557] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:32:50 2022] POST /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:32:51.149995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:51.151306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:51.162196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:51.162838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:51.164438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:51.165928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:51.166612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:51.167400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:51.490292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:51.505018 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-385ea08f-57d4-4456-9e24-9cd5dedf14d9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.364648 Oct 25 03:32:51.505975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2724/5558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:51 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:51.695566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:51.696301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:51.715507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:51.715970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:51.716423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:51.723708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:51.725153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:51.725987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:51.934960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:51.944216 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-980ffe5b-4986-4e4a-8b3a-5d8125774e35 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.252890 Oct 25 03:32:51.945055 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2835/5559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:51 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:52.538266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:52.540577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:52.548659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:52.549443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:52.551023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:52.551947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:52.552750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:52.553346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:52.786528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:52.799149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-064a2125-f473-412b-8f98-de467c6481bf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.273014 Oct 25 03:32:52.800039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2725/5560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:52 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:52.975245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:52.976566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:53.000973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:53.001695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:53.002346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:53.004331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:53.005490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:53.006529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:53.199031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:53.207776 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d12e558-27e3-4201-9cc8-a2659ed1599e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.239880 Oct 25 03:32:53.208377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2836/5561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:52 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:53.823029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:53.823676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:53.830646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:53.831692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:53.832131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:53.833101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:53.833627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:53.834241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:53.998699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:54.012571 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0753986-28c7-4d87-a05b-d4379ff73464 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.193547 Oct 25 03:32:54.033440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2726/5562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:53 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:54.231058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:54.231909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:54.240161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:54.240659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:54.241102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:54.241840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:54.249371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:54.249814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:54.450056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:54.459861 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f6266a3-3213-499d-a0a5-e06c1cba918e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.232544 Oct 25 03:32:54.460628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2837/5563] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:54 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:55.041437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:55.045282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:55.063149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:55.064079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:55.064745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:55.067625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:55.075370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:55.076172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:55.133467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:55.343848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:55.354008 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0032d2b5-210c-45a7-8e5c-13c5827cdd53 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.316076 Oct 25 03:32:55.367531 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2727/5564] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:55 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:55.484329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:55.485594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:55.492845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:55.493343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:55.493815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:55.494531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:55.495000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:55.495643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:55.515441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:55.656403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:55.668887 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8345ff52-a139-4d9c-bdd7-3465396fe831 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.188529 Oct 25 03:32:55.670192 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2838/5565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:55 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:56.379603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:56.380222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:56.398651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:56.399344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:56.400029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:56.401002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:56.401636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:56.402288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:56.623801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:56.668565 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f11c0066-a07f-4c6c-af95-a933ed021069 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.286669 Oct 25 03:32:56.671121 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2728/5566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:56 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:56.692914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:56.693540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:56.702351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:56.703086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:56.704297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:56.705212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:56.706517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:56.707132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:56.882140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:56.892917 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0953c693-5311-44d1-aa23-7867b161dc1b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.204104 Oct 25 03:32:56.894029 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2839/5567] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:56 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:57.696737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:57.698641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:57.705630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:57.706975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:57.707454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:57.708398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:57.708925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:57.709362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:57.927199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:57.927983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:57.934244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:57.936188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:57.937090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:57.937567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:57.938423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:57.939038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:57.939564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:57.948616 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-388c216c-7868-4daa-b40f-88449ea8e939 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.255939 Oct 25 03:32:57.950187 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2729/5568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:57 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:58.119922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:58.128874 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94763c9f-35c5-4c2e-bb39-494df4ffc9de tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.209031 Oct 25 03:32:58.129924 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2840/5569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:57 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:58.973458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:58.974923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:58.982694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:32:58.984555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:58.985281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:58.986213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:58.987949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:58.988539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:58.989549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:59.154039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:32:59.155272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:32:59.166721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:59.167964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:59.170024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:59.171950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:32:59.172596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:32:59.178556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:32:59.195350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:59.205236 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8ab8bb8-d0cb-4b4a-9062-f6b245c0145b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.236615 Oct 25 03:32:59.207029 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2730/5570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:58 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:32:59.457872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:32:59.466466 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6aebc242-c150-4b0c-9b70-65aaf1b3cc6c tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.316768 Oct 25 03:32:59.467268 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2841/5571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:32:59 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:33:00.236557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:00.241789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:00.267326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:00.269303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:00.270541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:00.271474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:00.275149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:00.276566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:00.491117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:00.491739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:00.507803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=41 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:00.510076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:00.511007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:00.511783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:00.514000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:00.514791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:00.515485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:00.554730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:00.563413 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c11a690e-b98f-4bce-b469-5b1f66bf4060 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.335394 Oct 25 03:33:00.581211 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2731/5572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:00 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:00.716323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:00.729592 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5632aa46-071d-4f8d-93fb-37a3cadf6cb6 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.242624 Oct 25 03:33:00.730326 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2842/5573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:00 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:01.590068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:01.594717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:01.615824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:01.616619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:01.618967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:01.620035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:01.620811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:01.621399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:01.755954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:01.756823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:01.768817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:01.771626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:01.772157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:01.774491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:01.775038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:01.776248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:01.895781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:01.943986 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-082f6223-1340-465b-bf8f-a0b7aad39d04 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.359129 Oct 25 03:33:01.945994 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2732/5574] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:01 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:01.999049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:02.008018 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea23d286-01ca-4bc3-9f69-f00b454bad94 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.258305 Oct 25 03:33:02.010371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2843/5575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:01 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:33:02.968934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:02.969790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:02.977410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:02.977935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:02.978383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:02.979302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:02.979800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:02.980234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:03.033246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:03.033982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:03.042638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:03.043398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:03.043847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:03.044567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:03.045033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:03.045464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:03.266770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:03.303756 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-006d4861-4945-4f57-817c-2cfd1c66a8fc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.268629 Oct 25 03:33:03.309939 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2844/5576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:03 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:03.317635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:03.335287 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-71106478-76f8-432e-8da2-89c5ca2d6e72 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.361945 Oct 25 03:33:03.355810 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2733/5577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:02 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:04.330293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:04.332269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:04.341176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:04.341696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:04.342379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:04.343107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:04.343739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:04.344344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:04.359869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:04.360482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:04.376666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:04.377167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:04.379122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:04.379840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:04.380316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:04.380747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:04.562476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:04.573857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54753102-4528-4251-98b8-18e7458c4c59 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.249115 Oct 25 03:33:04.574791 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2845/5578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:04 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:04.663867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:04.678187 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-839307be-c2cc-432a-b197-89ad8563c070 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1735 microversion: 2.1 time: 0.317642 Oct 25 03:33:04.687954 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2734/5579] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:04 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1735 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:33:05.599038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:05.600331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:05.606533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:05.607097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:05.607611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:05.608386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:05.608924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:05.609425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:05.704495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:05.706376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:05.713436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:05.713948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:05.714573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:05.715273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:05.715831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:05.716478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:05.871460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:05.884213 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df051f30-f267-4e86-983d-56f7b194edaa tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.289448 Oct 25 03:33:05.898811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2846/5580] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:05 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:05.937829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:05.950067 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c9fd501-6ce3-43fe-8420-91d69f4de867 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1715 microversion: 2.1 time: 0.249334 Oct 25 03:33:05.951468 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2735/5581] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:05 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1715 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:33:06.132156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:06.133019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:06.141486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.142484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.143190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:06.144181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.144887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.145518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:06.298571 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Cannot 'detach_volume' instance fe07e59f-3971-4cea-9692-e2d048677c49 while it is in vm_state rescued Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments/8a499820-18d9-41ea-8827-037d2d5561e6 HTTP/1.1 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'detach_volume' instance fe07e59f-3971-4cea-9692-e2d048677c49 while it is in vm_state rescued Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': 'fe07e59f-3971-4cea-9692-e2d048677c49', 'id': '8a499820-18d9-41ea-8827-037d2d5561e6'} Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fe07e59f-3971-4cea-9692-e2d048677c49 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fe07e59f-3971-4cea-9692-e2d048677c49 while it is in vm_state rescued Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:06.300348 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fe07e59f-3971-4cea-9692-e2d048677c49 while it is in vm_state rescued Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 409 to user: Cannot 'detach_volume' instance fe07e59f-3971-4cea-9692-e2d048677c49 while it is in vm_state rescued {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3804e7d8-7492-4c27-9338-077d774b1253 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments/8a499820-18d9-41ea-8827-037d2d5561e6" status: 409 len: 152 microversion: 2.1 time: 0.178664 Oct 25 03:33:06.306991 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2847/5582] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:33:06 2022] DELETE /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments/8a499820-18d9-41ea-8827-037d2d5561e6 => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:33:06.311251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:06.311824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:06.319028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.321022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.322496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:06.323463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.324151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.324810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:06.411377 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a4f75bd-85a2-4856-b75f-98e4a43193e8 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/action" status: 202 len: 0 microversion: 2.1 time: 0.104170 Oct 25 03:33:06.413253 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2736/5583] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:33:06 2022] POST /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:33:06.422771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:06.425168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:06.433216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.434101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.434563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:06.435337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.436388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.437066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:06.912871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:06.914653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:06.950662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.951735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.952549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:06.953488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:06.956842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:06.957662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:07.027603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:07.052505 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cfba80a8-dcb4-49ac-bd73-ba691f266362 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1723 microversion: 2.1 time: 0.634276 Oct 25 03:33:07.054109 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2848/5584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:06 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1723 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:07.411698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:07.423120 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-249bd15a-4ca1-4192-97ce-e3f79e692905 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.516126 Oct 25 03:33:07.424171 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2737/5585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:06 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:08.084904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:08.085538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:08.107018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:08.107534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:08.107985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:08.108963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:08.109725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:08.109880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:08.403758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:08.421290 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4caab8a8-bf92-49fa-a002-41001d55b32a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1723 microversion: 2.1 time: 0.340542 Oct 25 03:33:08.439326 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2849/5586] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:08 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:33:08.447564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:08.448181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:08.463349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:08.464059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:08.464716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:08.465642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:08.466297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:08.466909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:08.692715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:08.701668 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c97f5766-2507-4ee0-a62e-95afe72b4559 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.257809 Oct 25 03:33:08.718491 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2738/5587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:08 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:09.457601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:09.458344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:09.475893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:09.477260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:09.480262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:09.481327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:09.482215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:09.482849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:09.729468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:09.730909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:09.739833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:09.740996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:09.741716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:09.742717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:09.743590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:09.744287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:09.763163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:09.774542 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50d44b1a-d980-40c6-ab54-5c90f5b9dcf5 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1723 microversion: 2.1 time: 0.329769 Oct 25 03:33:09.775719 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2850/5588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:09 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:09.936829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:09.947274 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ab6e59f0-9d36-47ae-b845-f8d36c90e8ff tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.223265 Oct 25 03:33:09.949429 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2739/5589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:09 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:33:10.803220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:10.811046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:10.848909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:10.849433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:10.849929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:10.850682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:10.851141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:10.851567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:10.973216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:10.975118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:10.982371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:10.985873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:10.986481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:10.998426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:10.999262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:11.004303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:11.021114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:11.030294 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a0657758-5e30-41fa-8335-0a921ecc5369 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1729 microversion: 2.1 time: 0.234868 Oct 25 03:33:11.031564 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2851/5590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:10 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:11.057146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:11.057843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:11.067277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:11.068187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:11.068892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:11.069768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:11.070492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:11.071058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:11.158473 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d50a9e34-a1a6-44ec-8422-04f17400f303 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106884 Oct 25 03:33:11.159960 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2852/5591] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:33:11 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:33:11.224022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:11.234824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bdce2089-58dc-4299-8379-3e9d14f80c47 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1522 microversion: 2.1 time: 0.265884 Oct 25 03:33:11.237452 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2740/5592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:10 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:12.260691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:12.261296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:12.276882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:12.277389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:12.277871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:12.278593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:12.279055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:12.279492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:12.558477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:12.570811 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7be42dde-0b96-494c-affe-66b09102f15e tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1502 microversion: 2.1 time: 0.314930 Oct 25 03:33:12.588948 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2853/5593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:12 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1502 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:12.600454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5c095efd-ecac-4a15-8ed7-7521c7ec826d tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'create', calling method: .version_select at 0x7efd32937160>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-679879535", "description": "tempest-description-820407383"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:12.889962 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5c095efd-ecac-4a15-8ed7-7521c7ec826d tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.295869 Oct 25 03:33:12.898970 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2741/5594] 10.222.0.36 () {60 vars in 1180 bytes} [Tue Oct 25 03:33:12 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:12.905394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-679879535"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:12.906124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:12.932654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:12.935748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:12.936193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:12.941407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:12.941956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:12.942402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:13.306413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-368c7e73-5014-4920-b8cf-20e2d54cd13a req-4fc656b0-f827-4e4f-bb4b-f34e5f38e34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe07e59f-3971-4cea-9692-e2d048677c49", "tag": "e3fcef15-2932-46ba-8733-c6b08e897c17"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:13.332770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-368c7e73-5014-4920-b8cf-20e2d54cd13a req-4fc656b0-f827-4e4f-bb4b-f34e5f38e34c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:13.333260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-368c7e73-5014-4920-b8cf-20e2d54cd13a req-4fc656b0-f827-4e4f-bb4b-f34e5f38e34c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:13.333818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-368c7e73-5014-4920-b8cf-20e2d54cd13a req-4fc656b0-f827-4e4f-bb4b-f34e5f38e34c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:13.345712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-368c7e73-5014-4920-b8cf-20e2d54cd13a req-4fc656b0-f827-4e4f-bb4b-f34e5f38e34c service nova] Creating event network-changed:e3fcef15-2932-46ba-8733-c6b08e897c17 for instance fe07e59f-3971-4cea-9692-e2d048677c49 on n-h1-862355-1 Oct 25 03:33:13.363926 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-368c7e73-5014-4920-b8cf-20e2d54cd13a req-4fc656b0-f827-4e4f-bb4b-f34e5f38e34c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061116 Oct 25 03:33:13.364906 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2742/5595] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:13.437082 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.network.security_group_api [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Adding security group 000ca4c9-8620-4683-ac87-fc35bab17923 to port 36eefca6-cdd3-4ff1-9048-6ab345939543 Oct 25 03:33:14.023170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9946c686-9e86-48b4-b59b-ea314baeb5fd tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action" status: 202 len: 0 microversion: 2.1 time: 1.122700 Oct 25 03:33:14.023933 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2854/5596] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:33:12 2022] POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:33:14.035473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-679879535"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:14.036808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:14.051546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:14.052435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:14.053051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:14.053976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:14.055958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:14.056587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:14.564415 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.network.security_group_api [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Removing security group 000ca4c9-8620-4683-ac87-fc35bab17923 from port 36eefca6-cdd3-4ff1-9048-6ab345939543 Oct 25 03:33:15.224961 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d185c09-eded-4445-bc89-d0ec0e1a19cb tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action" status: 202 len: 0 microversion: 2.1 time: 1.194732 Oct 25 03:33:15.226603 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2743/5597] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:33:14 2022] POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action => generated 0 bytes in 1197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:33:15.235703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86d5ead9-9cad-43d6-ac29-55972f2c993b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'create', calling method: .version_select at 0x7efd3b7ecca0>, body: {"pool": null} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:15.340706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-5191bf4d-f24d-4540-b04b-9eec8aa499ca req-0897f59c-3be9-4c9a-8b56-43c30b1948b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5", "tag": "36eefca6-cdd3-4ff1-9048-6ab345939543"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:15.353833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5191bf4d-f24d-4540-b04b-9eec8aa499ca req-0897f59c-3be9-4c9a-8b56-43c30b1948b8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:15.354635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5191bf4d-f24d-4540-b04b-9eec8aa499ca req-0897f59c-3be9-4c9a-8b56-43c30b1948b8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:15.355448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5191bf4d-f24d-4540-b04b-9eec8aa499ca req-0897f59c-3be9-4c9a-8b56-43c30b1948b8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:15.378723 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-5191bf4d-f24d-4540-b04b-9eec8aa499ca req-0897f59c-3be9-4c9a-8b56-43c30b1948b8 service nova] Creating event network-changed:36eefca6-cdd3-4ff1-9048-6ab345939543 for instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 on n-h1-862355-1 Oct 25 03:33:15.392425 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-5191bf4d-f24d-4540-b04b-9eec8aa499ca req-0897f59c-3be9-4c9a-8b56-43c30b1948b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054799 Oct 25 03:33:15.396974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2744/5598] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:15.475635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-543476ba-f8fc-4423-aa8c-cd44a3a8ae35 req-29bb1630-d69c-4841-b68c-73f37b574e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe07e59f-3971-4cea-9692-e2d048677c49", "tag": "e3fcef15-2932-46ba-8733-c6b08e897c17"}, {"name": "network-changed", "server_uuid": "fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5", "tag": "36eefca6-cdd3-4ff1-9048-6ab345939543"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:15.500411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-543476ba-f8fc-4423-aa8c-cd44a3a8ae35 req-29bb1630-d69c-4841-b68c-73f37b574e95 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:15.505779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-543476ba-f8fc-4423-aa8c-cd44a3a8ae35 req-29bb1630-d69c-4841-b68c-73f37b574e95 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:15.507189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-543476ba-f8fc-4423-aa8c-cd44a3a8ae35 req-29bb1630-d69c-4841-b68c-73f37b574e95 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:15.520714 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-543476ba-f8fc-4423-aa8c-cd44a3a8ae35 req-29bb1630-d69c-4841-b68c-73f37b574e95 service nova] Creating event network-changed:e3fcef15-2932-46ba-8733-c6b08e897c17 for instance fe07e59f-3971-4cea-9692-e2d048677c49 on n-h1-862355-1 Oct 25 03:33:15.521532 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-543476ba-f8fc-4423-aa8c-cd44a3a8ae35 req-29bb1630-d69c-4841-b68c-73f37b574e95 service nova] Creating event network-changed:36eefca6-cdd3-4ff1-9048-6ab345939543 for instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 on n-h1-862355-1 Oct 25 03:33:15.529769 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-543476ba-f8fc-4423-aa8c-cd44a3a8ae35 req-29bb1630-d69c-4841-b68c-73f37b574e95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057723 Oct 25 03:33:15.530937 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2745/5599] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:33:16.005644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:16.006624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:16.019781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:16.021107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:16.022093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:16.025488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:16.026121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:16.026533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:16.039870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:16.064428 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f09d6dc-ef2c-4bb3-98ff-7cb93cf384ad tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/ips" status: 200 len: 153 microversion: 2.20 time: 0.064157 Oct 25 03:33:16.071881 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2746/5600] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Oct 25 03:33:15 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/ips => generated 153 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:33:17.427676 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-86d5ead9-9cad-43d6-ac29-55972f2c993b tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.195682 Oct 25 03:33:17.428289 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2855/5601] 10.222.0.36 () {60 vars in 1170 bytes} [Tue Oct 25 03:33:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:17.444058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.45"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:17.446635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:17.454687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:17.455818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:17.456610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:17.457602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:17.460791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:17.463615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:17.792139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "refresh_cache-fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:33:17.792880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquired lock "refresh_cache-fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:33:19.325992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:19.327118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:19.343261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:19.344281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:19.344957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:19.346988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:19.348035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:19.348675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:19.400770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lazy-loading 'flavor' on Instance uuid 6e876c67-75d1-4207-b711-1ec24fb64413 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:33:19.404742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:19.709293 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b61856d5-e0d6-4c7f-ab68-edede8a7500d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/action" status: 202 len: 0 microversion: 2.20 time: 0.387937 Oct 25 03:33:19.710090 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2856/5602] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:33:19 2022] POST /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:33:19.718908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:19.719894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:19.732226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:19.733148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:19.733855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:19.734766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:19.735406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:19.736139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:19.914863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Building network info cache for instance {{(pid=120563) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:33:20.149613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:20.164225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:20.166042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:20.169730 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-83615682-9c79-4150-bcbd-24b4fecb65de tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.455660 Oct 25 03:33:20.173275 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2857/5603] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:19 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:33:20.185439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-110f0a67-7247-4112-b6c7-999b626bd60b req-81c869b2-4bed-48d5-a333-822017952b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5", "tag": "36eefca6-cdd3-4ff1-9048-6ab345939543"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:20.219468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-110f0a67-7247-4112-b6c7-999b626bd60b req-81c869b2-4bed-48d5-a333-822017952b70 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:20.220811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-110f0a67-7247-4112-b6c7-999b626bd60b req-81c869b2-4bed-48d5-a333-822017952b70 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:20.230722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-110f0a67-7247-4112-b6c7-999b626bd60b req-81c869b2-4bed-48d5-a333-822017952b70 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:20.261305 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-110f0a67-7247-4112-b6c7-999b626bd60b req-81c869b2-4bed-48d5-a333-822017952b70 service nova] Creating event network-changed:36eefca6-cdd3-4ff1-9048-6ab345939543 for instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 on n-h1-862355-1 Oct 25 03:33:20.267739 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-110f0a67-7247-4112-b6c7-999b626bd60b req-81c869b2-4bed-48d5-a333-822017952b70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092918 Oct 25 03:33:20.268730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2858/5604] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:21.131532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Updating instance_info_cache with network_info: [{"id": "36eefca6-cdd3-4ff1-9048-6ab345939543", "address": "fa:16:3e:22:71:5d", "network": {"id": "af2bf74f-0286-419c-a2bc-0c278fb8c7aa", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-243608945-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8bec6a866c7646a39532dc769ce28195", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap36eefca6-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120563) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:33:21.155538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Releasing lock "refresh_cache-fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" {{(pid=120563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:33:21.156843 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8b358cc-5ff1-4350-8cd2-9a87bedaf2c1 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action" status: 202 len: 0 microversion: 2.1 time: 3.717782 Oct 25 03:33:21.159334 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2747/5605] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:33:17 2022] POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action => generated 0 bytes in 3721 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 25 03:33:21.168898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.45"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:21.204106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:21.206040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:21.228254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:21.228763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:21.229213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:21.229963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:21.230426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:21.230862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:21.444410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:21.451724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:21.452399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:21.453010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:21.454098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:21.454405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:21.454869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:21.458289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:21.466485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:21.468223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:21.471848 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a630eb4a-19be-45d4-ae87-26edd670b361 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.273486 Oct 25 03:33:21.472589 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2748/5606] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:21 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:33:22.085955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "refresh_cache-fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 25 03:33:22.086742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquired lock "refresh_cache-fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 25 03:33:22.496804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:22.497545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:22.516357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:22.517131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:22.519743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:22.520853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:22.521341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:22.521823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:22.888462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Building network info cache for instance {{(pid=120562) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 25 03:33:23.227851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:23.248673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:23.250183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:23.251400 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c49b8aa-852f-4407-bb2d-e95e39c09201 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.758891 Oct 25 03:33:23.260779 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2749/5607] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:22 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:23.269745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-773937eb-fb50-4cc2-8300-57edb978a97a req-f7f6baf0-7bfb-4d3e-8a68-3da939b7bef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5", "tag": "36eefca6-cdd3-4ff1-9048-6ab345939543"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:23.304984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-773937eb-fb50-4cc2-8300-57edb978a97a req-f7f6baf0-7bfb-4d3e-8a68-3da939b7bef8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:23.305472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-773937eb-fb50-4cc2-8300-57edb978a97a req-f7f6baf0-7bfb-4d3e-8a68-3da939b7bef8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:23.305932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-773937eb-fb50-4cc2-8300-57edb978a97a req-f7f6baf0-7bfb-4d3e-8a68-3da939b7bef8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:23.322137 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-773937eb-fb50-4cc2-8300-57edb978a97a req-f7f6baf0-7bfb-4d3e-8a68-3da939b7bef8 service nova] Creating event network-changed:36eefca6-cdd3-4ff1-9048-6ab345939543 for instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 on n-h1-862355-1 Oct 25 03:33:23.328350 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-773937eb-fb50-4cc2-8300-57edb978a97a req-f7f6baf0-7bfb-4d3e-8a68-3da939b7bef8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066070 Oct 25 03:33:23.331003 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2750/5608] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:23.699004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Updating instance_info_cache with network_info: [{"id": "36eefca6-cdd3-4ff1-9048-6ab345939543", "address": "fa:16:3e:22:71:5d", "network": {"id": "af2bf74f-0286-419c-a2bc-0c278fb8c7aa", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-243608945-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8bec6a866c7646a39532dc769ce28195", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap36eefca6-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120562) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 25 03:33:23.723395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Releasing lock "refresh_cache-fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" {{(pid=120562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 25 03:33:23.724555 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4d58ba68-0b0d-4c0b-a5f9-be3b2025e773 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action" status: 202 len: 0 microversion: 2.1 time: 2.561222 Oct 25 03:33:23.728579 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2859/5609] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:33:21 2022] POST /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5/action => generated 0 bytes in 2563 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 25 03:33:23.735055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12c8aacf-0910-4047-b673-4862611d694a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '.version_select at 0x7efd3b744310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:24.286531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:24.287776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:24.295800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:24.296754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:24.297408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:24.298375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:24.299102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:24.299988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:24.723793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:24.746165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:24.747607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:24.748808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5feaaf3b-1b65-4a8f-a81e-93db2ddd79cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.466547 Oct 25 03:33:24.749391 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2860/5610] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:24 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:33:25.137867 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12c8aacf-0910-4047-b673-4862611d694a tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/f7cbb808-9b12-4423-9a25-4f74b6159a2a" status: 202 len: 0 microversion: 2.1 time: 1.407385 Oct 25 03:33:25.142267 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2751/5611] 10.222.0.36 () {58 vars in 1263 bytes} [Tue Oct 25 03:33:23 2022] DELETE /compute/v2.1/os-floating-ips/f7cbb808-9b12-4423-9a25-4f74b6159a2a => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:33:25.149644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d1a2680-9d8e-45ff-b9b5-d8bb0d557fd2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '.version_select at 0x7efd339e9a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:25.579095 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d1a2680-9d8e-45ff-b9b5-d8bb0d557fd2 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/000ca4c9-8620-4683-ac87-fc35bab17923" status: 202 len: 0 microversion: 2.1 time: 0.433826 Oct 25 03:33:25.579729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2861/5612] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 03:33:25 2022] DELETE /compute/v2.1/os-security-groups/000ca4c9-8620-4683-ac87-fc35bab17923 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:33:25.589175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:25.589907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:25.597870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:25.598356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:25.599246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:25.600572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:25.601204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:25.601867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:25.633638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:33:25.729803 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bdf7b37c-d3cd-4212-9831-37da889b9526 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 204 len: 0 microversion: 2.1 time: 0.144134 Oct 25 03:33:25.731098 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2752/5613] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:33:25 2022] DELETE /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:33:25.742926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:25.743552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:25.750700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:25.751206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:25.751657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:25.752889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:25.753394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:25.753851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:25.779236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:25.779871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:25.791406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:25.793149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:25.793810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:25.794842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:25.795466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:25.796060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:25.917047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:25.928271 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-434a1b8c-81b5-4bf5-bee3-8472988629dc tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1508 microversion: 2.1 time: 0.192358 Oct 25 03:33:25.930828 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2862/5614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:25 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:25.987090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:25.995561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:25.997031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:25.998267 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee928cac-b62d-4f08-a52f-1cecc81eeb9d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.226463 Oct 25 03:33:26.014113 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2753/5615] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:25 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:26.956032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:26.957085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:26.963688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:26.964180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:26.964603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:26.965294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:26.965923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:26.966268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:27.026318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:27.027173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:27.034839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:27.035589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:27.036027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:27.036727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:27.037631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:27.038281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:27.138400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:27.160192 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-498b129b-012f-4f6a-a58c-8e54e4ff3a78 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1508 microversion: 2.1 time: 0.207939 Oct 25 03:33:27.160800 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2863/5616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:26 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:27.218497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:27.228227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:27.229814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:27.231032 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73512d5e-cdfa-49f0-b386-736eadfde2bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.209088 Oct 25 03:33:27.231608 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2754/5617] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:27 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:28.187248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:28.192890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:28.200522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:28.201743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:28.203850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:28.206570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:28.207370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:28.208226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:28.257264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:28.258612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:28.297379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:28.298468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:28.299266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:28.300386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:28.301118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:28.301838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:28.396482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:28.404560 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f6b3e9d-49ac-4e20-aa8b-9a7dc77a8c72 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1508 microversion: 2.1 time: 0.223982 Oct 25 03:33:28.405080 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2864/5618] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:28 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:28.608384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:28.617326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:28.618823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:28.620179 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58c6ebc9-d450-4d25-9734-8eb4fcbed12d tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.367442 Oct 25 03:33:28.621015 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2755/5619] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:28 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:28.834510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-582bba5e-b813-4a85-9290-918759dd3712 req-41065f95-3ec4-4d67-82f7-6dc230ea6fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5", "name": "network-vif-deleted", "tag": "36eefca6-cdd3-4ff1-9048-6ab345939543"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:28.852393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-582bba5e-b813-4a85-9290-918759dd3712 req-41065f95-3ec4-4d67-82f7-6dc230ea6fd4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:28.852886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-582bba5e-b813-4a85-9290-918759dd3712 req-41065f95-3ec4-4d67-82f7-6dc230ea6fd4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:28.853700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-582bba5e-b813-4a85-9290-918759dd3712 req-41065f95-3ec4-4d67-82f7-6dc230ea6fd4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:28.866637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-582bba5e-b813-4a85-9290-918759dd3712 req-41065f95-3ec4-4d67-82f7-6dc230ea6fd4 service nova] Creating event network-vif-deleted:36eefca6-cdd3-4ff1-9048-6ab345939543 for instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 on n-h1-862355-1 Oct 25 03:33:28.871590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-582bba5e-b813-4a85-9290-918759dd3712 req-41065f95-3ec4-4d67-82f7-6dc230ea6fd4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041946 Oct 25 03:33:28.872245 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2865/5620] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:29.431963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:29.433579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:29.438698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:29.447243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:29.448071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:29.449092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:29.450057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:29.451012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:29.451685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:29.499156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:29.499918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:29.500508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:29.501864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lazy-loading 'fault' on Instance uuid fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:33:29.551899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b48769fd7aa414faf0ce3bd1bfb4b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bec6a866c7646a39532dc769ce28195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:29.560084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12af1893-953a-4191-a740-9953d6137869 tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 200 len: 1312 microversion: 2.1 time: 0.133110 Oct 25 03:33:29.561395 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2756/5621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:29 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 1312 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:29.649282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:29.650140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:29.656370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:29.656863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:29.657305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:29.658042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:29.658542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:29.659014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:29.824717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:29.833894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:29.835335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:29.836559 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81f81fd0-e09a-44ec-8b7f-199b6ebd96c2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.193591 Oct 25 03:33:29.837306 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2866/5622] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:29 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:33:30.586126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:30.586684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] [instance: fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:30.595597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:30.595813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:30.599507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:30.600393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:30.600802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:30.601236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:30.616446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] HTTP exception thrown: Instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 could not be found. Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Request method failure captured: Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 HTTP/1.1 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1jLupljI_zg1dmSgmcESUs0K87ih96h0RyxOX2Zxh6ONF-qmrAS4Mzp4lAadN9pYh8dj3n6v5WVLTKazSD7z0ivTDSR9x4IneR6sx4x3SyCaTZlenc2kLkxLeMs3Zus2dcP0gweQ-iFcXKTAZAGsFnNMzlELnGnj9VH7h2j1vrmeOU Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8bec6a866c7646a39532dc769ce28195 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-579341928 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bec6a866c7646a39532dc769ce28195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8bec6a866c7646a39532dc769ce28195"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8bec6a866c7646a39532dc769ce28195", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8bec6a866c7646a39532dc769ce28195"}]}] Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-579341928 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8bec6a866c7646a39532dc769ce28195 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-579341928 Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerRescueTestJSONUnderV235-579341928-project Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 6b48769fd7aa414faf0ce3bd1bfb4b5e Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-579341928-project Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 could not be found. Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5'} Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 could not be found. Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 could not be found. Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:33:30.618135 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 could not be found. Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] Returning 404 to user: Instance fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-29c09b43-5a9d-4f25-b847-0fe4689ea0ca tempest-ServerRescueTestJSONUnderV235-579341928 tempest-ServerRescueTestJSONUnderV235-579341928-project] 10.222.0.36 "GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5" status: 404 len: 111 microversion: 2.1 time: 0.037492 Oct 25 03:33:30.623114 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2757/5623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:30 2022] GET /compute/v2.1/servers/fef05ceb-1f47-4a57-a8bb-3f9e5243e2c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:33:30.863396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:30.864008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:30.890069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=46 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:30.892297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:30.892737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:30.893185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:30.893931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:30.894382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:30.894982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:31.134160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:31.143954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:31.146538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:31.148540 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4712091d-242f-445c-83b1-a8faed2e9f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.289600 Oct 25 03:33:31.149364 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2867/5624] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:30 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:32.178233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:32.179132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:32.188907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:32.190561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:32.191427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:32.192400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:32.192905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:32.193403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:32.398223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:32.414177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:32.415985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:32.417385 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9eefa261-f45e-4745-93a0-b3a32785b6f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1745 microversion: 2.20 time: 0.244996 Oct 25 03:33:32.418759 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2758/5625] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:32 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1745 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:33.444592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:33.445571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:33.458602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:33.459111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:33.459560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:33.460277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:33.460822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:33.461963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:33.660503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:33.669868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:33.671332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:33.675962 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8691c107-a39d-4106-9b62-38e2656852f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1745 microversion: 2.20 time: 0.236649 Oct 25 03:33:33.677009 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2868/5626] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:33 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:34.703606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:34.704229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:34.718567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:34.719064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:34.719509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:34.720226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:34.720683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:34.725414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:34.998989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:35.013367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:35.015312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:35.017001 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f315ce26-5cc2-42e5-b45a-9bb1732539b6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1745 microversion: 2.20 time: 0.317182 Oct 25 03:33:35.018810 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2759/5627] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:34 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1745 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:36.047489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:36.048117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:36.065472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:36.065753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:36.066180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:36.066901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:36.067364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:36.067797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:36.339859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:36.350436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:36.355033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:36.358097 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-673ee283-e543-4333-b549-65265f9795d4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.314394 Oct 25 03:33:36.367015 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2869/5628] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:36 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:36.650161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7692860c-ddfd-4a97-94f2-4ae449f19fce req-e388ff66-bc9d-4092-a8e0-b6174e6fbb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e876c67-75d1-4207-b711-1ec24fb64413", "name": "network-vif-plugged", "status": "completed", "tag": "88a235e2-bc90-41e5-8661-26311d3d2e96"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:36.671037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7692860c-ddfd-4a97-94f2-4ae449f19fce req-e388ff66-bc9d-4092-a8e0-b6174e6fbb59 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:36.673161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7692860c-ddfd-4a97-94f2-4ae449f19fce req-e388ff66-bc9d-4092-a8e0-b6174e6fbb59 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:36.675351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7692860c-ddfd-4a97-94f2-4ae449f19fce req-e388ff66-bc9d-4092-a8e0-b6174e6fbb59 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:36.708784 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7692860c-ddfd-4a97-94f2-4ae449f19fce req-e388ff66-bc9d-4092-a8e0-b6174e6fbb59 service nova] Creating event network-vif-plugged:88a235e2-bc90-41e5-8661-26311d3d2e96 for instance 6e876c67-75d1-4207-b711-1ec24fb64413 on n-h2-862355-1 Oct 25 03:33:36.722431 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7692860c-ddfd-4a97-94f2-4ae449f19fce req-e388ff66-bc9d-4092-a8e0-b6174e6fbb59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072796 Oct 25 03:33:36.727394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2760/5629] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:37.395624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:37.396868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:37.416880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:37.418430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:37.420227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:37.421154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:37.421825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:37.422574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:37.811647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:37.827203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:37.832801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:37.835602 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c7060c6-6358-4470-ba35-d5ed63fce3a1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.447829 Oct 25 03:33:37.836870 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2870/5630] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:37 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:38.863761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:38.864477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:38.879987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:38.880991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:38.881752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:38.882660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:38.885907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:38.886611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:39.166576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:39.179597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:39.181783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:39.183382 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-44679e5a-721f-4937-b7e6-23378b2e5ef7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.324381 Oct 25 03:33:39.195116 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2761/5631] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:38 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:40.214365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:40.215673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:40.230411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:40.233210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:40.233923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:40.240611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:40.241437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:40.242112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:41.024311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:41.041052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:41.043788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:41.052021 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dadb3ed9-5ca9-467f-b584-8e7f42a89cb1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.842618 Oct 25 03:33:41.054799 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2871/5632] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:40 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:41.453491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:41.458854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:41.481287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:41.482705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:41.483556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:41.490580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:41.491648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:41.492389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:41.655516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lazy-loading 'services' on Instance uuid fe07e59f-3971-4cea-9692-e2d048677c49 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:33:41.795469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:41.827601 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-63933e63-7515-41f4-be6c-995e044b2ce9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments/8a499820-18d9-41ea-8827-037d2d5561e6" status: 202 len: 0 microversion: 2.1 time: 0.386559 Oct 25 03:33:41.844984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:41.852140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:41.860731 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2762/5633] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:33:41 2022] DELETE /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments/8a499820-18d9-41ea-8827-037d2d5561e6 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:33:41.899048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:41.907960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:41.910377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:41.914101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:41.914608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:41.915043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:42.000827 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cdbe3b0d-f5cb-4ef7-9aaf-a753c5ac708c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166779 Oct 25 03:33:42.003442 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2872/5634] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:41 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:42.085306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:42.086059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:42.102297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:42.104130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:42.107088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:42.108050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:42.109208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:42.111948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:42.632251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:42.665228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:42.672422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:42.677500 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6407c7b5-e2ff-4fac-b127-bd71b3d86b54 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.596338 Oct 25 03:33:42.689621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2763/5635] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:42 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:43.018014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:43.021510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:43.048105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:43.054875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:43.058935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:43.061075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:43.068359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:43.070040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:43.084225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:43.249779 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36a848cd-9fee-488a-afd2-5b61dad488a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238673 Oct 25 03:33:43.252234 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2873/5636] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:43 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:43.718624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:43.720271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:43.740302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:43.745560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:43.748525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:43.755660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:43.756552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:43.759847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:44.176553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:44.200587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:44.226011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:44.230345 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8f6b46d-764b-4e38-acb8-bb19a6112e3a tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.514966 Oct 25 03:33:44.253670 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2764/5637] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:43 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:44.262710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:44.265647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:44.320154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:44.322413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:44.324580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:44.326241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:44.333866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:44.334732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:44.410414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e62cc75-a16a-449a-933b-2a2d7b2f7bbf tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153108 Oct 25 03:33:44.411636 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2874/5638] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:44 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:45.261888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:45.265798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:45.287772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:45.288291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:45.291495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:45.292534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:45.296414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:45.297388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:45.598602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:45.613461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:45.617116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:45.621514 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c6cd721-64b4-4fd9-8bda-4023a0999dd7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.362339 Oct 25 03:33:45.622516 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2765/5639] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:45 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:45.640908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:45.648483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:45.675546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:45.676058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:45.676479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:45.677198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:45.677663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:45.678100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:45.733620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-903102882", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "3b8d6369-c98e-48af-90e6-e0419e2fe3ed"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:45.802992 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-764f5dd5-9845-4d3c-b2d3-bd9e60f559ab tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178802 Oct 25 03:33:45.807303 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2766/5640] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:45 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:45.863400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] validate_networks() for [('3b8d6369-c98e-48af-90e6-e0419e2fe3ed', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:33:46.650473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:46.651132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:46.663786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:46.665584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:46.668422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:46.672105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:46.673389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:46.674738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:46.959127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:33:46.960099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:33:46.960803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:33:46.961433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:33:46.962125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:33:46.981602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:46.984660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:46.985381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:46.989786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:46.990702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:46.991357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:47.043779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Getting quotas for project 9b2ca0f32a4b4ee79762e5af56fe3bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:33:47.055496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Getting quotas for user c382bf7a3f7841fb906e3a4c6812a810 and project 9b2ca0f32a4b4ee79762e5af56fe3bf3. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:33:47.067711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:47.078231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:47.084464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:47.091631 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c701f568-6f10-4bd4-bf1c-564d56c4a4d6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.443735 Oct 25 03:33:47.112775 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2767/5641] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:46 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:47.119031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:47.121292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:47.127654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:33:47.132312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:33:47.145384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:47.146221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:47.147947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:47.148974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:47.150466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:47.151168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:47.230611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2c38548-6648-4d6e-93a9-617fba7c2364 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115227 Oct 25 03:33:47.231489 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2768/5642] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:47 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:47.241810 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b0027908-4aae-4923-9e08-1e2990c46869 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.886200 Oct 25 03:33:47.243690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2875/5643] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:33:47.256215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-653924be-7575-42a3-ab50-b89a8b71e9be tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:47.256994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-653924be-7575-42a3-ab50-b89a8b71e9be tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:47.358777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-653924be-7575-42a3-ab50-b89a8b71e9be tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:47.371209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-653924be-7575-42a3-ab50-b89a8b71e9be tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:47.376428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-653924be-7575-42a3-ab50-b89a8b71e9be tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:47.379155 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-653924be-7575-42a3-ab50-b89a8b71e9be tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1261 microversion: 2.26 time: 0.127073 Oct 25 03:33:47.380989 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2769/5644] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:47 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1261 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:48.118929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:48.120402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:48.130503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:48.131827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:48.132521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:48.133906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:48.134695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:48.135362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:48.245452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:48.249161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:48.275220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:48.280744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:48.284206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:48.286055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:48.287885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:48.290389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:48.374091 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b9c5f5c2-456f-44f4-8482-e7e2dc953d3e tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133725 Oct 25 03:33:48.375332 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2770/5645] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:48 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:48.391626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:48.410225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:48.411503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:48.423438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:48.424971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:48.426973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:48.428294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:48.430523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:48.434203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:48.438430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:48.440598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:48.463977 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e44ea015-6b9d-44b1-a59e-e29370240360 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.327605 Oct 25 03:33:48.465019 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2876/5646] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:48 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:48.600529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:48.621563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:48.623151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:48.624868 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37d4a91a-a992-4ab0-b502-b9f7421bd607 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1265 microversion: 2.26 time: 0.218299 Oct 25 03:33:48.646143 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2771/5647] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:48 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:33:49.388757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:49.391617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:49.412816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:49.413412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:49.414870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:49.415958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:49.421597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:49.423769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:49.493823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:49.494498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:49.508939 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed351409-3bf8-425d-9a8d-6ccb8cf114fa tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124272 Oct 25 03:33:49.524459 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2877/5648] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:49 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:49.534911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:49.535430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:49.535885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:49.536613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:49.537079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:49.537514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:49.653109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:49.653917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:49.663992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:49.664558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:49.665006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:49.671877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:49.673125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:49.676444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:49.838302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:49.854545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:49.856752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:49.858554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea6ca9ce-fc46-4c8c-b969-43ca7a20aed1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1321 microversion: 2.26 time: 0.209460 Oct 25 03:33:49.860284 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2878/5649] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:49 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:50.173401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:50.188084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:50.190042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:50.191531 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a331dd0f-885a-4b19-9942-70f9a39cd1d5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.701845 Oct 25 03:33:50.193257 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2772/5650] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:49 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:50.521871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:50.527322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:50.545012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:50.545993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:50.546621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:50.547519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:50.548135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:50.550333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:50.622279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7bbfda84-4f17-4737-b83b-cd12c1cfeaa7 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105078 Oct 25 03:33:50.625668 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2879/5651] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:50 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:50.891033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:50.892306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:50.906984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:50.907902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:50.914379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:50.916046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:50.917645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:50.918741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:51.125368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:51.141120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:51.148359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:51.150807 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8983d5ca-5ff7-4d11-9cab-8a7f0738419a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1319 microversion: 2.26 time: 0.264191 Oct 25 03:33:51.179440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2773/5652] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:50 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:51.220910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:51.222257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:51.247023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:51.262343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:51.262841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:51.263660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:51.264149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:51.264592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:51.554892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:51.567302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:51.569621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:51.571048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0caf29cf-45b2-48bd-b28b-7d42bc2d90f5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.354493 Oct 25 03:33:51.572201 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2880/5653] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:51 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:51.638570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:51.640730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:51.649743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:51.650252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:51.650698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:51.651415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:51.651881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:51.652320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:51.717445 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f15ca91-8778-4053-891a-15abb237b56b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082986 Oct 25 03:33:51.719086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2774/5654] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:51 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:52.188566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:52.189295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:52.204119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:52.204641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:52.205763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:52.207022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:52.223649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:52.228782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:52.598254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:52.599033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:52.616847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:52.617258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:52.617726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:52.618449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:52.627901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:52.628528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:52.648770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:52.663234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:52.664700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:52.675561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d55a0885-4371-42fa-abe1-5458e337506a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.490685 Oct 25 03:33:52.676965 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2881/5655] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:52 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:52.732195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:52.739271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:52.749825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:52.753473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:52.754311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:52.756370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:52.758143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:52.769576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:52.881241 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-723322a8-aeef-40d5-bee9-1a4fdded11a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153094 Oct 25 03:33:52.882147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2882/5656] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:33:52 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:33:53.005314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:53.016852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:53.028664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.030449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.031583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.032504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.034754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.035857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.079659 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Cannot 'reboot' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.087574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action HTTP/1.1 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 28 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: {"reboot": {"type": "HARD"}} Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'reboot' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9ae48ec9-a744-4b6d-b1ce-b945e18331aa', 'body': {'reboot': {'type': 'HARD'}}} Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:33:53.090839 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 409 to user: Cannot 'reboot' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-99ad5525-eaf4-414d-8f9a-961349ec434b tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action" status: 409 len: 145 microversion: 2.1 time: 0.094781 Oct 25 03:33:53.102719 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2883/5657] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:33:52 2022] POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:33:53.111821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:53.117034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:53.119474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cbab9b33-85f0-4154-bcdb-3b89e322170b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.525520 Oct 25 03:33:53.133816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:53.133816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:53.134770 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2775/5658] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:52 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:33:53.141623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.141623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.141623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.141623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.141623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.141623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.192347 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Cannot 'rebuild' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action HTTP/1.1 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 65 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: exception: Cannot 'rebuild' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9ae48ec9-a744-4b6d-b1ce-b945e18331aa', 'body': {'rebuild': {'imageRef': 'aaf4b9eb-e26e-4d56-8bee-d6f868921bec'}}} Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:33:53.201928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 409 to user: Cannot 'rebuild' instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa while it is in vm_state rescued {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e51e2a5-87e6-446e-b99a-d5810d3925c2 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action" status: 409 len: 146 microversion: 2.1 time: 0.103003 Oct 25 03:33:53.207635 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2884/5659] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:33:53 2022] POST /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa/action => generated 146 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:33:53.219096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:53.220333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:53.232077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.232910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.233570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.241288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.242184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.242840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.306336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:33:53.475210 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-354b34e9-dd45-4dc9-a0ae-e7c177b6a398 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 204 len: 0 microversion: 2.1 time: 0.260164 Oct 25 03:33:53.476549 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2776/5660] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:33:53 2022] DELETE /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:33:53.484223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:53.484849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:53.497116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.497617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.502924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.503777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.510118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.514516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.707521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:53.708160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:53.726444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.726992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.727446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.728411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:53.732461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:53.733497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:53.762105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:53.782263 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7374eb71-bd81-4076-aa01-5916db6687a9 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1689 microversion: 2.1 time: 0.297908 Oct 25 03:33:53.785126 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2885/5661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:53 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:54.017390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:54.027730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:54.029481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:54.030876 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f66b989-6b9a-4d57-9e79-1689391db0b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.328836 Oct 25 03:33:54.031627 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2777/5662] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:53 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:33:54.056272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b459de4d-0782-43b5-99a2-a8fdede2b681 req-ca0ec2a5-ec40-4b5a-9379-a797ea63a0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efae544-cd20-4c21-8e27-de3f7c1f9763", "tag": "b8547b60-ec7f-43e0-b50e-149ca3debe96"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:54.078820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b459de4d-0782-43b5-99a2-a8fdede2b681 req-ca0ec2a5-ec40-4b5a-9379-a797ea63a0cd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:54.079226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b459de4d-0782-43b5-99a2-a8fdede2b681 req-ca0ec2a5-ec40-4b5a-9379-a797ea63a0cd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:54.079937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b459de4d-0782-43b5-99a2-a8fdede2b681 req-ca0ec2a5-ec40-4b5a-9379-a797ea63a0cd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:54.099988 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b459de4d-0782-43b5-99a2-a8fdede2b681 req-ca0ec2a5-ec40-4b5a-9379-a797ea63a0cd service nova] Creating event network-changed:b8547b60-ec7f-43e0-b50e-149ca3debe96 for instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 on n-h1-862355-1 Oct 25 03:33:54.109441 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b459de4d-0782-43b5-99a2-a8fdede2b681 req-ca0ec2a5-ec40-4b5a-9379-a797ea63a0cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057586 Oct 25 03:33:54.112560 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2886/5663] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:33:54.150643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:54.151505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:54.164887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:54.165382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:54.165860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:54.166796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:54.167258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:54.167682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:54.345164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:54.348559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:54.357021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:54.359273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:54.360737 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-04ae19d6-3de2-4f9d-b29a-1521e6ed86b1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.214945 Oct 25 03:33:54.362165 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2778/5664] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:54 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:54.819459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:54.821102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:54.829661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:54.831678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:54.832378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:54.833324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:54.835280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:54.835978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:55.025220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:55.033139 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb9311f4-56cb-4bf2-b0f4-8d18958a7437 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1689 microversion: 2.1 time: 0.221820 Oct 25 03:33:55.040205 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2887/5665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:54 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:55.060023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:55.060642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:55.070404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:55.070809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:55.071833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:55.071977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:55.072424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:55.072855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:55.249265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:55.259453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:55.261397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:55.264425 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17ec7c92-9daf-4ed8-8c38-0713b2428814 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.208903 Oct 25 03:33:55.265474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2779/5666] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:55 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:55.387645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:55.388545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:55.396015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:55.396817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:55.397431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:55.398349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:55.398976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:55.399599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:55.554469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:55.568618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:55.571165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:55.572878 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8c26b83-da6f-43b6-8799-da839112fbe1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.189253 Oct 25 03:33:55.573618 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2888/5667] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:55 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:56.066031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:56.066031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:56.073652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:56.074877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:56.075585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:56.076533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:56.077217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:56.077911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:56.291799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:56.292428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:56.318167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:56.318585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:56.319034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:56.319754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:56.320219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:56.320652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:56.328387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:56.337660 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d844c75b-5281-4c5a-b876-9dcde70fb870 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1689 microversion: 2.1 time: 0.277187 Oct 25 03:33:56.359260 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2780/5668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:56 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:56.549235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:56.558446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:56.560276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:56.563152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-433e8ccb-7114-497f-af32-704a94b6df5e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.273842 Oct 25 03:33:56.567350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2889/5669] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:56 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:56.601298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:56.602219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:56.608567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:56.609265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:56.609918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:56.610808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:56.611552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:56.612270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:56.915329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:56.926882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:56.931284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:56.934021 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36ca0891-6981-4dd7-9e78-f084e8b7a1e2 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.337711 Oct 25 03:33:56.953464 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2781/5670] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:56 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:57.366192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:57.367409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:57.370399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:57.371337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:57.403806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:57.413162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:57.416289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:57.417292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:57.418233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:57.418991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:57.596659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:57.598031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:57.607887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:57.610582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:57.612009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:57.612912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:57.613873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:57.614510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:57.615143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:57.649383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:57.660813 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-abcf3cd4-eff7-42c8-8f32-efd813e60a01 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1689 microversion: 2.1 time: 0.298696 Oct 25 03:33:57.661970 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2890/5671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:57 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1689 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:57.975920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:57.976762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:57.989290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:57.990104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:57.990645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:57.995389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:58.005862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:58.007439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:58.368001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:58.370117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:58.385844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:58.387552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:58.388749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-68a7c555-27b8-46b8-94f7-465007da1069 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.428121 Oct 25 03:33:58.389316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2891/5672] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:57 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:58.504513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:58.515390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:58.517056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:58.518767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15ea4560-9a32-4ebf-a211-8ad70e8d76d2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.928873 Oct 25 03:33:58.519726 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2782/5673] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:57 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:58.686962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:58.687695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:58.696991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:58.697912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:58.698770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:58.699914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:58.700629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:58.701298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:58.883095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:58.891865 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6ae7bd9-5137-4702-b123-b92907422c8d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1689 microversion: 2.1 time: 0.209345 Oct 25 03:33:58.898687 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2892/5674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:58 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:33:59.395663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4af1c1a5-607e-4ecb-bc54-e23e444c447e req-1361958d-1a68-4ffe-90fc-239eef9e17af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe07e59f-3971-4cea-9692-e2d048677c49", "name": "network-vif-deleted", "tag": "e3fcef15-2932-46ba-8733-c6b08e897c17"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:33:59.412125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4af1c1a5-607e-4ecb-bc54-e23e444c447e req-1361958d-1a68-4ffe-90fc-239eef9e17af service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:59.413974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4af1c1a5-607e-4ecb-bc54-e23e444c447e req-1361958d-1a68-4ffe-90fc-239eef9e17af service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:59.415133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4af1c1a5-607e-4ecb-bc54-e23e444c447e req-1361958d-1a68-4ffe-90fc-239eef9e17af service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:59.426141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:59.427725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:59.437644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:59.438689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:59.440359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:59.441326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:59.442100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:59.443237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:59.447712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4af1c1a5-607e-4ecb-bc54-e23e444c447e req-1361958d-1a68-4ffe-90fc-239eef9e17af service nova] Creating event network-vif-deleted:e3fcef15-2932-46ba-8733-c6b08e897c17 for instance fe07e59f-3971-4cea-9692-e2d048677c49 on n-h1-862355-1 Oct 25 03:33:59.467524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4af1c1a5-607e-4ecb-bc54-e23e444c447e req-1361958d-1a68-4ffe-90fc-239eef9e17af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076704 Oct 25 03:33:59.469809 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2783/5675] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:33:59.551541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:59.566899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:59.574076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:33:59.576535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:59.577192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:59.577954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:59.580896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:59.581568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:59.582188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:59.647314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:59.657236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:59.659844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:59.661338 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22678ba9-8fbb-4bd1-a568-4575ad259ff6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1740 microversion: 2.20 time: 0.244608 Oct 25 03:33:59.662503 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2893/5676] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:59 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:59.780062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:59.790338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:59.792229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:33:59.795308 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0256ec7-555d-4553-957b-eb280a43a36c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.250318 Oct 25 03:33:59.799893 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2784/5677] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:33:59 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:33:59.926422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:33:59.927058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:33:59.942417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:59.942944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:59.943393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:33:59.944342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:33:59.944802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:33:59.946004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:00.200896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:00.200896 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe241924-3a82-447f-85f2-9533c6b30272 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 200 len: 1621 microversion: 2.1 time: 0.138514 Oct 25 03:34:00.200896 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2894/5678] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:33:59 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 1621 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:00.701864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:00.702346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:00.710478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:00.711032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:00.711672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:00.712584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:00.713230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:00.713772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:00.824408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:00.825033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:00.850753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:00.851297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:00.851759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:00.852529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:00.853000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:00.854324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:00.967139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:00.982036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:00.984086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:00.989135 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73aad0e1-6a97-4177-9016-9c41a2f883fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1722 microversion: 2.20 time: 0.304200 Oct 25 03:34:00.990114 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2785/5679] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:00 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:01.093112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:01.094189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: fe07e59f-3971-4cea-9692-e2d048677c49] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:01.109079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:01.109698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:01.110557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:01.113155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:01.113901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:01.114725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:01.134877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Instance fe07e59f-3971-4cea-9692-e2d048677c49 could not be found. Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 HTTP/1.1 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fe07e59f-3971-4cea-9692-e2d048677c49 could not be found. Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fe07e59f-3971-4cea-9692-e2d048677c49'} Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe07e59f-3971-4cea-9692-e2d048677c49 could not be found. Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe07e59f-3971-4cea-9692-e2d048677c49 could not be found. Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:01.137375 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe07e59f-3971-4cea-9692-e2d048677c49 could not be found. Oct 25 03:34:01.144159 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:01.145859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 404 to user: Instance fe07e59f-3971-4cea-9692-e2d048677c49 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:01.146940 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2886afd4-f3de-4385-b72e-6cdd89237d0c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49" status: 404 len: 111 microversion: 2.1 time: 0.060667 Oct 25 03:34:01.148674 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2786/5680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:01 2022] GET /compute/v2.1/servers/fe07e59f-3971-4cea-9692-e2d048677c49 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:34:01.157593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-04a33a71-fbc0-495f-a68a-5781c051c289 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '.version_select at 0x7efd3313b430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:01.194604 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-04a33a71-fbc0-495f-a68a-5781c051c289 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738540917" status: 202 len: 0 microversion: 2.1 time: 0.041812 Oct 25 03:34:01.196094 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2787/5681] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738540917 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:34:01.235908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:01.255544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:01.257798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:01.259112 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b4bd7aff-5066-4aaf-bf8a-624391351953 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.438685 Oct 25 03:34:01.260804 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2895/5682] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:00 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:02.023009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:02.024142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:02.054631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:02.065783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:02.067418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:02.069640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:02.070394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:02.072661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:02.289732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:02.290343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:02.300007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:02.306661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:02.307832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:02.308452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:02.323747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:02.324902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:02.325524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:02.344844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:02.369123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:02.370685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:02.371900 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e26917c7-fe63-4d38-b610-11bc28776ae7 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1722 microversion: 2.20 time: 0.356936 Oct 25 03:34:02.382124 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2788/5683] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:02 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:02.538462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:02.549895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:02.552345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:02.553552 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b45240c-68ce-4d98-936f-79ceeb4ac7ec tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.268342 Oct 25 03:34:02.554477 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2896/5684] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:02 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:03.399683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:03.400296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:03.410651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:03.411749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:03.412363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:03.413730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:03.414367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:03.415220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:03.517008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-20c8e7f5-8826-43d5-bbbe-edf01fd88531 req-a0dadfa1-4ee0-42d5-950f-e4a8baea8219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efae544-cd20-4c21-8e27-de3f7c1f9763", "name": "network-vif-plugged", "status": "completed", "tag": "b8547b60-ec7f-43e0-b50e-149ca3debe96"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:03.534761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-20c8e7f5-8826-43d5-bbbe-edf01fd88531 req-a0dadfa1-4ee0-42d5-950f-e4a8baea8219 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:03.535254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-20c8e7f5-8826-43d5-bbbe-edf01fd88531 req-a0dadfa1-4ee0-42d5-950f-e4a8baea8219 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:03.539845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-20c8e7f5-8826-43d5-bbbe-edf01fd88531 req-a0dadfa1-4ee0-42d5-950f-e4a8baea8219 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:03.567359 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-20c8e7f5-8826-43d5-bbbe-edf01fd88531 req-a0dadfa1-4ee0-42d5-950f-e4a8baea8219 service nova] Creating event network-vif-plugged:b8547b60-ec7f-43e0-b50e-149ca3debe96 for instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 on n-h1-862355-1 Oct 25 03:34:03.589940 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-20c8e7f5-8826-43d5-bbbe-edf01fd88531 req-a0dadfa1-4ee0-42d5-950f-e4a8baea8219 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076405 Oct 25 03:34:03.591126 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2897/5685] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:34:03.596624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:03.597350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:03.614226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:03.614756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:03.615400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:03.616302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:03.619162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:03.619811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:03.696696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:03.717307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:03.739536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:03.749785 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac22aebe-6fe2-4de8-815a-229862d41915 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1665 microversion: 2.20 time: 0.345773 Oct 25 03:34:03.756286 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2789/5686] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:03 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1665 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:03.779549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "939772df-1d9d-4e0b-89e2-a89f0064865d"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:03.781914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:03.808235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:03.812061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:03.812539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:03.813276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:03.815613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:03.816694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:03.991927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:04.050156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:04.051851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:04.094554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-394ce61a-cebf-4637-b00a-147efbe79ddc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.501911 Oct 25 03:34:04.096612 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2898/5687] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:03 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:04.306140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-25084c0a-719e-4410-aa8e-206f7007f06b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.533809 Oct 25 03:34:04.307316 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2790/5688] 10.222.0.36 () {62 vars in 1364 bytes} [Tue Oct 25 03:34:03 2022] POST /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-volume_attachments => generated 188 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:34:04.465758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:04.466940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:04.476580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:04.477233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:04.477882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:04.479060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:04.479676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:04.480275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:04.952875 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-29296c9d-64ed-4ca1-928a-e238485b3dfc tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-volume_attachments/939772df-1d9d-4e0b-89e2-a89f0064865d" status: 202 len: 0 microversion: 2.20 time: 0.491075 Oct 25 03:34:04.954962 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2899/5689] 10.222.0.36 () {60 vars in 1457 bytes} [Tue Oct 25 03:34:04 2022] DELETE /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-volume_attachments/939772df-1d9d-4e0b-89e2-a89f0064865d => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:34:05.044641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:05.045307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:05.057332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:05.058427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:05.059068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:05.059993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:05.060642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:05.061612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:05.104848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120563) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 25 03:34:05.125287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:05.126016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:05.146287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:05.147090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:05.147685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:05.148614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:05.149246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:05.149865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:05.236167 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba775865-0b88-427d-a4af-1a3a856469cd tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "POST /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/action" status: 202 len: 0 microversion: 2.20 time: 0.207556 Oct 25 03:34:05.245662 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2791/5690] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Oct 25 03:34:05 2022] POST /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:34:05.253555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:05.254261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:05.261173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:05.261824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:05.262272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:05.263719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:05.264514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:05.264752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:05.448585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:05.459103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:05.461514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:05.462969 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-22fbe5c3-80aa-4fcf-b747-6cc027cb041e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1673 microversion: 2.20 time: 0.216428 Oct 25 03:34:05.479129 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2792/5691] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:05 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:05.479440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:05.494349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:05.495799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:05.497140 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab839184-bbff-4499-98f0-a987be1523d1 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1361 microversion: 2.26 time: 0.375826 Oct 25 03:34:05.498367 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2900/5692] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:05 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1361 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:05.622017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-35bbbb38-3482-417c-8473-6cc82d7a3acf req-9e9d80cf-dda4-49ac-a21b-936ec44d61e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e876c67-75d1-4207-b711-1ec24fb64413", "name": "network-vif-unplugged", "status": "completed", "tag": "88a235e2-bc90-41e5-8661-26311d3d2e96"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:05.640220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-35bbbb38-3482-417c-8473-6cc82d7a3acf req-9e9d80cf-dda4-49ac-a21b-936ec44d61e9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:05.640731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-35bbbb38-3482-417c-8473-6cc82d7a3acf req-9e9d80cf-dda4-49ac-a21b-936ec44d61e9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:05.641160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-35bbbb38-3482-417c-8473-6cc82d7a3acf req-9e9d80cf-dda4-49ac-a21b-936ec44d61e9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:05.661827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.compute.server_external_events [req-35bbbb38-3482-417c-8473-6cc82d7a3acf req-9e9d80cf-dda4-49ac-a21b-936ec44d61e9 service nova] Unable to find a host for instance 6e876c67-75d1-4207-b711-1ec24fb64413. Dropping event network-vif-unplugged {{(pid=120563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 25 03:34:05.663005 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-35bbbb38-3482-417c-8473-6cc82d7a3acf req-9e9d80cf-dda4-49ac-a21b-936ec44d61e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045069 Oct 25 03:34:05.669329 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2793/5693] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 25 03:34:06.490624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:06.491872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:06.499930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.500685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.501380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.503012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.503631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.504228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.540423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:06.541614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:06.553759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.554551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.555904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.567391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.568158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.568734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.672787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:06.682554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:06.684723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:06.686251 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c39ae29e-ebe0-4fa7-98d8-a02ae8c35f11 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1673 microversion: 2.20 time: 0.200515 Oct 25 03:34:06.687064 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2901/5694] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:06 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:06.804256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:06.807588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:06.818893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:06.820695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:06.823255 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad91e1e9-8899-4fd5-aee5-cd4dc5e1a4d9 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1544 microversion: 2.26 time: 0.299707 Oct 25 03:34:06.846422 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2794/5695] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:06 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1544 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:06.854118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd33499790>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:06.867029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.867542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.867993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.868492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:06.875737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.876243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.876756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.877549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.877956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.878581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.931988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.935995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.936685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:06.952926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:06.953865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:06.954483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.016544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:07.083256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-738ec797-81ca-4b1f-b2e4-46939367b6f2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-920048124" status: 201 len: 0 microversion: 2.26 time: 0.231972 Oct 25 03:34:07.087282 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2902/5696] 10.222.0.36 () {62 vars in 1377 bytes} [Tue Oct 25 03:34:06 2022] PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-920048124 => generated 0 bytes in 238 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 25 03:34:07.098519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c1140a5-8515-4c50-a6ef-39b53a70525a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd3330d0d0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:07.122197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c1140a5-8515-4c50-a6ef-39b53a70525a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.122729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c1140a5-8515-4c50-a6ef-39b53a70525a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.127383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c1140a5-8515-4c50-a6ef-39b53a70525a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.188119 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c1140a5-8515-4c50-a6ef-39b53a70525a tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-920048124" status: 204 len: 0 microversion: 2.26 time: 0.095542 Oct 25 03:34:07.193157 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2795/5697] 10.222.0.36 () {60 vars in 1358 bytes} [Tue Oct 25 03:34:07 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-920048124 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:34:07.198953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd33e7a670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:07.213247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.213819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.216561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.219712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:07.233710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.238466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.239183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.240199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.240669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.241103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.291756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.292250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.292693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.335520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:07.369237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d0681438-a838-4145-ad91-1f2c4015c74e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 204 len: 0 microversion: 2.26 time: 0.174836 Oct 25 03:34:07.370223 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2903/5698] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 25 03:34:07 2022] DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:34:07.380456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6732261-856e-4e10-a0e7-e612239c4fd2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd328d2430>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:07.407237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6732261-856e-4e10-a0e7-e612239c4fd2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.412997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6732261-856e-4e10-a0e7-e612239c4fd2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.414726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6732261-856e-4e10-a0e7-e612239c4fd2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.440905 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f6732261-856e-4e10-a0e7-e612239c4fd2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 200 len: 12 microversion: 2.26 time: 0.065325 Oct 25 03:34:07.443696 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2796/5699] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 03:34:07 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:07.454196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd3377e280>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:07.471848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.472352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.472801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.473299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:07.491534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.491534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.491534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.492338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.492427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.492804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.538518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:07.570645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.571145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.571841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.602129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.602889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.603783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.654475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:07.704992 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3fcbe854-027d-4fd9-90bf-98648e90409e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1476524443" status: 201 len: 0 microversion: 2.26 time: 0.254863 Oct 25 03:34:07.706449 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2904/5700] 10.222.0.36 () {62 vars in 1380 bytes} [Tue Oct 25 03:34:07 2022] PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1476524443 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 25 03:34:07.714268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:07.715193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:07.720100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd499f67-3f18-4923-b843-401b62dc19b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd33826d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:07.731405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.731921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.732361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.735437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.736318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.741123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.741854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd499f67-3f18-4923-b843-401b62dc19b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.743241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd499f67-3f18-4923-b843-401b62dc19b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.745169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd499f67-3f18-4923-b843-401b62dc19b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.770814 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd499f67-3f18-4923-b843-401b62dc19b3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 200 len: 36 microversion: 2.26 time: 0.055218 Oct 25 03:34:07.771770 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2905/5701] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 03:34:07 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 36 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:07.781997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd32b6c670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:07.804753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.808832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.809516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.816102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:07.847482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.848275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.858566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.859622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.860267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.860941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.916185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:07.916682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:07.917118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:07.987305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:08.046289 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed8bf45c-f0e7-4c60-bf1f-fb20569bd125 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1476524443" status: 204 len: 0 microversion: 2.26 time: 0.268126 Oct 25 03:34:08.051034 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2906/5702] 10.222.0.36 () {60 vars in 1364 bytes} [Tue Oct 25 03:34:07 2022] DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1476524443 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 25 03:34:08.060315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc2f432f-0ff4-487e-9ec0-3d00c45facf7 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd32db4430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:08.080249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc2f432f-0ff4-487e-9ec0-3d00c45facf7 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.080759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc2f432f-0ff4-487e-9ec0-3d00c45facf7 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.081209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dc2f432f-0ff4-487e-9ec0-3d00c45facf7 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.096529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:08.105762 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc2f432f-0ff4-487e-9ec0-3d00c45facf7 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 200 len: 12 microversion: 2.26 time: 0.053135 Oct 25 03:34:08.108380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:08.114151 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2907/5703] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 03:34:08 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 12 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:08.116404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:08.117933 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8fa6f597-0bf9-45f7-95d4-d31235eb6519 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.407960 Oct 25 03:34:08.125964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd334afdc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:08.142498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2797/5704] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:07 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:08.158535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.159498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.160056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.160666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:08.179738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.180714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.181371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.182354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.184010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.189789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.247066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.249376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.252899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.276076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:08.316291 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24d0c00e-9091-4945-b208-82f5791428b2 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 204 len: 0 microversion: 2.26 time: 0.200895 Oct 25 03:34:08.316951 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2908/5705] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 25 03:34:08 2022] DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:34:08.342617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd33618790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:08.396183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.398770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.399932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.402444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:08.415443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.420153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.420793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.421832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.422745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.424297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.484061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.484834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.485913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.526291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.529029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.530926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.632624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:08.691665 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf220dc5-9360-49ad-9d59-245ebe136213 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-545402446" status: 201 len: 0 microversion: 2.26 time: 0.352950 Oct 25 03:34:08.692362 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2798/5706] 10.222.0.36 () {62 vars in 1377 bytes} [Tue Oct 25 03:34:08 2022] PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-545402446 => generated 0 bytes in 354 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 25 03:34:08.702353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd338261f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:08.718355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.726694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.727580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.728317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:08.740649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.742272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.745764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.747032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.747825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.748499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.842226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.847510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.848086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.872491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.873017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.874762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.945826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:08.968862 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-028afd18-55cf-4799-823f-96cb0dee09e3 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1963418331" status: 201 len: 0 microversion: 2.26 time: 0.270547 Oct 25 03:34:08.969892 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2909/5707] 10.222.0.36 () {62 vars in 1380 bytes} [Tue Oct 25 03:34:08 2022] PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1963418331 => generated 0 bytes in 272 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 25 03:34:08.980768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd33c54280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:08.991542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:08.992023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:08.992461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:08.992945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:09.009388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.009971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.010419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.015869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.016361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.016802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.062466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.063227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.063827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.098035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:09.117817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ef998bd-da85-413d-8ad7-f9757837621d tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 204 len: 0 microversion: 2.26 time: 0.141886 Oct 25 03:34:09.130200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b55cd34-5ab3-4646-92df-b1de5d6add88 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd32b6cd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:09.133987 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2799/5708] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 25 03:34:08 2022] DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:34:09.140939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b55cd34-5ab3-4646-92df-b1de5d6add88 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.141813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b55cd34-5ab3-4646-92df-b1de5d6add88 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.143776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b55cd34-5ab3-4646-92df-b1de5d6add88 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.150000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:09.150879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:09.161796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.162509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.163135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.164060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.164880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.165470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.180583 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b55cd34-5ab3-4646-92df-b1de5d6add88 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 200 len: 12 microversion: 2.26 time: 0.056427 Oct 25 03:34:09.186421 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2910/5709] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 03:34:09 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:09.208986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd32a17310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:09.234774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.240272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.251249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.252717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:09.269042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.271504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.272181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.273545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.279208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.279942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.360164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.361025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.361456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.392335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:09.417741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3337df02-a6a8-46c6-a360-688fb882c229 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 204 len: 0 microversion: 2.26 time: 0.229211 Oct 25 03:34:09.419663 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2911/5710] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 25 03:34:09 2022] DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:34:09.433068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd32d094c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:09.452921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.453624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.454090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.455437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:09.463345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.464258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.464840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.465593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.466258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.466901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.494967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:09.520681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:09.522737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:09.524626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-450bd95a-c35b-42ef-be64-ed55a672fd21 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.378819 Oct 25 03:34:09.525784 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2800/5711] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:09 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:09.538060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.538941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.539933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.563083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.563896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.567714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.631013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:09.676447 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-396608cd-b677-4b97-8b50-d0284dd08593 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1974818983" status: 201 len: 0 microversion: 2.26 time: 0.247969 Oct 25 03:34:09.683595 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2912/5712] 10.222.0.36 () {62 vars in 1380 bytes} [Tue Oct 25 03:34:09 2022] PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1974818983 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 25 03:34:09.689990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd3330d670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:09.709305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.709537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.710912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.715923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:09.728025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.729230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.730335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.732552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.733957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.734891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.787146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.788211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.789051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.806403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.807541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.808262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.849035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:09.890738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-688e6850-de55-4003-a4ba-387b69e84a47 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1479637866" status: 201 len: 0 microversion: 2.26 time: 0.204939 Oct 25 03:34:09.892975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2801/5713] 10.222.0.36 () {62 vars in 1380 bytes} [Tue Oct 25 03:34:09 2022] PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags/tempest-tag-1479637866 => generated 0 bytes in 207 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 25 03:34:09.904368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Action: 'update_all', calling method: .version_select at 0x7efd32a17430>, body: {"tags": ["tempest-tag-518570640", "tempest-tag-440919809"]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:09.928289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.935942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.936817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.937844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:09.954071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.954656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.955166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:09.956059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:09.956553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:09.957213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.019891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.020718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.021396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.082793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:10.105199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:10.112919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ab1dfa0-d9cf-4ecf-b55c-f2571c8abed6 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 200 len: 60 microversion: 2.26 time: 0.213612 Oct 25 03:34:10.113979 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2913/5714] 10.222.0.36 () {62 vars in 1312 bytes} [Tue Oct 25 03:34:09 2022] PUT /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 60 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:10.125721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef15f27d-e3ab-431b-859a-c4090875e671 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd33596ca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:10.136924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef15f27d-e3ab-431b-859a-c4090875e671 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.137490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef15f27d-e3ab-431b-859a-c4090875e671 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.138006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef15f27d-e3ab-431b-859a-c4090875e671 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.150354 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef15f27d-e3ab-431b-859a-c4090875e671 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 200 len: 60 microversion: 2.26 time: 0.030223 Oct 25 03:34:10.152139 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2802/5715] 10.222.0.36 () {60 vars in 1292 bytes} [Tue Oct 25 03:34:10 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 60 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:10.164454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '.version_select at 0x7efd32b6cee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:10.185552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.186342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.186733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.187314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:10.203151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.203775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.209623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.211147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.211844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.212480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.270682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.271694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.272307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.303515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'flavor' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:10.344742 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6fccac22-a843-43e0-86a6-d3a20e80a79c tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags" status: 204 len: 0 microversion: 2.26 time: 0.185484 Oct 25 03:34:10.348152 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2914/5716] 10.222.0.36 () {60 vars in 1295 bytes} [Tue Oct 25 03:34:10 2022] DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763/tags => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:34:10.362825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:10.363478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:10.382543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.387362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.388337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.392825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.394927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.395641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.497025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:34:10.571388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:10.572176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:10.578942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.579406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.579922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.581092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.581591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.582192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.723979 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-19396b29-5501-49ae-885e-3b6d7798dbfb tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 204 len: 0 microversion: 2.26 time: 0.371579 Oct 25 03:34:10.728302 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2803/5717] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:34:10 2022] DELETE /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:34:10.736954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:10.743293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:10.761266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.762135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.763672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:10.764581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:10.767715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:10.768576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:11.023508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:11.044974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:11.049440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:11.053572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ebdac14e-6d00-4747-92e5-f60c9a659650 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.486933 Oct 25 03:34:11.054217 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2915/5718] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:10 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:11.169327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:11.180635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:11.188270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:11.192323 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bd043841-c514-42c3-a8d1-1cbea57eb914 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1550 microversion: 2.26 time: 0.461222 Oct 25 03:34:11.195647 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2804/5719] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:10 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1550 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:11.619678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:11.620283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:11.631867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:11.633664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:11.634578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:11.635443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:11.636208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:11.636961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:11.680566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:34:11.873962 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00e63ba3-54ad-4c78-93a7-77acd5a93750 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 204 len: 0 microversion: 2.1 time: 0.259228 Oct 25 03:34:11.878449 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2916/5720] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:34:11 2022] DELETE /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:34:11.884045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:11.884692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:11.903317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:11.907599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:11.908202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:11.909159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:11.909634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:11.910091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:12.086224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:12.087543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:12.104540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:12.105422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:12.106208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:12.107187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:12.107882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:12.108352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:12.332359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:12.341323 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c6abca64-030e-45c2-a44e-bccd49b16f19 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1508 microversion: 2.1 time: 0.461365 Oct 25 03:34:12.346351 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2805/5721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:11 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1508 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:12.357704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:12.363093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:12.371832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:12.372577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:12.373262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:12.374262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:12.375041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:12.375850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:12.512526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:12.535645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:12.537640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:12.539165 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b065409b-103c-4589-9980-d68bc2e816e6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.458124 Oct 25 03:34:12.540438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2917/5722] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:12 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:12.710789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:12.719269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:12.721847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:12.723293 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5defb257-3b10-4c90-a3fd-48aef15f66dc tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1550 microversion: 2.26 time: 0.375715 Oct 25 03:34:12.724118 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2806/5723] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:12 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1550 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:13.213084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a6391c2b-03c8-4a38-a6dd-6cd38ea6455c req-dad15a9f-6014-4348-a42e-e3f8081d228a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efae544-cd20-4c21-8e27-de3f7c1f9763", "name": "network-vif-deleted", "tag": "b8547b60-ec7f-43e0-b50e-149ca3debe96"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:13.228779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a6391c2b-03c8-4a38-a6dd-6cd38ea6455c req-dad15a9f-6014-4348-a42e-e3f8081d228a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.229262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a6391c2b-03c8-4a38-a6dd-6cd38ea6455c req-dad15a9f-6014-4348-a42e-e3f8081d228a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.229713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a6391c2b-03c8-4a38-a6dd-6cd38ea6455c req-dad15a9f-6014-4348-a42e-e3f8081d228a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.252379 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a6391c2b-03c8-4a38-a6dd-6cd38ea6455c req-dad15a9f-6014-4348-a42e-e3f8081d228a service nova] Creating event network-vif-deleted:b8547b60-ec7f-43e0-b50e-149ca3debe96 for instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 on n-h1-862355-1 Oct 25 03:34:13.266218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a6391c2b-03c8-4a38-a6dd-6cd38ea6455c req-dad15a9f-6014-4348-a42e-e3f8081d228a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049840 Oct 25 03:34:13.267917 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2918/5724] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:13.369309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:13.370081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:13.378922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.379700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.380431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.381550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.382223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.382830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.409147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:13.582188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:13.583162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:13.590347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.591190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.591639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.592391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.592853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.593484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.609478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:13.619545 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1591d5fa-f301-4a37-8c79-150feaac6b7d tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1508 microversion: 2.1 time: 0.254932 Oct 25 03:34:13.620831 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2807/5725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:13 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:13.751212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:13.754233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:13.765007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.765837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.766466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.767789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.768422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.769021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.853814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:13.870429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:13.870928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:13.871371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:13.871825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lazy-loading 'fault' on Instance uuid 9efae544-cd20-4c21-8e27-de3f7c1f9763 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:13.873265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:13.880190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:13.881879 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd00164d-2155-4c8c-8494-d82d0e765eae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.310549 Oct 25 03:34:13.888755 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2919/5726] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:13 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:13.960902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:13.976515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:13.981128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c382bf7a3f7841fb906e3a4c6812a810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2ca0f32a4b4ee79762e5af56fe3bf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:13.985657 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d53e7783-1481-49bc-ba73-e203c5a7117e tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 200 len: 1351 microversion: 2.26 time: 0.236820 Oct 25 03:34:14.005820 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2808/5727] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:13 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 1351 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:14.645413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:14.646719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:14.654330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:14.655194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:14.655833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:14.656777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:14.657248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:14.657809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:14.915611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:14.916239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:14.925458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:14.928814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:14.934145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:14.935319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:14.937037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:14.937840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:14.959806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:14.968110 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8c3fee96-df56-4581-8f29-1e8fa750e909 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1508 microversion: 2.1 time: 0.327604 Oct 25 03:34:14.968711 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2920/5728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:14 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:15.018775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:15.019620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] [instance: 9efae544-cd20-4c21-8e27-de3f7c1f9763] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:15.027144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:15.028037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:15.029215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:15.030651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:15.037229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:15.038133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:15.070211 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] HTTP exception thrown: Instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 could not be found. Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Request method failure captured: Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 HTTP/1.1 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1kYfQUZtZB7r9GYpQL66TFOMD4A2PxQqSYMBxEdC2l-eqhsYYScIkH2o64lK6nErRgbQzhcCeeSYRgrjwUV8nrsct2s2K9GFDrUAZDi0TSkhqykAYiu1UB2pXWHIOGzxcTvf0NXgZZGII827ui3FdUICLSO3U7VsOSg0yA7KjX1DPo Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.26 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 9b2ca0f32a4b4ee79762e5af56fe3bf3 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerTagsTestJSON-1907559253 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b2ca0f32a4b4ee79762e5af56fe3bf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9b2ca0f32a4b4ee79762e5af56fe3bf3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9b2ca0f32a4b4ee79762e5af56fe3bf3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9b2ca0f32a4b4ee79762e5af56fe3bf3"}]}] Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerTagsTestJSON-1907559253 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 9b2ca0f32a4b4ee79762e5af56fe3bf3 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerTagsTestJSON-1907559253 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerTagsTestJSON-1907559253-project Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: c382bf7a3f7841fb906e3a4c6812a810 Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerTagsTestJSON-1907559253-project Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 could not be found. Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9efae544-cd20-4c21-8e27-de3f7c1f9763'} Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 could not be found. Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 could not be found. Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:15.074085 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:15.085901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:15.085901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:15.085901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:15.085901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:15.085901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:15.085901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 could not be found. Oct 25 03:34:15.085901 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:15.087952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] Returning 404 to user: Instance 9efae544-cd20-4c21-8e27-de3f7c1f9763 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:15.089109 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1de0dcb5-e50b-42d2-9279-d85f51b69db0 tempest-ServerTagsTestJSON-1907559253 tempest-ServerTagsTestJSON-1907559253-project] 10.222.0.36 "GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763" status: 404 len: 111 microversion: 2.26 time: 0.076655 Oct 25 03:34:15.102023 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2921/5729] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:15 2022] GET /compute/v2.1/servers/9efae544-cd20-4c21-8e27-de3f7c1f9763 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:34:15.386895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:15.397819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:15.401612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:15.403888 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6ed90e91-00c7-4f78-a61b-83025a27881e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.492098 Oct 25 03:34:15.414528 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2809/5730] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:14 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:15.998040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:15.998781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:16.015041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:16.016384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:16.018315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:16.019354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:16.022685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:16.023426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:16.452748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:16.457523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:16.484944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:16.485190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:16.485634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:16.491492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:16.492798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:16.495546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:16.646852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:16.655859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1edc773b-31ce-4509-b465-58d86ec18a2f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1508 microversion: 2.1 time: 0.662337 Oct 25 03:34:16.656436 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2922/5731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:15 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:16.848474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:16.878033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:16.881784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:16.886012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e0dd28a-085d-4eba-8cd7-62eb5ee4074f tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.441777 Oct 25 03:34:16.923901 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2810/5732] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:16 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:17.685008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:17.686483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:17.708702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:17.710361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:17.712275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:17.717052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:17.718302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:17.721350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:17.920130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:17.920750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:17.926501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:17.940647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:17.942648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:17.942947 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ce68d5ab-8723-4a84-8b71-9a5fe55af647 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1466 microversion: 2.1 time: 0.262109 Oct 25 03:34:17.943712 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2923/5733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:17 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1466 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:17.944385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:17.946864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:17.947355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:17.949108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:18.313356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:18.342514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:18.346969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:18.354171 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43677baf-9532-480a-b376-bd84f61031fb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.432847 Oct 25 03:34:18.369621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2811/5734] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:17 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:18.473327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-27932273-db49-4e98-99de-a2b3c3f3afa8 req-34bd1d2a-0ef0-40ac-80d5-68e9be4a4126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae48ec9-a744-4b6d-b1ce-b945e18331aa", "name": "network-vif-deleted", "tag": "f62db723-ec1f-4679-94e4-684a40afeca4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:18.504337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27932273-db49-4e98-99de-a2b3c3f3afa8 req-34bd1d2a-0ef0-40ac-80d5-68e9be4a4126 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:18.504835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27932273-db49-4e98-99de-a2b3c3f3afa8 req-34bd1d2a-0ef0-40ac-80d5-68e9be4a4126 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:18.512859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27932273-db49-4e98-99de-a2b3c3f3afa8 req-34bd1d2a-0ef0-40ac-80d5-68e9be4a4126 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:18.565202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-27932273-db49-4e98-99de-a2b3c3f3afa8 req-34bd1d2a-0ef0-40ac-80d5-68e9be4a4126 service nova] Creating event network-vif-deleted:f62db723-ec1f-4679-94e4-684a40afeca4 for instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa on n-h2-862355-1 Oct 25 03:34:18.578320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-27932273-db49-4e98-99de-a2b3c3f3afa8 req-34bd1d2a-0ef0-40ac-80d5-68e9be4a4126 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108806 Oct 25 03:34:18.589225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2924/5735] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:18.974824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:18.975532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:19.021031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:19.023813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:19.024492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:19.027270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:19.031757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:19.032391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:19.120943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:19.121432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:19.125517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:19.127686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lazy-loading 'fault' on Instance uuid 9ae48ec9-a744-4b6d-b1ce-b945e18331aa {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:19.227798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:19.240042 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-729381b3-93e7-4d19-a717-94ea41e3670f tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 200 len: 1311 microversion: 2.1 time: 0.270900 Oct 25 03:34:19.241230 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2812/5736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:18 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 1311 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:19.387625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:19.388534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:19.414946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:19.415337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:19.415788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:19.418586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:19.420054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:19.421709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:19.808655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:19.827389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:19.831965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:19.834405 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d621a5eb-21b7-457c-ba7a-86406e93b786 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.456028 Oct 25 03:34:19.856408 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2925/5737] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:19 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:20.273244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:20.275475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9ae48ec9-a744-4b6d-b1ce-b945e18331aa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:20.310841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.312895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.313368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:20.322779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.323427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.323896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:20.383655 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa could not be found. Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa HTTP/1.1 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa could not be found. Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9ae48ec9-a744-4b6d-b1ce-b945e18331aa'} Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa could not be found. Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa could not be found. Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:20.392070 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa could not be found. Oct 25 03:34:20.399692 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:20.403070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 404 to user: Instance 9ae48ec9-a744-4b6d-b1ce-b945e18331aa could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:20.404256 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-585c2a0d-0d52-4bfb-8511-96803c66d023 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa" status: 404 len: 111 microversion: 2.1 time: 0.143366 Oct 25 03:34:20.408053 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2813/5738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:20 2022] GET /compute/v2.1/servers/9ae48ec9-a744-4b6d-b1ce-b945e18331aa => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:34:20.415373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:20.415872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:20.424593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.435375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.435681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:20.440434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.441862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.444531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:20.544481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:34:20.748303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a4ce14e5-0a93-4eff-991f-af9ec49bfc80 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 204 len: 0 microversion: 2.1 time: 0.336778 Oct 25 03:34:20.750031 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2926/5739] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:34:20 2022] DELETE /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:34:20.760063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:20.761002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:20.805348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.805893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.808259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:20.809226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.811810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.812779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:20.875742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:20.877028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:20.901202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.921410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.922288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:20.925268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:20.929924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:20.935082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:21.254859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:21.267648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:21.269129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:21.277785 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05d36292-dbe3-4e95-a8ec-7822a368e1ae tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.399237 Oct 25 03:34:21.278953 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2927/5740] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:20 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:21.321929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:21.330551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1dcbc99-d625-4f84-a728-26d738b81bee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.575511 Oct 25 03:34:21.331600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2814/5741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:20 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:22.309609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:22.310347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:22.319545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:22.319914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:22.320914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:22.322029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:22.322654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:22.323247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:22.356514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:22.357142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:22.368210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:22.368661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:22.369120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:22.369892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:22.370362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:22.370801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:22.591417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:22.598226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:22.601060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:22.602540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:22.603749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1570b96d-a870-4d32-b2a7-5dda457b74e0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.303031 Oct 25 03:34:22.618126 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2928/5742] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:22 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:23.029962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:23.055811 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4191cde0-6d1e-4e37-b279-090c9457c19a tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.702119 Oct 25 03:34:23.058704 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2815/5743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:22 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:23.631470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:23.638117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:23.647662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:23.648623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:23.649246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:23.650168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:23.650986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:23.651679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:23.916618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:23.946146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:23.948429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:23.955556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c623cbd-a5bb-4d88-8fdc-8f38d9ac87f0 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.328875 Oct 25 03:34:23.961175 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2929/5744] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:23 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:24.087265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:24.087887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:24.113013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:24.113013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:24.113013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:24.113013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:24.113013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:24.113013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:24.355684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:24.365603 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c348e7c-c4ab-4319-b364-1f8bcd4ad81c tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.287940 Oct 25 03:34:24.366454 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2816/5745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:24 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:24.990871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:24.992228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:24.996184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:25.004834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:25.016744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:25.018024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:25.019117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:25.019768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:25.020413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:25.230844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:25.243416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:25.245558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:25.247012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee92504e-f99b-4684-b07b-43d69d3abfc5 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.261038 Oct 25 03:34:25.265824 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2930/5746] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:24 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:25.395309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:25.396510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:25.408829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:25.409663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:25.410822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:25.411818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:25.414766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:25.415923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:25.615525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:25.624952 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-751ae442-df63-4af1-b8c1-0c2e586740cc tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.234030 Oct 25 03:34:25.626799 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2817/5747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:25 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:26.276208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:26.276841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:26.297387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:26.300904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:26.302588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:26.303371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:26.303845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:26.304278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:26.651784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:26.652434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:26.666356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:26.667055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:26.667684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:26.668940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:26.674776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:26.675544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:26.768560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:26.782336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:26.787191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:26.791502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-99b1d6e9-b711-4fd1-b0cd-874c96d26a1b tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.522181 Oct 25 03:34:26.793040 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2931/5748] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:26 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:26.993502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:27.035186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-25aa4239-d96e-4617-b7e5-9ae5dffd6919 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1522 microversion: 2.1 time: 0.372225 Oct 25 03:34:27.038348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2818/5749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:26 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:27.824547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:27.825253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:27.848287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f4140f6d-8e8f-4754-9c22-408ceb3715cd req-525c7356-d032-4a9c-9f71-81415c11cb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9930048d-9d62-4f8f-a57b-2b232b15dc2c", "name": "network-vif-deleted", "tag": "7c253ff3-adba-4fe4-ae41-3e275c1f0231"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:27.854653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:27.855414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:27.856367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:27.857214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:27.857795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:27.858315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:27.861301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f4140f6d-8e8f-4754-9c22-408ceb3715cd req-525c7356-d032-4a9c-9f71-81415c11cb27 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:27.861827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f4140f6d-8e8f-4754-9c22-408ceb3715cd req-525c7356-d032-4a9c-9f71-81415c11cb27 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:27.862376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f4140f6d-8e8f-4754-9c22-408ceb3715cd req-525c7356-d032-4a9c-9f71-81415c11cb27 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:27.886441 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f4140f6d-8e8f-4754-9c22-408ceb3715cd req-525c7356-d032-4a9c-9f71-81415c11cb27 service nova] Creating event network-vif-deleted:7c253ff3-adba-4fe4-ae41-3e275c1f0231 for instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c on n-h2-862355-1 Oct 25 03:34:27.898929 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f4140f6d-8e8f-4754-9c22-408ceb3715cd req-525c7356-d032-4a9c-9f71-81415c11cb27 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265845 Oct 25 03:34:27.899682 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2932/5750] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:28.067488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:28.068219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:28.080630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:28.081135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:28.081579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:28.082381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:28.082785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:28.083210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:28.134748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:28.199668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:28.213730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:28.215034 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11ae55cd-08bc-41e9-9f09-bc952de403c1 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.394640 Oct 25 03:34:28.215825 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2819/5751] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:27 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:28.280522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:28.291159 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d87ec23-55c0-4bba-a9e9-6ce01217d5a6 tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1480 microversion: 2.1 time: 0.228962 Oct 25 03:34:28.307318 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2933/5752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:28 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1480 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:29.248150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:29.249505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:29.262973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:29.264733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:29.265889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:29.268372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:29.270212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:29.271666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:29.324587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:29.328438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:29.340667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:29.342026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:29.342908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:29.344211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:29.345045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:29.345968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:29.421027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:29.423407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:29.424187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:29.425045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lazy-loading 'fault' on Instance uuid 9930048d-9d62-4f8f-a57b-2b232b15dc2c {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:34:29.504639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0961d97e347042a190549c04dd3f386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea59242063e4d0599459a00b01770ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:29.526303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb1a48d3-3990-4121-b83f-8c5975b335ee tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 200 len: 1312 microversion: 2.1 time: 0.207935 Oct 25 03:34:29.534804 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2934/5753] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:29 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:29.785834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:29.801566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:29.808788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:29.810080 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-32faa2bd-591b-4e00-83be-8f43abd72bc6 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.566324 Oct 25 03:34:29.810854 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2820/5754] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:29 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:30.565446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:30.566067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] [instance: 9930048d-9d62-4f8f-a57b-2b232b15dc2c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:30.595925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:30.599284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:30.600332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:30.603200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:30.605011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:30.606167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:30.649436 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] HTTP exception thrown: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c could not be found. Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Request method failure captured: Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c HTTP/1.1 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1gpk9FuiSwNOBLE9RL8Zx7vXY3cX23iv03fuDSgpRUBDkDiM0EBA35Lj5de1zi9WYHmWdM5SX3QKTPDMc7Ec6R87yiXd5FHmCsA1E3NHfB4nxtai_Lgy4FKTgxgUVYJJtQFidV4x3X2A52aFUiMk8PIQxSGLE7edw7de7KkZTfyUI4 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bea59242063e4d0599459a00b01770ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bea59242063e4d0599459a00b01770ee", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bea59242063e4d0599459a00b01770ee"}]}] Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: bea59242063e4d0599459a00b01770ee Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1311884881 Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0961d97e347042a190549c04dd3f386d Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1311884881-project Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c could not be found. Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9930048d-9d62-4f8f-a57b-2b232b15dc2c'} Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c could not be found. Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c could not be found. Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:30.651931 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c could not be found. Oct 25 03:34:30.658971 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:30.669707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] Returning 404 to user: Instance 9930048d-9d62-4f8f-a57b-2b232b15dc2c could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:30.671292 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d5b41a6-a105-454e-bb17-cd73410ddfea tempest-ServerRescueNegativeTestJSON-1311884881 tempest-ServerRescueNegativeTestJSON-1311884881-project] 10.222.0.36 "GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c" status: 404 len: 111 microversion: 2.1 time: 0.113087 Oct 25 03:34:30.673334 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2935/5755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:30 2022] GET /compute/v2.1/servers/9930048d-9d62-4f8f-a57b-2b232b15dc2c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:34:30.840924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:30.841494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:30.853970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:30.864945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:30.870334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:30.870884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:30.872766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:30.878045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:30.879727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:31.486687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:31.502805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:31.504385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:31.505832 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad01d544-8da1-4b82-a4c3-8294d1fdf549 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.669096 Oct 25 03:34:31.512358 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2821/5756] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:30 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:32.089083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-220844815", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "89c4e82f-3c5d-498c-ad61-d6c45bb94847"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:32.193340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:34:32.547762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:32.549438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:32.571484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:32.572700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:32.573401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:32.574407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:32.575290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:32.575973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:32.862028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:32.887349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:32.889959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:32.891217 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6a602a80-28a8-41c2-8cf6-082d58b0fa99 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.354514 Oct 25 03:34:32.901732 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2822/5757] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:32 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:33.395552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2eedc203-7033-404d-bbc2-a692512488dc req-006de0c6-77d4-4b13-abb6-a0083218616a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e876c67-75d1-4207-b711-1ec24fb64413", "name": "network-vif-plugged", "status": "completed", "tag": "88a235e2-bc90-41e5-8661-26311d3d2e96"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:33.448967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2eedc203-7033-404d-bbc2-a692512488dc req-006de0c6-77d4-4b13-abb6-a0083218616a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:33.449992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2eedc203-7033-404d-bbc2-a692512488dc req-006de0c6-77d4-4b13-abb6-a0083218616a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:33.450565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2eedc203-7033-404d-bbc2-a692512488dc req-006de0c6-77d4-4b13-abb6-a0083218616a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:33.497635 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2eedc203-7033-404d-bbc2-a692512488dc req-006de0c6-77d4-4b13-abb6-a0083218616a service nova] Creating event network-vif-plugged:88a235e2-bc90-41e5-8661-26311d3d2e96 for instance 6e876c67-75d1-4207-b711-1ec24fb64413 on n-h2-862355-1 Oct 25 03:34:33.516257 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2eedc203-7033-404d-bbc2-a692512488dc req-006de0c6-77d4-4b13-abb6-a0083218616a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127977 Oct 25 03:34:33.525804 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2823/5758] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:34:33.924548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:33.926387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:33.935174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:33.935854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:33.936479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:33.937345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:33.937998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:33.939016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:33.964676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:34:33.965175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:34:33.965748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:34:33.966174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:34:33.967324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:34:33.980071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:33.983712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:33.984278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:33.984716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:33.985579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:33.990647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:34.002327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:34.065529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:34:34.071813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:34:34.089580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:34:34.093239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:34:34.247195 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e11b3137-0e21-418c-9af1-d15db1e5f269 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.406719 Oct 25 03:34:34.251855 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2936/5759] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:34:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:34:34.264750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24f65613-1aff-4537-9b47-bfd2eac2a499 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:34.265954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-24f65613-1aff-4537-9b47-bfd2eac2a499 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:34.467314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:34.478333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-24f65613-1aff-4537-9b47-bfd2eac2a499 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:34.486665 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24f65613-1aff-4537-9b47-bfd2eac2a499 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1192 microversion: 2.1 time: 0.227941 Oct 25 03:34:34.498987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2937/5760] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:34 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1192 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:34.499709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:34.499709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:34.499709 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81084eb8-5823-4510-810c-90b1827395a8 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.575668 Oct 25 03:34:34.504174 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2824/5761] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:33 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:35.540255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:35.543749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:35.544120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:35.555500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:35.600441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:35.603838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:35.604343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:35.604857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:35.606000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:35.606447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:35.607170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:35.621100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:35.624200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:35.624789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:35.628673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:35.630079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:35.842908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:35.874241 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8254af72-d269-4dd8-a1c5-b1fb839ad868 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1196 microversion: 2.1 time: 0.341434 Oct 25 03:34:35.880087 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2938/5762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:35 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1196 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:36.334300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:36.353093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:36.356277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:36.357808 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0397db58-b37f-4699-b6e9-fa82d7bc692e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1731 microversion: 2.20 time: 0.825394 Oct 25 03:34:36.358921 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2825/5763] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:35 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1731 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:34:36.905584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:36.908114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:36.929815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:36.930374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:36.932776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:36.933738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:36.935490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:36.936067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:37.125464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:37.140989 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aa5a79ff-fb25-4b0c-8114-bad790511ad3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1250 microversion: 2.1 time: 0.240813 Oct 25 03:34:37.160361 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2939/5764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:36 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1250 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:37.387267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:37.387892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:37.405816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:37.406540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:37.407129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:37.408091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:37.408713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:37.409293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:38.170377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:38.171763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:38.184450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:38.186765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:38.187735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:38.190762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:38.191405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:38.193935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:38.205743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:38.219071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:38.224356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:38.227681 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc54bac9-3b76-4d3d-ae0b-f51237cfeb81 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1718 microversion: 2.20 time: 0.844363 Oct 25 03:34:38.231030 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2826/5765] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:34:37 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1718 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:34:39.318537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:39.328919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a937341d-e7ef-4d7c-9a85-1ee1137dda4a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1292 microversion: 2.1 time: 1.164503 Oct 25 03:34:39.332548 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2940/5766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:38 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1292 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:40.358230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:40.359405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:40.375352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:40.375938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:40.381613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:40.382432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:40.382920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:40.383367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:40.537183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e2221661-0626-417e-97c0-284b0907fe1f req-0b69fe81-8074-4d7e-8160-d86e465adc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17c89a5-cc1c-4274-90f7-aaeee63b851a", "tag": "9aab4c5c-ca5e-4f38-b008-9c6bbb7387c9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:40.564723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e2221661-0626-417e-97c0-284b0907fe1f req-0b69fe81-8074-4d7e-8160-d86e465adc30 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:40.565484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e2221661-0626-417e-97c0-284b0907fe1f req-0b69fe81-8074-4d7e-8160-d86e465adc30 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:40.566286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e2221661-0626-417e-97c0-284b0907fe1f req-0b69fe81-8074-4d7e-8160-d86e465adc30 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:40.585842 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e2221661-0626-417e-97c0-284b0907fe1f req-0b69fe81-8074-4d7e-8160-d86e465adc30 service nova] Creating event network-changed:9aab4c5c-ca5e-4f38-b008-9c6bbb7387c9 for instance e17c89a5-cc1c-4274-90f7-aaeee63b851a on n-h1-862355-1 Oct 25 03:34:40.592857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e2221661-0626-417e-97c0-284b0907fe1f req-0b69fe81-8074-4d7e-8160-d86e465adc30 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059782 Oct 25 03:34:40.594286 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2941/5767] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:40.995547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:41.008185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-135b4f47-8020-4808-8800-bf10f784b1d3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1292 microversion: 2.1 time: 0.654320 Oct 25 03:34:41.010219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2827/5768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:40 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1292 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:42.052856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:42.053934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:42.072259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:42.073439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:42.075061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:42.077538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:42.080724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:42.081599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:42.436767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:42.463232 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8d957f9-9164-45c4-bf3a-3fbef9ef672e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1292 microversion: 2.1 time: 0.428415 Oct 25 03:34:42.464008 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2942/5769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:42 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1292 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:43.491633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:43.492248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:43.507447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:43.507940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:43.508382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:43.547233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:43.551784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:43.552248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:43.940311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30415034-5f48-4782-97b9-4b3ed7cf9af8 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Action: 'create', calling method: .version_select at 0x7efd3280ddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-298991422", "metadata": {"Type": "work"}}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:44.022785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:44.039960 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cbe03ea0-8fb6-4a59-b545-df11d7d675cd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1292 microversion: 2.1 time: 0.552095 Oct 25 03:34:44.041478 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2828/5770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:43 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1292 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:44.052813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:44.487641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:44.570869 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30415034-5f48-4782-97b9-4b3ed7cf9af8 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.829445 Oct 25 03:34:44.571811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2943/5771] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 25 03:34:43 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 831 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 25 03:34:44.588434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0b92b69-e878-49af-8e25-157bd7a7485f tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd3383a670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:44.733288 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0b92b69-e878-49af-8e25-157bd7a7485f tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 200 len: 352 microversion: 2.1 time: 0.151946 Oct 25 03:34:44.741182 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2829/5772] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:44 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:45.077877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:45.080459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:45.111412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:45.118841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:45.119683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:45.120600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:45.121227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:45.121838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:45.765106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fec7d250-8848-42fd-9f0f-b6d137482d30 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd334fb820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:45.841379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:45.854610 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19412be0-fe46-4671-8fc5-5b4a9480d026 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1292 microversion: 2.1 time: 0.791944 Oct 25 03:34:45.855648 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2944/5773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:45 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1292 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:45.905343 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fec7d250-8848-42fd-9f0f-b6d137482d30 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 200 len: 352 microversion: 2.1 time: 0.159123 Oct 25 03:34:45.906637 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2830/5774] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:45 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:46.096527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c033373b-8a8e-4ab1-8c07-ad6953dfb415 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'create', calling method: .version_select at 0x7efd38dd3280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1359334983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADoGfg1LJAHPVVlLRD90kf/2rNEuT1vp+KgzzZElD04ZQPSvMs4iL+8XTEHIloILwnbNsnENfWnhjwZQZS3Wx+NHcUN2joqWtWU3k1LjHqYUsKXUHURfVFKL7sSgjKASA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:46.113002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c033373b-8a8e-4ab1-8c07-ad6953dfb415 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:34:46.119223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c033373b-8a8e-4ab1-8c07-ad6953dfb415 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for user 65b962a4e0844dbfa0493777365cf6cd and project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:34:46.147830 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c033373b-8a8e-4ab1-8c07-ad6953dfb415 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055310 Oct 25 03:34:46.148847 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2945/5775] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:34:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:46.881661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:46.883053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:46.900344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:46.901468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:46.902242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:46.903116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:46.903705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:46.904668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:46.920836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c38ab82-15e0-44ba-a259-23dae6043913 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd3280ddc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:47.077692 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c38ab82-15e0-44ba-a259-23dae6043913 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 200 len: 353 microversion: 2.1 time: 0.161056 Oct 25 03:34:47.086610 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2946/5776] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:46 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:47.091636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d17e166-d592-4a86-bc38-a56e2650fbc7 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd3280d550>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:47.195151 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d17e166-d592-4a86-bc38-a56e2650fbc7 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 200 len: 353 microversion: 2.1 time: 0.107311 Oct 25 03:34:47.195728 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2947/5777] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:47 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:34:47.214560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b1c943c7-1223-4aab-9cd0-1024d56c8de7 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd32b6cd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:47.351953 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b1c943c7-1223-4aab-9cd0-1024d56c8de7 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 202 len: 0 microversion: 2.1 time: 0.144616 Oct 25 03:34:47.353079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2948/5778] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:34:47 2022] DELETE /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:34:47.362124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a8e048a-a765-4f25-8ba5-7e318256e100 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd32a17dc0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:47.524770 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a8e048a-a765-4f25-8ba5-7e318256e100 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 200 len: 352 microversion: 2.1 time: 0.167278 Oct 25 03:34:47.526245 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2949/5779] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:47 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:47.581380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:47.598226 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0dbd284-8910-49d9-a3ee-102b110f0bf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1292 microversion: 2.1 time: 0.717337 Oct 25 03:34:47.599556 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2831/5780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:46 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1292 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:48.220475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0b044c0b-aebf-4867-b3ed-a7f552dabfbc req-1e1e6ef9-a581-453b-a381-bcfae9d33d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17c89a5-cc1c-4274-90f7-aaeee63b851a", "name": "network-vif-plugged", "status": "completed", "tag": "9aab4c5c-ca5e-4f38-b008-9c6bbb7387c9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:48.254526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0b044c0b-aebf-4867-b3ed-a7f552dabfbc req-1e1e6ef9-a581-453b-a381-bcfae9d33d8c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:48.255378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0b044c0b-aebf-4867-b3ed-a7f552dabfbc req-1e1e6ef9-a581-453b-a381-bcfae9d33d8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:48.256019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0b044c0b-aebf-4867-b3ed-a7f552dabfbc req-1e1e6ef9-a581-453b-a381-bcfae9d33d8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:48.309469 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0b044c0b-aebf-4867-b3ed-a7f552dabfbc req-1e1e6ef9-a581-453b-a381-bcfae9d33d8c service nova] Creating event network-vif-plugged:9aab4c5c-ca5e-4f38-b008-9c6bbb7387c9 for instance e17c89a5-cc1c-4274-90f7-aaeee63b851a on n-h1-862355-1 Oct 25 03:34:48.324063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0b044c0b-aebf-4867-b3ed-a7f552dabfbc req-1e1e6ef9-a581-453b-a381-bcfae9d33d8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108419 Oct 25 03:34:48.324690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2950/5781] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:48.547553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3b32e12c-4b15-4c9e-9863-03d90845124b tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd333d2040>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:48.629041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:48.630774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:48.674863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:48.675880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:48.679126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:48.681367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:48.684333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:48.688281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:48.754852 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3b32e12c-4b15-4c9e-9863-03d90845124b tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 200 len: 352 microversion: 2.1 time: 0.217733 Oct 25 03:34:48.755466 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2832/5782] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:48 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 352 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:34:48.760224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-716320560", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "2b0ca8ea-37f4-4878-aea6-83f457279f95"}], "key_name": "tempest-TestNetworkBasicOps-1359334983", "security_groups": [{"name": "tempest-secgroup-smoke-88163934"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:48.975656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] validate_networks() for [('2b0ca8ea-37f4-4878-aea6-83f457279f95', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:34:49.081810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:49.100200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6283f0e-63c4-45d3-bd1c-940cf2c71279 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1292 microversion: 2.1 time: 0.478778 Oct 25 03:34:49.102443 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2951/5783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:48 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1292 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:49.769793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c246a3a-217f-4115-8f20-d6d8a9f03cd6 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd329c6820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:49.879298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:34:49.879856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:34:49.882161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:34:49.883000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:34:49.883676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:34:49.894586 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c246a3a-217f-4115-8f20-d6d8a9f03cd6 tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 200 len: 352 microversion: 2.1 time: 0.129768 Oct 25 03:34:49.898596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:49.899588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:49.900231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:49.901133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:49.902003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:49.902757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:49.902927 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2952/5784] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:49 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:49.929612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:34:49.936687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for user 65b962a4e0844dbfa0493777365cf6cd and project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:34:49.952825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:34:49.955974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:34:50.039881 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc64151a-66a8-47d0-86a3-a079687d2bdb tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.283379 Oct 25 03:34:50.047159 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2833/5785] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:34:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:34:50.058277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00890c2b-da45-4916-ab8b-677f9b18832c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:50.059128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00890c2b-da45-4916-ab8b-677f9b18832c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:50.125296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:50.126395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:50.138634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:50.140274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:50.143181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:50.145087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:50.145631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:50.147786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:50.197456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00890c2b-da45-4916-ab8b-677f9b18832c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:50.217766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00890c2b-da45-4916-ab8b-677f9b18832c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1248 microversion: 2.1 time: 0.167319 Oct 25 03:34:50.235942 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2953/5786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:50 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1248 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:50.368721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:50.386028 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b9f9eca-4432-492c-b12a-2bb63c6f0025 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1472 microversion: 2.1 time: 0.264836 Oct 25 03:34:50.402834 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2834/5787] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:50 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:50.614864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1912777248", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:50.695512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:34:50.910145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c67f6dc8-0ea2-41ef-80e3-83b98caa65bd tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Calling method '.version_select at 0x7efd32f291f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:50.956877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c67f6dc8-0ea2-41ef-80e3-83b98caa65bd tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] HTTP exception thrown: Volume e480c306-b482-43bf-b61e-1afe1bc4dbe1 could not be found. Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c67f6dc8-0ea2-41ef-80e3-83b98caa65bd tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Request method failure captured: Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 HTTP/1.1 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lTvQBh1v6DHyHoS6jeSXjh8p7QbALbUyaJlnuSw2KVYCR5XOsM6LxIiyNyfN5OSCV6RtkWxWANNqkUTk0I-eIcS0Vg_2C6CC3PiGHskm0Q5XWKe0lNAiWJV04mmhlgvMGV73onMdECFIkGgSCqIvR1Uii2dJbgrJs9-2bo4MZ1zso Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: eed15d5d1407496d9eaf4a47d42628db Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-VolumesGetTestJSON-1509860959 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eed15d5d1407496d9eaf4a47d42628db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/eed15d5d1407496d9eaf4a47d42628db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_eed15d5d1407496d9eaf4a47d42628db", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/eed15d5d1407496d9eaf4a47d42628db"}]}] Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-VolumesGetTestJSON-1509860959 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: eed15d5d1407496d9eaf4a47d42628db Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-VolumesGetTestJSON-1509860959 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-VolumesGetTestJSON-1509860959-project Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 21582beb0f8048e5981ab2eea1f22f43 Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-VolumesGetTestJSON-1509860959-project Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: exception: Volume e480c306-b482-43bf-b61e-1afe1bc4dbe1 could not be found. Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e480c306-b482-43bf-b61e-1afe1bc4dbe1'} Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e480c306-b482-43bf-b61e-1afe1bc4dbe1 could not be found. (HTTP 404) (Request-ID: req-fe7d0daa-81cf-44bf-a939-7004bca3523d) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:34:50.977122 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e480c306-b482-43bf-b61e-1afe1bc4dbe1 could not be found. Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e480c306-b482-43bf-b61e-1afe1bc4dbe1 could not be found. Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e480c306-b482-43bf-b61e-1afe1bc4dbe1 could not be found. Oct 25 03:34:50.981215 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:50.983830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c67f6dc8-0ea2-41ef-80e3-83b98caa65bd tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] Returning 404 to user: Volume e480c306-b482-43bf-b61e-1afe1bc4dbe1 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:50.986774 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c67f6dc8-0ea2-41ef-80e3-83b98caa65bd tempest-VolumesGetTestJSON-1509860959 tempest-VolumesGetTestJSON-1509860959-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1" status: 404 len: 109 microversion: 2.1 time: 0.080889 Oct 25 03:34:50.988228 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2835/5788] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:50 2022] GET /compute/v2.1/os-volumes/e480c306-b482-43bf-b61e-1afe1bc4dbe1 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:34:51.248262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:51.250641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:51.261641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:51.264765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:51.265433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:51.267444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:51.268378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:51.269004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:51.342981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:34:51.343460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:34:51.343884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:34:51.344302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:34:51.344764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:34:51.357193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:51.364296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:51.365055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:51.365702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:51.366617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:51.367413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:51.368043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:51.368644 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8310c099-e26b-4eea-b020-e4056935cdc8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1300 microversion: 2.1 time: 0.125065 Oct 25 03:34:51.382077 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2836/5789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:51 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:51.403638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:34:51.411578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:34:51.428787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:34:51.432388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: bf58f4b5-368e-40d6-b914-2eb578fe7b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:34:51.518585 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b37047a6-fadc-4eb9-9765-02e7d9ba1612 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909564 Oct 25 03:34:51.520472 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2954/5790] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:34:51.534779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47557e33-1a76-4886-aba4-d68859043e31 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:51.536095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47557e33-1a76-4886-aba4-d68859043e31 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: bf58f4b5-368e-40d6-b914-2eb578fe7b55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:51.614765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47557e33-1a76-4886-aba4-d68859043e31 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: bf58f4b5-368e-40d6-b914-2eb578fe7b55] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:34:51.926558 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47557e33-1a76-4886-aba4-d68859043e31 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55" status: 204 len: 0 microversion: 2.1 time: 0.397902 Oct 25 03:34:51.927196 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2837/5791] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:34:51 2022] DELETE /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:34:51.936421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fa5a88d-e872-4f0d-a908-8de49dbb552c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:51.937202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fa5a88d-e872-4f0d-a908-8de49dbb552c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: bf58f4b5-368e-40d6-b914-2eb578fe7b55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:51.958338 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0fa5a88d-e872-4f0d-a908-8de49dbb552c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fa5a88d-e872-4f0d-a908-8de49dbb552c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55 HTTP/1.1 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'bf58f4b5-368e-40d6-b914-2eb578fe7b55'} Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:51.961507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:34:51.964939 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:51.969224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fa5a88d-e872-4f0d-a908-8de49dbb552c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:51.971526 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fa5a88d-e872-4f0d-a908-8de49dbb552c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55" status: 404 len: 111 microversion: 2.1 time: 0.039585 Oct 25 03:34:51.972625 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2955/5792] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:51 2022] GET /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:34:52.106367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-420062892", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "89c4e82f-3c5d-498c-ad61-d6c45bb94847"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:52.178420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:34:52.397533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:52.398177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:52.407152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:52.408426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:52.408873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:52.409587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:52.410067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:52.410494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:52.577967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:52.587400 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e79b778c-b664-4818-9203-aeae77f1c77a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1306 microversion: 2.1 time: 0.193700 Oct 25 03:34:52.589414 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2956/5793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:52 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1306 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:52.765107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:34:52.765530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:34:52.766274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:34:52.766947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:34:52.767561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:34:52.777540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:52.778146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:52.778482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:52.779465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:52.779660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:52.780086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:52.822466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:34:52.828976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:34:52.844198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:34:52.847515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:34:52.905111 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5f1ae07-15b7-420f-b29d-fcc298b6cd62 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803257 Oct 25 03:34:52.910177 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2838/5794] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:34:52.923189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a0ae2b02-4503-4018-8136-6f4661644fc2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:52.925602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a0ae2b02-4503-4018-8136-6f4661644fc2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:53.036212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a0ae2b02-4503-4018-8136-6f4661644fc2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:53.044870 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a0ae2b02-4503-4018-8136-6f4661644fc2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1220 microversion: 2.1 time: 0.125924 Oct 25 03:34:53.046829 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2957/5795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:52 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:53.629438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:53.631437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:53.653437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:53.654408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:53.656178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:53.656975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:53.658782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:53.659234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:53.872460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ffce5df3-a38c-40bd-ad81-1349cc03da4d tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Action: 'create', calling method: .version_select at 0x7efd3814e700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-101990224", "metadata": {"Type": "work"}}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ffce5df3-a38c-40bd-ad81-1349cc03da4d tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Request method failure captured: Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 121 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1ldGbLU_m_lnnEe9ZJ55yDi5IeENg3VCkvHqRyi_0Jdxl980dkGQDR3zEVwxjZbpSAsaDhJXqFyXJQezQebWy5ye8BhRKnqErKDebX_mwX3BMGF0KAbI_B4qhTwg-iKwv-ypMfOGJwLxmOaAa5-Wh7NVFPNjiL5ZRi7vjfwH8TJalg Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8b02e777290c4e6ea3d9388813a33f79", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8b02e777290c4e6ea3d9388813a33f79"}]}] Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 62c876fb3b88479f8e4b8a6d82e91a71 Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-101990224", "metadata": {"Type": "work"}}} Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-101990224', 'metadata': {'Type': 'work'}}}} Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi '#$%' Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:34:53.880658 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 25 03:34:53.884477 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.887620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ffce5df3-a38c-40bd-ad81-1349cc03da4d tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:53.888759 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ffce5df3-a38c-40bd-ad81-1349cc03da4d tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.278749 Oct 25 03:34:53.889433 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2958/5796] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 25 03:34:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:34:53.910993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9da3784a-eac4-4142-bffa-143764a296f3 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Action: 'create', calling method: .version_select at 0x7efd3261f670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-207863847", "metadata": {"Type": "work"}}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9da3784a-eac4-4142-bffa-143764a296f3 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Request method failure captured: Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 119 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1ldGbLU_m_lnnEe9ZJ55yDi5IeENg3VCkvHqRyi_0Jdxl980dkGQDR3zEVwxjZbpSAsaDhJXqFyXJQezQebWy5ye8BhRKnqErKDebX_mwX3BMGF0KAbI_B4qhTwg-iKwv-ypMfOGJwLxmOaAa5-Wh7NVFPNjiL5ZRi7vjfwH8TJalg Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8b02e777290c4e6ea3d9388813a33f79", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8b02e777290c4e6ea3d9388813a33f79"}]}] Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 62c876fb3b88479f8e4b8a6d82e91a71 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-207863847", "metadata": {"Type": "work"}}} Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-207863847', 'metadata': {'Type': 'work'}}}} Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi '0' Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:34:53.915652 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9da3784a-eac4-4142-bffa-143764a296f3 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:53.919694 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9da3784a-eac4-4142-bffa-143764a296f3 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020912 Oct 25 03:34:53.921259 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2959/5797] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 25 03:34:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:34:53.942746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d9c952f-ffe1-47b1-9cd1-6b84e3f943e7 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Action: 'create', calling method: .version_select at 0x7efd32b67700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1517063702", "metadata": {"Type": "work"}}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:53.948404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d9c952f-ffe1-47b1-9cd1-6b84e3f943e7 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Request method failure captured: Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 119 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1ldGbLU_m_lnnEe9ZJ55yDi5IeENg3VCkvHqRyi_0Jdxl980dkGQDR3zEVwxjZbpSAsaDhJXqFyXJQezQebWy5ye8BhRKnqErKDebX_mwX3BMGF0KAbI_B4qhTwg-iKwv-ypMfOGJwLxmOaAa5-Wh7NVFPNjiL5ZRi7vjfwH8TJalg Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8b02e777290c4e6ea3d9388813a33f79", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8b02e777290c4e6ea3d9388813a33f79"}]}] Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 62c876fb3b88479f8e4b8a6d82e91a71 Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1517063702", "metadata": {"Type": "work"}}} Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1517063702', 'metadata': {'Type': 'work'}}}} Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi '' Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 03:34:53.951853 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d9c952f-ffe1-47b1-9cd1-6b84e3f943e7 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:53.955293 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d9c952f-ffe1-47b1-9cd1-6b84e3f943e7 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024716 Oct 25 03:34:53.961365 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2960/5798] 10.222.0.36 () {60 vars in 1156 bytes} [Tue Oct 25 03:34:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:34:53.968288 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6a430fb9-fae9-4a8d-8e64-3a94ea8b1f19 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1372 microversion: 2.1 time: 0.358046 Oct 25 03:34:53.970144 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2839/5799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:53 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1372 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:53.971772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a972cdba-8f27-4ba7-924f-d42a2ea99a78 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Calling method '.version_select at 0x7efd3b890040>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:54.011749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a972cdba-8f27-4ba7-924f-d42a2ea99a78 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] HTTP exception thrown: Volume tempest-invalid-1886482229 could not be found. Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a972cdba-8f27-4ba7-924f-d42a2ea99a78 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Request method failure captured: Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1886482229 HTTP/1.1 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1ldGbLU_m_lnnEe9ZJ55yDi5IeENg3VCkvHqRyi_0Jdxl980dkGQDR3zEVwxjZbpSAsaDhJXqFyXJQezQebWy5ye8BhRKnqErKDebX_mwX3BMGF0KAbI_B4qhTwg-iKwv-ypMfOGJwLxmOaAa5-Wh7NVFPNjiL5ZRi7vjfwH8TJalg Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8b02e777290c4e6ea3d9388813a33f79", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8b02e777290c4e6ea3d9388813a33f79"}]}] Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 62c876fb3b88479f8e4b8a6d82e91a71 Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: method: Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: exception: Volume tempest-invalid-1886482229 could not be found. Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'tempest-invalid-1886482229'} Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1886482229 could not be found. (HTTP 404) (Request-ID: req-91133094-7da7-498e-a493-69b38f96376d) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:34:54.014368 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1886482229 could not be found. Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1886482229 could not be found. Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1886482229 could not be found. Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.019217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a972cdba-8f27-4ba7-924f-d42a2ea99a78 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Returning 404 to user: Volume tempest-invalid-1886482229 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:54.026821 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a972cdba-8f27-4ba7-924f-d42a2ea99a78 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1886482229" status: 404 len: 99 microversion: 2.1 time: 0.064383 Oct 25 03:34:54.028029 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2961/5800] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:34:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1886482229 => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 25 03:34:54.039952 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7319e0a6-f2c2-41bd-b0ec-7e2a8defcf6e tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004283 Oct 25 03:34:54.046597 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2840/5801] 10.222.0.36 () {58 vars in 1140 bytes} [Tue Oct 25 03:34:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 25 03:34:54.052808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e2c64ba-723e-4427-b87e-e1e297b9aa81 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004830 Oct 25 03:34:54.053655 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2962/5802] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:34:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 25 03:34:54.066580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe58bc33-ebcd-47d1-b2a6-592fc52ee1c0 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Calling method '.version_select at 0x7efd3363ed30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:54.078762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:54.079526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:54.089988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:54.090977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:54.091708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:54.092704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:54.093301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:54.094026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:54.101112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=88 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:54.120855 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-fe58bc33-ebcd-47d1-b2a6-592fc52ee1c0 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] HTTP exception thrown: Volume 32174f3c-ce50-408d-a6e1-61dbd58b67c1 could not be found. Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe58bc33-ebcd-47d1-b2a6-592fc52ee1c0 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Request method failure captured: Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/os-volumes/32174f3c-ce50-408d-a6e1-61dbd58b67c1 HTTP/1.1 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1ldGbLU_m_lnnEe9ZJ55yDi5IeENg3VCkvHqRyi_0Jdxl980dkGQDR3zEVwxjZbpSAsaDhJXqFyXJQezQebWy5ye8BhRKnqErKDebX_mwX3BMGF0KAbI_B4qhTwg-iKwv-ypMfOGJwLxmOaAa5-Wh7NVFPNjiL5ZRi7vjfwH8TJalg Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8b02e777290c4e6ea3d9388813a33f79", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8b02e777290c4e6ea3d9388813a33f79"}]}] Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 62c876fb3b88479f8e4b8a6d82e91a71 Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: exception: Volume 32174f3c-ce50-408d-a6e1-61dbd58b67c1 could not be found. Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '32174f3c-ce50-408d-a6e1-61dbd58b67c1'} Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32174f3c-ce50-408d-a6e1-61dbd58b67c1 could not be found. (HTTP 404) (Request-ID: req-f2e5c3ce-7857-422e-9460-17a7679afd77) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:34:54.123093 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32174f3c-ce50-408d-a6e1-61dbd58b67c1 could not be found. Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32174f3c-ce50-408d-a6e1-61dbd58b67c1 could not be found. Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32174f3c-ce50-408d-a6e1-61dbd58b67c1 could not be found. Oct 25 03:34:54.126895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.130419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe58bc33-ebcd-47d1-b2a6-592fc52ee1c0 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Returning 404 to user: Volume 32174f3c-ce50-408d-a6e1-61dbd58b67c1 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:54.131524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe58bc33-ebcd-47d1-b2a6-592fc52ee1c0 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/32174f3c-ce50-408d-a6e1-61dbd58b67c1" status: 404 len: 109 microversion: 2.1 time: 0.071259 Oct 25 03:34:54.132557 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2841/5803] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:34:54 2022] DELETE /compute/v2.1/os-volumes/32174f3c-ce50-408d-a6e1-61dbd58b67c1 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:34:54.144066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-28e84760-3b15-4fac-a6e5-67ac870b6a88 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Calling method '.version_select at 0x7efd335a9790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:54.194519 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-28e84760-3b15-4fac-a6e5-67ac870b6a88 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] HTTP exception thrown: Volume bb05ae5e-b35a-4a95-8624-94c90c2db5d1 could not be found. Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-28e84760-3b15-4fac-a6e5-67ac870b6a88 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Request method failure captured: Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/os-volumes/bb05ae5e-b35a-4a95-8624-94c90c2db5d1 HTTP/1.1 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1ldGbLU_m_lnnEe9ZJ55yDi5IeENg3VCkvHqRyi_0Jdxl980dkGQDR3zEVwxjZbpSAsaDhJXqFyXJQezQebWy5ye8BhRKnqErKDebX_mwX3BMGF0KAbI_B4qhTwg-iKwv-ypMfOGJwLxmOaAa5-Wh7NVFPNjiL5ZRi7vjfwH8TJalg Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8b02e777290c4e6ea3d9388813a33f79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8b02e777290c4e6ea3d9388813a33f79", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8b02e777290c4e6ea3d9388813a33f79"}]}] Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8b02e777290c4e6ea3d9388813a33f79 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-VolumesNegativeTest-1188417193 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 62c876fb3b88479f8e4b8a6d82e91a71 Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-VolumesNegativeTest-1188417193-project Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: method: Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: exception: Volume bb05ae5e-b35a-4a95-8624-94c90c2db5d1 could not be found. Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'bb05ae5e-b35a-4a95-8624-94c90c2db5d1'} Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb05ae5e-b35a-4a95-8624-94c90c2db5d1 could not be found. (HTTP 404) (Request-ID: req-e224eb48-31ad-4acb-8dd9-b761338df676) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 25 03:34:54.196779 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb05ae5e-b35a-4a95-8624-94c90c2db5d1 could not be found. Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb05ae5e-b35a-4a95-8624-94c90c2db5d1 could not be found. Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb05ae5e-b35a-4a95-8624-94c90c2db5d1 could not be found. Oct 25 03:34:54.200934 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:34:54.209004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-28e84760-3b15-4fac-a6e5-67ac870b6a88 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] Returning 404 to user: Volume bb05ae5e-b35a-4a95-8624-94c90c2db5d1 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:34:54.210145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:54.215458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-28e84760-3b15-4fac-a6e5-67ac870b6a88 tempest-VolumesNegativeTest-1188417193 tempest-VolumesNegativeTest-1188417193-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/bb05ae5e-b35a-4a95-8624-94c90c2db5d1" status: 404 len: 109 microversion: 2.1 time: 0.068701 Oct 25 03:34:54.217498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2842/5804] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:34:54 2022] GET /compute/v2.1/os-volumes/bb05ae5e-b35a-4a95-8624-94c90c2db5d1 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:34:54.225044 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da5c24ab-0b4d-4f88-a71b-0fd0a2674c8d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1272 microversion: 2.1 time: 0.152256 Oct 25 03:34:54.225748 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2963/5805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:54 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:54.230145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-63aef28b-8aeb-402f-88cc-c50e1bcbd778 req-83eda301-4850-46c8-a75e-ce3b0f1726bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1fdbcd-fcba-4aea-819a-9693ee03114c", "tag": "5a2879f7-b7fc-441d-8f71-04e9ff350d8d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:54.262318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-63aef28b-8aeb-402f-88cc-c50e1bcbd778 req-83eda301-4850-46c8-a75e-ce3b0f1726bf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:54.262865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-63aef28b-8aeb-402f-88cc-c50e1bcbd778 req-83eda301-4850-46c8-a75e-ce3b0f1726bf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:54.263727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-63aef28b-8aeb-402f-88cc-c50e1bcbd778 req-83eda301-4850-46c8-a75e-ce3b0f1726bf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:54.287110 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-63aef28b-8aeb-402f-88cc-c50e1bcbd778 req-83eda301-4850-46c8-a75e-ce3b0f1726bf service nova] Creating event network-changed:5a2879f7-b7fc-441d-8f71-04e9ff350d8d for instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c on n-h2-862355-1 Oct 25 03:34:54.292441 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-63aef28b-8aeb-402f-88cc-c50e1bcbd778 req-83eda301-4850-46c8-a75e-ce3b0f1726bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070863 Oct 25 03:34:54.293653 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2843/5806] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:54.997508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:54.998275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:55.008058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:55.008988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:55.009765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:55.010773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:55.011407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:55.012054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:55.252019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:55.252874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:55.265873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:55.267388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:55.267843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:55.268740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:55.269374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:55.269999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:55.273475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:55.286566 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b599405-d634-4ef0-b69a-0f928a823382 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1372 microversion: 2.1 time: 0.294163 Oct 25 03:34:55.288549 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2964/5807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:54 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1372 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:55.410664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:55.421145 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-141fab37-097f-4181-9d45-4927a74e5806 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1278 microversion: 2.1 time: 0.175850 Oct 25 03:34:55.422516 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2844/5808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:55 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:56.312608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:56.313216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:56.316676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:34:56.322842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:56.323582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:56.324211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:56.325174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:56.325839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:56.326548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:56.448659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:56.450319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:56.474071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:56.476033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:56.477262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:56.479711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:56.480473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:56.481510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:56.616046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:56.625329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d8527878-5582-434c-b10c-31266470f520 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1372 microversion: 2.1 time: 0.316621 Oct 25 03:34:56.627416 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2965/5809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:56 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:56.633153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b85ce5ce-b1b4-4ae2-8848-813bd4488fcd req-b26f86ba-111a-4c87-88c3-9868c72e790a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a769371-0c0e-4382-bc3c-f3e5986e1509", "tag": "1a2e68f0-4940-4294-8b14-6fe6c79aeae8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:56.643566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b85ce5ce-b1b4-4ae2-8848-813bd4488fcd req-b26f86ba-111a-4c87-88c3-9868c72e790a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:56.644049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b85ce5ce-b1b4-4ae2-8848-813bd4488fcd req-b26f86ba-111a-4c87-88c3-9868c72e790a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:56.644566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b85ce5ce-b1b4-4ae2-8848-813bd4488fcd req-b26f86ba-111a-4c87-88c3-9868c72e790a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:56.657345 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b85ce5ce-b1b4-4ae2-8848-813bd4488fcd req-b26f86ba-111a-4c87-88c3-9868c72e790a service nova] Creating event network-changed:1a2e68f0-4940-4294-8b14-6fe6c79aeae8 for instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 on n-h1-862355-1 Oct 25 03:34:56.663487 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b85ce5ce-b1b4-4ae2-8848-813bd4488fcd req-b26f86ba-111a-4c87-88c3-9868c72e790a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033897 Oct 25 03:34:56.664103 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2966/5810] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:34:56.820099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:56.828729 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e22c56cb-17fd-4b61-8d66-044aebbbd7e9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1320 microversion: 2.1 time: 0.386007 Oct 25 03:34:56.830605 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2845/5811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:56 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:34:57.649279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:57.650139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:57.658479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:57.659699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:57.660407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:57.661198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:57.661747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:57.662247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:57.828074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:57.837223 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e44a5407-9cd2-4536-85a8-6d037f4211a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1372 microversion: 2.1 time: 0.192068 Oct 25 03:34:57.838165 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2967/5812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:57 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:57.855931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:57.856549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:57.863325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:57.863813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:57.864247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:57.864940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:57.865738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:57.866310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:58.081471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:58.091800 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fc620c49-afeb-474a-b6db-c6676655b388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1320 microversion: 2.1 time: 0.240585 Oct 25 03:34:58.097908 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2846/5813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:57 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:58.863296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:58.863844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:58.871923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:58.872670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:58.873108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:58.874083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:58.874553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:58.874995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:59.038994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:59.048171 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e0f98e18-8f4c-4b7b-84c1-01c90b3e55a3 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1372 microversion: 2.1 time: 0.189580 Oct 25 03:34:59.048989 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2968/5814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:58 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:59.119406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:34:59.120556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:34:59.129444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:59.130095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:59.130608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:59.131404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:59.131977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:59.132481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:59.286448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:34:59.296375 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5439c1f7-c578-43a8-a477-d94da1bb9f2b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1320 microversion: 2.1 time: 0.181284 Oct 25 03:34:59.299343 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2847/5815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:34:59 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:34:59.479300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-689ba7f4-0065-4a76-85a2-a5a3491ef209 req-eb785963-3352-4647-800f-336c114348c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1fdbcd-fcba-4aea-819a-9693ee03114c", "name": "network-vif-plugged", "status": "completed", "tag": "5a2879f7-b7fc-441d-8f71-04e9ff350d8d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:34:59.494754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-689ba7f4-0065-4a76-85a2-a5a3491ef209 req-eb785963-3352-4647-800f-336c114348c9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:34:59.495926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-689ba7f4-0065-4a76-85a2-a5a3491ef209 req-eb785963-3352-4647-800f-336c114348c9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:34:59.496719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-689ba7f4-0065-4a76-85a2-a5a3491ef209 req-eb785963-3352-4647-800f-336c114348c9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:34:59.511949 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-689ba7f4-0065-4a76-85a2-a5a3491ef209 req-eb785963-3352-4647-800f-336c114348c9 service nova] Creating event network-vif-plugged:5a2879f7-b7fc-441d-8f71-04e9ff350d8d for instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c on n-h2-862355-1 Oct 25 03:34:59.520544 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-689ba7f4-0065-4a76-85a2-a5a3491ef209 req-eb785963-3352-4647-800f-336c114348c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045342 Oct 25 03:34:59.522436 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2969/5816] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:35:00.072323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:00.072941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:00.079964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:00.080463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:00.080908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:00.081615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:00.082113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:00.082545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:00.233376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:00.244738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4cb9b383-af1a-455f-9bdf-e9efacb46a93 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1372 microversion: 2.1 time: 0.175761 Oct 25 03:35:00.245783 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2848/5817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:00 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:00.324956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:00.326427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:00.334894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:00.335382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:00.335983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:00.337125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:00.337947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:00.341821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:00.512246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:00.527022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1cb5f41-df42-45c4-81ed-1e804b78809f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1320 microversion: 2.1 time: 0.205923 Oct 25 03:35:00.529009 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2970/5818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:00 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:01.272451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:01.273903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:01.279988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:01.285727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:01.286624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:01.287364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:01.288848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:01.289530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:01.290934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:01.539530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:01.553323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:01.553988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:01.560583 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c3b77e5e-eb21-46e2-b801-9fef2583f839 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1543 microversion: 2.1 time: 0.293761 Oct 25 03:35:01.561541 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2849/5819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:01 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1543 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:01.565305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:01.580204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:01.582295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:01.582936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:01.585109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:01.586486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:01.586799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:01.587313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:01.587998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:01.599494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:01.600586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:01.601486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:01.602330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:01.602999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:01.603624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:01.910872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:01.917329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:01.920363 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed8512b4-45fa-44b2-84a8-e4da300ec417 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1320 microversion: 2.1 time: 0.372558 Oct 25 03:35:01.928050 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c06d4b52-7182-41b4-b460-3558ba5831c2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1543 microversion: 2.1 time: 0.346531 Oct 25 03:35:01.930245 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2850/5820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:01 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1543 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:01.934178 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2971/5821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:01 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1320 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:01.935759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-687ea005-2eb2-4d6a-aa36-7c35a3727fd0 req-f1ae05ba-b531-49ce-aa3e-563d8a121bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a769371-0c0e-4382-bc3c-f3e5986e1509", "name": "network-vif-plugged", "status": "completed", "tag": "1a2e68f0-4940-4294-8b14-6fe6c79aeae8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:01.950583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-687ea005-2eb2-4d6a-aa36-7c35a3727fd0 req-f1ae05ba-b531-49ce-aa3e-563d8a121bae service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:01.951311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-687ea005-2eb2-4d6a-aa36-7c35a3727fd0 req-f1ae05ba-b531-49ce-aa3e-563d8a121bae service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:01.951950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-687ea005-2eb2-4d6a-aa36-7c35a3727fd0 req-f1ae05ba-b531-49ce-aa3e-563d8a121bae service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:01.957361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:01.966329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-687ea005-2eb2-4d6a-aa36-7c35a3727fd0 req-f1ae05ba-b531-49ce-aa3e-563d8a121bae service nova] Creating event network-vif-plugged:1a2e68f0-4940-4294-8b14-6fe6c79aeae8 for instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 on n-h1-862355-1 Oct 25 03:35:01.972749 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-687ea005-2eb2-4d6a-aa36-7c35a3727fd0 req-f1ae05ba-b531-49ce-aa3e-563d8a121bae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040727 Oct 25 03:35:01.974466 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2851/5822] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:02.945714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:02.946252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:02.955974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:02.956559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:02.957166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:02.957904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:02.958392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:02.958817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:03.044577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:03.203869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:03.216729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4bdd3afd-4cb8-4f50-addf-8eac178d2811 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1320 microversion: 2.1 time: 0.274856 Oct 25 03:35:03.218034 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2972/5823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:02 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:04.189032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-cd640638-65e6-49bb-80a1-8c9d67b606d8 req-728f6cb8-b542-41e4-9fce-077f6435a622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1fdbcd-fcba-4aea-819a-9693ee03114c", "tag": "5a2879f7-b7fc-441d-8f71-04e9ff350d8d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:04.210662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:04.212166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=14 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:04.219153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cd640638-65e6-49bb-80a1-8c9d67b606d8 req-728f6cb8-b542-41e4-9fce-077f6435a622 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:04.220934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cd640638-65e6-49bb-80a1-8c9d67b606d8 req-728f6cb8-b542-41e4-9fce-077f6435a622 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:04.221730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cd640638-65e6-49bb-80a1-8c9d67b606d8 req-728f6cb8-b542-41e4-9fce-077f6435a622 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:04.244662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:04.245221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:04.252687 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-cd640638-65e6-49bb-80a1-8c9d67b606d8 req-728f6cb8-b542-41e4-9fce-077f6435a622 service nova] Creating event network-changed:5a2879f7-b7fc-441d-8f71-04e9ff350d8d for instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c on n-h2-862355-1 Oct 25 03:35:04.264933 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-cd640638-65e6-49bb-80a1-8c9d67b606d8 req-728f6cb8-b542-41e4-9fce-077f6435a622 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090684 Oct 25 03:35:04.266168 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2852/5824] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:04.272981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:04.273922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:04.274574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:04.275533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:04.276196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:04.276901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:04.785284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:04.795502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6362bf0-9c93-49e0-ab10-807822910ff5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1501 microversion: 2.1 time: 0.556845 Oct 25 03:35:04.796099 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2973/5825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:04 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1501 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:04.823112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:04.823805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:04.843005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:04.843718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:04.844314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:04.846326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:04.846962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:04.847570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:05.136674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:05.154483 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-310f0d14-f44f-4946-bf55-43af5681b73f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1501 microversion: 2.1 time: 0.336199 Oct 25 03:35:05.155640 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2853/5826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:04 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:05.179158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:05.179670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:05.192176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:05.192682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:05.193130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:05.195160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:05.198072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:05.198545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:05.241624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:35:05.350256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0c341bc-c789-4c37-a424-a08f0a6fced6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 204 len: 0 microversion: 2.1 time: 0.174404 Oct 25 03:35:05.357006 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2974/5827] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:35:05 2022] DELETE /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:35:05.371900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:05.372897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:05.396688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:05.415959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:05.423166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:05.428924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:05.438962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:05.446903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:05.702779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:05.712602 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-842648dc-4af2-48a7-9938-eb7d28a4ba41 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1507 microversion: 2.1 time: 0.355367 Oct 25 03:35:05.714851 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2854/5828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:05 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:06.750540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:06.756521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:06.769658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:06.773788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:06.774523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:06.775427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:06.777104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:06.778311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:06.980133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:06.995417 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd8a4c71-0a1d-454f-9075-644d9bbf97b8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1507 microversion: 2.1 time: 0.260261 Oct 25 03:35:06.996461 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2975/5829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:06 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:07.460684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ccd84d8e-baf8-4da8-a7c8-5a911bd51a6c req-65c81f20-5948-4db1-9adb-1d97cd7b4185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a769371-0c0e-4382-bc3c-f3e5986e1509", "name": "network-vif-deleted", "tag": "1a2e68f0-4940-4294-8b14-6fe6c79aeae8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:07.482974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ccd84d8e-baf8-4da8-a7c8-5a911bd51a6c req-65c81f20-5948-4db1-9adb-1d97cd7b4185 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:07.484427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ccd84d8e-baf8-4da8-a7c8-5a911bd51a6c req-65c81f20-5948-4db1-9adb-1d97cd7b4185 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:07.485162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ccd84d8e-baf8-4da8-a7c8-5a911bd51a6c req-65c81f20-5948-4db1-9adb-1d97cd7b4185 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:07.530466 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ccd84d8e-baf8-4da8-a7c8-5a911bd51a6c req-65c81f20-5948-4db1-9adb-1d97cd7b4185 service nova] Creating event network-vif-deleted:1a2e68f0-4940-4294-8b14-6fe6c79aeae8 for instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 on n-h1-862355-1 Oct 25 03:35:07.542475 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ccd84d8e-baf8-4da8-a7c8-5a911bd51a6c req-65c81f20-5948-4db1-9adb-1d97cd7b4185 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085247 Oct 25 03:35:07.548626 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2855/5830] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:08.021769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:08.022895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:08.031504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:08.033050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:08.033485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:08.034560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:08.035367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:08.035947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:08.087205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:08.087897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:08.088472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:08.089070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lazy-loading 'fault' on Instance uuid 9a769371-0c0e-4382-bc3c-f3e5986e1509 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:35:08.154076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:08.172204 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ddcec5bc-06b7-43ed-a550-44865e0869e4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 200 len: 1310 microversion: 2.1 time: 0.156459 Oct 25 03:35:08.174736 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2976/5831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:08 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 1310 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:09.204972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:09.207487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:09.214803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:09.215479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:09.216080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:09.217144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:09.217762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:09.218350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:09.234284 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 HTTP/1.1 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9a769371-0c0e-4382-bc3c-f3e5986e1509'} Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:09.237048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:09.241145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:09.241145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:09.241145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:35:09.241145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:35:09.241145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:35:09.241145 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:09.243188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:35:09.244342 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2aea3162-f573-40c7-9b88-87881411a63e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 404 len: 111 microversion: 2.1 time: 0.046379 Oct 25 03:35:09.245438 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2856/5832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:09 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:35:09.259761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc33fc44-5db4-48c6-a869-00d88b670a89 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: .version_select at 0x7efd32a17310>, body: {"keypair": {"name": "tempest-key-255672261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMzoJ3LXIyYMYOghUxlHpBlBQ1kK5ysGTyetK92svcFUTPfyu86w3jqcWymxpNWkOisdRKjnPOaPbm9SMc1wPLtqqi9MO4oXrsRb2i/Fmd23Gt92W+arcmbYPfPUHzgbQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:09.278455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cc33fc44-5db4-48c6-a869-00d88b670a89 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:35:09.285529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cc33fc44-5db4-48c6-a869-00d88b670a89 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:35:09.313754 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc33fc44-5db4-48c6-a869-00d88b670a89 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.058092 Oct 25 03:35:09.314538 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2977/5833] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:35:09 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:09.325424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8804a0b-0126-4f90-b2b5-3e1b57ed1cd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '.version_select at 0x7efd3343fdc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:09.329709 n-d-862355-1 devstack@n-api.service[120563]: WARNING oslo_db.sqlalchemy.utils [None req-b8804a0b-0126-4f90-b2b5-3e1b57ed1cd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 25 03:35:09.337564 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8804a0b-0126-4f90-b2b5-3e1b57ed1cd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.016066 Oct 25 03:35:09.338474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2857/5834] 10.222.0.36 () {58 vars in 1137 bytes} [Tue Oct 25 03:35:09 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:09.458637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-450853393", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-key-255672261", "networks": [{"uuid": "89c4e82f-3c5d-498c-ad61-d6c45bb94847"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:09.525753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:35:10.013132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:35:10.014006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:35:10.014649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:35:10.015211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:35:10.015810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:35:10.034008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:10.036975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:10.036975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:10.036975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:10.036975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:10.036975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:10.059892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:35:10.066201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:35:10.083861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:35:10.086289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:35:10.143315 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3853785-b348-40c2-8463-ee810cee07c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686811 Oct 25 03:35:10.145959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2978/5835] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:35:10.158732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35592b65-f054-47a0-8828-4578b46dedfa tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:10.159274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35592b65-f054-47a0-8828-4578b46dedfa tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:10.257181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35592b65-f054-47a0-8828-4578b46dedfa tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:10.269098 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35592b65-f054-47a0-8828-4578b46dedfa tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1227 microversion: 2.1 time: 0.115261 Oct 25 03:35:10.270695 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2858/5836] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:10 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1227 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:11.293705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:11.295202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:11.304536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:11.305311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:11.305882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:11.306756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:11.307170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:11.307609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:11.415917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:11.428988 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-265e8a26-5489-419c-9b4b-f80ec234d632 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1279 microversion: 2.1 time: 0.140176 Oct 25 03:35:11.445597 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2979/5837] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:11 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:12.454400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:12.454998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:12.471398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:12.472211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:12.472834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:12.474077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:12.474425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:12.478183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:13.149055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:13.162931 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f4ee0375-6cbe-4fc4-8619-a0e51ebc39a8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1327 microversion: 2.1 time: 0.714174 Oct 25 03:35:13.175029 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2859/5838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:12 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1327 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:13.888253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a5f4e8b1-8d42-43da-a64a-e8d1f35e1fa4 req-857f2f75-8040-4d65-a358-81734b73fa9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33", "tag": "ab1087d6-b708-452e-9aa6-77d6a5b189bf"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:13.904865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a5f4e8b1-8d42-43da-a64a-e8d1f35e1fa4 req-857f2f75-8040-4d65-a358-81734b73fa9b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:13.905570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a5f4e8b1-8d42-43da-a64a-e8d1f35e1fa4 req-857f2f75-8040-4d65-a358-81734b73fa9b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:13.906180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a5f4e8b1-8d42-43da-a64a-e8d1f35e1fa4 req-857f2f75-8040-4d65-a358-81734b73fa9b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:13.921912 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a5f4e8b1-8d42-43da-a64a-e8d1f35e1fa4 req-857f2f75-8040-4d65-a358-81734b73fa9b service nova] Creating event network-changed:ab1087d6-b708-452e-9aa6-77d6a5b189bf for instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 on n-h1-862355-1 Oct 25 03:35:13.927856 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a5f4e8b1-8d42-43da-a64a-e8d1f35e1fa4 req-857f2f75-8040-4d65-a358-81734b73fa9b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043529 Oct 25 03:35:13.929022 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2980/5839] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:14.197539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:14.198306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:14.209057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:14.209551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:14.210018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:14.210725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:14.211185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:14.211614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:14.478763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:14.490527 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13363cb9-78f5-4ab9-86a7-27bb3cbd49ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1327 microversion: 2.1 time: 0.294833 Oct 25 03:35:14.502845 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2860/5840] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:14 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1327 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:15.520782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:15.521480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:15.527972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:15.528644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:15.529474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:15.530355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:15.530809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:15.531403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:15.561421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:15.697378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:15.707146 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fa468f1-10cb-4efa-9e4d-930b5af116c5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1327 microversion: 2.1 time: 0.193058 Oct 25 03:35:15.707760 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2981/5841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:15 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1327 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:16.732912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:16.733855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:16.743861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:16.744369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:16.744912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:16.745804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:16.746260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:16.746692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:16.905467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:16.913941 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ff41d419-fcfe-4de0-97dc-0465beaba679 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1327 microversion: 2.1 time: 0.185853 Oct 25 03:35:16.914687 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2861/5842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:16 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:17.940015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:17.941524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:17.960375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:17.964814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:17.965805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:17.967246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:17.969158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:17.970792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:18.197590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:18.209344 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90027e25-b934-4002-8449-349313c63978 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1327 microversion: 2.1 time: 0.272121 Oct 25 03:35:18.210388 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2982/5843] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:17 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1327 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:19.232640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:19.233338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:19.241531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:19.242118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:19.242644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:19.243532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:19.244120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:19.244624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:19.443541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:19.452605 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-895c1612-7e96-4b36-900a-da09b516d99e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1327 microversion: 2.1 time: 0.223679 Oct 25 03:35:19.453147 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2862/5844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:19 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1327 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:19.811126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1334ea8d-323d-4423-a6c1-1d1cc42a8b7b req-9721100b-475b-48d5-a5c2-bd41caa9dd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33", "name": "network-vif-plugged", "status": "completed", "tag": "ab1087d6-b708-452e-9aa6-77d6a5b189bf"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:19.829471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1334ea8d-323d-4423-a6c1-1d1cc42a8b7b req-9721100b-475b-48d5-a5c2-bd41caa9dd43 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:19.830066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1334ea8d-323d-4423-a6c1-1d1cc42a8b7b req-9721100b-475b-48d5-a5c2-bd41caa9dd43 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:19.830507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1334ea8d-323d-4423-a6c1-1d1cc42a8b7b req-9721100b-475b-48d5-a5c2-bd41caa9dd43 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:19.848890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1334ea8d-323d-4423-a6c1-1d1cc42a8b7b req-9721100b-475b-48d5-a5c2-bd41caa9dd43 service nova] Creating event network-vif-plugged:ab1087d6-b708-452e-9aa6-77d6a5b189bf for instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 on n-h1-862355-1 Oct 25 03:35:19.875028 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1334ea8d-323d-4423-a6c1-1d1cc42a8b7b req-9721100b-475b-48d5-a5c2-bd41caa9dd43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067495 Oct 25 03:35:19.875601 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2983/5845] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:20.478361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:20.479561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:20.489854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:20.494016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:20.494855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:20.495306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:20.496027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:20.496572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:20.497167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:20.726872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:20.741212 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b9c866f6-1fa2-40be-a2df-b6edcc3b0883 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1327 microversion: 2.1 time: 0.268093 Oct 25 03:35:20.742647 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2863/5846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:20 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1327 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:21.766343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:21.767667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:21.776886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:21.777806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=10 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:21.780882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:21.781547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:21.782826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:21.784152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:21.784914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:21.785497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:22.283306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:22.293512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54685a1f-8484-4385-9bc3-29caecaeb572 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1507 microversion: 2.1 time: 0.532352 Oct 25 03:35:22.316857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:22.318173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:22.324833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:22.325319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:22.325801 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2984/5847] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:21 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:22.326721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:22.327857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:22.329054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:22.329783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:22.559268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:22.567513 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3511c373-6633-4114-ba1f-3f0340d18a2a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1507 microversion: 2.1 time: 0.254604 Oct 25 03:35:22.583456 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2864/5848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:22 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:35:22.596471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:22.596986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:22.605510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:22.606032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:22.606938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:22.607664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:22.608123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:22.608555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:22.641425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:35:22.728929 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3195641c-e426-4252-929c-af664b18d4be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 204 len: 0 microversion: 2.1 time: 0.139358 Oct 25 03:35:22.730221 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2985/5849] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:35:22 2022] DELETE /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:35:22.738927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:22.739747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:22.746083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:22.746675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:22.747187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:22.747974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:22.748503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:22.749591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:23.007498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:23.018767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3859380-c265-49a3-8eba-1401a8078590 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1513 microversion: 2.1 time: 0.284386 Oct 25 03:35:23.021916 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2865/5850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:22 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:24.048085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:24.049356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:24.057216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:24.057775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:24.058216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:24.059023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:24.059542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:24.060134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:24.379785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:24.390506 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-004257a9-9de5-4450-b455-a23061f96024 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1513 microversion: 2.1 time: 0.348031 Oct 25 03:35:24.393562 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2986/5851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:24 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:25.135098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-76cdc725-c6fb-4669-b9ed-cb5a49c39f1b req-67d81a4c-a86f-447c-85fa-5f4c3c5cb025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33", "name": "network-vif-deleted", "tag": "ab1087d6-b708-452e-9aa6-77d6a5b189bf"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:25.163988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-76cdc725-c6fb-4669-b9ed-cb5a49c39f1b req-67d81a4c-a86f-447c-85fa-5f4c3c5cb025 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:25.166448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-76cdc725-c6fb-4669-b9ed-cb5a49c39f1b req-67d81a4c-a86f-447c-85fa-5f4c3c5cb025 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:25.167703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-76cdc725-c6fb-4669-b9ed-cb5a49c39f1b req-67d81a4c-a86f-447c-85fa-5f4c3c5cb025 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:25.225140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-76cdc725-c6fb-4669-b9ed-cb5a49c39f1b req-67d81a4c-a86f-447c-85fa-5f4c3c5cb025 service nova] Creating event network-vif-deleted:ab1087d6-b708-452e-9aa6-77d6a5b189bf for instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 on n-h1-862355-1 Oct 25 03:35:25.238678 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-76cdc725-c6fb-4669-b9ed-cb5a49c39f1b req-67d81a4c-a86f-447c-85fa-5f4c3c5cb025 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108540 Oct 25 03:35:25.239313 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2866/5852] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:25.418768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:25.420553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:25.430358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:25.431147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:25.431770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:25.432642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:25.433827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:25.434408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:25.472667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:25.473142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:25.473571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:25.474071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lazy-loading 'fault' on Instance uuid c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:35:25.519946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:25.529380 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd5958a2-feb0-4f5f-988d-f702fe377455 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 200 len: 1317 microversion: 2.1 time: 0.116294 Oct 25 03:35:25.530090 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2987/5853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:25 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 1317 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:26.557223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:26.557927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:26.569425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:26.569942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:26.570387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:26.571098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:26.571568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:26.571991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:26.589452 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 HTTP/1.1 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33'} Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:26.591174 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02df237e-d923-41d2-8425-51596bb64b3e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 404 len: 111 microversion: 2.1 time: 0.041095 Oct 25 03:35:26.597325 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2867/5854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:26 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:35:26.602597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-be1e2298-3221-48bc-9f6c-3c170621c8f2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '.version_select at 0x7efd326b0700>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:26.611060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:26.626700 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-be1e2298-3221-48bc-9f6c-3c170621c8f2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-key-255672261" status: 202 len: 0 microversion: 2.1 time: 0.027775 Oct 25 03:35:26.627605 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2988/5855] 10.222.0.36 () {58 vars in 1206 bytes} [Tue Oct 25 03:35:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-255672261 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:35:26.742656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2036195608", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "89c4e82f-3c5d-498c-ad61-d6c45bb94847"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:26.805817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:35:27.511025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:35:27.511816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:35:27.512619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:35:27.513538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:35:27.514482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:35:27.524723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:27.525474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:27.526323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:27.527492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:27.528143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:27.528759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:27.550550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:35:27.557968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:35:27.571886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:35:27.574253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:35:27.638224 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-defdaf76-a7c2-4056-b85c-e40fc61a9434 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901214 Oct 25 03:35:27.639521 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2868/5856] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:35:27.657536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-732aa8c9-e5cd-439d-a752-d03e2cd418be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:27.659675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-732aa8c9-e5cd-439d-a752-d03e2cd418be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:27.732581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-732aa8c9-e5cd-439d-a752-d03e2cd418be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:27.741636 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-732aa8c9-e5cd-439d-a752-d03e2cd418be tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1209 microversion: 2.1 time: 0.093569 Oct 25 03:35:27.742495 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2989/5857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:27 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:28.766912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:28.767548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:28.775470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:28.776207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:28.776792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:28.777657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:28.778311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:28.778739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:28.861888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:28.870889 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f686c956-0ba7-4924-9b1f-9878870bd233 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1261 microversion: 2.1 time: 0.109128 Oct 25 03:35:28.871927 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2869/5858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:28 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:29.895916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:29.896544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:29.909614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:29.910134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:29.910585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:29.911302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:29.911762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:29.912198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:30.182850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:30.196674 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8203c1ae-6535-4212-a36f-96b3a2ef7cb1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.305557 Oct 25 03:35:30.197404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2990/5859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:29 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:30.540423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e076e89e-833b-4678-b708-81c84060909b req-87c4f405-49be-47c5-b4d9-09e1af16589c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4b3559-c2d0-465c-9684-8c8b2451b132", "tag": "3a488042-162e-4f1b-ab17-58f157402d4f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:30.578043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e076e89e-833b-4678-b708-81c84060909b req-87c4f405-49be-47c5-b4d9-09e1af16589c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:30.579164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e076e89e-833b-4678-b708-81c84060909b req-87c4f405-49be-47c5-b4d9-09e1af16589c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:30.579608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e076e89e-833b-4678-b708-81c84060909b req-87c4f405-49be-47c5-b4d9-09e1af16589c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:30.595748 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e076e89e-833b-4678-b708-81c84060909b req-87c4f405-49be-47c5-b4d9-09e1af16589c service nova] Creating event network-changed:3a488042-162e-4f1b-ab17-58f157402d4f for instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 on n-h1-862355-1 Oct 25 03:35:30.615359 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e076e89e-833b-4678-b708-81c84060909b req-87c4f405-49be-47c5-b4d9-09e1af16589c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080246 Oct 25 03:35:30.615862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2870/5860] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:31.223158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:31.223806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:31.231160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:31.231857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:31.232295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:31.233143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:31.233607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:31.234058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:31.459853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:31.468297 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-efec690c-f053-47bb-a431-3c64ef814508 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.251345 Oct 25 03:35:31.469781 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2991/5861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:31 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:32.492932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:32.493805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:32.497117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:32.509793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:32.511446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:32.515632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:32.516719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:32.517352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:32.518001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:32.523468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=76 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:32.836520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:32.848411 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-59d80f20-8c61-4aaa-8a05-d94f0a606c18 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.359710 Oct 25 03:35:32.849024 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2871/5862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:32 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:33.876941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:33.886516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:33.895653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:33.896653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:33.897507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:33.898505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:33.899381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:33.900030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:34.080160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:34.087985 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93144316-09c7-4f17-a16d-0993ef1dbb8c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.216620 Oct 25 03:35:34.098355 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2992/5863] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:33 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:35.112131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:35.112758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:35.120347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:35.120831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:35.121554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:35.122316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:35.122778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:35.123481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:35.284816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:35.293974 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9bcb9d1-613b-4428-9edd-a8a7d8ac6761 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.186468 Oct 25 03:35:35.295321 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2872/5864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:35 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:36.319580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:36.322883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:36.336538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:36.337036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:36.337475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:36.338320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:36.338910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:36.339439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:36.528003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:36.538022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-02154dfd-61d2-48d0-8dd1-b48da9d47cb5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.222457 Oct 25 03:35:36.539165 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2993/5865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:36 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:37.085628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:37.088009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:37.095385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:37.095852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:37.096313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:37.096994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:37.097757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:37.098648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:37.161958 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2f11700-1277-49f5-851f-8cbdd06390b6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c/action" status: 200 len: 24574 microversion: 2.1 time: 0.085209 Oct 25 03:35:37.162751 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2873/5866] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:35:37 2022] POST /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c/action => generated 24574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:35:37.565618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:37.567004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:37.575201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:37.575956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:37.576411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:37.577135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:37.577798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:37.578243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:37.738326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:37.879356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-53aff9c3-9efc-4309-9ed0-4b1fc8666c6a req-8818d12b-4879-4518-8c72-fc301129a978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4b3559-c2d0-465c-9684-8c8b2451b132", "name": "network-vif-plugged", "status": "completed", "tag": "3a488042-162e-4f1b-ab17-58f157402d4f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:37.890527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:37.893301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:37.903883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53aff9c3-9efc-4309-9ed0-4b1fc8666c6a req-8818d12b-4879-4518-8c72-fc301129a978 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:37.913485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53aff9c3-9efc-4309-9ed0-4b1fc8666c6a req-8818d12b-4879-4518-8c72-fc301129a978 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:37.914161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53aff9c3-9efc-4309-9ed0-4b1fc8666c6a req-8818d12b-4879-4518-8c72-fc301129a978 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:37.938011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-53aff9c3-9efc-4309-9ed0-4b1fc8666c6a req-8818d12b-4879-4518-8c72-fc301129a978 service nova] Creating event network-vif-plugged:3a488042-162e-4f1b-ab17-58f157402d4f for instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 on n-h1-862355-1 Oct 25 03:35:37.951386 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-53aff9c3-9efc-4309-9ed0-4b1fc8666c6a req-8818d12b-4879-4518-8c72-fc301129a978 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076851 Oct 25 03:35:37.952315 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2874/5867] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:37.995206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:38.019478 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d7e04cc-7844-4cd4-9d0c-311ebc3da784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.458501 Oct 25 03:35:38.020076 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2994/5868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:37 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:39.043661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:39.044607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:39.052844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:39.053335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:39.053803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:39.054509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:39.054966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:39.055397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:39.756295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:39.764358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7faf50c6-daa5-499b-aa5e-e1ed0a86d64d tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1309 microversion: 2.1 time: 0.725026 Oct 25 03:35:39.764947 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2875/5869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:39 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1309 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:40.788554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:40.789773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:40.797852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:40.798642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:40.799270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:40.800284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:40.800654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:40.801348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:40.976364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:40.985796 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-673a5775-5dfa-4f5a-b5ab-41f3687481f9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1490 microversion: 2.1 time: 0.201577 Oct 25 03:35:40.986287 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2995/5870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:40 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1490 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:41.126174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2036195608", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "89c4e82f-3c5d-498c-ad61-d6c45bb94847"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:41.200142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:35:41.755150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:35:41.755582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:35:41.756065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:35:41.756480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:35:41.756900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:35:41.767725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:41.768244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:41.768644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:41.769381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:41.770131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:41.770570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:41.790180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:35:41.795747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:35:41.808634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:35:41.811086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:35:41.862870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1dbb511-5a7d-40bd-81d9-76852b09903b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741026 Oct 25 03:35:41.863657 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2876/5871] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:35:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:35:41.876538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f88c0595-e0a9-4a92-a282-d64ae743c784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:41.877321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f88c0595-e0a9-4a92-a282-d64ae743c784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:41.947740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f88c0595-e0a9-4a92-a282-d64ae743c784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:41.960714 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f88c0595-e0a9-4a92-a282-d64ae743c784 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1209 microversion: 2.1 time: 0.089471 Oct 25 03:35:41.974126 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2996/5872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:41 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:42.146319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:42.148970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:42.157133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:42.157777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:42.158262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:42.159345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:42.159975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:42.160406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:42.218301 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4590ec8-ee64-4809-92cd-ca362ca005bb tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076202 Oct 25 03:35:42.219348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2877/5873] 10.222.0.36 () {60 vars in 1343 bytes} [Tue Oct 25 03:35:42 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:42.292144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:42.292944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:42.303466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:42.304136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:42.304772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:42.305472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:42.306134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:42.306925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:42.335699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:35:42.454283 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f58fe998-45cf-4220-81eb-371ff41bb077 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 204 len: 0 microversion: 2.20 time: 0.164728 Oct 25 03:35:42.455193 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2997/5874] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:35:42 2022] DELETE /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:35:42.465976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:42.466712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:42.475453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:42.475821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:42.476431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:42.477140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:42.477819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:42.478577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:42.674447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:42.680254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:42.681717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:42.683397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a2fee1c5-4f99-4bb1-b315-141d5456ea60 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.223282 Oct 25 03:35:42.684067 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2878/5875] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:35:42 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:35:42.986218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:42.986941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:42.997967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:43.000678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:43.004110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:43.006400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:43.008518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:43.008977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:43.020301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:43.101381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:43.110709 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-60a47f99-74fc-4e6f-86e2-880aac0fe4a1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1205 microversion: 2.1 time: 0.129690 Oct 25 03:35:43.111369 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2998/5876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:42 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1205 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:43.711234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:43.712035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:43.720506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:43.721153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:43.721842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:43.722936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:43.723537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:43.724101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:43.925805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:43.936487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:43.939409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:43.941806 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e4b3ef7-0470-4c88-96e4-e3548cb8ff73 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1724 microversion: 2.20 time: 0.235608 Oct 25 03:35:43.942399 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2879/5877] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:35:43 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:35:44.134755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:44.135596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:44.153634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:44.153634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:44.153634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:44.153634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:44.153634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:44.153634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:44.371121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:44.392969 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51422eee-80d5-4cb7-ad30-1d209422d94b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1261 microversion: 2.1 time: 0.262089 Oct 25 03:35:44.408941 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 2999/5878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:44 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1261 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:44.969472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:44.972769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:44.984268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:44.986379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:44.986984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:44.990687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:44.991829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:44.992591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:45.113015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:45.134185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:45.136228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:45.142213 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c6fd2e88-dfa6-4d20-9e5c-b9077ad7f40c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1657 microversion: 2.20 time: 0.175142 Oct 25 03:35:45.142985 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2880/5879] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:35:44 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1657 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:35:45.425906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:45.428333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:45.441877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:45.443550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:45.445264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:45.447354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:45.448120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:45.449593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:45.944205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:45.952854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4851c908-b07f-4406-abae-f4b3f4fbcb84 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1267 microversion: 2.1 time: 0.534305 Oct 25 03:35:45.957718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3000/5880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:45 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1267 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:46.035333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1303a00c-efcd-4df4-b1a0-35862ee962f5 req-2c0ed815-f7dd-4352-b399-0897cc858c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e876c67-75d1-4207-b711-1ec24fb64413", "name": "network-vif-deleted", "tag": "88a235e2-bc90-41e5-8661-26311d3d2e96"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:46.056772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1303a00c-efcd-4df4-b1a0-35862ee962f5 req-2c0ed815-f7dd-4352-b399-0897cc858c8c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:46.057375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1303a00c-efcd-4df4-b1a0-35862ee962f5 req-2c0ed815-f7dd-4352-b399-0897cc858c8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:46.063554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1303a00c-efcd-4df4-b1a0-35862ee962f5 req-2c0ed815-f7dd-4352-b399-0897cc858c8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:46.098699 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1303a00c-efcd-4df4-b1a0-35862ee962f5 req-2c0ed815-f7dd-4352-b399-0897cc858c8c service nova] Creating event network-vif-deleted:88a235e2-bc90-41e5-8661-26311d3d2e96 for instance 6e876c67-75d1-4207-b711-1ec24fb64413 on n-h2-862355-1 Oct 25 03:35:46.112849 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1303a00c-efcd-4df4-b1a0-35862ee962f5 req-2c0ed815-f7dd-4352-b399-0897cc858c8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083985 Oct 25 03:35:46.113711 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2881/5881] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:46.168825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:46.169806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:46.182790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:46.183540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:46.184057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:46.184972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:46.185510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:46.190333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:46.271437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:46.278740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:46.279402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:46.279982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lazy-loading 'fault' on Instance uuid 6e876c67-75d1-4207-b711-1ec24fb64413 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:35:46.401599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:46.416374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:46.417958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b8a3ce5bebf4745b1f095653b010f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb22a91945422f9fe1b9c5e85e0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:46.419306 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-72610841-cd2f-4e1c-b068-4c2587bfe1e9 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 200 len: 1371 microversion: 2.20 time: 0.254525 Oct 25 03:35:46.432988 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3001/5882] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:35:46 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:35:46.986068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:46.986933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:46.997574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:46.999654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:47.003173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:47.009248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:47.012671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:47.013356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:47.455328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:47.456668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:47.457291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:47.464509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:47.465189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:47.465801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:47.467182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:47.467785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:47.468384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:47.473895 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5c0149f2-55ac-4e32-8b32-0a428cf94d16 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1309 microversion: 2.1 time: 0.492423 Oct 25 03:35:47.475785 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2882/5883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:46 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1309 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:47.484611 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] HTTP exception thrown: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Request method failure captured: Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 HTTP/1.1 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1dmtkkQB6PVFo_t8zHwRBr8jAJ-rE4gtdLNmmO8-b8w_2Kf-xxhILQ5N7hCveszZ-9llVUjfG7lbfRDcXwsAVG0PDen8NBz8fKNUUcrGSw50mQvEjdoV0zRJmoRpIekoYqhfgEsA0uqllTM4-FxC8p51yArK7hUA8SUwTc3edwZPY4 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.20 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82eb22a91945422f9fe1b9c5e85e0aed", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82eb22a91945422f9fe1b9c5e85e0aed"}]}] Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9b8a3ce5bebf4745b1f095653b010f5e Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6e876c67-75d1-4207-b711-1ec24fb64413'} Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:47.486304 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:47.490798 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:47.492114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Returning 404 to user: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:35:47.493126 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a06b3e0a-9bff-47d7-ac21-19d1c5240956 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 404 len: 111 microversion: 2.20 time: 0.048178 Oct 25 03:35:47.493877 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3002/5884] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:35:47 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:35:47.503018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1fdbced2-9c02-4645-87f7-ba454e6b8e27 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '.version_select at 0x7efd3295bd30>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:47.556425 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1fdbced2-9c02-4645-87f7-ba454e6b8e27 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631483846" status: 204 len: 0 microversion: 2.20 time: 0.057797 Oct 25 03:35:47.560740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2883/5885] 10.222.0.36 () {60 vars in 1259 bytes} [Tue Oct 25 03:35:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631483846 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:35:48.270768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8ff51f12-f9c5-45e0-90cb-fca2eb8732ac req-3518dfd1-9a61-45e0-95b9-f464ad89db86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf", "tag": "78b0a507-bf53-479f-bb97-ac19aa94f0b1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:48.293055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8ff51f12-f9c5-45e0-90cb-fca2eb8732ac req-3518dfd1-9a61-45e0-95b9-f464ad89db86 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:48.294378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8ff51f12-f9c5-45e0-90cb-fca2eb8732ac req-3518dfd1-9a61-45e0-95b9-f464ad89db86 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:48.295241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8ff51f12-f9c5-45e0-90cb-fca2eb8732ac req-3518dfd1-9a61-45e0-95b9-f464ad89db86 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:48.333170 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8ff51f12-f9c5-45e0-90cb-fca2eb8732ac req-3518dfd1-9a61-45e0-95b9-f464ad89db86 service nova] Creating event network-changed:78b0a507-bf53-479f-bb97-ac19aa94f0b1 for instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf on n-h2-862355-1 Oct 25 03:35:48.345432 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8ff51f12-f9c5-45e0-90cb-fca2eb8732ac req-3518dfd1-9a61-45e0-95b9-f464ad89db86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078365 Oct 25 03:35:48.346316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3003/5886] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:35:48.498742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:48.499380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:48.516794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:48.517708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:48.518650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:48.520046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:48.520854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:48.521283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:48.855026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:48.878500 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ab7c5243-9da1-4b56-a88d-30c6096bf9c2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1309 microversion: 2.1 time: 0.380749 Oct 25 03:35:48.879611 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2884/5887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:48 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:49.904184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:49.905472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:49.914332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:49.915041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:49.915620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:49.916505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:49.917117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:49.917548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:50.112744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:50.127257 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a26143a3-d5c9-4346-ac5f-4ea47249abb6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1309 microversion: 2.1 time: 0.226990 Oct 25 03:35:50.143432 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3004/5888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:49 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:51.156232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:51.157440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:51.177531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:51.178315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:51.178916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:51.179827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:51.180719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:51.182776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:51.428525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:51.438897 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ccbc2db8-edb5-4eb1-9391-76716d5424e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1309 microversion: 2.1 time: 0.287882 Oct 25 03:35:51.440762 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2885/5889] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:51 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:52.465405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:52.466054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:52.475479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:52.477721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:52.478644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:52.479240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:52.480239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:52.480870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:52.481458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:52.716622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:52.728186 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cfebec21-cc59-4818-a3c5-ae5a88236391 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1309 microversion: 2.1 time: 0.267407 Oct 25 03:35:52.730662 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3005/5890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:52 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:53.256120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:53.256654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:53.259134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:53.259942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:53.277587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:53.279183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:53.280229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:53.282175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:53.283719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:53.284341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:53.307408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] HTTP exception thrown: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Request method failure captured: Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 HTTP/1.1 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1dmtkkQB6PVFo_t8zHwRBr8jAJ-rE4gtdLNmmO8-b8w_2Kf-xxhILQ5N7hCveszZ-9llVUjfG7lbfRDcXwsAVG0PDen8NBz8fKNUUcrGSw50mQvEjdoV0zRJmoRpIekoYqhfgEsA0uqllTM4-FxC8p51yArK7hUA8SUwTc3edwZPY4 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.20 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82eb22a91945422f9fe1b9c5e85e0aed", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82eb22a91945422f9fe1b9c5e85e0aed"}]}] Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 9b8a3ce5bebf4745b1f095653b010f5e Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '6e876c67-75d1-4207-b711-1ec24fb64413'} Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:35:53.309314 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Returning 404 to user: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e759e66a-1c2b-4013-8bae-54b6ca990a0c tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 404 len: 111 microversion: 2.20 time: 0.059406 Oct 25 03:35:53.314186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2886/5891] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:35:53 2022] DELETE /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:35:53.320463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:53.321179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 6e876c67-75d1-4207-b711-1ec24fb64413] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:53.329776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:53.330645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:53.331162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:53.331929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:53.332448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:53.333067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:53.350139 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] HTTP exception thrown: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Request method failure captured: Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 HTTP/1.1 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1dmtkkQB6PVFo_t8zHwRBr8jAJ-rE4gtdLNmmO8-b8w_2Kf-xxhILQ5N7hCveszZ-9llVUjfG7lbfRDcXwsAVG0PDen8NBz8fKNUUcrGSw50mQvEjdoV0zRJmoRpIekoYqhfgEsA0uqllTM4-FxC8p51yArK7hUA8SUwTc3edwZPY4 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.20 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82eb22a91945422f9fe1b9c5e85e0aed", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82eb22a91945422f9fe1b9c5e85e0aed"}]}] Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9b8a3ce5bebf4745b1f095653b010f5e Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6e876c67-75d1-4207-b711-1ec24fb64413'} Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.352252 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. Oct 25 03:35:53.356586 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:53.359046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Returning 404 to user: Instance 6e876c67-75d1-4207-b711-1ec24fb64413 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:35:53.361521 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d29a124a-643c-46d4-a630-2b48376a23af tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413" status: 404 len: 111 microversion: 2.20 time: 0.044285 Oct 25 03:35:53.363404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3006/5892] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:35:53 2022] GET /compute/v2.1/servers/6e876c67-75d1-4207-b711-1ec24fb64413 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:35:53.753301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:53.754558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:53.768722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:53.769229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:53.769702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:53.774958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:53.775459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:53.776061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:53.974678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-93a30c56-3ca6-4433-8be0-684fe521ae6b req-8661fbc7-9f91-44f6-b7f1-32a57155cf75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf", "name": "network-vif-plugged", "status": "completed", "tag": "78b0a507-bf53-479f-bb97-ac19aa94f0b1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:35:53.991379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-93a30c56-3ca6-4433-8be0-684fe521ae6b req-8661fbc7-9f91-44f6-b7f1-32a57155cf75 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:53.992202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-93a30c56-3ca6-4433-8be0-684fe521ae6b req-8661fbc7-9f91-44f6-b7f1-32a57155cf75 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:53.992845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-93a30c56-3ca6-4433-8be0-684fe521ae6b req-8661fbc7-9f91-44f6-b7f1-32a57155cf75 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:54.007757 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-93a30c56-3ca6-4433-8be0-684fe521ae6b req-8661fbc7-9f91-44f6-b7f1-32a57155cf75 service nova] Creating event network-vif-plugged:78b0a507-bf53-479f-bb97-ac19aa94f0b1 for instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf on n-h2-862355-1 Oct 25 03:35:54.016857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-93a30c56-3ca6-4433-8be0-684fe521ae6b req-8661fbc7-9f91-44f6-b7f1-32a57155cf75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048038 Oct 25 03:35:54.018435 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3007/5893] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:35:54.086991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:54.106509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d2f0bf2-d05b-4301-9044-74492e9709b5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1309 microversion: 2.1 time: 0.357844 Oct 25 03:35:54.107508 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2887/5894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:53 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:55.137833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:55.139773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:55.188826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:55.190074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:55.190537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:55.199636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:55.202340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:55.202812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:55.452865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:55.468085 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7dbe0200-300a-44d0-92ee-2ad307ee460f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1309 microversion: 2.1 time: 0.336321 Oct 25 03:35:55.489896 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3008/5895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:55 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:56.504433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:56.505456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:56.523167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:56.523803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:56.524358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:56.525277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:56.525870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:56.526513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:56.727903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:56.740327 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-175a0798-a61b-49e4-9bc1-177b5aa90dab tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1490 microversion: 2.1 time: 0.241303 Oct 25 03:35:56.741507 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2888/5896] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:56 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1490 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:56.767279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:56.768912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:56.780221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:35:56.784185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:56.787911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:56.789310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:56.793108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:56.794242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:56.795699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.160865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:57.169006 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0121e09-adc9-45d4-aca6-81b9d931db80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1490 microversion: 2.1 time: 0.408211 Oct 25 03:35:57.170158 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3009/5897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:56 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1490 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:57.193193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:57.193856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:57.200034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.200531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.200971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.202004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.202455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.203153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.467194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:57.477318 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1a9dd7f-4a49-4c8f-84ab-b9249e50fadb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1490 microversion: 2.1 time: 0.287761 Oct 25 03:35:57.478369 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2889/5898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:57 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1490 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:35:57.503956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:57.504734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:57.512850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.519670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.520381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.521332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.522037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.522684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.551952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:35:57.663127 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bb10594c-d877-4093-afc0-cb1a8a90d0c1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 204 len: 0 microversion: 2.1 time: 0.163238 Oct 25 03:35:57.664044 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3010/5899] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:35:57 2022] DELETE /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:35:57.672922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:57.673539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:57.688526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.688526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.688869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.689747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.690175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.690602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.841082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:57.841530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:57.851205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.852180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.864532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.866011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.869384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.870130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.894425 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] HTTP exception thrown: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Request method failure captured: Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d HTTP/1.1 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1dmtkkQB6PVFo_t8zHwRBr8jAJ-rE4gtdLNmmO8-b8w_2Kf-xxhILQ5N7hCveszZ-9llVUjfG7lbfRDcXwsAVG0PDen8NBz8fKNUUcrGSw50mQvEjdoV0zRJmoRpIekoYqhfgEsA0uqllTM4-FxC8p51yArK7hUA8SUwTc3edwZPY4 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.20 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82eb22a91945422f9fe1b9c5e85e0aed", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82eb22a91945422f9fe1b9c5e85e0aed"}]}] Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9b8a3ce5bebf4745b1f095653b010f5e Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '607eba3e-2e4d-4aad-9dcd-a91d25ed665d'} Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:35:57.896102 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.900289 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.902361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Returning 404 to user: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:35:57.903407 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-306a0f7d-2221-413e-a46e-fa848ef96f0e tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "DELETE /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 404 len: 111 microversion: 2.20 time: 0.066709 Oct 25 03:35:57.904401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3011/5900] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:35:57 2022] DELETE /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 25 03:35:57.916458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:57.920993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] [instance: 607eba3e-2e4d-4aad-9dcd-a91d25ed665d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:57.927480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.928366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.928989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.930484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:57.931125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:57.931843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:57.948589 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] HTTP exception thrown: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Request method failure captured: Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d HTTP/1.1 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1dmtkkQB6PVFo_t8zHwRBr8jAJ-rE4gtdLNmmO8-b8w_2Kf-xxhILQ5N7hCveszZ-9llVUjfG7lbfRDcXwsAVG0PDen8NBz8fKNUUcrGSw50mQvEjdoV0zRJmoRpIekoYqhfgEsA0uqllTM4-FxC8p51yArK7hUA8SUwTc3edwZPY4 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Openstack-Nova-Api-Version: 2.20 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82eb22a91945422f9fe1b9c5e85e0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82eb22a91945422f9fe1b9c5e85e0aed", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82eb22a91945422f9fe1b9c5e85e0aed"}]}] Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 82eb22a91945422f9fe1b9c5e85e0aed Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-182502925 Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 9b8a3ce5bebf4745b1f095653b010f5e Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-182502925-project Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '607eba3e-2e4d-4aad-9dcd-a91d25ed665d'} Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.950733 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. Oct 25 03:35:57.954675 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:35:57.956391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] Returning 404 to user: Instance 607eba3e-2e4d-4aad-9dcd-a91d25ed665d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:35:57.957426 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6184c3d5-c43d-42d1-abaf-5d8a667899b4 tempest-AttachVolumeShelveTestJSON-182502925 tempest-AttachVolumeShelveTestJSON-182502925-project] 10.222.0.36 "GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d" status: 404 len: 111 microversion: 2.20 time: 0.048062 Oct 25 03:35:57.958582 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3012/5901] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:35:57 2022] GET /compute/v2.1/servers/607eba3e-2e4d-4aad-9dcd-a91d25ed665d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:35:57.968049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:57.983227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8571dd91-0e0b-4cd2-9b11-884b0d2227cf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1496 microversion: 2.1 time: 0.314629 Oct 25 03:35:57.986672 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2890/5902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:57 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1496 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:35:59.011890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:35:59.013571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:35:59.023697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:59.024448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:59.024989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:59.026201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:35:59.026861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:35:59.027481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:35:59.345195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:35:59.354763 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-95177318-5c90-4479-ada8-f6160f4f02ee tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1496 microversion: 2.1 time: 0.346591 Oct 25 03:35:59.373916 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3013/5903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:35:59 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1496 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:00.357828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f19360ac-a784-4461-8b2e-a4159b10b1bc req-10d7f49e-78bd-4e3d-aadb-d83c1b4b2b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf", "name": "network-vif-deleted", "tag": "78b0a507-bf53-479f-bb97-ac19aa94f0b1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:00.383613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:00.384314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:00.399002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:00.402675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:00.404668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f19360ac-a784-4461-8b2e-a4159b10b1bc req-10d7f49e-78bd-4e3d-aadb-d83c1b4b2b33 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:00.405333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:00.405771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f19360ac-a784-4461-8b2e-a4159b10b1bc req-10d7f49e-78bd-4e3d-aadb-d83c1b4b2b33 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:00.407361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:00.409116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:00.409818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:00.433406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f19360ac-a784-4461-8b2e-a4159b10b1bc req-10d7f49e-78bd-4e3d-aadb-d83c1b4b2b33 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:00.469367 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f19360ac-a784-4461-8b2e-a4159b10b1bc req-10d7f49e-78bd-4e3d-aadb-d83c1b4b2b33 service nova] Creating event network-vif-deleted:78b0a507-bf53-479f-bb97-ac19aa94f0b1 for instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf on n-h2-862355-1 Oct 25 03:36:00.488560 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f19360ac-a784-4461-8b2e-a4159b10b1bc req-10d7f49e-78bd-4e3d-aadb-d83c1b4b2b33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136357 Oct 25 03:36:00.489874 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2891/5904] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:00.570254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:00.595346 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-325c894f-dbbc-4cf2-ac9f-4b40ee130ac8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 200 len: 1294 microversion: 2.1 time: 0.218133 Oct 25 03:36:00.598587 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3014/5905] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:00 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:00.740827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-140377657", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "1eb0bad2-6a68-4f73-adcf-10e84de8c696"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:00.805472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] validate_networks() for [('1eb0bad2-6a68-4f73-adcf-10e84de8c696', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:36:01.620582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:01.621189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:01.629764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.630657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.631327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:01.632271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.633249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.634485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:01.650505 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf HTTP/1.1 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf'} Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:01.652446 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:01.656577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:01.656577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:01.656577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:36:01.656577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:36:01.656577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:36:01.656577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:01.659329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:36:01.660807 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b5a22c85-e3e8-4641-b22d-b8629a4b8205 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 404 len: 111 microversion: 2.1 time: 0.044087 Oct 25 03:36:01.661919 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3015/5906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:01 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:36:01.670650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:36:01.671147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:36:01.672340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:01.673056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:36:01.673285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:36:01.674249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:01.674359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:36:01.684337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.685187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.686078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:01.687034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.688371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.689045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:01.693590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.694175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.694627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:01.696004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.697373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.697996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:01.722558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:36:01.725971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Getting quotas for project 85de6b31ded749959cecc26eb1fa9cc9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:01.736501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Getting quotas for user e019f7f29f2d45d6b3e09676383cc8cb and project 85de6b31ded749959cecc26eb1fa9cc9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:01.755195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:36:01.757762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:01.760174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:36:01.857143 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e1272be-8677-4251-a6b7-2191353d90d6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.301942 Oct 25 03:36:01.865246 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2892/5907] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:36:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:36:01.881907 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46f108c6-0e31-42c7-a62d-6c56f80984fc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 204 len: 0 microversion: 2.1 time: 0.214814 Oct 25 03:36:01.882017 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3016/5908] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:36:01 2022] DELETE /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:36:01.891339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:01.892054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:01.892778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-beaa54eb-b620-4642-b9eb-719346bd8b41 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:01.897790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-beaa54eb-b620-4642-b9eb-719346bd8b41 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:01.906356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.907048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.907669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:01.908545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:01.909160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:01.909849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:02.047706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-beaa54eb-b620-4642-b9eb-719346bd8b41 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:02.058959 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-beaa54eb-b620-4642-b9eb-719346bd8b41 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1214 microversion: 2.1 time: 0.191411 Oct 25 03:36:02.059560 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2893/5909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:01 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:02.276767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:02.288518 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8cbc53dd-d281-4b3a-97dc-6913d7576769 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1496 microversion: 2.1 time: 0.401838 Oct 25 03:36:02.289739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3017/5910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:01 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1496 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:03.085114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:03.085709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:03.088456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:03.097146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:03.097652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:03.098253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:03.098970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:03.099433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:03.100154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:03.108675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:03.231865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:03.246944 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-594fdcf5-eb22-48ec-8398-ea29de50d555 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1266 microversion: 2.1 time: 0.165712 Oct 25 03:36:03.266629 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2894/5911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:03 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:03.321433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:03.322616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:03.333037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:03.334621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:03.335251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:03.336152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:03.337714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:03.339256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:03.719972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:03.728502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-767fb40b-5ed5-42e6-b5fe-002893e83f0b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1496 microversion: 2.1 time: 0.411728 Oct 25 03:36:03.729977 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3018/5912] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:03 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1496 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:04.276475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:04.277454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:04.287180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:04.287835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:04.288364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:04.289143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:04.289723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:04.290248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:04.395566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:04.412158 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-31cda938-902b-418c-9a7e-21718fbda7c3 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1272 microversion: 2.1 time: 0.137081 Oct 25 03:36:04.413104 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2895/5913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:04 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:04.639123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-91f87942-eea9-41d1-96d7-93f371d4f8f5 req-866025c5-21d4-40c1-a6b5-0487161a25dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4b3559-c2d0-465c-9684-8c8b2451b132", "name": "network-vif-deleted", "tag": "3a488042-162e-4f1b-ab17-58f157402d4f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:04.676725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-91f87942-eea9-41d1-96d7-93f371d4f8f5 req-866025c5-21d4-40c1-a6b5-0487161a25dc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:04.677240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-91f87942-eea9-41d1-96d7-93f371d4f8f5 req-866025c5-21d4-40c1-a6b5-0487161a25dc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:04.677668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-91f87942-eea9-41d1-96d7-93f371d4f8f5 req-866025c5-21d4-40c1-a6b5-0487161a25dc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:04.706873 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-91f87942-eea9-41d1-96d7-93f371d4f8f5 req-866025c5-21d4-40c1-a6b5-0487161a25dc service nova] Creating event network-vif-deleted:3a488042-162e-4f1b-ab17-58f157402d4f for instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 on n-h1-862355-1 Oct 25 03:36:04.717240 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-91f87942-eea9-41d1-96d7-93f371d4f8f5 req-866025c5-21d4-40c1-a6b5-0487161a25dc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082940 Oct 25 03:36:04.718782 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3019/5914] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:04.754917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:04.755935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:04.769936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:04.770692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:04.771334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:04.772390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:04.772997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:04.773568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:04.852864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:04.853829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:04.855449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:04.856118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lazy-loading 'fault' on Instance uuid 2f4b3559-c2d0-465c-9684-8c8b2451b132 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:36:04.943534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:04.958168 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2f1af8dc-f898-4c12-8f97-f6cb33b1a4ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 200 len: 1299 microversion: 2.1 time: 0.208725 Oct 25 03:36:04.962981 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2896/5915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:04 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:05.437818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:05.439327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:05.449955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:05.450461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:05.450908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:05.451839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:05.452308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:05.452742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:05.903108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:05.916806 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f866cbd5-dbe8-4f6a-a373-6d7bc39e4bfc tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.483994 Oct 25 03:36:05.917570 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3020/5916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:05 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:05.990504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:05.991299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:06.004713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:06.005475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:06.007009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:06.007965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:06.008636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:06.009262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:06.042124 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 HTTP/1.1 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '2f4b3559-c2d0-465c-9684-8c8b2451b132'} Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:06.045552 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d582f5a9-519c-4c9a-aa66-f8a5439f87e0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 404 len: 111 microversion: 2.1 time: 0.065777 Oct 25 03:36:06.055346 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2897/5917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:05 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:36:06.203881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-97300098", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "89c4e82f-3c5d-498c-ad61-d6c45bb94847"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:06.267204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:36:06.941205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:06.941878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:06.955202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:06.955706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:06.956158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:06.956878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:06.957348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:06.957822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:07.342224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:07.365017 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-32d3e800-2503-4a08-b9a8-a189168a4137 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.428083 Oct 25 03:36:07.366403 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2898/5918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:06 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:07.387390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-78518dce-8c36-4365-8551-703ff3c1553e req-0e162e93-08cc-4aee-9f47-af777dff7da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8001b02-712b-4c87-b6ca-c66ffb02146e", "tag": "0d8acc22-be5b-4ab6-b9a0-c34c48b1f730"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:07.414881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-78518dce-8c36-4365-8551-703ff3c1553e req-0e162e93-08cc-4aee-9f47-af777dff7da2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:07.415392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-78518dce-8c36-4365-8551-703ff3c1553e req-0e162e93-08cc-4aee-9f47-af777dff7da2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:07.418043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-78518dce-8c36-4365-8551-703ff3c1553e req-0e162e93-08cc-4aee-9f47-af777dff7da2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:07.443413 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-78518dce-8c36-4365-8551-703ff3c1553e req-0e162e93-08cc-4aee-9f47-af777dff7da2 service nova] Creating event network-changed:0d8acc22-be5b-4ab6-b9a0-c34c48b1f730 for instance d8001b02-712b-4c87-b6ca-c66ffb02146e on n-h2-862355-1 Oct 25 03:36:07.459754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-78518dce-8c36-4365-8551-703ff3c1553e req-0e162e93-08cc-4aee-9f47-af777dff7da2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091889 Oct 25 03:36:07.460434 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2899/5919] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:07.502608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:36:07.503554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:36:07.504469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:36:07.505033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:36:07.505592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:36:07.522738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:07.525791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:07.526631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:07.527550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:07.535118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:07.535800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:07.576198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:07.596338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:07.621584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:36:07.627910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:36:07.771791 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f1861e72-aef5-46d8-8282-8c51a3af6de1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566763 Oct 25 03:36:07.778697 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3021/5920] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:36:07.785268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36fffb00-760a-46fd-a20d-da7966931ab4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:07.786242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-36fffb00-760a-46fd-a20d-da7966931ab4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:07.967936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36fffb00-760a-46fd-a20d-da7966931ab4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:07.979176 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36fffb00-760a-46fd-a20d-da7966931ab4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1207 microversion: 2.1 time: 0.198620 Oct 25 03:36:07.984857 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2900/5921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:07 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1207 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:08.389710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:08.393577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:08.408873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:08.414395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:08.415066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:08.422158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:08.423134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:08.423835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:08.744781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:08.756509 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba042603-623d-4549-b082-27328bdd7ce7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.371758 Oct 25 03:36:08.757520 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3022/5922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:08 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:09.017390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:09.026181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:09.035553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:09.036058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:09.036503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:09.037217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:09.041236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:09.042030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:09.163691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:09.173178 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4dde300b-5245-44dc-874b-8a469f6db88b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1259 microversion: 2.1 time: 0.160616 Oct 25 03:36:09.174088 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2901/5923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:09 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:09.782032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:09.782559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:09.795335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:09.795987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:09.796441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:09.797207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:09.797804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:09.798248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:10.198834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:10.200068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:10.207398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:10.208273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:10.209014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:10.209966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:10.210637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:10.211298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:10.319928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:10.338854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-35d06e44-8552-4122-ab22-8543d0e3f71e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.560757 Oct 25 03:36:10.340827 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3023/5924] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:09 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:10.771724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:10.782259 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2f5d2312-c1b0-496d-bad9-19dae0179ba5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1265 microversion: 2.1 time: 0.586580 Oct 25 03:36:10.783540 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2902/5925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:10 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1265 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:11.366784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:11.367945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:11.389665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:11.390128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:11.390893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:11.391832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:11.392312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:11.392873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:11.809384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:11.810744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:11.822886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:11.836533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:11.840156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:11.840808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:11.841787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:11.844838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:11.845749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:11.925344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:11.933814 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-86fbeebb-8bf6-4537-b65f-dece2dbc56de tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.572569 Oct 25 03:36:11.935034 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3024/5926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:11 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:12.284448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:12.293031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-578d40bc-3840-4428-bc0e-393d1951c09c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.489708 Oct 25 03:36:12.297717 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2903/5927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:11 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:12.962120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:12.963362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:12.981301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:12.982080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:12.982683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:12.983594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:12.984657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:12.985255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:13.231654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:13.256709 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5ef5d570-3547-4f89-a1be-9f3c835f1c37 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.292006 Oct 25 03:36:13.278876 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3025/5928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:12 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:13.289244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-dd4db1c7-b8e9-47f0-8144-9b5fb02f7712 req-6cb87ee4-38ad-4887-8b24-dd286bdf7f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18345b4-72e0-4e61-9570-a442554d4d90", "tag": "3999af3d-329b-429d-ae8d-38ac22bf9b05"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:13.319156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:13.319979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:13.324639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dd4db1c7-b8e9-47f0-8144-9b5fb02f7712 req-6cb87ee4-38ad-4887-8b24-dd286bdf7f17 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:13.328920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:13.329412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:13.329891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dd4db1c7-b8e9-47f0-8144-9b5fb02f7712 req-6cb87ee4-38ad-4887-8b24-dd286bdf7f17 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:13.330532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dd4db1c7-b8e9-47f0-8144-9b5fb02f7712 req-6cb87ee4-38ad-4887-8b24-dd286bdf7f17 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:13.335773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:13.336762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:13.337240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:13.337670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:13.362451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-dd4db1c7-b8e9-47f0-8144-9b5fb02f7712 req-6cb87ee4-38ad-4887-8b24-dd286bdf7f17 service nova] Creating event network-changed:3999af3d-329b-429d-ae8d-38ac22bf9b05 for instance e18345b4-72e0-4e61-9570-a442554d4d90 on n-h1-862355-1 Oct 25 03:36:13.372373 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-dd4db1c7-b8e9-47f0-8144-9b5fb02f7712 req-6cb87ee4-38ad-4887-8b24-dd286bdf7f17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085847 Oct 25 03:36:13.373364 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2904/5929] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:13.670330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:13.682729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-997d99d3-4d99-40be-9e3e-8ce15ec15cf5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.367512 Oct 25 03:36:13.683864 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3026/5930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:13 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:13.841109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0fcaa9a-aa49-4c34-b653-abfaa45ae1aa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: .version_select at 0x7efd33feaaf0>, body: {"keypair": {"name": "tempest-keypair-1671402907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7D03nhuLit1loelC86LuP33O6ne/IPQCe8U4tDW86/3XBaSeX7KyQYlLq+f3e7LyktOLf1D+EpOQNIPo8gIK8EaIuu7X8iBsLew/plzXHCZ8BfvA5XlBkP15SUVU2jMA=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:13.880028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a0fcaa9a-aa49-4c34-b653-abfaa45ae1aa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:13.887482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a0fcaa9a-aa49-4c34-b653-abfaa45ae1aa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:13.926572 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0fcaa9a-aa49-4c34-b653-abfaa45ae1aa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.319254 Oct 25 03:36:13.927817 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2905/5931] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:36:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:36:14.287717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:14.288777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:14.301214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:14.301898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:14.302491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:14.303762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:14.304444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:14.304981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:14.651811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:14.677641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b2c2513-ce3a-4856-a6f8-acfe397398b8 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.396786 Oct 25 03:36:14.684134 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3027/5932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:14 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:14.709378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:14.711111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:14.720670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:14.722082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:14.722705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:14.724364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:14.724972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:14.726166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:15.054717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:15.086092 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eca08266-ebe4-495c-92c6-c416b7e970df tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.379900 Oct 25 03:36:15.090027 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2906/5933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:14 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:15.505275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d51fbe9-8dd7-40f0-ad0e-9c33f6e246c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'create', calling method: .version_select at 0x7efd329c8430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-738091138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnSZS6wN5u3pLeluEWDXXoFIyteIJFkUjLfZc+smhXsoffV78mIHuH7fEWOmCVFT77tlJ/cezQQH1tA5p/viUjf62rXoo4jx5Wbel0p6O59R/L+kZwsDPhphVEjKmHpHQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:15.532125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8d51fbe9-8dd7-40f0-ad0e-9c33f6e246c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:15.539295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-8d51fbe9-8dd7-40f0-ad0e-9c33f6e246c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for user 65b962a4e0844dbfa0493777365cf6cd and project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:15.571506 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d51fbe9-8dd7-40f0-ad0e-9c33f6e246c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.072136 Oct 25 03:36:15.580561 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3028/5934] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:36:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:15.709482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:15.710768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:15.724996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:15.727182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:15.728868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:15.730697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:15.731178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:15.731606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:16.120170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:16.122463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:16.163303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:16.163806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:16.164246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:16.164959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:16.165416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:16.166055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:16.210384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:16.220734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5a07ae2-821b-4434-b5e4-181c2a58725a tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.515303 Oct 25 03:36:16.222131 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2907/5935] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:15 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:16.533083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7d086eac-c026-4b06-9bb6-ecabde96c7cd req-10878c44-7e15-430e-8545-a14b57c86e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8001b02-712b-4c87-b6ca-c66ffb02146e", "name": "network-vif-plugged", "status": "completed", "tag": "0d8acc22-be5b-4ab6-b9a0-c34c48b1f730"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:16.561723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7d086eac-c026-4b06-9bb6-ecabde96c7cd req-10878c44-7e15-430e-8545-a14b57c86e2d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:16.561723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7d086eac-c026-4b06-9bb6-ecabde96c7cd req-10878c44-7e15-430e-8545-a14b57c86e2d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:16.561723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7d086eac-c026-4b06-9bb6-ecabde96c7cd req-10878c44-7e15-430e-8545-a14b57c86e2d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:16.586926 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7d086eac-c026-4b06-9bb6-ecabde96c7cd req-10878c44-7e15-430e-8545-a14b57c86e2d service nova] Creating event network-vif-plugged:0d8acc22-be5b-4ab6-b9a0-c34c48b1f730 for instance d8001b02-712b-4c87-b6ca-c66ffb02146e on n-h2-862355-1 Oct 25 03:36:16.594034 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7d086eac-c026-4b06-9bb6-ecabde96c7cd req-10878c44-7e15-430e-8545-a14b57c86e2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063724 Oct 25 03:36:16.595595 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2908/5936] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:36:16.654888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:16.665786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5b7776c-3a8f-43b4-8c2b-bd1de789cc99 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.552744 Oct 25 03:36:16.680342 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3029/5937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:16 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:17.251916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:17.252641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:17.263783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:17.265911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:17.266684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:17.267656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:17.268524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:17.269182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:17.593194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:17.612066 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-831ab96b-65ae-49db-b888-ee5983963c04 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1314 microversion: 2.1 time: 0.368245 Oct 25 03:36:17.630867 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2909/5938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:17 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:17.705159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-709613134", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe069d9f-9479-42aa-b1da-5e77a91badbd"}], "security_groups": [{"name": "tempest-securitygroup--64458493"}], "key_name": "tempest-keypair-1671402907", "user_data": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:17.724662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:17.728279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:17.758194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:17.758685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:17.759318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:17.760186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:17.762626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:17.763257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:17.767662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:18.065246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:18.076756 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e6805426-ee64-4ea3-bc9b-dbaa158357a5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.372632 Oct 25 03:36:18.085706 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2910/5939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:17 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:18.132017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] validate_networks() for [('fe069d9f-9479-42aa-b1da-5e77a91badbd', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:36:18.304468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1734946552", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "4d06342a-a52d-40f9-a8bd-c41986db5d04"}], "key_name": "tempest-TestNetworkBasicOps-738091138", "security_groups": [{"name": "tempest-secgroup-smoke-853646881"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:18.445092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] validate_networks() for [('4d06342a-a52d-40f9-a8bd-c41986db5d04', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:36:19.000328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:36:19.001099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:36:19.001775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:36:19.002347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:36:19.002910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:36:19.020994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.022293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.022897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.023884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.024522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.025751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.048206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:19.055025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for user 65b962a4e0844dbfa0493777365cf6cd and project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:19.073886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:36:19.077166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:36:19.180858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d8b5312-2c77-4541-a46d-f5f3c722bea7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.868954 Oct 25 03:36:19.182254 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2911/5940] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:36:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:36:19.192056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:19.192805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:19.203827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.204482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.205161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:36:19.205577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.205855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:36:19.205855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:36:19.206224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:36:19.206494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.206687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:36:19.207268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.207802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.223923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.224634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.225087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.225858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.226464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.226902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.247739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:19.254535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:19.278105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:36:19.283206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:36:19.361324 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3261ee2f-7477-47aa-b4b8-ec99380c41fd tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.663140 Oct 25 03:36:19.370005 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3030/5941] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:36:17 2022] POST /compute/v2.1/servers => generated 400 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:36:19.376292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:19.377229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:19.403367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.404069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.405283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.406765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.407389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.408052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.573796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:19.584347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d85e28d5-08fa-440a-a6cd-d9ab9e811426 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1501 microversion: 2.1 time: 0.400917 Oct 25 03:36:19.587563 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2912/5942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:19 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1501 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:19.597523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97e3119f-e7c5-4f8d-8398-5d2278565cb2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:19.598161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97e3119f-e7c5-4f8d-8398-5d2278565cb2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:19.628052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:19.638581 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92165183-562e-402f-8cd9-e697613bc1ad tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.267031 Oct 25 03:36:19.651367 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3031/5943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:19 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:19.664420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47d6189a-c7e7-4616-acd2-d4538a185a41 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:19.667506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47d6189a-c7e7-4616-acd2-d4538a185a41 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:19.692740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:19.732507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97e3119f-e7c5-4f8d-8398-5d2278565cb2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:19.744826 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97e3119f-e7c5-4f8d-8398-5d2278565cb2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1248 microversion: 2.1 time: 0.155709 Oct 25 03:36:19.746871 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2913/5944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:19 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1248 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:19.761061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:19.763208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:19.777191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.777714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.778176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.778901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:19.779398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:19.785516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:19.792036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47d6189a-c7e7-4616-acd2-d4538a185a41 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:19.806900 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47d6189a-c7e7-4616-acd2-d4538a185a41 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1241 microversion: 2.1 time: 0.152991 Oct 25 03:36:19.807909 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3032/5945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:19 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:20.048466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:20.064443 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-82bbd6bc-2c25-4169-b28f-90e4a2336eea tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1501 microversion: 2.1 time: 0.315843 Oct 25 03:36:20.066567 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2914/5946] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:19 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:20.092113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:20.092762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:20.107581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.108093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.108798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.110573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.111564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.111695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.138822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lazy-loading 'flavor' on Instance uuid d8001b02-712b-4c87-b6ca-c66ffb02146e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:36:20.152729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3088b762-872e-4897-b384-6d67f333ccc2 req-c058eeb6-a44d-44c1-a8a7-ea4053b775cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18345b4-72e0-4e61-9570-a442554d4d90", "name": "network-vif-plugged", "status": "completed", "tag": "3999af3d-329b-429d-ae8d-38ac22bf9b05"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:20.167583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3088b762-872e-4897-b384-6d67f333ccc2 req-c058eeb6-a44d-44c1-a8a7-ea4053b775cd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.168066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3088b762-872e-4897-b384-6d67f333ccc2 req-c058eeb6-a44d-44c1-a8a7-ea4053b775cd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.168666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3088b762-872e-4897-b384-6d67f333ccc2 req-c058eeb6-a44d-44c1-a8a7-ea4053b775cd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.183191 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3088b762-872e-4897-b384-6d67f333ccc2 req-c058eeb6-a44d-44c1-a8a7-ea4053b775cd service nova] Creating event network-vif-plugged:3999af3d-329b-429d-ae8d-38ac22bf9b05 for instance e18345b4-72e0-4e61-9570-a442554d4d90 on n-h1-862355-1 Oct 25 03:36:20.189054 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3088b762-872e-4897-b384-6d67f333ccc2 req-c058eeb6-a44d-44c1-a8a7-ea4053b775cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040516 Oct 25 03:36:20.190191 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2915/5947] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:20.273350 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3aa32dea-0fea-4446-b5c2-af5f8171cfb7 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action" status: 202 len: 0 microversion: 2.1 time: 0.186505 Oct 25 03:36:20.281430 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3033/5948] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:36:20 2022] POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:36:20.286500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:20.287575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:20.295659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.296481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.297667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.298610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.299218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.299793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.611688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:20.620866 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9ebb6db8-c368-4124-a502-a269bf1849b9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1509 microversion: 2.1 time: 0.338741 Oct 25 03:36:20.623075 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2916/5949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:20 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:20.667640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:20.668353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:20.676399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.676900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.677341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.678069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.678527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.678958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.777696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:20.777696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:20.785780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.786489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.787063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.787859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.788415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.789085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.813230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:20.868579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:20.877153 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-83ed9973-561a-46f9-8868-ba53b84c67bf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1300 microversion: 2.1 time: 0.105465 Oct 25 03:36:20.877770 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2917/5950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:20 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:20.889956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:20.889956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:20.894763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.894763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.894763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.895000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:20.895112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:20.895112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:20.895112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:20.895326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:20.901765 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df0c6940-5a4d-454f-b3c8-23837292f7a7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.238463 Oct 25 03:36:20.902571 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3034/5951] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:20 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:20.959718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:20.967742 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe631871-492a-407f-9704-168a4bfdb7a4 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1237 microversion: 2.1 time: 0.088147 Oct 25 03:36:20.968914 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2918/5952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:20 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:21.646966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:21.647737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:21.655430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:21.656500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:21.657092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:21.657822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:21.658291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:21.658725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:21.902874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:21.903490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:21.911646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:21.912398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:21.913006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:21.913733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:21.914200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:21.914637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:21.952392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:21.961174 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a057945-8966-4e97-a1ab-89b8a727da51 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1492 microversion: 2.1 time: 0.319148 Oct 25 03:36:21.978109 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3035/5953] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:21 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1492 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:21.983110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:21.983734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:21.988174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:21.992512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:21.993252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:21.993960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:21.994884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:21.995560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:21.996210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:22.001100 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23af6575-0298-4430-a599-5ec82b08452f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1306 microversion: 2.1 time: 0.101934 Oct 25 03:36:22.002087 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2919/5954] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:21 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:22.008913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:22.009872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:22.020198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:22.021030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:22.021729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:22.022762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:22.023455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:22.024105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:22.199406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:22.211227 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b58e86ec-78ef-413e-a55b-4dca7e0386b8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1293 microversion: 2.1 time: 0.207782 Oct 25 03:36:22.212885 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2920/5955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:22 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1293 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:22.241708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:22.242630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:22.252252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:22.253160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:22.253847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:22.254787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:22.255571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:22.256314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:22.261594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:22.277260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27f5e877-4715-41aa-8410-65820db51700 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1307 microversion: 2.1 time: 0.297123 Oct 25 03:36:22.278291 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3036/5956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:21 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:22.353284 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4b0f2b04-67f1-494f-8ecc-df26f6e23381 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action" status: 202 len: 0 microversion: 2.1 time: 0.122138 Oct 25 03:36:22.357745 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2921/5957] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:36:22 2022] POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:36:22.363864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:22.364461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:22.373324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:22.375059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:22.375695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:22.376563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:22.377728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:22.379368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:22.732202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:22.749295 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee2d9342-1a3b-4cd7-81da-ba66f0ca8de6 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1498 microversion: 2.1 time: 0.388850 Oct 25 03:36:22.751109 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3037/5958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:22 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1498 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:23.029424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:23.030166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:23.038081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.038791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.039409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.040259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.040862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.041435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.242398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:23.243599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:23.251427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.252259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.252876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.254270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.254786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.255256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.371996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:23.382347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-854f4144-1399-4c9c-91f7-a50be3abf6ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.358548 Oct 25 03:36:23.390446 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2922/5959] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:23 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:23.390446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:23.390446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:23.398546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.399344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.399989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.401591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.402081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.402674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.436734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:23.448857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-450ac159-18c9-4226-a6a1-8ab25a2ee79c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1299 microversion: 2.1 time: 0.211328 Oct 25 03:36:23.450019 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3038/5960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:23 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1299 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:23.743228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:23.753312 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a3261ae-9dd2-4e41-b88e-a37e33c9594a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1488 microversion: 2.1 time: 0.368684 Oct 25 03:36:23.760754 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2923/5961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:23 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1488 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:23.787910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:23.789356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:23.792173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:23.794910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:23.802768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.803516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.804114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.804977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.806182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.806818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.808923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.809546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.810122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.810950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.811515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.814564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.940919 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50eab0b4-a93c-4aea-8d01-b6f7a7d5c1d7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "PUT /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1083 microversion: 2.1 time: 0.157326 Oct 25 03:36:23.941927 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2924/5962] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:36:23 2022] PUT /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1083 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:23.961551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:23.962221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:23.969852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.970350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.970794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:23.971506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:23.971960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:23.972386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:24.177861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:24.190013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-58eadbeb-8ef2-46d7-8932-6b984cd65f40 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1498 microversion: 2.1 time: 0.411407 Oct 25 03:36:24.204867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3039/5963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:23 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1498 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:24.204867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2d221290-0af1-410c-ae8a-cb3689b36114 req-156608a2-231b-443f-aab8-a3b8adde35e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd70acb-c5e6-4413-a290-c7429ff78912", "tag": "21f45683-09c7-4e20-92cc-bfaf780b624e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:24.210924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2d221290-0af1-410c-ae8a-cb3689b36114 req-156608a2-231b-443f-aab8-a3b8adde35e0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:24.211408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2d221290-0af1-410c-ae8a-cb3689b36114 req-156608a2-231b-443f-aab8-a3b8adde35e0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:24.211845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2d221290-0af1-410c-ae8a-cb3689b36114 req-156608a2-231b-443f-aab8-a3b8adde35e0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:24.229229 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2d221290-0af1-410c-ae8a-cb3689b36114 req-156608a2-231b-443f-aab8-a3b8adde35e0 service nova] Creating event network-changed:21f45683-09c7-4e20-92cc-bfaf780b624e for instance 2fd70acb-c5e6-4413-a290-c7429ff78912 on n-h1-862355-1 Oct 25 03:36:24.237604 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2d221290-0af1-410c-ae8a-cb3689b36114 req-156608a2-231b-443f-aab8-a3b8adde35e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045081 Oct 25 03:36:24.238933 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3040/5964] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:24.378594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:24.388401 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ff288d9d-e16d-473f-9e81-a49902b8548b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1509 microversion: 2.1 time: 0.430702 Oct 25 03:36:24.389139 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2925/5965] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:23 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:24.415828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:24.419015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:24.423791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:24.425227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:24.434951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:24.435900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:24.436787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:24.437843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:24.439085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:24.439743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:24.447531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:24.447959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:24.448462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:24.449191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:24.449648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:24.450090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:24.775338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:24.784439 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2cddc5e2-9e09-4c09-a5c2-42a65cdcd440 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.376147 Oct 25 03:36:24.791831 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3041/5966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:24 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:24.800605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:24.801576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:24.810268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:24.810765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:24.811287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:24.812660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:24.813258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:24.813727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.037576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:25.046945 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b5dbf66c-b76c-47a0-b6bb-b05720134d96 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.251856 Oct 25 03:36:25.047585 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3042/5967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:24 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:25.119414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:25.129000 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da2d78f2-83f5-4475-b512-ff6d2fa56f42 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1509 microversion: 2.1 time: 0.719216 Oct 25 03:36:25.130270 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2926/5968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:24 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1509 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:25.153295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:25.153859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:25.160217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.160698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.161131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.161895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.162769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.162769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.190541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:36:25.219522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:25.222002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:25.236212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.236784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.237400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.242703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.243203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.243652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.299704 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-469b4c13-9f61-493a-9939-610425abce9b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 204 len: 0 microversion: 2.1 time: 0.150005 Oct 25 03:36:25.300535 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3043/5969] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:36:25 2022] DELETE /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:36:25.309513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:25.310257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:25.317184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.317963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.318450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.319156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.319606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.320031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.514550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:25.526606 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-125d219d-fcb2-49a0-8ad0-08d53d823ccd tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1501 microversion: 2.1 time: 0.317156 Oct 25 03:36:25.538427 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2927/5970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:25 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1501 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:25.550870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:25.551368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:25.554436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:25.556280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:25.558389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.559273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.559926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.560904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.561571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.562836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.565028 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e0730f4-ae5d-4bda-81a6-2f49680d1575 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1515 microversion: 2.1 time: 0.260129 Oct 25 03:36:25.565632 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3044/5971] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:25 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:25.589359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lazy-loading 'flavor' on Instance uuid d8001b02-712b-4c87-b6ca-c66ffb02146e {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:36:25.664376 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ed8d61e-825d-4092-89ed-a15757145b93 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action" status: 202 len: 0 microversion: 2.1 time: 0.117587 Oct 25 03:36:25.668498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2928/5972] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:36:25 2022] POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:36:25.674763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:25.676113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:25.685998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.686649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.687793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.688886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.689525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.689969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.809055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:25.809838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:25.816839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.817320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.817796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.818505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:25.818967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:25.819402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:25.918050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:25.927435 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8793517-d43c-402f-b5c6-c98662eb2c5d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1509 microversion: 2.1 time: 0.258067 Oct 25 03:36:25.928544 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3045/5973] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:25 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:25.966955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:25.974879 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-412d1200-b200-45a7-b113-c276f44a7d68 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.170254 Oct 25 03:36:25.975818 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2929/5974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:25 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:26.071011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:26.071546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:26.077506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:26.078015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:26.078455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:26.079143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:26.079594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:26.080017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:26.261983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3b5134b1-48de-4e0a-b04e-f25a34d94094 req-af4a2fa9-e292-4a26-a9d7-027a989431c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc02d7c8-0307-47e9-9acd-0bb9cd64cb39", "tag": "d80aec0d-d250-4ab6-a987-dc24b4fa3a3b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:26.273514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b5134b1-48de-4e0a-b04e-f25a34d94094 req-af4a2fa9-e292-4a26-a9d7-027a989431c3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:26.274035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b5134b1-48de-4e0a-b04e-f25a34d94094 req-af4a2fa9-e292-4a26-a9d7-027a989431c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:26.274470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3b5134b1-48de-4e0a-b04e-f25a34d94094 req-af4a2fa9-e292-4a26-a9d7-027a989431c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:26.286875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3b5134b1-48de-4e0a-b04e-f25a34d94094 req-af4a2fa9-e292-4a26-a9d7-027a989431c3 service nova] Creating event network-changed:d80aec0d-d250-4ab6-a987-dc24b4fa3a3b for instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 on n-h1-862355-1 Oct 25 03:36:26.291884 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3b5134b1-48de-4e0a-b04e-f25a34d94094 req-af4a2fa9-e292-4a26-a9d7-027a989431c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033675 Oct 25 03:36:26.292491 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2930/5975] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:36:26.323051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:26.330793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1f82d84-1e77-4b03-b895-08ff4513254b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.263649 Oct 25 03:36:26.331461 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3046/5976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:26 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:26.590064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:26.591504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:26.598781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:26.599283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:26.600617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:26.602855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:26.603335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:26.603768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:26.621166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:26.778889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:26.787921 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b49072c-d821-4086-adef-ca73840b618a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1515 microversion: 2.1 time: 0.202631 Oct 25 03:36:26.788530 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2931/5977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:26 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:26.953199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:26.954355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:26.960722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:26.961211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:26.961646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:26.962374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:26.962828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:26.963251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:26.999035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:27.000287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:27.006651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.007135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.007576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.008293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.008753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.009179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.150833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:27.159099 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2da6e96-0207-4d74-bd7d-ad2989118d7d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.163997 Oct 25 03:36:27.159688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2932/5978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:26 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:27.230524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:27.238736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53f6deb8-ba72-4449-81ba-490f966544e4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1492 microversion: 2.1 time: 0.290217 Oct 25 03:36:27.239314 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3047/5979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:26 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1492 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:27.264334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:27.265260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:27.272573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.273061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.273498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.274255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.274714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.275135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.343762 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-beea27ed-6b1d-492b-8590-e17b89ee3b00 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action" status: 202 len: 0 microversion: 2.1 time: 0.082602 Oct 25 03:36:27.344869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2933/5980] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:36:27 2022] POST /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:36:27.353757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:27.354060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:27.363305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:27.366542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:27.367446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.368020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.368516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.369277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.369837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.370347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.378978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.379856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.380684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.381666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.382307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.383156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.556132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:27.565027 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58f5e7e5-9609-47c2-bebe-91a4d050f7c0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.206835 Oct 25 03:36:27.565720 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2934/5981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:27 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:27.665695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:27.675356 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e082c54c-fe97-4871-af23-3eeb7e3234f9 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1498 microversion: 2.1 time: 0.326099 Oct 25 03:36:27.690511 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3048/5982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:27 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:27.813932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:27.814816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:27.821382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.822242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.822889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:27.823857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:27.824606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:27.825217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:28.187573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:28.188915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:28.206127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:28.207044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:28.208019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:28.210236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:28.211424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:28.212625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:28.319338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:28.329870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-299d2f1a-3ee3-484e-8034-2cf522a252f5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1515 microversion: 2.1 time: 0.521208 Oct 25 03:36:28.330459 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2935/5983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:27 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1515 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:28.526204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:28.537800 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c8d35533-b226-4c21-a4c2-f7b5638c0e2c tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.357355 Oct 25 03:36:28.538311 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3049/5984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:28 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:28.588105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:28.588740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:28.596167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:28.596629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:28.597232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:28.597824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:28.598307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:28.598733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:28.700934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:28.701793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:28.710430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:28.710982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:28.711432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:28.712343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:28.712906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:28.713216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:28.768294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:28.908210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:28.917001 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9de9c550-793c-4645-86da-4e8f65863dde tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1498 microversion: 2.1 time: 0.220215 Oct 25 03:36:28.917757 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3050/5985] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:28 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1498 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:29.035847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:29.059291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:29.087993 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b1fa8aa-8495-46ee-8aeb-a7b83618f423 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.504020 Oct 25 03:36:29.106366 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2936/5986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:28 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:29.130426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-abcfaa49-02bd-41f8-b717-666874ac9197 req-dbccb97b-4c80-4937-b7cb-f025f4eba5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18345b4-72e0-4e61-9570-a442554d4d90", "name": "network-vif-deleted", "tag": "3999af3d-329b-429d-ae8d-38ac22bf9b05"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:29.148869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-abcfaa49-02bd-41f8-b717-666874ac9197 req-dbccb97b-4c80-4937-b7cb-f025f4eba5c8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:29.149364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-abcfaa49-02bd-41f8-b717-666874ac9197 req-dbccb97b-4c80-4937-b7cb-f025f4eba5c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:29.149824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-abcfaa49-02bd-41f8-b717-666874ac9197 req-dbccb97b-4c80-4937-b7cb-f025f4eba5c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:29.163997 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-abcfaa49-02bd-41f8-b717-666874ac9197 req-dbccb97b-4c80-4937-b7cb-f025f4eba5c8 service nova] Creating event network-vif-deleted:3999af3d-329b-429d-ae8d-38ac22bf9b05 for instance e18345b4-72e0-4e61-9570-a442554d4d90 on n-h1-862355-1 Oct 25 03:36:29.172956 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-abcfaa49-02bd-41f8-b717-666874ac9197 req-dbccb97b-4c80-4937-b7cb-f025f4eba5c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046197 Oct 25 03:36:29.174361 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3051/5987] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:29.357030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:29.357874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:29.388223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:29.389058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:29.394407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:29.395401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:29.396294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:29.397242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:29.476869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:29.486173 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f8840196-b25c-4f60-b20a-d2f7d9690fbe tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1473 microversion: 2.1 time: 0.136489 Oct 25 03:36:29.486958 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2937/5988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:29 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1473 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:29.560890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:29.566971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:29.567883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:29.575289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:29.575894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:29.576441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:29.577260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:29.578313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:29.578829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:29.804723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=18 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:29.912606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:29.922928 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f2d54bf-eb20-426c-9209-c0e1304109fe tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.363199 Oct 25 03:36:29.923690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3052/5989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:29 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:29.942414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:29.943238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:29.948987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=22 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:29.951112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:29.951890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:29.953063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:29.954610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:29.955110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:29.955610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.120563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:30.121185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:30.133282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.134021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.134598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.135209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.136137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.136720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.253983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:30.264916 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81fd5e6f-0369-4f76-ac5e-e2e936f629d1 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1501 microversion: 2.1 time: 0.326413 Oct 25 03:36:30.266685 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2938/5990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:29 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1501 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:30.290051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:30.290557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:30.304921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.305642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.306376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.307200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.308459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.308971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.337905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:36:30.473122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:30.474879 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60943f09-b1c3-4696-ae67-22ed8185ffd4 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 204 len: 0 microversion: 2.1 time: 0.187634 Oct 25 03:36:30.476333 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2939/5991] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:36:30 2022] DELETE /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:36:30.482114 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51ce9839-1ee4-4e93-9130-1ad369eddcb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.364850 Oct 25 03:36:30.487395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:30.488619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:30.494895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.496270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.496775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.497548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.498232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.499217 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3053/5992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:30 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:30.499379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.512482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:30.514072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:30.521258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.522076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.522698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.524403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.526089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.528479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.586025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.588045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.589047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.589655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lazy-loading 'fault' on Instance uuid e18345b4-72e0-4e61-9570-a442554d4d90 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:36:30.669726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:30.684822 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-316e4f09-05e2-48cc-813e-e0a76c125298 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 200 len: 1318 microversion: 2.1 time: 0.174920 Oct 25 03:36:30.685526 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3054/5993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:30 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:30.717014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:30.727870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ed0d5d2-c525-4a70-9a00-194c3d39734e tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1507 microversion: 2.1 time: 0.246938 Oct 25 03:36:30.728856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2940/5994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:30 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:30.951185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:30.951813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:30.965006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.965969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.966424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:30.967127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:30.967586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:30.968016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:31.208623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:31.218018 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d3b9c823-140c-49fa-9cd3-7183fc741faf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.271215 Oct 25 03:36:31.218929 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3055/5995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:30 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:31.507524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:31.508243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:31.516866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:31.517701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:31.518377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:31.519346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:31.520001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:31.521039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:31.708858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:31.709391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:31.716162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:31.716649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:31.717085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:31.717801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:31.718822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:31.719258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:31.733282 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 HTTP/1.1 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e18345b4-72e0-4e61-9570-a442554d4d90'} Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:31.735577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00477a05-6ddb-440b-afad-cdc8f451ad45 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 404 len: 111 microversion: 2.1 time: 0.032436 Oct 25 03:36:31.749187 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3056/5996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:31 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:36:31.755979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:31.756599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:31.762648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:31.763132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:31.763573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:31.764270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:31.764409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:31.764735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:31.765184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:31.781263 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2afe36e-fca3-480f-8e5c-45f72e6c223d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.277856 Oct 25 03:36:31.782564 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2941/5997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:31 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:31.811490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-99206412", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "89c4e82f-3c5d-498c-ad61-d6c45bb94847"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:31.886562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] validate_networks() for [('89c4e82f-3c5d-498c-ad61-d6c45bb94847', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:36:31.928630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:31.939857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0250195b-bfa2-41cc-8452-d7ad1dc61952 tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1507 microversion: 2.1 time: 0.187867 Oct 25 03:36:31.941863 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3057/5998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:31 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:32.212704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8e6f4760-f4fa-4021-abfd-c56046c9354a req-f04293cc-a061-46d9-a7ec-fa827789e4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd70acb-c5e6-4413-a290-c7429ff78912", "name": "network-vif-plugged", "status": "completed", "tag": "21f45683-09c7-4e20-92cc-bfaf780b624e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:32.228983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e6f4760-f4fa-4021-abfd-c56046c9354a req-f04293cc-a061-46d9-a7ec-fa827789e4c7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:32.231891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e6f4760-f4fa-4021-abfd-c56046c9354a req-f04293cc-a061-46d9-a7ec-fa827789e4c7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:32.233583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e6f4760-f4fa-4021-abfd-c56046c9354a req-f04293cc-a061-46d9-a7ec-fa827789e4c7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:32.249979 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8e6f4760-f4fa-4021-abfd-c56046c9354a req-f04293cc-a061-46d9-a7ec-fa827789e4c7 service nova] Creating event network-vif-plugged:21f45683-09c7-4e20-92cc-bfaf780b624e for instance 2fd70acb-c5e6-4413-a290-c7429ff78912 on n-h1-862355-1 Oct 25 03:36:32.257397 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8e6f4760-f4fa-4021-abfd-c56046c9354a req-f04293cc-a061-46d9-a7ec-fa827789e4c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054790 Oct 25 03:36:32.258888 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3058/5999] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:32.266640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:32.267463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:32.275752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:32.276533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:32.277127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:32.278053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:32.278668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:32.279251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:32.515445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:32.526793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63ff6935-d472-4ede-9315-9955f39d556b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.265905 Oct 25 03:36:32.528346 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3059/6000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:32 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:32.805963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:32.807389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:32.816927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:32.818472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:32.819244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:32.821273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:32.822025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:32.822624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.037237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:33.046022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56132c91-34f8-44d5-a23b-b7e7efe86bb7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.243890 Oct 25 03:36:33.047547 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3060/6001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:32 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:33.052238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:33.053056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:33.059216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:33.059732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:33.060223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.061001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:33.062066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:33.062817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.080473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:36:33.081445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:36:33.082645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:36:33.083369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:36:33.083958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:36:33.095662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:33.096550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:33.096968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.097770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:33.098225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:33.098653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.117648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:33.123282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Getting quotas for user dcfed9af4c79401faac288652541cd10 and project 0bd1e23bd3514ad0a66d7c09232b87b1. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:33.137819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:36:33.142016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:36:33.146831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e019f7f29f2d45d6b3e09676383cc8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de6b31ded749959cecc26eb1fa9cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:33.167575 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3a33783a-8b5a-4a2c-9418-4bbea61e9d8d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 200 len: 1299 microversion: 2.1 time: 0.118679 Oct 25 03:36:33.168821 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3061/6002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:33 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:33.178649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-26aea591-97d8-4ca9-972c-62b49a035776 req-2251bc9f-f2c5-4de2-b0ca-357952fee1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8001b02-712b-4c87-b6ca-c66ffb02146e", "name": "network-vif-deleted", "tag": "0d8acc22-be5b-4ab6-b9a0-c34c48b1f730"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:33.190996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26aea591-97d8-4ca9-972c-62b49a035776 req-2251bc9f-f2c5-4de2-b0ca-357952fee1fd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:33.191676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26aea591-97d8-4ca9-972c-62b49a035776 req-2251bc9f-f2c5-4de2-b0ca-357952fee1fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:33.191909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26aea591-97d8-4ca9-972c-62b49a035776 req-2251bc9f-f2c5-4de2-b0ca-357952fee1fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.205935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-26aea591-97d8-4ca9-972c-62b49a035776 req-2251bc9f-f2c5-4de2-b0ca-357952fee1fd service nova] Creating event network-vif-deleted:0d8acc22-be5b-4ab6-b9a0-c34c48b1f730 for instance d8001b02-712b-4c87-b6ca-c66ffb02146e on n-h2-862355-1 Oct 25 03:36:33.208266 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c253821c-9b72-4942-9b19-89770aaafd3a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402282 Oct 25 03:36:33.211750 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-26aea591-97d8-4ca9-972c-62b49a035776 req-2251bc9f-f2c5-4de2-b0ca-357952fee1fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041535 Oct 25 03:36:33.216519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3062/6003] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:33.222443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-95e98a8f-1bc5-4c3d-910b-ea131f4750ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:33.223154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-95e98a8f-1bc5-4c3d-910b-ea131f4750ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:33.226054 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2942/6004] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:36:33.287786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-95e98a8f-1bc5-4c3d-910b-ea131f4750ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:33.295731 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-95e98a8f-1bc5-4c3d-910b-ea131f4750ff tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1207 microversion: 2.1 time: 0.077767 Oct 25 03:36:33.297398 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3063/6005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:33 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1207 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:33.553295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:33.554048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:33.580266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:33.580698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:33.581173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.587151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:33.587716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:33.588277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:33.840161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:33.849987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a700f4da-83b3-4d19-a5aa-1d9e71f6026d tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1373 microversion: 2.1 time: 0.300874 Oct 25 03:36:33.851270 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2943/6006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:33 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1373 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:34.071010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:34.071896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:34.091702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.100490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.100978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.101807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.102242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.102682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.193429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:34.197284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] [instance: d8001b02-712b-4c87-b6ca-c66ffb02146e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:34.203851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.204641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.205223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.206099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.206705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.207441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.222966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] HTTP exception thrown: Instance d8001b02-712b-4c87-b6ca-c66ffb02146e could not be found. Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Request method failure captured: Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e HTTP/1.1 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1mdmLUaiDzrX7Z-Be_CKUZQ5RFRtDkRALfhgZZnJ6zbKrlhMWb4YEepxdY0EDKAMPrkRNx-r7cR496GPgG0rZfIz4gxiOLbN6OW6MvFf3kHno1oFjavzgGz85xWIHPtAjasZQTTvLyO_qbotS98KTf4TkUM7H8Cc3ROTYy8a9jGj2M Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 85de6b31ded749959cecc26eb1fa9cc9 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestServerAdvancedOps-1667433952 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85de6b31ded749959cecc26eb1fa9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85de6b31ded749959cecc26eb1fa9cc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85de6b31ded749959cecc26eb1fa9cc9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85de6b31ded749959cecc26eb1fa9cc9"}]}] Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestServerAdvancedOps-1667433952 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 85de6b31ded749959cecc26eb1fa9cc9 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestServerAdvancedOps-1667433952 Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestServerAdvancedOps-1667433952-project Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: e019f7f29f2d45d6b3e09676383cc8cb Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestServerAdvancedOps-1667433952-project Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance d8001b02-712b-4c87-b6ca-c66ffb02146e could not be found. Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'd8001b02-712b-4c87-b6ca-c66ffb02146e'} Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8001b02-712b-4c87-b6ca-c66ffb02146e could not be found. Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8001b02-712b-4c87-b6ca-c66ffb02146e could not be found. Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:36:34.224649 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8001b02-712b-4c87-b6ca-c66ffb02146e could not be found. Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] Returning 404 to user: Instance d8001b02-712b-4c87-b6ca-c66ffb02146e could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a8430469-af2d-400d-8241-c78e1371868d tempest-TestServerAdvancedOps-1667433952 tempest-TestServerAdvancedOps-1667433952-project] 10.222.0.36 "GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e" status: 404 len: 111 microversion: 2.1 time: 0.036873 Oct 25 03:36:34.228586 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2944/6007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:34 2022] GET /compute/v2.1/servers/d8001b02-712b-4c87-b6ca-c66ffb02146e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:36:34.277077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e775d336-5f05-4de3-99ba-aa552a827afa req-e0cc771b-0358-48c5-97e6-706674cca5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc02d7c8-0307-47e9-9acd-0bb9cd64cb39", "name": "network-vif-plugged", "status": "completed", "tag": "d80aec0d-d250-4ab6-a987-dc24b4fa3a3b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:34.291830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e775d336-5f05-4de3-99ba-aa552a827afa req-e0cc771b-0358-48c5-97e6-706674cca5d8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.292774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e775d336-5f05-4de3-99ba-aa552a827afa req-e0cc771b-0358-48c5-97e6-706674cca5d8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.293430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e775d336-5f05-4de3-99ba-aa552a827afa req-e0cc771b-0358-48c5-97e6-706674cca5d8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.300617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:34.319787 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-86a66aeb-7695-4695-81b1-78361a72863a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.253135 Oct 25 03:36:34.322362 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3064/6008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:34 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:34.337591 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e775d336-5f05-4de3-99ba-aa552a827afa req-e0cc771b-0358-48c5-97e6-706674cca5d8 service nova] Creating event network-vif-plugged:d80aec0d-d250-4ab6-a987-dc24b4fa3a3b for instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 on n-h1-862355-1 Oct 25 03:36:34.342054 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e775d336-5f05-4de3-99ba-aa552a827afa req-e0cc771b-0358-48c5-97e6-706674cca5d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069158 Oct 25 03:36:34.342666 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2945/6009] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:34.347410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:34.348461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:34.365436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.366848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.367445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.368376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.368981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.369584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.521532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:34.541794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ceecb5f-12f2-497b-aec2-765ac917eee9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1267 microversion: 2.1 time: 0.197717 Oct 25 03:36:34.542475 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3065/6010] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:34 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:34.874770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:34.875772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:34.883037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.883776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.884357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:34.885339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:34.885979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:34.886571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:35.122847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:35.132702 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a53ffb42-940d-415f-ad18-07fbb3d7f01f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1546 microversion: 2.1 time: 0.262607 Oct 25 03:36:35.133216 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2946/6011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:34 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:35.156041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:35.156659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:35.166710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:35.167753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:35.168305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:35.169149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:35.169767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:35.170565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:35.345928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:35.346779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:35.353308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:35.353979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:35.354679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:35.355868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:35.356808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:35.357537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:35.398509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:35.579963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:35.588008 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3439bf00-7480-42e3-b207-b244e087d604 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1546 microversion: 2.1 time: 0.435799 Oct 25 03:36:35.589130 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3066/6012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:35 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1546 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:35.594179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:35.594963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:35.602577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:35.603137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:35.603548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:35.604241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:35.604865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:35.605362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:35.664277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:35.680332 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58d17c48-719b-4445-8b27-9197ed7f9107 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1365 microversion: 2.1 time: 0.339038 Oct 25 03:36:35.681540 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2947/6013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:35 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:35.732127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:35.756239 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8da444e-6de2-44bb-a0fd-d19f1e1fd7f4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1265 microversion: 2.1 time: 0.152043 Oct 25 03:36:35.759514 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3067/6014] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:35 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:36.706532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:36.707147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:36.713606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:36.714113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:36.714554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:36.715262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:36.715701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:36.716130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:36.795107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:36.797977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:36.806440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:36.806931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:36.807371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:36.808076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:36.809147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:36.809809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:36.975615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:36.988973 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9033c833-e9e3-49a4-b842-989c855f449f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1556 microversion: 2.1 time: 0.285577 Oct 25 03:36:36.990651 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2948/6015] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:36 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1556 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:37.017153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:37.017925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:37.020147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:37.027947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:37.028702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:37.029361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:37.030029 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed4ffb43-7ff2-492c-beed-25b84432be5c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1307 microversion: 2.1 time: 0.239940 Oct 25 03:36:37.031030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:37.031647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:37.041703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3068/6016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:36 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:37.058814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:37.416853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-515a731a-2c7b-4ff6-ac7b-cd97d41eda18 req-49eab485-243a-4225-a3c5-5ee91d553ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6e96dc-da8e-4c32-8606-0fb376f1dbe6", "tag": "da80024f-9504-404f-b172-5f8716d39171"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:37.455689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-515a731a-2c7b-4ff6-ac7b-cd97d41eda18 req-49eab485-243a-4225-a3c5-5ee91d553ada service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:37.456438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-515a731a-2c7b-4ff6-ac7b-cd97d41eda18 req-49eab485-243a-4225-a3c5-5ee91d553ada service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:37.457038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-515a731a-2c7b-4ff6-ac7b-cd97d41eda18 req-49eab485-243a-4225-a3c5-5ee91d553ada service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:37.472392 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-515a731a-2c7b-4ff6-ac7b-cd97d41eda18 req-49eab485-243a-4225-a3c5-5ee91d553ada service nova] Creating event network-changed:da80024f-9504-404f-b172-5f8716d39171 for instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 on n-h2-862355-1 Oct 25 03:36:37.478491 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-515a731a-2c7b-4ff6-ac7b-cd97d41eda18 req-49eab485-243a-4225-a3c5-5ee91d553ada service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067424 Oct 25 03:36:37.479504 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3069/6017] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:36:37.489711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3ff66599-d33b-4b54-bfe3-f4c338e1ffb9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.478487 Oct 25 03:36:37.490375 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2949/6018] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:36:37 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-interface => generated 285 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:36:38.060510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:38.061823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:38.076128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:38.078523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:38.080851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:38.083052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:38.087205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:38.087638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:38.366024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:38.384451 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8a391339-cc2c-4267-9b1d-4e94f0ab3ab0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1307 microversion: 2.1 time: 0.328796 Oct 25 03:36:38.398070 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3070/6019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:38 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1307 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:39.074799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7b4e3480-03f2-4fdd-b210-033eb24d02e6 req-0061103e-ba78-41d7-84d1-4238e1e2acf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc02d7c8-0307-47e9-9acd-0bb9cd64cb39", "tag": "d80aec0d-d250-4ab6-a987-dc24b4fa3a3b"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:39.086487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7b4e3480-03f2-4fdd-b210-033eb24d02e6 req-0061103e-ba78-41d7-84d1-4238e1e2acf8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:39.086980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7b4e3480-03f2-4fdd-b210-033eb24d02e6 req-0061103e-ba78-41d7-84d1-4238e1e2acf8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:39.087580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7b4e3480-03f2-4fdd-b210-033eb24d02e6 req-0061103e-ba78-41d7-84d1-4238e1e2acf8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:39.100872 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7b4e3480-03f2-4fdd-b210-033eb24d02e6 req-0061103e-ba78-41d7-84d1-4238e1e2acf8 service nova] Creating event network-changed:d80aec0d-d250-4ab6-a987-dc24b4fa3a3b for instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 on n-h1-862355-1 Oct 25 03:36:39.106404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7b4e3480-03f2-4fdd-b210-033eb24d02e6 req-0061103e-ba78-41d7-84d1-4238e1e2acf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037368 Oct 25 03:36:39.107946 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2950/6020] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:39.412931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:39.413775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:39.429637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:39.430203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:39.433171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:39.434235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:39.434654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:39.435765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:39.443070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:39.777298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:39.790395 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bfb11843-70a1-4c7e-88b2-b27a7734500c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1307 microversion: 2.1 time: 0.382845 Oct 25 03:36:39.790996 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3071/6021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:39 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:40.815783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:40.816492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:40.825593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:40.829415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:40.830114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:40.831016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:40.831615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:40.831979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:41.037169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:41.065160 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-61ac6bf8-56d4-496d-8fec-e30065ce846f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1307 microversion: 2.1 time: 0.254182 Oct 25 03:36:41.080982 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2951/6022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:40 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1307 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:42.088468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:42.089663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:42.099997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:42.100806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:42.101662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:42.102530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:42.103137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:42.103718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:42.449873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:42.458991 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2403c93-c385-41bf-a68d-f4761c68ed8f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1307 microversion: 2.1 time: 0.374453 Oct 25 03:36:42.472169 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3072/6023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:42 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:43.489636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:43.490905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:43.494135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:43.495049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:43.513327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:43.514107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:43.514745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:43.515610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:43.520107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:43.520766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:43.879362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:43.895528 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-183df770-72dc-4818-a8b0-75e09cbee916 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1307 microversion: 2.1 time: 0.409738 Oct 25 03:36:43.898314 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2952/6024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:43 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1307 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:44.484498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ce417de7-f70e-4c08-a992-f8cafcc562ea req-0c9a87c4-df7b-4678-a4ae-2c320e77ad74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6e96dc-da8e-4c32-8606-0fb376f1dbe6", "name": "network-vif-plugged", "status": "completed", "tag": "da80024f-9504-404f-b172-5f8716d39171"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:44.505115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:44.510091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ce417de7-f70e-4c08-a992-f8cafcc562ea req-0c9a87c4-df7b-4678-a4ae-2c320e77ad74 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:44.511063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ce417de7-f70e-4c08-a992-f8cafcc562ea req-0c9a87c4-df7b-4678-a4ae-2c320e77ad74 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:44.512156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ce417de7-f70e-4c08-a992-f8cafcc562ea req-0c9a87c4-df7b-4678-a4ae-2c320e77ad74 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:44.535272 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ce417de7-f70e-4c08-a992-f8cafcc562ea req-0c9a87c4-df7b-4678-a4ae-2c320e77ad74 service nova] Creating event network-vif-plugged:da80024f-9504-404f-b172-5f8716d39171 for instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 on n-h2-862355-1 Oct 25 03:36:44.542509 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ce417de7-f70e-4c08-a992-f8cafcc562ea req-0c9a87c4-df7b-4678-a4ae-2c320e77ad74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063921 Oct 25 03:36:44.544953 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3073/6025] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:44.923225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:44.925224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:44.938309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:44.954712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:44.955539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:44.957242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:44.958298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:44.959207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:45.235359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:45.251133 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7894fc17-8617-4eb7-beaa-bdca22cc1734 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1307 microversion: 2.1 time: 0.334815 Oct 25 03:36:45.253855 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2953/6026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:44 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1307 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:46.278733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:46.279435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:46.308167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:46.308666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:46.309113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:46.311083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:46.311615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:46.330108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:46.704921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:46.741942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4a4b9ba-8e22-423f-af33-a2717c0cdbcd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1487 microversion: 2.1 time: 0.465518 Oct 25 03:36:46.745456 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3074/6027] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:46 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1487 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:46.767194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1019319049"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:46.770035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:46.787888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:46.790298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:46.791322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:46.793082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:46.795650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:46.797582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:46.959031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bf3887d7-ab87-40e5-a744-1db29bf59bb3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "PUT /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1074 microversion: 2.1 time: 0.197435 Oct 25 03:36:46.959838 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2954/6028] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:36:46 2022] PUT /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1074 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:46.982807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:46.984343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:46.992975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:46.993814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:46.994494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:46.995599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:46.996285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:46.996921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:47.294322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:47.306110 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43be7ac7-6c62-40eb-b67d-c08badf453b0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1500 microversion: 2.1 time: 0.329655 Oct 25 03:36:47.308218 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3075/6029] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:46 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1500 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:47.341707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:47.342945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:47.351652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:47.353450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:47.355627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:47.359466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:47.361124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:47.362316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:47.798891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:47.809746 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-639b0533-7426-45c3-9a30-187193409388 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1500 microversion: 2.1 time: 0.478947 Oct 25 03:36:47.817506 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2955/6030] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:47 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1500 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:47.841119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9b1b01b-a3c0-413c-ae7d-e7542ec07982 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:47.850482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9b1b01b-a3c0-413c-ae7d-e7542ec07982 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:47.851211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9b1b01b-a3c0-413c-ae7d-e7542ec07982 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:47.851706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9b1b01b-a3c0-413c-ae7d-e7542ec07982 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:47.881600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9b1b01b-a3c0-413c-ae7d-e7542ec07982 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:36:47.936240 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9b1b01b-a3c0-413c-ae7d-e7542ec07982 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "POST /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6/action" status: 202 len: 0 microversion: 2.1 time: 0.104552 Oct 25 03:36:47.937079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3076/6031] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:36:47 2022] POST /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:36:47.950900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:47.951982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:47.976629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:47.985947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:47.987795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:47.988945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:47.994400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:47.995032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:48.376984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:48.385712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a09cc2de-9595-4a46-90cf-6ed0a7d314e5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.440503 Oct 25 03:36:48.387029 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2956/6032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:47 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:49.413439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:49.414177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:49.416256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:49.430153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:49.434588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:49.435786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:49.443152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:49.443850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:49.447888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:49.830750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:49.840048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca1d3888-87a6-4a39-8bce-740952756ff3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.432488 Oct 25 03:36:49.841858 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3077/6033] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:49 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:50.867588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:50.868224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:50.879295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:50.879867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:50.880211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:50.880919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:50.889311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:50.890359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:51.219460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:51.239844 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-59fc4a34-eef5-4780-9ade-cf673fa17da5 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.378430 Oct 25 03:36:51.242562 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2957/6034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:50 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:52.269782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:52.271536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:52.278634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:52.279323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:52.279919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:52.281666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:52.282327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:52.286956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:52.539319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:52.551986 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-94cac9bd-a218-47a6-883c-8cba3f2981a0 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.287239 Oct 25 03:36:52.566608 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3078/6035] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:52 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:53.582890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:53.584938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:53.605507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:53.606360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:53.606778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:53.607715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:53.610639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:53.611491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:53.790228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:53.802310 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b6005c9c-0dcd-4377-ab52-9b5392bc1801 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.227060 Oct 25 03:36:53.803847 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2958/6036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:53 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:53.810171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:53.813161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:53.813652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:53.814142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:53.815073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:53.815714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:53.816143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:53.845274 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-61ad1d95-13dc-4a11-ba62-e28ba83fb561 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.253672 Oct 25 03:36:53.846640 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3079/6037] 10.222.0.36 () {58 vars in 1185 bytes} [Tue Oct 25 03:36:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:36:53.954912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1263796573", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "availability_zone": "nova:n-h2-862355-1", "networks": [{"uuid": "993f2c30-39b4-494d-a977-179d9eaa437e"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:54.024895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] validate_networks() for [('993f2c30-39b4-494d-a977-179d9eaa437e', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:36:54.482891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:36:54.484375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:36:54.485022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:36:54.485435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:36:54.485907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:36:54.495752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:54.496238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:54.496712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:54.497444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:54.497929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:54.498358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:54.523950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Getting quotas for project fcd8edbc2c07420e9e9f74d8b9799612. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:36:54.529670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Getting quotas for user 06cd3e7e87bf44168dd82666e00c8f58 and project fcd8edbc2c07420e9e9f74d8b9799612. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:36:54.543889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:36:54.547149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:36:54.597284 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4bea481d-8560-48c3-bdc5-b8567e79ef5b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646090 Oct 25 03:36:54.598290 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2959/6038] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:36:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:36:54.609811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2575a1ab-7291-4405-88fb-aef7c6e6214b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:54.610442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2575a1ab-7291-4405-88fb-aef7c6e6214b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:54.717250 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2575a1ab-7291-4405-88fb-aef7c6e6214b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1329 microversion: 2.1 time: 0.111907 Oct 25 03:36:54.736479 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3080/6039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:54 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1329 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:54.826427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:54.827093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:54.829447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:36:54.851616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:54.851616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:54.852476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:54.853214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:54.853708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:54.855392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:55.142302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:55.152193 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c180494e-e93a-47f3-b379-8f2857739093 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.330074 Oct 25 03:36:55.153130 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2960/6040] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:54 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:55.740084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:55.740706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:55.748928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:55.749415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:55.749895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:55.750602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:55.751071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:55.751503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:55.824274 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c2a9c3bc-aa50-499f-b539-2f4807cd4b68 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1416 microversion: 2.1 time: 0.087872 Oct 25 03:36:55.825199 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3081/6041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:55 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1416 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:56.178358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:56.178983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:56.190156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:56.190649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:56.191110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:56.191945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:56.192435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:56.192941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:56.382109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:56.390846 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe6cf028-2af1-4087-85f3-84dfcbd8cb37 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.217058 Oct 25 03:36:56.391709 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2961/6042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:56 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:56.847469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:56.848096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:56.861769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:56.862238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:56.862752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:56.863381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:56.863848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:56.864283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:57.167308 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3a62b85b-d60a-44ab-83dc-9ea919bcbaed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1464 microversion: 2.1 time: 0.322382 Oct 25 03:36:57.168567 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3082/6043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:56 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:57.417227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:57.418844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:57.427483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:57.427975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:57.430126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:57.430839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:57.431297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:57.431730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:57.596111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:57.606346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-404cc24e-c76b-40c6-851a-c7bb4ad8466b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.194033 Oct 25 03:36:57.614862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2962/6044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:57 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:57.627147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2ce82edd-dd34-4909-9399-d9e1a2fd7425 req-76a94448-88cb-48ee-9472-e177f6565678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d058a391-7f4a-412b-aa5c-60c200b275cb", "tag": "d1d2d943-f66a-4df5-9614-74ddc63bd079"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:36:57.638954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2ce82edd-dd34-4909-9399-d9e1a2fd7425 req-76a94448-88cb-48ee-9472-e177f6565678 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:57.639938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2ce82edd-dd34-4909-9399-d9e1a2fd7425 req-76a94448-88cb-48ee-9472-e177f6565678 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:57.640738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2ce82edd-dd34-4909-9399-d9e1a2fd7425 req-76a94448-88cb-48ee-9472-e177f6565678 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:57.654948 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2ce82edd-dd34-4909-9399-d9e1a2fd7425 req-76a94448-88cb-48ee-9472-e177f6565678 service nova] Creating event network-changed:d1d2d943-f66a-4df5-9614-74ddc63bd079 for instance d058a391-7f4a-412b-aa5c-60c200b275cb on n-h2-862355-1 Oct 25 03:36:57.660257 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2ce82edd-dd34-4909-9399-d9e1a2fd7425 req-76a94448-88cb-48ee-9472-e177f6565678 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038248 Oct 25 03:36:57.660942 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3083/6045] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:36:58.197530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:58.198310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:58.205732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:58.206299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:58.206812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:58.207577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:58.208109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:58.208622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:58.350077 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e514c209-292f-45d1-ac71-b3f6a9c7d497 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1464 microversion: 2.1 time: 0.156195 Oct 25 03:36:58.350759 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2963/6046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:58 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:36:58.637923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:58.638636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:58.645184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:58.645705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:58.646141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:58.646880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:58.647346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:58.648448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:58.790987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:36:58.799990 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-98c2063a-6802-48e5-b838-750d63aa3c6e tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.167300 Oct 25 03:36:58.806055 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3084/6047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:58 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:59.372813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:59.373539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:59.382645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:59.383685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:59.384141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:59.384869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:59.385340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:59.385796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:59.520158 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52e3a9b0-8596-4189-9a29-ec54412a0e65 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1464 microversion: 2.1 time: 0.151132 Oct 25 03:36:59.520758 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2964/6048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:59 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:36:59.824833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:36:59.825450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:36:59.833505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:59.834284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:59.834802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:36:59.835651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:36:59.836501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:36:59.837217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:00.092041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:00.106413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-71a61fa6-ea8a-4f35-bb96-397f492bfc7a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.284891 Oct 25 03:37:00.107716 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3085/6049] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:36:59 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:00.544976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:00.546238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:00.553404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:00.554163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:00.554871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:00.555761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:00.556234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:00.556654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:00.560754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:00.762734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-576fcd41-1a64-405f-8bc6-d6ba5a4fc43d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1464 microversion: 2.1 time: 0.221595 Oct 25 03:37:00.777731 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2965/6050] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:00 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:01.133260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:01.134795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:01.164020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:01.167158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:01.169169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:01.175528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:01.176568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:01.176568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:01.705724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:01.723083 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5910e8fc-05c6-413c-bdb5-af53ce0953a2 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.594223 Oct 25 03:37:01.723687 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3086/6051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:01 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:01.792654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:01.795216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:01.806967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:01.807865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:01.808493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:01.810100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:01.810762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:01.812074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:02.125481 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a29d6af-d29f-4dc9-b66c-1fada8873d27 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1464 microversion: 2.1 time: 0.337438 Oct 25 03:37:02.126149 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2966/6052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:01 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:02.683821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c56be5f9-58d5-4ae6-a7e6-11807a8ef730 req-04e6590d-03af-4b97-9777-11719eeabf22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d058a391-7f4a-412b-aa5c-60c200b275cb", "name": "network-vif-plugged", "status": "completed", "tag": "d1d2d943-f66a-4df5-9614-74ddc63bd079"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:02.705564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c56be5f9-58d5-4ae6-a7e6-11807a8ef730 req-04e6590d-03af-4b97-9777-11719eeabf22 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:02.706340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c56be5f9-58d5-4ae6-a7e6-11807a8ef730 req-04e6590d-03af-4b97-9777-11719eeabf22 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:02.706960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c56be5f9-58d5-4ae6-a7e6-11807a8ef730 req-04e6590d-03af-4b97-9777-11719eeabf22 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:02.726772 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c56be5f9-58d5-4ae6-a7e6-11807a8ef730 req-04e6590d-03af-4b97-9777-11719eeabf22 service nova] Creating event network-vif-plugged:d1d2d943-f66a-4df5-9614-74ddc63bd079 for instance d058a391-7f4a-412b-aa5c-60c200b275cb on n-h2-862355-1 Oct 25 03:37:02.732764 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c56be5f9-58d5-4ae6-a7e6-11807a8ef730 req-04e6590d-03af-4b97-9777-11719eeabf22 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354933 Oct 25 03:37:02.734844 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3087/6053] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:02.753337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:02.760138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:02.790979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:02.791562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:02.791950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:02.800007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:02.803661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:02.804715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:03.121641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:03.134425 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08df5b3f-9961-4df9-b86f-2afbcef52fb4 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.385491 Oct 25 03:37:03.135258 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2967/6054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:02 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:03.159094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:03.160086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:03.167331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:03.167830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:03.168822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:03.169540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:03.170039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:03.173442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:03.321599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:03.322712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:03.334974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:03.336715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:03.337525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:03.339425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:03.341264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:03.342045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:03.350370 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d629d64-1859-4a13-80e2-cff20a5d4967 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1464 microversion: 2.1 time: 0.197100 Oct 25 03:37:03.350970 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3088/6055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:03 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:03.395924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:37:03.602587 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db0dd77a-30de-47f8-ac33-7ce83f9981c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 204 len: 0 microversion: 2.1 time: 0.287144 Oct 25 03:37:03.603689 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2968/6056] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:03 2022] DELETE /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:37:03.614263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:03.614888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:03.626731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:03.628185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:03.628953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:03.629888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:03.630523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:03.631109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:03.825055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:03.866414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:03.881581 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b5e6d8d0-6f33-45b8-83cc-0244c79e8a75 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1552 microversion: 2.1 time: 0.271851 Oct 25 03:37:03.893797 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3089/6057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:03 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1552 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:04.171501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:04.172301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:04.184509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:04.185291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:04.185943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:04.186907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:04.187548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:04.188121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:04.375634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:04.376279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:04.386552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:04.398751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:04.399020 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-45586b46-354d-4675-9126-0733e17bee17 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.240376 Oct 25 03:37:04.400402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:04.402148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:04.403096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:04.404793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:04.408647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:04.414490 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2969/6058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:04 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:04.448696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:04.690472 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37aba968-1edd-4e49-a98a-58345613b5ed tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1464 microversion: 2.1 time: 0.320487 Oct 25 03:37:04.691703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3090/6059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:04 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:04.904720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:04.912906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:04.919947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:04.921880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:04.950747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:04.951256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:04.951704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:04.952543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:04.953908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:04.958715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:05.337624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:05.350573 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97ff19ed-7c00-47e1-908e-5774fcffba5b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1552 microversion: 2.1 time: 0.445762 Oct 25 03:37:05.353219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2970/6060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:04 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1552 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:05.426406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:05.427648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:05.445216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:05.447170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:05.450705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:05.450705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:05.450940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:05.451339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:05.451769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:05.715779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:05.716513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:05.732672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:05.737344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:05.737935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:05.738728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:05.739220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:05.740230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:05.772189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:05.784265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36696dfc-761a-464e-b7c1-a056fc2aa7ca tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.361873 Oct 25 03:37:05.785653 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3091/6061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:05 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:06.079116 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6eb13689-afd4-43c1-981a-253c7ae18521 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1649 microversion: 2.1 time: 0.368471 Oct 25 03:37:06.079725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2971/6062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:05 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1649 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:06.101987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:06.102793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:06.109563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.110081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.110513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.111207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.111656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.112076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.266889 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5635becc-cdba-4f8d-8362-017bf37772a8 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1649 microversion: 2.1 time: 0.168561 Oct 25 03:37:06.268258 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3092/6063] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:06 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1649 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:06.285786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-70710350-45c1-475d-933a-2ce8b95ff230 req-43bbfb4f-ead3-43f7-99e9-18f1b2efbf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd70acb-c5e6-4413-a290-c7429ff78912", "name": "network-vif-deleted", "tag": "21f45683-09c7-4e20-92cc-bfaf780b624e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:06.296165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:06.297190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:06.304225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.305023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.305669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.310064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.310836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.311887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.312103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-70710350-45c1-475d-933a-2ce8b95ff230 req-43bbfb4f-ead3-43f7-99e9-18f1b2efbf19 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.313989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-70710350-45c1-475d-933a-2ce8b95ff230 req-43bbfb4f-ead3-43f7-99e9-18f1b2efbf19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.315153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-70710350-45c1-475d-933a-2ce8b95ff230 req-43bbfb4f-ead3-43f7-99e9-18f1b2efbf19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.360704 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-70710350-45c1-475d-933a-2ce8b95ff230 req-43bbfb4f-ead3-43f7-99e9-18f1b2efbf19 service nova] Creating event network-vif-deleted:21f45683-09c7-4e20-92cc-bfaf780b624e for instance 2fd70acb-c5e6-4413-a290-c7429ff78912 on n-h1-862355-1 Oct 25 03:37:06.370253 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-70710350-45c1-475d-933a-2ce8b95ff230 req-43bbfb4f-ead3-43f7-99e9-18f1b2efbf19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091193 Oct 25 03:37:06.371586 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2972/6064] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:06.379338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:06.380372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:06.388072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.388888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.390539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.391997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.393188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.394765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.456501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.457102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.458072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.458612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lazy-loading 'fault' on Instance uuid 2fd70acb-c5e6-4413-a290-c7429ff78912 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:37:06.506657 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-962bb743-3384-4aec-a5e3-5ca9c9600b85 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1649 microversion: 2.1 time: 0.215704 Oct 25 03:37:06.508016 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3093/6065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:06 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1649 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:06.542049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:06.551821 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e36f10c-9a5c-4dda-a84d-d4de2aeddaf7 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 200 len: 1338 microversion: 2.1 time: 0.178828 Oct 25 03:37:06.552877 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2973/6066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:06 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 1338 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:06.697724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1186564272", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "availability_zone": "nova:n-h1-862355-1", "networks": [{"uuid": "993f2c30-39b4-494d-a977-179d9eaa437e"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:06.778891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] validate_networks() for [('993f2c30-39b4-494d-a977-179d9eaa437e', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:37:06.807601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:06.808472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:06.815846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.816564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.817214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:06.818180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:06.818790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:06.819440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:07.178930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:07.189154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2cfc6b2c-1815-4b65-b7ec-dbaff49f3fdc tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.385695 Oct 25 03:37:07.189780 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2974/6067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:06 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:07.519911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:37:07.520438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:37:07.521092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:37:07.521741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:37:07.522345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:37:07.537542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:07.538635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:07.539676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:07.540648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:07.541326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:07.541973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:07.576926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:07.578408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 2fd70acb-c5e6-4413-a290-c7429ff78912] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:07.589737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Getting quotas for project fcd8edbc2c07420e9e9f74d8b9799612. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:37:07.592075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:07.593130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:07.593861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:07.594609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:07.595067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:07.606299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Getting quotas for user 06cd3e7e87bf44168dd82666e00c8f58 and project fcd8edbc2c07420e9e9f74d8b9799612. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:37:07.610447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:07.629764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:37:07.633456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:37:07.647052 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] HTTP exception thrown: Instance 2fd70acb-c5e6-4413-a290-c7429ff78912 could not be found. Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Request method failure captured: Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 HTTP/1.1 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lJ4PaPaMKipyEDPjtXPqLJgzKyri4OVuu-rV_WIuEyoIRXIH4Fu9BzQK4ADNE9s_yFYxGCk0R5ldr3Z3kc-4JQJV9THeEVoLTh5yXYRfz-THkyZTOVWFHStgmnowN86Qci7FeezfvVR92w4JfbH3npaAVYyUlgM8HWA89pI8Zn_A4 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b0eb7ddb59f543ee965a20283f1c1487 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0eb7ddb59f543ee965a20283f1c1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0eb7ddb59f543ee965a20283f1c1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b0eb7ddb59f543ee965a20283f1c1487", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b0eb7ddb59f543ee965a20283f1c1487"}]}] Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b0eb7ddb59f543ee965a20283f1c1487 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestNetworkBasicOps-2114969983-project Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 65b962a4e0844dbfa0493777365cf6cd Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestNetworkBasicOps-2114969983-project Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 2fd70acb-c5e6-4413-a290-c7429ff78912 could not be found. Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '2fd70acb-c5e6-4413-a290-c7429ff78912'} Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd70acb-c5e6-4413-a290-c7429ff78912 could not be found. Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd70acb-c5e6-4413-a290-c7429ff78912 could not be found. Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:07.648825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd70acb-c5e6-4413-a290-c7429ff78912 could not be found. Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Returning 404 to user: Instance 2fd70acb-c5e6-4413-a290-c7429ff78912 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8e8c359-47ed-40a7-866f-71259636e88a tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912" status: 404 len: 111 microversion: 2.1 time: 0.078226 Oct 25 03:37:07.652816 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2975/6068] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:07 2022] GET /compute/v2.1/servers/2fd70acb-c5e6-4413-a290-c7429ff78912 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:37:07.743489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-574353f8-74de-4607-b69e-255d0c92d1ea tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049358 Oct 25 03:37:07.744427 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3094/6069] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:37:07.756088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17a06062-0ff7-46c3-8335-f593d74e5b1c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:07.756983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-17a06062-0ff7-46c3-8335-f593d74e5b1c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:07.896071 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17a06062-0ff7-46c3-8335-f593d74e5b1c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1329 microversion: 2.1 time: 0.143772 Oct 25 03:37:07.906390 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2976/6070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:07 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1329 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:08.064030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f402484-e199-417d-bf02-c22c5345d1f2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '.version_select at 0x7efd3204dd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:08.117779 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f402484-e199-417d-bf02-c22c5345d1f2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-738091138" status: 202 len: 0 microversion: 2.1 time: 0.058135 Oct 25 03:37:08.118396 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3095/6071] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 25 03:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-738091138 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:37:08.213544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:08.215042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:08.226636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:08.236088 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:08.236656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:08.240508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:08.241165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:08.241941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:08.534928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:08.560728 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f8a52eb-bfcb-40a7-a8ea-a766abc2aa6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.351961 Oct 25 03:37:08.562188 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2977/6072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:08 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:08.926634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:08.928179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:08.942136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:08.942637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:08.943088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:08.943847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:08.944311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:08.944742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:09.073074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d8a7a162-a0dd-4bcb-8275-a884604f8189 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1416 microversion: 2.1 time: 0.150484 Oct 25 03:37:09.074005 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3096/6073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:08 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:09.589011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:09.590468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:09.600172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:09.600963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:09.601766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:09.602769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:09.603504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:09.604179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:09.918169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:09.927333 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46b6abcd-ce84-497f-9d59-a7fb3781f6f3 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.342232 Oct 25 03:37:09.928079 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2978/6074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:09 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:10.098959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:10.099733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:10.106805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:10.107422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:10.107958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:10.109027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:10.109465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:10.110143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:10.422965 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4dab1f8d-8d96-48bd-9e25-accfa89e92f3 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.327383 Oct 25 03:37:10.425195 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3097/6075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:10 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:10.956629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:10.957307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:10.974971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:10.975482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:10.975930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:10.979230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.004162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:11.004632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:11.267884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:11.279015 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e766b8a-b577-42ba-8236-c3e53793953c tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.328683 Oct 25 03:37:11.281076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2979/6076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:10 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:11.359211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-31fee4f3-73ef-4eb0-927b-0988130c1a48 req-9d181c60-ea1f-4686-bee9-8f5371e36313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b6b63f-a76a-4a1c-b782-f83babc6cef4", "tag": "aebac122-5b65-4e91-b042-ebc34358ce66"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:11.391562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-31fee4f3-73ef-4eb0-927b-0988130c1a48 req-9d181c60-ea1f-4686-bee9-8f5371e36313 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.392299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-31fee4f3-73ef-4eb0-927b-0988130c1a48 req-9d181c60-ea1f-4686-bee9-8f5371e36313 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:11.392908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-31fee4f3-73ef-4eb0-927b-0988130c1a48 req-9d181c60-ea1f-4686-bee9-8f5371e36313 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:11.423068 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-31fee4f3-73ef-4eb0-927b-0988130c1a48 req-9d181c60-ea1f-4686-bee9-8f5371e36313 service nova] Creating event network-changed:aebac122-5b65-4e91-b042-ebc34358ce66 for instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 on n-h1-862355-1 Oct 25 03:37:11.430611 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-31fee4f3-73ef-4eb0-927b-0988130c1a48 req-9d181c60-ea1f-4686-bee9-8f5371e36313 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076922 Oct 25 03:37:11.431759 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3098/6077] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:11.452362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:11.453229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:11.459639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.460192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:11.460565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:11.461270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.461757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:11.462190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:11.677261 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12752f1a-75c8-415d-a0d8-976460a85c90 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.228593 Oct 25 03:37:11.678236 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2980/6078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:11 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:11.768011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:11.768767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:11.776967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.777603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:11.778162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:11.779110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.779779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:11.780455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:11.784187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e94c6e3c-a8e2-4887-9b0b-b314bb274913 req-21e5505d-7f25-4fc8-916b-fab7af09cde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1fdbcd-fcba-4aea-819a-9693ee03114c", "tag": "5a2879f7-b7fc-441d-8f71-04e9ff350d8d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:11.794679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e94c6e3c-a8e2-4887-9b0b-b314bb274913 req-21e5505d-7f25-4fc8-916b-fab7af09cde8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.795159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e94c6e3c-a8e2-4887-9b0b-b314bb274913 req-21e5505d-7f25-4fc8-916b-fab7af09cde8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:11.796159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e94c6e3c-a8e2-4887-9b0b-b314bb274913 req-21e5505d-7f25-4fc8-916b-fab7af09cde8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:11.813529 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e94c6e3c-a8e2-4887-9b0b-b314bb274913 req-21e5505d-7f25-4fc8-916b-fab7af09cde8 service nova] Creating event network-changed:5a2879f7-b7fc-441d-8f71-04e9ff350d8d for instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c on n-h2-862355-1 Oct 25 03:37:11.819586 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e94c6e3c-a8e2-4887-9b0b-b314bb274913 req-21e5505d-7f25-4fc8-916b-fab7af09cde8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041060 Oct 25 03:37:11.820667 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2981/6079] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:11.822388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:37:11.973803 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6104025-0b3a-4924-81e9-5052f9649b1e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 204 len: 0 microversion: 2.1 time: 0.209827 Oct 25 03:37:11.975137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3099/6080] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:11 2022] DELETE /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:37:11.984647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:11.985349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:11.992672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:11.999431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:12.000335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:12.001361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:12.002029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:12.002612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:12.200063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:12.208597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:12.211805 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ede25cd-6990-49dc-9a8e-017401cc5023 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1668 microversion: 2.1 time: 0.231508 Oct 25 03:37:12.212831 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2982/6081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:11 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:12.309451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:12.310856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:12.318721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:12.319205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:12.319810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:12.321383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:12.322009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:12.322436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:12.538770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:12.548147 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-079f6b9f-646d-4f34-9183-d62e8bf4edd1 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1510 microversion: 2.1 time: 0.247488 Oct 25 03:37:12.549120 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3100/6082] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:12 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:12.701554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:12.703064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:12.711123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:12.711686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:12.712760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:12.713481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:12.713973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:12.714664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.236600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:13.237310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:13.243696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.244167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.244606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.245345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.245812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.246238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.360278 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ade4f681-30f8-4315-9b51-9b4746073446 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.662753 Oct 25 03:37:13.376841 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2983/6083] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:12 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:13.571667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:13.572503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:13.579741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.580316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.580821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.581785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.582312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.582969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.611195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:13.638278 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6705ffcd-adf9-4994-8e3d-cbd215192024 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1668 microversion: 2.1 time: 0.405562 Oct 25 03:37:13.642010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3101/6084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:13 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1668 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:13.807983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:13.816779 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-10790153-0ea8-4f1f-a9d8-e6fca2a0f8ae tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1487 microversion: 2.1 time: 0.248926 Oct 25 03:37:13.829169 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2984/6085] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:13 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1487 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:13.840605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1596308941"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:13.845245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:13.853187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.854023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.855123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.855930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.856598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.857103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.932789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a7c7218d-87ae-401b-aef1-c0cdd88a0c1f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "PUT /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1060 microversion: 2.1 time: 0.096242 Oct 25 03:37:13.942863 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3102/6086] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:37:13 2022] PUT /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1060 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:13.953114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:13.953765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:13.959852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.960340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.960784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:13.961478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:13.961952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:13.962378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.107022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:14.115448 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c66e124-c068-455d-b6dd-a8d30dfc3bb7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1487 microversion: 2.1 time: 0.166387 Oct 25 03:37:14.116033 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2985/6087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:13 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1487 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:14.138512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:14.139154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:14.146040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.146517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.146978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.147698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.148150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.148566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.384069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:14.384726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:14.391763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.392260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.392696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.393408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.393900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.394339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.448945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:14.460510 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-399cd119-adff-4cb2-9034-08650a1d546f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1487 microversion: 2.1 time: 0.325895 Oct 25 03:37:14.461660 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3103/6088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:14 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1487 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:14.487364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:14.487860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:14.494335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.494814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.495271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.495995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.496494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.496920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.530517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:37:14.566141 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e679320d-7c70-47e0-8eb7-58e45e84269b tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.186120 Oct 25 03:37:14.582234 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2986/6089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:14 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:14.611241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e02e0977-9bf9-4ae6-a186-d2602a48b3dd req-4657c35c-a1df-4945-9d57-f5b4302101a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1fdbcd-fcba-4aea-819a-9693ee03114c", "name": "network-vif-deleted", "tag": "5a2879f7-b7fc-441d-8f71-04e9ff350d8d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:14.640506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e02e0977-9bf9-4ae6-a186-d2602a48b3dd req-4657c35c-a1df-4945-9d57-f5b4302101a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.641294 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34f8ab7e-3b88-4638-af59-b6fee7b610e6 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 204 len: 0 microversion: 2.1 time: 0.158171 Oct 25 03:37:14.641973 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3104/6090] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:14 2022] DELETE /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:37:14.646033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e02e0977-9bf9-4ae6-a186-d2602a48b3dd req-4657c35c-a1df-4945-9d57-f5b4302101a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.648282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e02e0977-9bf9-4ae6-a186-d2602a48b3dd req-4657c35c-a1df-4945-9d57-f5b4302101a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.665842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:14.666944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:14.669579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e02e0977-9bf9-4ae6-a186-d2602a48b3dd req-4657c35c-a1df-4945-9d57-f5b4302101a7 service nova] Creating event network-vif-deleted:5a2879f7-b7fc-441d-8f71-04e9ff350d8d for instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c on n-h2-862355-1 Oct 25 03:37:14.676711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.677530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.677913 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e02e0977-9bf9-4ae6-a186-d2602a48b3dd req-4657c35c-a1df-4945-9d57-f5b4302101a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071328 Oct 25 03:37:14.678388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.679879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.680877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.681831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.682750 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2987/6091] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:37:14.689756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:14.690470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:14.700046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.700046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.700046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.705033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.705448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:14.705864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.706309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.835464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:14.863538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:14.874668 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9c323874-110f-41ba-bcd0-914bafeac483 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1493 microversion: 2.1 time: 0.223811 Oct 25 03:37:14.891063 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3105/6092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:14 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1493 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:14.891658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-702f6639-1ef3-4d80-a2d0-806b3becec97 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1333 microversion: 2.1 time: 0.187307 Oct 25 03:37:14.891658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2988/6093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:14 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1333 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:14.891923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:14.891923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:14.899479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.899981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.900449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.901193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:14.901860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:14.910314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:14.945713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f2ddb54-8adf-4a1e-bb62-85ec749c927c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/ips" status: 200 len: 150 microversion: 2.1 time: 0.067393 Oct 25 03:37:14.945713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3106/6094] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:37:14 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:15.591152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:15.591929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:15.599993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:15.600621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:15.601169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:15.602012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:15.602578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:15.603119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:15.756884 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aeae20ec-da7c-4cac-a6c5-57ece5910b04 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.170072 Oct 25 03:37:15.757816 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2989/6095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:15 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:15.898590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:15.899205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:15.905534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:15.906462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:15.907010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:15.907628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:15.908073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:15.911060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:15.911060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:15.911060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:15.917890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:15.918748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:15.919357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:15.921442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:15.922230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:15.922826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:15.969706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:15.970221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:15.970660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:15.971237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lazy-loading 'fault' on Instance uuid 7e1fdbcd-fcba-4aea-819a-9693ee03114c {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:37:16.023848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:16.033855 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-28f55cbd-a0bf-47cf-a0b6-8f72bc507eba tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 200 len: 1338 microversion: 2.1 time: 0.134644 Oct 25 03:37:16.034843 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2990/6096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:15 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 1338 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:16.104499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:16.126660 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d6c5f258-15ad-4407-a4de-656df57d0b6f tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1493 microversion: 2.1 time: 0.231485 Oct 25 03:37:16.127320 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3107/6097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:15 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1493 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:16.383660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f0f07ca-129a-4048-86cd-aab40e925ebe"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:16.386441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:16.397267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:16.399536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:16.402225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:16.404347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:16.404741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:16.405833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:16.789391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:16.790731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:16.801941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:16.802803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:16.803252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:16.804011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:16.804898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:16.805784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:16.909486 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b05aa6ad-9655-4d66-b581-c7c6ba4c1eda tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506187 Oct 25 03:37:16.911322 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2991/6098] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:37:16 2022] POST /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:17.059152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:17.060159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: 7e1fdbcd-fcba-4aea-819a-9693ee03114c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:17.068937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:17.069429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:17.078600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:17.079408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:17.080060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:17.080677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:17.084145 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff334968-d0f6-481a-b146-2b9a47ac8235 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.304821 Oct 25 03:37:17.087601 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3108/6099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:16 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:17.122478 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] HTTP exception thrown: Instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c could not be found. Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Request method failure captured: Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c HTTP/1.1 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lJ4PaPaMKipyEDPjtXPqLJgzKyri4OVuu-rV_WIuEyoIRXIH4Fu9BzQK4ADNE9s_yFYxGCk0R5ldr3Z3kc-4JQJV9THeEVoLTh5yXYRfz-THkyZTOVWFHStgmnowN86Qci7FeezfvVR92w4JfbH3npaAVYyUlgM8HWA89pI8Zn_A4 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b0eb7ddb59f543ee965a20283f1c1487 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0eb7ddb59f543ee965a20283f1c1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0eb7ddb59f543ee965a20283f1c1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b0eb7ddb59f543ee965a20283f1c1487", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b0eb7ddb59f543ee965a20283f1c1487"}]}] Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b0eb7ddb59f543ee965a20283f1c1487 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestNetworkBasicOps-2114969983-project Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 65b962a4e0844dbfa0493777365cf6cd Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestNetworkBasicOps-2114969983-project Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c could not be found. Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '7e1fdbcd-fcba-4aea-819a-9693ee03114c'} Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c could not be found. Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c could not be found. Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:17.124817 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c could not be found. Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Returning 404 to user: Instance 7e1fdbcd-fcba-4aea-819a-9693ee03114c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:17.129635 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51e2f9c4-f643-49be-9f89-494a02632d0f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c" status: 404 len: 111 microversion: 2.1 time: 0.071562 Oct 25 03:37:17.130436 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2992/6100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:17 2022] GET /compute/v2.1/servers/7e1fdbcd-fcba-4aea-819a-9693ee03114c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:17.152437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:17.153060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:17.161622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:17.162329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:17.163089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:17.163974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:17.165420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:17.166097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:17.189557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4890774d-dd19-4618-8b75-dd653b7b677c req-2fed7196-2e18-4061-9b64-1c7a069c97d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6e96dc-da8e-4c32-8606-0fb376f1dbe6", "name": "network-vif-deleted", "tag": "da80024f-9504-404f-b172-5f8716d39171"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:17.212150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4890774d-dd19-4618-8b75-dd653b7b677c req-2fed7196-2e18-4061-9b64-1c7a069c97d5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:17.213868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4890774d-dd19-4618-8b75-dd653b7b677c req-2fed7196-2e18-4061-9b64-1c7a069c97d5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:17.214752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4890774d-dd19-4618-8b75-dd653b7b677c req-2fed7196-2e18-4061-9b64-1c7a069c97d5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:17.263186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4890774d-dd19-4618-8b75-dd653b7b677c req-2fed7196-2e18-4061-9b64-1c7a069c97d5 service nova] Creating event network-vif-deleted:da80024f-9504-404f-b172-5f8716d39171 for instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 on n-h2-862355-1 Oct 25 03:37:17.270081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4890774d-dd19-4618-8b75-dd653b7b677c req-2fed7196-2e18-4061-9b64-1c7a069c97d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084619 Oct 25 03:37:17.272156 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2993/6101] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:17.341139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:17.361916 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ab4bdfc-fad6-4506-98cd-2938a4576fed tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 200 len: 1451 microversion: 2.1 time: 0.212419 Oct 25 03:37:17.364701 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3109/6102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:17 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:17.507693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07261c0e-8e4a-406b-a329-1d3a30119bda tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '.version_select at 0x7efd3351c670>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:17.546701 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07261c0e-8e4a-406b-a329-1d3a30119bda tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1359334983" status: 202 len: 0 microversion: 2.1 time: 0.043836 Oct 25 03:37:17.547507 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2994/6103] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 25 03:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1359334983 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:37:18.119613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.120848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.122848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:18.123668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:18.126194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:18.133114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.133951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.134703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.135624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.136308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.137659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.350671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:18.355188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e452c3d0-dfee-46bf-8950-2843307940bb req-837cfa51-688f-4591-b4b1-a233e059596f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b6b63f-a76a-4a1c-b782-f83babc6cef4", "name": "network-vif-plugged", "status": "completed", "tag": "aebac122-5b65-4e91-b042-ebc34358ce66"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:18.367955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e452c3d0-dfee-46bf-8950-2843307940bb req-837cfa51-688f-4591-b4b1-a233e059596f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.368430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e452c3d0-dfee-46bf-8950-2843307940bb req-837cfa51-688f-4591-b4b1-a233e059596f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.369079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e452c3d0-dfee-46bf-8950-2843307940bb req-837cfa51-688f-4591-b4b1-a233e059596f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.387280 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e452c3d0-dfee-46bf-8950-2843307940bb req-837cfa51-688f-4591-b4b1-a233e059596f service nova] Creating event network-vif-plugged:aebac122-5b65-4e91-b042-ebc34358ce66 for instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 on n-h1-862355-1 Oct 25 03:37:18.395378 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e452c3d0-dfee-46bf-8950-2843307940bb req-837cfa51-688f-4591-b4b1-a233e059596f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044633 Oct 25 03:37:18.397332 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2995/6104] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:37:18.404547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.407095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.417287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.418245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.422257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.423957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.424773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.425519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.445967 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 HTTP/1.1 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '6c6e96dc-da8e-4c32-8606-0fb376f1dbe6'} Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.450304 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.456358 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.456358 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.456358 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.456358 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.456358 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.456358 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.456358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.460858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f45263ca-02f8-48ad-83f4-6e258800cdbb tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 404 len: 111 microversion: 2.1 time: 0.058437 Oct 25 03:37:18.460858 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2996/6105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.475041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.475786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.480526 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57767067-287c-49bd-b893-76ee9af861a2 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.365291 Oct 25 03:37:18.482629 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3110/6106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:18.487438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.487950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.488412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.489129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.489586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.490053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.504850 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 HTTP/1.1 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '6c6e96dc-da8e-4c32-8606-0fb376f1dbe6'} Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.506449 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4923d9e3-724b-4d21-9d45-ea82717a62ce tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 404 len: 111 microversion: 2.1 time: 0.042141 Oct 25 03:37:18.510292 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2997/6107] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:18 2022] DELETE /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:37:18.516969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.517649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.534580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.535446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.536141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.537075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.538248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.539007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.564244 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 HTTP/1.1 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6c6e96dc-da8e-4c32-8606-0fb376f1dbe6'} Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.566409 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.570150 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1fffcb8a-0e63-42ba-afe3-dc306fbd6697 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6" status: 404 len: 111 microversion: 2.1 time: 0.056250 Oct 25 03:37:18.571915 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3111/6108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/6c6e96dc-da8e-4c32-8606-0fb376f1dbe6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.581215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.582706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.589943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.590751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.591433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.592451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.594023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.594731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.623145 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 HTTP/1.1 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e18345b4-72e0-4e61-9570-a442554d4d90'} Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.628048 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.632929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.637601 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-67e20c07-c381-49a3-8c76-ead805522fdf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 404 len: 111 microversion: 2.1 time: 0.061151 Oct 25 03:37:18.638313 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2998/6109] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:18 2022] DELETE /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.649341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.649341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e18345b4-72e0-4e61-9570-a442554d4d90] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.656061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.656874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.657487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.658406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.658874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.659288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.674373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 HTTP/1.1 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e18345b4-72e0-4e61-9570-a442554d4d90'} Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.675919 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance e18345b4-72e0-4e61-9570-a442554d4d90 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.680450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2656d2b6-9220-422b-84df-bd9f3c0a5d79 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90" status: 404 len: 111 microversion: 2.1 time: 0.034417 Oct 25 03:37:18.681487 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3112/6110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/e18345b4-72e0-4e61-9570-a442554d4d90 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.686389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.686980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.693180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.693898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.694591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.695509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.696038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.696534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.712725 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf HTTP/1.1 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf'} Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.714432 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.719703 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db168f9c-15d1-468e-895d-2859b067e61a tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 404 len: 111 microversion: 2.1 time: 0.035425 Oct 25 03:37:18.720592 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 2999/6111] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:18 2022] DELETE /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:37:18.728101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.728834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.735574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.736156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.736662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.737463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.738056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.738589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.753360 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf HTTP/1.1 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf'} Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.755325 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.760146 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.760146 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.760146 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.760146 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.760146 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. Oct 25 03:37:18.760146 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.760146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.761272 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3bfe6deb-3599-4f11-86e7-c93ec96260c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf" status: 404 len: 111 microversion: 2.1 time: 0.037005 Oct 25 03:37:18.762153 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3113/6112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/6e08c695-a4a5-4f2d-864a-d4ab6f0deeaf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.770360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.770922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.778037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.778878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.779410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.780922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.781460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.782022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.797011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 HTTP/1.1 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '2f4b3559-c2d0-465c-9684-8c8b2451b132'} Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.798762 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.805059 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9f7616d-94b7-44de-95fe-32549552cb80 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 404 len: 111 microversion: 2.1 time: 0.037504 Oct 25 03:37:18.807898 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3000/6113] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:18 2022] DELETE /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.815786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.816670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 2f4b3559-c2d0-465c-9684-8c8b2451b132] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.827330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.827982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.828806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.829796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.830349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.830853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.845705 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 HTTP/1.1 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '2f4b3559-c2d0-465c-9684-8c8b2451b132'} Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.847478 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 2f4b3559-c2d0-465c-9684-8c8b2451b132 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.853032 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f7c2b86e-6c3c-4007-a371-c9917596b9ef tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132" status: 404 len: 111 microversion: 2.1 time: 0.040868 Oct 25 03:37:18.861032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.861646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.861850 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3114/6114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/2f4b3559-c2d0-465c-9684-8c8b2451b132 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:37:18.868746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.869375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.869921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.870693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.871220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.871760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.887153 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 HTTP/1.1 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33'} Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.888825 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.893957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.894827 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c6a8702c-1d3a-40d5-b829-6ea76c630a56 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 404 len: 111 microversion: 2.1 time: 0.037887 Oct 25 03:37:18.898433 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3001/6115] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:18 2022] DELETE /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.903313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.903933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.911018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.911537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.911971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.912675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.913124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.913547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.929052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 HTTP/1.1 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33'} Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.930632 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7fb67932-249b-4926-af1a-92d3ce9c4bd8 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33" status: 404 len: 111 microversion: 2.1 time: 0.032668 Oct 25 03:37:18.936231 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3115/6116] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/c64f5975-a3c6-4fb8-9dbe-c1774a1d3f33 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:37:18.942202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.942844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.949545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.950223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.950795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.951614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.952237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.952938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.969550 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 HTTP/1.1 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9a769371-0c0e-4382-bc3c-f3e5986e1509'} Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:18.971350 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:18.975824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:18.977505 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc49302f-4b1b-4abf-80f3-2f5dd764458b tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 404 len: 111 microversion: 2.1 time: 0.039166 Oct 25 03:37:18.981968 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3002/6117] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:18 2022] DELETE /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:18.987610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:18.988245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: 9a769371-0c0e-4382-bc3c-f3e5986e1509] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:18.995373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.995868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.996484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:18.997356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:18.998001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:18.998620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:19.014466 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 HTTP/1.1 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9a769371-0c0e-4382-bc3c-f3e5986e1509'} Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.016259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance 9a769371-0c0e-4382-bc3c-f3e5986e1509 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5bada515-c2c3-40dc-b581-b3dbd7b381dd tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509" status: 404 len: 111 microversion: 2.1 time: 0.034736 Oct 25 03:37:19.020425 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3116/6118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:18 2022] GET /compute/v2.1/servers/9a769371-0c0e-4382-bc3c-f3e5986e1509 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:37:19.027464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3f4b23e1-c0da-4391-a2ab-d51de5d5bbd7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:19.028105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3f4b23e1-c0da-4391-a2ab-d51de5d5bbd7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: bf58f4b5-368e-40d6-b914-2eb578fe7b55] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:19.033909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:19.035737 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3f4b23e1-c0da-4391-a2ab-d51de5d5bbd7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3f4b23e1-c0da-4391-a2ab-d51de5d5bbd7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55 HTTP/1.1 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'bf58f4b5-368e-40d6-b914-2eb578fe7b55'} Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:19.037468 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3f4b23e1-c0da-4391-a2ab-d51de5d5bbd7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3f4b23e1-c0da-4391-a2ab-d51de5d5bbd7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55" status: 404 len: 111 microversion: 2.1 time: 0.017922 Oct 25 03:37:19.042176 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3003/6119] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:19 2022] DELETE /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:19.051009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c9e9ef4-fa7a-4ce0-99c6-a0718fa79595 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:19.051009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c9e9ef4-fa7a-4ce0-99c6-a0718fa79595 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: bf58f4b5-368e-40d6-b914-2eb578fe7b55] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:19.056729 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0c9e9ef4-fa7a-4ce0-99c6-a0718fa79595 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c9e9ef4-fa7a-4ce0-99c6-a0718fa79595 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55 HTTP/1.1 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'bf58f4b5-368e-40d6-b914-2eb578fe7b55'} Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:19.058470 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:19.063871 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:19.063871 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:19.063871 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. Oct 25 03:37:19.063871 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:19.064182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c9e9ef4-fa7a-4ce0-99c6-a0718fa79595 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance bf58f4b5-368e-40d6-b914-2eb578fe7b55 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:19.065200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0c9e9ef4-fa7a-4ce0-99c6-a0718fa79595 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55" status: 404 len: 111 microversion: 2.1 time: 0.019645 Oct 25 03:37:19.066127 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3117/6120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:19 2022] GET /compute/v2.1/servers/bf58f4b5-368e-40d6-b914-2eb578fe7b55 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:19.074625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:19.075628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:19.083318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:19.083959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:19.084654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:19.085476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:19.086080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:19.086620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:19.115783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:37:19.212159 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-274aae2b-0b2f-4d4f-837b-016c10258800 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 204 len: 0 microversion: 2.1 time: 0.141813 Oct 25 03:37:19.212993 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3004/6121] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:19 2022] DELETE /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:37:19.222090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:19.222893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:19.231000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:19.231487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:19.231923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:19.232646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:19.233823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:19.233823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:19.483419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:19.496743 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54f0ccf0-f741-4054-be9a-6ee1955c11c7 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1478 microversion: 2.1 time: 0.279499 Oct 25 03:37:19.499159 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3118/6122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:19 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1478 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:19.506835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:19.508078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:19.515822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:19.516519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:19.517136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:19.518020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:19.518623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:19.519200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:19.540607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:19.788361 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa3c9056-cc9f-4f33-a208-c7a4f916122c tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1464 microversion: 2.1 time: 0.285439 Oct 25 03:37:19.791388 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3005/6123] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:19 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:20.525221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:20.526111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:20.535072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:20.535981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:20.536721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:20.537626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:20.538341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:20.539127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:20.778323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:20.791959 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-de93e256-f58e-4f96-910d-98fc68f7e0bf tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1478 microversion: 2.1 time: 0.270484 Oct 25 03:37:20.793703 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3119/6124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:20 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1478 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:20.815430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:20.816136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:20.836840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:20.838841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:20.839549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:20.840297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:20.840758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:20.841404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:21.539870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47e6af34-f369-4b3f-a93a-809cc766578a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1650 microversion: 2.1 time: 0.722528 Oct 25 03:37:21.547675 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3006/6125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:20 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1650 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:21.564430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:21.565615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:21.572935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:21.573657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:21.578315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:21.579326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:21.579970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:21.580550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:21.830852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:21.831483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:21.846387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:21.846885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:21.850577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:21.851349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:21.851826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:21.854849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:21.927358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c666c3f6-9557-46d1-8439-9ed3a7abc84d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1650 microversion: 2.1 time: 0.367241 Oct 25 03:37:21.951048 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3120/6126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:21 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1650 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:21.964135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:21.966371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:22.005170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:22.005710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:22.006165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:22.008462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:22.009604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:22.010462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:22.501089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a467006-d7b8-4842-9923-bb7b7ce3f943 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1650 microversion: 2.1 time: 0.541286 Oct 25 03:37:22.501768 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3121/6127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:21 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1650 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:22.527660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:22.528243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:22.535515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:22.536027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:22.536651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:22.537529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:22.538165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:22.538749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:22.568231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:37:22.650761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:22.660359 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b1be75d-ba3d-49ff-97f8-7e4b7ccd5af9 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1478 microversion: 2.1 time: 0.845542 Oct 25 03:37:22.664885 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3007/6128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:21 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1478 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:22.704809 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1c9a07df-a236-4eb2-a193-3d994a6c8395 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 204 len: 0 microversion: 2.1 time: 0.180873 Oct 25 03:37:22.710664 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3122/6129] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:22 2022] DELETE /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:37:22.715757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:22.716706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:22.729074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:22.729891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:22.730542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:22.731683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:22.732673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:22.734167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:22.769580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5406efac-6f2c-4dc0-a412-9f8174c9a630 req-4ad80cf6-d3a4-4f4e-82ab-f18d6195461a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17c89a5-cc1c-4274-90f7-aaeee63b851a", "name": "network-vif-deleted", "tag": "9aab4c5c-ca5e-4f38-b008-9c6bbb7387c9"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:22.781720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5406efac-6f2c-4dc0-a412-9f8174c9a630 req-4ad80cf6-d3a4-4f4e-82ab-f18d6195461a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:22.782550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5406efac-6f2c-4dc0-a412-9f8174c9a630 req-4ad80cf6-d3a4-4f4e-82ab-f18d6195461a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:22.783145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5406efac-6f2c-4dc0-a412-9f8174c9a630 req-4ad80cf6-d3a4-4f4e-82ab-f18d6195461a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:22.800445 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5406efac-6f2c-4dc0-a412-9f8174c9a630 req-4ad80cf6-d3a4-4f4e-82ab-f18d6195461a service nova] Creating event network-vif-deleted:9aab4c5c-ca5e-4f38-b008-9c6bbb7387c9 for instance e17c89a5-cc1c-4274-90f7-aaeee63b851a on n-h1-862355-1 Oct 25 03:37:22.807072 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5406efac-6f2c-4dc0-a412-9f8174c9a630 req-4ad80cf6-d3a4-4f4e-82ab-f18d6195461a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042698 Oct 25 03:37:22.807958 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3123/6130] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:37:22.905401 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c24486f-78c6-4aba-8deb-8551c9f96466 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1656 microversion: 2.1 time: 0.193326 Oct 25 03:37:22.907090 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3008/6131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:22 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1656 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:23.694399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:23.695023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:23.701257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:23.702784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:23.703227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:23.704292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:23.704852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:23.705180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:23.781979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcfed9af4c79401faac288652541cd10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd1e23bd3514ad0a66d7c09232b87b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:23.790260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eea9ed71-2893-4ec5-93c4-22ffaa2c0f40 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 200 len: 1436 microversion: 2.1 time: 0.101236 Oct 25 03:37:23.797445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3124/6132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:23 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 1436 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:23.932709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:23.933378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:23.942558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:23.943053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:23.943501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:23.944223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:23.944803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:23.945179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:24.115338 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc87e20c-92af-4f3f-b3fe-3b30f2ace89d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1656 microversion: 2.1 time: 0.186934 Oct 25 03:37:24.116165 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3009/6133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:23 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1656 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:24.814874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:24.816087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] [instance: e17c89a5-cc1c-4274-90f7-aaeee63b851a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:24.831014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:24.835425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:24.836084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:24.837047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:24.837799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:24.838924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:24.840020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f7e5e91d-349d-4531-a7ec-28ed7175ea22 req-b72ddde3-0b37-4282-a218-4cd39f6d06d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b6b63f-a76a-4a1c-b782-f83babc6cef4", "name": "network-vif-deleted", "tag": "aebac122-5b65-4e91-b042-ebc34358ce66"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:24.877044 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] HTTP exception thrown: Instance e17c89a5-cc1c-4274-90f7-aaeee63b851a could not be found. Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Request method failure captured: Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a HTTP/1.1 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1lHgQGH2nVQdrRyenirx6pFvXF5XTx53Dp4Jzx2V5X1yrOhU3QVGLmKEZotWGEwcGM1GtiXqmSKq3njMPKePs_48fe8MUXcCRpcfTC4QN6U78U6FCBbB5dZt7b6SJp1ephCbv1YAUQtEkXYV5IgjMndyy7cAr0g9wXWsdolgjwPN2g Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bd1e23bd3514ad0a66d7c09232b87b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bd1e23bd3514ad0a66d7c09232b87b1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bd1e23bd3514ad0a66d7c09232b87b1"}]}] Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersTestJSON-894893790 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 0bd1e23bd3514ad0a66d7c09232b87b1 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersTestJSON-894893790 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersTestJSON-894893790-project Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: dcfed9af4c79401faac288652541cd10 Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersTestJSON-894893790-project Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e17c89a5-cc1c-4274-90f7-aaeee63b851a could not be found. Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e17c89a5-cc1c-4274-90f7-aaeee63b851a'} Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17c89a5-cc1c-4274-90f7-aaeee63b851a could not be found. Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17c89a5-cc1c-4274-90f7-aaeee63b851a could not be found. Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:24.885154 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:24.890719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:24.890719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:24.890719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:24.890719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:24.890719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17c89a5-cc1c-4274-90f7-aaeee63b851a could not be found. Oct 25 03:37:24.890719 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:37:24.891531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f7e5e91d-349d-4531-a7ec-28ed7175ea22 req-b72ddde3-0b37-4282-a218-4cd39f6d06d0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:24.891630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f7e5e91d-349d-4531-a7ec-28ed7175ea22 req-b72ddde3-0b37-4282-a218-4cd39f6d06d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:24.892239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f7e5e91d-349d-4531-a7ec-28ed7175ea22 req-b72ddde3-0b37-4282-a218-4cd39f6d06d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:24.901319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] Returning 404 to user: Instance e17c89a5-cc1c-4274-90f7-aaeee63b851a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:24.913794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-14781bf3-f434-4d7f-9583-6c42df140a60 tempest-ServersTestJSON-894893790 tempest-ServersTestJSON-894893790-project] 10.222.0.36 "GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a" status: 404 len: 111 microversion: 2.1 time: 0.096280 Oct 25 03:37:24.913794 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3125/6134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:24 2022] GET /compute/v2.1/servers/e17c89a5-cc1c-4274-90f7-aaeee63b851a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:24.921940 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f7e5e91d-349d-4531-a7ec-28ed7175ea22 req-b72ddde3-0b37-4282-a218-4cd39f6d06d0 service nova] Creating event network-vif-deleted:aebac122-5b65-4e91-b042-ebc34358ce66 for instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 on n-h1-862355-1 Oct 25 03:37:24.934182 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f7e5e91d-349d-4531-a7ec-28ed7175ea22 req-b72ddde3-0b37-4282-a218-4cd39f6d06d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098897 Oct 25 03:37:24.935480 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3010/6135] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:37:25.141973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:25.143094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:25.149343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:25.150805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:25.151468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:25.152676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:25.153823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:25.154470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:25.189928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:25.190670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:25.191318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:25.191985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lazy-loading 'fault' on Instance uuid d2b6b63f-a76a-4a1c-b782-f83babc6cef4 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:37:25.289599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:25.302656 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9e26fad-bd9e-4bc7-b9b3-05edc7a40686 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 200 len: 1454 microversion: 2.1 time: 0.164857 Oct 25 03:37:25.304990 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3126/6136] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:25 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:26.331758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:26.332469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d2b6b63f-a76a-4a1c-b782-f83babc6cef4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:26.339633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:26.340145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:26.340572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:26.341282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:26.341907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:26.342410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:26.359812 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] HTTP exception thrown: Instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 could not be found. Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Request method failure captured: Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 HTTP/1.1 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1nV33wVE0OKVoV4QXriCd7sx8rtQeLx1gUUp5owvHskb8rZhCbhQncDsVqT-kIE30Pn8fadj7Ssyw1um-xOUxxL-tB4YLHELlzHAmbVqb5TNILLsIbcbru6VsDk4aKBSAL-pzBsr27LJWhfMRZ8WpVR8GU6hHV52-DS62h_5anQt34 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: fcd8edbc2c07420e9e9f74d8b9799612 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestServerMultinode-2110047910 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fcd8edbc2c07420e9e9f74d8b9799612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fcd8edbc2c07420e9e9f74d8b9799612"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fcd8edbc2c07420e9e9f74d8b9799612", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fcd8edbc2c07420e9e9f74d8b9799612"}]}] Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestServerMultinode-2110047910 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: fcd8edbc2c07420e9e9f74d8b9799612 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestServerMultinode-2110047910 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestServerMultinode-2110047910-project-admin Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 06cd3e7e87bf44168dd82666e00c8f58 Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestServerMultinode-2110047910-project-admin Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 could not be found. Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'd2b6b63f-a76a-4a1c-b782-f83babc6cef4'} Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 could not be found. Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 could not be found. Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:26.361511 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 could not be found. Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Returning 404 to user: Instance d2b6b63f-a76a-4a1c-b782-f83babc6cef4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87502707-d9ca-4c89-a152-e19c7a42899d tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4" status: 404 len: 111 microversion: 2.1 time: 0.037734 Oct 25 03:37:26.369499 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3011/6137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:26 2022] GET /compute/v2.1/servers/d2b6b63f-a76a-4a1c-b782-f83babc6cef4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:26.375087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:26.375591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:26.384626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:26.385343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:26.385825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:26.386554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:26.387016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:26.387448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:26.418729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:37:26.521664 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0665979c-653f-4ae7-8746-0bcfbef96b4a tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 204 len: 0 microversion: 2.1 time: 0.152347 Oct 25 03:37:26.522927 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3127/6138] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:37:26 2022] DELETE /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:37:26.531464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:26.532327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:26.540492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:26.541275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:26.541898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:26.542867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:26.543541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:26.544823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:26.729433 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea6216bd-2d0f-45e9-bb8c-33fea9a2d590 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1655 microversion: 2.1 time: 0.201755 Oct 25 03:37:26.730153 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3012/6139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:26 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1655 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:27.766996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:27.767789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:27.775704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:27.776631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:27.777351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:27.778646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:27.779356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:27.780525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:28.161691 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43ae4dfd-51ab-40c8-8c18-eb4b52d17ca0 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1655 microversion: 2.1 time: 0.406602 Oct 25 03:37:28.175240 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3128/6140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:27 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1655 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:29.204359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:29.206224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:29.227217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:29.233166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:29.233618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:29.234403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:29.234866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:29.235297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:30.076633 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-32c9b427-5fac-4c4d-b233-3ead48cbe23f tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1655 microversion: 2.1 time: 0.879458 Oct 25 03:37:30.077646 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3013/6141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:29 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1655 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:30.183515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d3edf466-bc59-441f-aa68-22c8bc995414 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: .version_select at 0x7efd33429dc0>, body: {"keypair": {"name": "tempest-keypair-1815319781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW7KtTRv9hHwS5dIumG5FnXvjazdUbfo+xT1LS5McWSoBO+knW3HVYAy5sK07HAlAyYtfqg+t8lnTKoym5vs0dm+xQZt91ukNJp+MHZOWkhjK3EhVfUhjx3Nx1MjL8eSw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:30.207729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d3edf466-bc59-441f-aa68-22c8bc995414 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:37:30.220847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d3edf466-bc59-441f-aa68-22c8bc995414 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:37:30.284836 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d3edf466-bc59-441f-aa68-22c8bc995414 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105832 Oct 25 03:37:30.285608 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3129/6142] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:37:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:30.842124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-6d8dff6e-ca26-46cd-a9ac-fa163ec41a14 req-ca950f8a-3466-408a-a14d-e73ebd5875db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d058a391-7f4a-412b-aa5c-60c200b275cb", "name": "network-vif-deleted", "tag": "d1d2d943-f66a-4df5-9614-74ddc63bd079"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:30.901346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6d8dff6e-ca26-46cd-a9ac-fa163ec41a14 req-ca950f8a-3466-408a-a14d-e73ebd5875db service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:30.934536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6d8dff6e-ca26-46cd-a9ac-fa163ec41a14 req-ca950f8a-3466-408a-a14d-e73ebd5875db service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:30.935002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6d8dff6e-ca26-46cd-a9ac-fa163ec41a14 req-ca950f8a-3466-408a-a14d-e73ebd5875db service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:30.965909 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-6d8dff6e-ca26-46cd-a9ac-fa163ec41a14 req-ca950f8a-3466-408a-a14d-e73ebd5875db service nova] Creating event network-vif-deleted:d1d2d943-f66a-4df5-9614-74ddc63bd079 for instance d058a391-7f4a-412b-aa5c-60c200b275cb on n-h2-862355-1 Oct 25 03:37:30.971557 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-6d8dff6e-ca26-46cd-a9ac-fa163ec41a14 req-ca950f8a-3466-408a-a14d-e73ebd5875db service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139230 Oct 25 03:37:30.972989 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3014/6143] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:31.104812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:31.105616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:31.122405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:31.123144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:31.131666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:31.133850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:31.135838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:31.136704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:31.214628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:31.215259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:31.215554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:31.216015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lazy-loading 'fault' on Instance uuid d058a391-7f4a-412b-aa5c-60c200b275cb {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:37:31.315199 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20a09e72-c89e-4db1-8c1d-a6c2db2f2789 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 200 len: 1454 microversion: 2.1 time: 0.214481 Oct 25 03:37:31.315909 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3130/6144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:31 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 1454 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:32.340579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:32.342620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] [instance: d058a391-7f4a-412b-aa5c-60c200b275cb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:32.349895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:32.350703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:32.351389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:32.352341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:32.353019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:32.353699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:32.371455 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] HTTP exception thrown: Instance d058a391-7f4a-412b-aa5c-60c200b275cb could not be found. Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Request method failure captured: Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb HTTP/1.1 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1nV33wVE0OKVoV4QXriCd7sx8rtQeLx1gUUp5owvHskb8rZhCbhQncDsVqT-kIE30Pn8fadj7Ssyw1um-xOUxxL-tB4YLHELlzHAmbVqb5TNILLsIbcbru6VsDk4aKBSAL-pzBsr27LJWhfMRZ8WpVR8GU6hHV52-DS62h_5anQt34 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: fcd8edbc2c07420e9e9f74d8b9799612 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestServerMultinode-2110047910 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fcd8edbc2c07420e9e9f74d8b9799612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fcd8edbc2c07420e9e9f74d8b9799612"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fcd8edbc2c07420e9e9f74d8b9799612", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fcd8edbc2c07420e9e9f74d8b9799612"}]}] Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestServerMultinode-2110047910 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: fcd8edbc2c07420e9e9f74d8b9799612 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestServerMultinode-2110047910 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestServerMultinode-2110047910-project-admin Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 06cd3e7e87bf44168dd82666e00c8f58 Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestServerMultinode-2110047910-project-admin Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance d058a391-7f4a-412b-aa5c-60c200b275cb could not be found. Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'd058a391-7f4a-412b-aa5c-60c200b275cb'} Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d058a391-7f4a-412b-aa5c-60c200b275cb could not be found. Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d058a391-7f4a-412b-aa5c-60c200b275cb could not be found. Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:37:32.374769 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:32.378657 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:37:32.378657 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:37:32.378657 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:37:32.378657 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:37:32.378657 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:37:32.378657 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d058a391-7f4a-412b-aa5c-60c200b275cb could not be found. Oct 25 03:37:32.378657 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:37:32.382241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] Returning 404 to user: Instance d058a391-7f4a-412b-aa5c-60c200b275cb could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:37:32.383797 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a720db9b-f021-47cb-9bee-5fbe0b039b71 tempest-TestServerMultinode-2110047910 tempest-TestServerMultinode-2110047910-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb" status: 404 len: 111 microversion: 2.1 time: 0.048789 Oct 25 03:37:32.388091 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3015/6145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:32 2022] GET /compute/v2.1/servers/d058a391-7f4a-412b-aa5c-60c200b275cb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:37:33.312850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-247508156", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe069d9f-9479-42aa-b1da-5e77a91badbd"}], "security_groups": [{"name": "tempest-securitygroup--222956290"}], "key_name": "tempest-keypair-1815319781", "user_data": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:33.576348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a3d843c-4a2a-455b-b3a4-178e29d953d9 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'create', calling method: .version_select at 0x7efd32434d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1644843836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Co/71ugiqQH8A89yqESHzJpQQb0cvrDX+iYip1XOpyYwiEkT+FZwgSdjOF3iOEh4rxxjBx49j1/fl1s1RCS9VmIPR99gJcFfrbo8b+pec7u8xixlWllBm8NBh6nDthw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:33.609775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4a3d843c-4a2a-455b-b3a4-178e29d953d9 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:37:33.623028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4a3d843c-4a2a-455b-b3a4-178e29d953d9 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for user 65b962a4e0844dbfa0493777365cf6cd and project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:37:33.664707 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a3d843c-4a2a-455b-b3a4-178e29d953d9 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.093123 Oct 25 03:37:33.665911 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3016/6146] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:37:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:33.743364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] validate_networks() for [('fe069d9f-9479-42aa-b1da-5e77a91badbd', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:37:35.724705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:37:35.725272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:37:35.725805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:37:35.726367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:37:35.726787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:37:35.747055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:35.747544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:35.747976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:35.750118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:35.750583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:35.751011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:35.782936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1014565227", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "31100c43-19d3-434d-8582-e855cf4728b0"}], "key_name": "tempest-TestNetworkBasicOps-1644843836", "security_groups": [{"name": "tempest-secgroup-smoke-1467591036"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:35.807943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:37:35.821523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:37:35.878846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:37:35.881236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:37:35.988290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] validate_networks() for [('31100c43-19d3-434d-8582-e855cf4728b0', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:37:35.995876 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f266952-20df-4bf6-af74-a960d498b5d7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.687781 Oct 25 03:37:36.003409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3131/6147] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:37:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:37:36.008572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fda76821-3d66-49bc-a6a0-07c674059855 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:36.009202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fda76821-3d66-49bc-a6a0-07c674059855 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:36.522796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fda76821-3d66-49bc-a6a0-07c674059855 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:36.530943 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fda76821-3d66-49bc-a6a0-07c674059855 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1241 microversion: 2.1 time: 0.526312 Oct 25 03:37:36.540121 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3132/6148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:36 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1241 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:37.476856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:37:37.477391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:37:37.477899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:37:37.478378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:37:37.478793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:37:37.502761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:37.504539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:37.505184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:37.506137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:37.506858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:37.507465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:37.569286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:37:37.570252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:37.570886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:37.601759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:37.601974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Getting quotas for user 65b962a4e0844dbfa0493777365cf6cd and project b0eb7ddb59f543ee965a20283f1c1487. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:37:37.602276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:37.602723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:37.609656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:37.610189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:37.610638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:37.647504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:37:37.652071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:37:37.759934 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-88cb4a0e-7244-40cf-b73f-71a2ac6638cf tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.982976 Oct 25 03:37:37.762118 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3017/6149] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:37:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:37:37.774449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a1ae400-6a64-4960-af2b-6f6e5245b1c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:37.775455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a1ae400-6a64-4960-af2b-6f6e5245b1c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:38.197130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:38.206672 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-673c073a-861c-4f7d-bbe9-9dc85c627ecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1293 microversion: 2.1 time: 0.642298 Oct 25 03:37:38.213290 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3133/6150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:37 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1293 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:38.230876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a1ae400-6a64-4960-af2b-6f6e5245b1c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:38.244918 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a1ae400-6a64-4960-af2b-6f6e5245b1c0 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1249 microversion: 2.1 time: 0.469782 Oct 25 03:37:38.250599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3018/6151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:37 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1249 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:39.241425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:39.242163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:39.264000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:39.266466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:39.275539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:39.276978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:39.282981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:39.286490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:39.288360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:39.291846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:39.304519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:39.312757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:39.313578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:39.322658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:39.324481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:39.327659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:39.540140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:39.557535 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-faacfc0e-c5ef-4177-841f-4e6c65d9bfb8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1301 microversion: 2.1 time: 0.279905 Oct 25 03:37:39.559012 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3019/6152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:39 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1301 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:39.593368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:39.616579 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ee24df9-0efd-4820-a269-128ed69172a5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1299 microversion: 2.1 time: 0.375603 Oct 25 03:37:39.617245 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3134/6153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:39 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1299 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:39.850359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-565832733", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": "none"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:39.945558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:37:39.946015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:37:39.946491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:37:39.946902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:37:39.947314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:37:39.956939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:39.957940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:39.958551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:39.959452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:39.960062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:39.960647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:40.028828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Getting quotas for project dbb051b5b5de46dd81f24f2bc18ed450. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:37:40.036444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Getting quotas for user 4532c702d3fa4abe8e22838dca0ff892 and project dbb051b5b5de46dd81f24f2bc18ed450. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:37:40.105642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:37:40.115649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:37:40.222706 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15a8dbbe-82c9-4a96-a77c-30fb13033f14 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.661752 Oct 25 03:37:40.223635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3020/6154] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Oct 25 03:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 25 03:37:40.246911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-771e27d5-0a5f-4278-9fb4-552bba35c05c tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:40.251452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-771e27d5-0a5f-4278-9fb4-552bba35c05c tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:40.422877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-771e27d5-0a5f-4278-9fb4-552bba35c05c tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:40.430811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-771e27d5-0a5f-4278-9fb4-552bba35c05c tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:40.433110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-771e27d5-0a5f-4278-9fb4-552bba35c05c tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:40.436856 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-771e27d5-0a5f-4278-9fb4-552bba35c05c tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1277 microversion: 2.54 time: 0.204598 Oct 25 03:37:40.438302 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3135/6155] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:40 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:40.580542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:40.581087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:40.599836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:40.601813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:40.602998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:40.607007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:40.608803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:40.611430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:40.643014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:40.643838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:40.677863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:40.682757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:40.684321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:40.685588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:40.688347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:40.689513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:40.864715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:40.880544 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d2ea46b2-d57d-4dbc-8316-0948e400d4f5 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1307 microversion: 2.1 time: 0.301706 Oct 25 03:37:40.881186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3021/6156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:40 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:41.098433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:41.106903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d08621a-dc18-40b6-a8ac-a8d9169863bb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.470973 Oct 25 03:37:41.125814 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3136/6157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:40 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:41.471419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:41.474353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:41.489076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:41.497278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:41.497945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:41.500539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:41.501476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:41.502379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:41.910634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:41.911272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:41.915226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:41.931160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:41.931671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:41.932116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:41.932842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:41.944536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:41.945213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:42.020015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:42.031476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:42.039502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:42.040705 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7246d86f-2f24-41ea-ae98-a62c9ee4808a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1329 microversion: 2.54 time: 0.575772 Oct 25 03:37:42.041283 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3022/6158] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:41 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1329 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:42.067612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e6effeca-ba40-46b4-b494-9b127856ea59 req-620ec3be-593b-4eb0-93d9-5f51f12ada95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ab2e52-4220-4274-8fae-b3279cb9495d", "tag": "046e57f5-868b-47e4-aafa-a43f412934ff"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:42.093579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e6effeca-ba40-46b4-b494-9b127856ea59 req-620ec3be-593b-4eb0-93d9-5f51f12ada95 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:42.094406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e6effeca-ba40-46b4-b494-9b127856ea59 req-620ec3be-593b-4eb0-93d9-5f51f12ada95 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:42.094934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e6effeca-ba40-46b4-b494-9b127856ea59 req-620ec3be-593b-4eb0-93d9-5f51f12ada95 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:42.122421 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e6effeca-ba40-46b4-b494-9b127856ea59 req-620ec3be-593b-4eb0-93d9-5f51f12ada95 service nova] Creating event network-changed:046e57f5-868b-47e4-aafa-a43f412934ff for instance 15ab2e52-4220-4274-8fae-b3279cb9495d on n-h2-862355-1 Oct 25 03:37:42.130920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:42.140824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e6effeca-ba40-46b4-b494-9b127856ea59 req-620ec3be-593b-4eb0-93d9-5f51f12ada95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091522 Oct 25 03:37:42.142805 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-708a187f-38f0-42cc-84a9-c49df7dba3ff tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1307 microversion: 2.1 time: 0.238027 Oct 25 03:37:42.143494 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3023/6159] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:42.147163 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3137/6160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:41 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1307 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:42.151726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:42.152655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:42.160832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:42.161758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:42.162412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:42.163319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:42.163979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:42.164604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:42.800693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:42.811710 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6913c220-56fa-4f57-9370-f005582f057a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.666219 Oct 25 03:37:42.820564 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3024/6161] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:42 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:43.068456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:43.069077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:43.076673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:43.077559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:43.078748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:43.079871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:43.080497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:43.081077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:43.174999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:43.175745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:43.186586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:43.187415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:43.191461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:43.192324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:43.192901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:43.193577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:43.206202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:43.215730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:43.217666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:43.219214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a3c531a-cf32-4136-853c-b03a0ed22e7a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1335 microversion: 2.54 time: 0.154639 Oct 25 03:37:43.220808 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3138/6162] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:43 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1335 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:43.476674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:43.490068 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a7405d2-96fd-4147-af14-7030dd5785f6 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1375 microversion: 2.1 time: 0.319317 Oct 25 03:37:43.491261 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3025/6163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:43 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1375 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:43.840137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:43.841087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:43.856041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:43.859181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:43.860143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:43.862108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:43.862592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:43.865399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:44.248894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:44.250516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:44.260365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:44.260979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:44.261636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:44.262652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:44.263221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:44.263705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:44.320356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:44.331722 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30975671-8ebd-43dc-81b8-d68bf3d350b6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.496411 Oct 25 03:37:44.332903 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3139/6164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:43 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:44.348489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:44.360089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:44.361740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:44.363132 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bba7d65e-5836-4c30-81b6-39591ef982a7 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1335 microversion: 2.54 time: 0.118867 Oct 25 03:37:44.364499 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3026/6165] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:44 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:37:44.515588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:44.516213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:44.528466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:44.530813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:44.532128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:44.533008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:44.533354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:44.533822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:44.594120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5db2128f-63a0-453e-9a6f-43ab85461d5b req-e7411052-cc56-4c69-b5a3-458bbc634924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f114a840-5e96-4cc5-bc6e-bd921b437161", "tag": "07267830-84d0-4d01-92e7-66835fe94d27"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:44.618431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5db2128f-63a0-453e-9a6f-43ab85461d5b req-e7411052-cc56-4c69-b5a3-458bbc634924 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:44.619435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5db2128f-63a0-453e-9a6f-43ab85461d5b req-e7411052-cc56-4c69-b5a3-458bbc634924 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:44.620269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5db2128f-63a0-453e-9a6f-43ab85461d5b req-e7411052-cc56-4c69-b5a3-458bbc634924 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:44.651050 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5db2128f-63a0-453e-9a6f-43ab85461d5b req-e7411052-cc56-4c69-b5a3-458bbc634924 service nova] Creating event network-changed:07267830-84d0-4d01-92e7-66835fe94d27 for instance f114a840-5e96-4cc5-bc6e-bd921b437161 on n-h1-862355-1 Oct 25 03:37:44.663827 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5db2128f-63a0-453e-9a6f-43ab85461d5b req-e7411052-cc56-4c69-b5a3-458bbc634924 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259641 Oct 25 03:37:44.667062 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3140/6166] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:37:44.925278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:44.935569 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e7186dd-17aa-4478-98ab-ce9e34b72951 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1375 microversion: 2.1 time: 0.425271 Oct 25 03:37:44.941995 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3027/6167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:44 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1375 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:45.361042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:45.362877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:45.373726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:45.374581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:45.376150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:45.377213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:45.377873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:45.378622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:45.391191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:45.392427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:45.410704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:45.411509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:45.412120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:45.413023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:45.413651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:45.414276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:45.593916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:45.596264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:45.605798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:45.607862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:45.614176 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-068afb20-83c2-4630-8aac-64c50a037912 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1335 microversion: 2.54 time: 0.227388 Oct 25 03:37:45.614797 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3028/6168] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:45 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1335 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:45.725111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:45.734913 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba186445-24a3-4f02-9544-f8087bbc535a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.382893 Oct 25 03:37:45.745707 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3141/6169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:45 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:45.964953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:45.968528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:45.971105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:45.986133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:45.986631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:45.987225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:45.988120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:45.988560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:45.989145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:46.153603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:46.167081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-604794a8-65ea-4e40-8cc8-2228be398870 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1375 microversion: 2.1 time: 0.206087 Oct 25 03:37:46.169019 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3029/6170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:45 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1375 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:46.641319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:46.642069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:46.644027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:46.657809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:46.658452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:46.659156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:46.661998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:46.662771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:46.663823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:46.759289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:46.760645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:46.762371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:46.771678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:46.772757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:46.773414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:46.774403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:46.775105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:46.775768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:46.781610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:46.785621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:46.788741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b93a7241-0246-461b-bca0-c8829ca558d5 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1335 microversion: 2.54 time: 0.151012 Oct 25 03:37:46.790551 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3142/6171] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:46 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1335 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:46.936952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:46.944821 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96b88d4b-6c6d-4c91-b2c0-4fbc69338a40 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.189735 Oct 25 03:37:46.945414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3030/6172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:46 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:47.193646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:47.194492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:47.200577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:47.201064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:47.201750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:47.202467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:47.203087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:47.203785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:47.649969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:47.666435 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e0105be5-d3a4-495e-9e88-56f63fa0ec84 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1375 microversion: 2.1 time: 0.477000 Oct 25 03:37:47.667027 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3143/6173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:47 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1375 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:47.816535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:47.818119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:47.832793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:47.833583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:47.834452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:47.835182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:47.835649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:47.836465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:47.950039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:47.964803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:47.967702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:47.969244 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57f33f45-7ee9-4d7f-ac14-0e022be241e4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1356 microversion: 2.54 time: 0.157291 Oct 25 03:37:47.970384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:47.970616 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3031/6174] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:47 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:47.971475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:47.986545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:47.987491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:47.988129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:47.989144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:47.992833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:47.993592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.005345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f7c4983d-db71-4f86-a4a0-106ffdb37891 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Action: 'create', calling method: .version_select at 0x7efd327f3280>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1476477765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcTn1B5FZLKW7Hc2tqv+vgoiayeW3q1Zyh7hvZrtaAe2f3tdfXO6eRWdEaoHnDyeZbnYesg687vUWlFh8TPVrYLnzn8k8GzN+Q8kv8/vQm8b4zT5kR3smrMyPihnobelg=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:48.036412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f7c4983d-db71-4f86-a4a0-106ffdb37891 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Getting quotas for project dbb051b5b5de46dd81f24f2bc18ed450. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:37:48.050431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-f7c4983d-db71-4f86-a4a0-106ffdb37891 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Getting quotas for user 4532c702d3fa4abe8e22838dca0ff892 and project dbb051b5b5de46dd81f24f2bc18ed450. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:37:48.085422 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f7c4983d-db71-4f86-a4a0-106ffdb37891 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.087346 Oct 25 03:37:48.086775 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3032/6175] 10.222.0.36 () {62 vars in 1200 bytes} [Tue Oct 25 03:37:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 25 03:37:48.104128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1476477765", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:48.107792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:48.114254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.114754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.117374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.119982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.120477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.120918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.226726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:37:48.227208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:37:48.227915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:37:48.228394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:37:48.228867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:37:48.322226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:48.341265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.342867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.344142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.348183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.349638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.350341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.399410 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e749ca4-852c-4c50-96e8-598b9f28752e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "POST /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd/action" status: 202 len: 1139 microversion: 2.54 time: 0.305147 Oct 25 03:37:48.400592 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3033/6176] 10.222.0.36 () {62 vars in 1320 bytes} [Tue Oct 25 03:37:48 2022] POST /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd/action => generated 1139 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 25 03:37:48.427785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:48.428615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:48.437624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.438339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.438995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.440091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.440697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.441271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.524782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:48.530916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:48.536001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:48.537717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:48.539317 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3aed18c6-8f3e-4ae3-ac82-4cc9dccbe9e2 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.115509 Oct 25 03:37:48.539893 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3034/6177] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:48 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:48.546388 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d19bbedd-f07d-4795-b5f0-cd95b8fed55b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.580637 Oct 25 03:37:48.546834 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3144/6178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:47 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:48.693125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:48.694278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:48.700720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.701745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.702361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.703324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:48.703787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:48.704224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:48.861169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:48.877459 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1b5026f-08db-4863-bf20-f940df97850e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1375 microversion: 2.1 time: 0.187997 Oct 25 03:37:48.881115 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3035/6179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:48 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:49.570007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:49.570630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:49.573645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:49.574901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:49.582108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:49.582602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:49.583040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:49.583759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:49.584212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:49.584643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:49.593875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:49.603561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:49.604289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:49.605218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:49.605896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:49.606492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:49.818584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:49.828893 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec8c1319-5c24-460b-8cfd-81301c970711 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.261480 Oct 25 03:37:49.841709 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3036/6180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:49 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:49.907776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:49.908453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:49.921812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:49.922327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:49.922770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:49.923485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:49.923950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:49.924381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:49.975665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:49.980008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:49.984905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:50.020458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:50.026332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:50.027834 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1433a954-476e-40b1-9e79-454086122325 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.467112 Oct 25 03:37:50.031879 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3145/6181] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:49 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:50.142953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:50.169144 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f78bd3b-bf25-42f9-85d2-ccfd08351f05 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1375 microversion: 2.1 time: 0.267722 Oct 25 03:37:50.171520 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3037/6182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:49 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1375 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:37:50.652069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1e0cd3df-9673-43a2-a184-7f6fb1e58ff7 req-f754b408-12a4-46d2-bb74-acd7aaef49db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f114a840-5e96-4cc5-bc6e-bd921b437161", "name": "network-vif-plugged", "status": "completed", "tag": "07267830-84d0-4d01-92e7-66835fe94d27"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:50.661185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:50.664302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e0cd3df-9673-43a2-a184-7f6fb1e58ff7 req-f754b408-12a4-46d2-bb74-acd7aaef49db service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:50.665106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e0cd3df-9673-43a2-a184-7f6fb1e58ff7 req-f754b408-12a4-46d2-bb74-acd7aaef49db service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:50.665729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e0cd3df-9673-43a2-a184-7f6fb1e58ff7 req-f754b408-12a4-46d2-bb74-acd7aaef49db service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:50.689462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1e0cd3df-9673-43a2-a184-7f6fb1e58ff7 req-f754b408-12a4-46d2-bb74-acd7aaef49db service nova] Creating event network-vif-plugged:07267830-84d0-4d01-92e7-66835fe94d27 for instance f114a840-5e96-4cc5-bc6e-bd921b437161 on n-h1-862355-1 Oct 25 03:37:50.696115 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1e0cd3df-9673-43a2-a184-7f6fb1e58ff7 req-f754b408-12a4-46d2-bb74-acd7aaef49db service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048755 Oct 25 03:37:50.696917 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3146/6183] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:50.854184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:50.855320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:50.868547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:50.869335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:50.871421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:50.872345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:50.874820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:50.875665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:51.061884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:51.063070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:51.070845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:51.071663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:51.072547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:51.073435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:51.074108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:51.074696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:51.208734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:51.218907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:51.224971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:51.226314 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2babe530-3353-4180-ac7f-32729c772cfc tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.171819 Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3147/6184] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:51 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:51.245123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:51.347010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:51.354718 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a26f1c4-2fb9-4406-974c-7fe7ab585330 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.506055 Oct 25 03:37:51.369897 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3038/6185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:50 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:51.910787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:51.922647 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d86c9df-8e8e-42f3-8844-e544495b958b tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1375 microversion: 2.1 time: 0.694322 Oct 25 03:37:51.923571 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3148/6186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:51 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1375 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:52.253884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:52.254848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:52.267398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:52.274798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:52.275343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:52.276164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:52.276715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:52.277225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:52.378214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:52.383605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:52.387364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:52.401571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:52.403845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:52.405961 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d78a83bc-432c-4a7b-813d-0eef404a772d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.156662 Oct 25 03:37:52.407853 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3039/6187] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:52 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:52.410158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:52.410759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:52.411415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:52.412252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:52.417964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:52.419058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:52.741704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-64a55786-2ca3-4f0c-95c6-23fb99f16d4b req-77e2e152-0567-4e47-8381-5fecc776d357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ab2e52-4220-4274-8fae-b3279cb9495d", "name": "network-vif-plugged", "status": "completed", "tag": "046e57f5-868b-47e4-aafa-a43f412934ff"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:52.753375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64a55786-2ca3-4f0c-95c6-23fb99f16d4b req-77e2e152-0567-4e47-8381-5fecc776d357 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:52.754154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64a55786-2ca3-4f0c-95c6-23fb99f16d4b req-77e2e152-0567-4e47-8381-5fecc776d357 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:52.755203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-64a55786-2ca3-4f0c-95c6-23fb99f16d4b req-77e2e152-0567-4e47-8381-5fecc776d357 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:52.784155 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-64a55786-2ca3-4f0c-95c6-23fb99f16d4b req-77e2e152-0567-4e47-8381-5fecc776d357 service nova] Creating event network-vif-plugged:046e57f5-868b-47e4-aafa-a43f412934ff for instance 15ab2e52-4220-4274-8fae-b3279cb9495d on n-h2-862355-1 Oct 25 03:37:52.795073 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-64a55786-2ca3-4f0c-95c6-23fb99f16d4b req-77e2e152-0567-4e47-8381-5fecc776d357 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057150 Oct 25 03:37:52.795877 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3040/6188] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:37:52.839051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:52.852479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a28e6b6-c004-4509-83a6-1c1e89852103 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.477334 Oct 25 03:37:52.854598 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3149/6189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:52 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:52.946589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:52.947532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:52.954926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:52.956385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:52.957076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:52.958323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:52.959123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:52.959998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:53.135308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:53.150196 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e4cd700-b1c2-4bf9-97e4-575123fcd5d2 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1546 microversion: 2.1 time: 0.207150 Oct 25 03:37:53.158986 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3041/6190] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:52 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:53.175464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:53.176403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:53.185107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:53.185947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:53.186888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:53.187922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:53.188632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:53.189290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:53.436525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:53.437958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:53.446641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:53.447467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:53.448099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:53.448978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:53.449439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:53.449908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:53.507717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:53.516489 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b6bceb8-c598-4ac6-8d76-0d00af28529e tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1546 microversion: 2.1 time: 0.346299 Oct 25 03:37:53.524064 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3150/6191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:53 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1546 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:53.538577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:53.549149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:53.551048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:53.552707 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e788aef-a231-4b41-a371-32d2ce1a1b6a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.120692 Oct 25 03:37:53.566559 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3042/6192] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:53 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:37:53.878983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:53.880044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:53.900917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:53.903628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:53.906324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:53.907322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:53.908639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:53.911608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:54.184605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:54.198390 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b12255cf-79c4-4e0e-9ed3-93e4f1457506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1366 microversion: 2.1 time: 0.325691 Oct 25 03:37:54.214597 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3151/6193] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:53 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:54.581513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:54.584191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:54.611600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:54.612495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:54.613207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:54.614305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:54.615022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:54.615665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:54.740514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:54.756441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:54.758233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:54.759619 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb2e07b8-66e6-4757-9241-a93e71e9ec8b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.183165 Oct 25 03:37:54.760394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3043/6194] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:54 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:55.224680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:55.225308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:55.234553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:55.235294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:55.235735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:55.236459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:55.236916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:55.237343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:55.566319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:55.574434 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f8961e3-1553-4f66-9fa4-536a723bf4e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1556 microversion: 2.1 time: 0.354040 Oct 25 03:37:55.578664 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3152/6195] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:37:55 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1556 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:37:55.601514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:55.602146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:55.615803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:55.616658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:55.617528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:55.620006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:55.623035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:55.623876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:55.729837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d332a8b-fafb-445b-b590-e09a216172a6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128898 Oct 25 03:37:55.738511 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3044/6196] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:37:55 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:55.791555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:55.792178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:55.799675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:55.800617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:55.801229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:55.802156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:55.802613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:55.803200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:55.972726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:55.989359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:55.990870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:55.992063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d685883a-29df-4cc3-8751-2c746e9a54cf tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.204417 Oct 25 03:37:55.992637 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3153/6197] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:55 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:56.337818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a0b5ca62-614e-46ef-9101-409e2237fcff req-99635c71-3634-4a68-99dd-423914c3b650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f114a840-5e96-4cc5-bc6e-bd921b437161", "tag": "07267830-84d0-4d01-92e7-66835fe94d27"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:56.363495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a0b5ca62-614e-46ef-9101-409e2237fcff req-99635c71-3634-4a68-99dd-423914c3b650 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:56.364379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a0b5ca62-614e-46ef-9101-409e2237fcff req-99635c71-3634-4a68-99dd-423914c3b650 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:56.364977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a0b5ca62-614e-46ef-9101-409e2237fcff req-99635c71-3634-4a68-99dd-423914c3b650 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:56.377287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:56.418149 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a0b5ca62-614e-46ef-9101-409e2237fcff req-99635c71-3634-4a68-99dd-423914c3b650 service nova] Creating event network-changed:07267830-84d0-4d01-92e7-66835fe94d27 for instance f114a840-5e96-4cc5-bc6e-bd921b437161 on n-h1-862355-1 Oct 25 03:37:56.438110 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a0b5ca62-614e-46ef-9101-409e2237fcff req-99635c71-3634-4a68-99dd-423914c3b650 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104580 Oct 25 03:37:56.441218 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3045/6198] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:57.023928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:57.024573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:57.035094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:57.035953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:57.036642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:57.038291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:57.038983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:57.039568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:57.216630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:57.225641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:57.239640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:57.240885 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aee622e5-5abc-4911-a24a-429b00e71eff tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.221200 Oct 25 03:37:57.241653 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3154/6199] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:57 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:58.075344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=22 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:37:58.080505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-8a184a8b-55c5-4aa4-9330-7a1554d98bf1 req-cd1bb868-440b-4891-945e-661a1983a319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ab2e52-4220-4274-8fae-b3279cb9495d", "tag": "046e57f5-868b-47e4-aafa-a43f412934ff"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:37:58.091611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8a184a8b-55c5-4aa4-9330-7a1554d98bf1 req-cd1bb868-440b-4891-945e-661a1983a319 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:58.092846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8a184a8b-55c5-4aa4-9330-7a1554d98bf1 req-cd1bb868-440b-4891-945e-661a1983a319 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:58.093274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-8a184a8b-55c5-4aa4-9330-7a1554d98bf1 req-cd1bb868-440b-4891-945e-661a1983a319 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:58.105077 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-8a184a8b-55c5-4aa4-9330-7a1554d98bf1 req-cd1bb868-440b-4891-945e-661a1983a319 service nova] Creating event network-changed:046e57f5-868b-47e4-aafa-a43f412934ff for instance 15ab2e52-4220-4274-8fae-b3279cb9495d on n-h2-862355-1 Oct 25 03:37:58.111439 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-8a184a8b-55c5-4aa4-9330-7a1554d98bf1 req-cd1bb868-440b-4891-945e-661a1983a319 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037831 Oct 25 03:37:58.112641 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3046/6200] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:37:58.271444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:58.272081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:58.291833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:58.292750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:58.294272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:58.296021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:58.296918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:58.297547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:58.412440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:58.424427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:58.427076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:58.428854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53005b90-e83a-4997-9bd5-4d297b5f46d6 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.161500 Oct 25 03:37:58.441931 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3155/6201] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:58 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:37:59.461274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:37:59.462685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:37:59.472864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:59.473627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:59.474344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:59.475948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:37:59.476518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:37:59.477046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:37:59.583248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:59.596567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:59.598573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:37:59.599797 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4a8f23b-3baa-46ef-9bc1-805e36872d36 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.145293 Oct 25 03:37:59.600383 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3047/6202] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:37:59 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:38:00.632018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:00.632630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:00.639993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:00.640534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:00.640999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:00.641719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:00.642172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:00.642708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:00.783627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:00.793613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:00.798684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:00.800187 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f25c67c-1138-4013-a329-2e72485e32af tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.171972 Oct 25 03:38:00.802324 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3156/6203] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:00 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:01.832657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:01.833989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:01.844525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:01.847758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:01.848235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:01.848985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:01.849458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:01.849918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:02.013057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:02.023510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:02.035374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:02.036716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6568f1a9-c1b6-4727-92c4-04e23f50beda tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.208740 Oct 25 03:38:02.037335 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3048/6204] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:01 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:03.066760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:03.067519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:03.074958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:03.075450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:03.075886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:03.077370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:03.078048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:03.078632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:03.176841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:03.188768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:03.190665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:03.192378 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4d61bfb-1682-463c-801d-03217390b98a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.129531 Oct 25 03:38:03.193201 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3157/6205] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:03 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:04.229908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:04.230689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:04.241366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:04.242005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:04.242845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:04.243961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:04.244533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:04.245176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:04.395163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:04.416809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:04.421936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:04.427630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-48683f54-fa3d-4ccc-b051-9f20b9d4bb69 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.209502 Oct 25 03:38:04.429072 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3049/6206] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:04 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:05.457440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:05.458133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:05.465809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:05.467268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:05.467941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:05.469103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:05.469790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:05.470406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:05.563634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:05.574929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:05.584811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:05.586620 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b8061793-681e-44c0-8eed-87652dd0e23a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.134824 Oct 25 03:38:05.602987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3158/6207] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:05 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:38:06.614800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:06.615425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:06.627602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:06.629552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:06.630191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:06.630914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:06.631377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:06.631809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:06.760538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:06.769750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:06.780186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:06.781759 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73b7c609-67ca-4e94-ab94-f6800848955e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.170868 Oct 25 03:38:06.782937 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3050/6208] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:06 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:07.813835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:07.815008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:07.822492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:07.822980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:07.823413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:07.824116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:07.824568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:07.825001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:07.929499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:07.944012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:07.946430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:07.947861 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-41739c39-cc86-4a13-9a05-dc34de574834 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.139282 Oct 25 03:38:07.948997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3159/6209] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:07 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:08.974572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:08.975969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:08.984187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:08.984896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:08.985864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:08.986820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:08.987615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:08.988269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:09.066675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:09.079108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:09.081153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:09.082768 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c38071c4-4169-468e-a3de-9d80ee200ee4 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.111978 Oct 25 03:38:09.083427 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3051/6210] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:08 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:10.111644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:10.113102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:10.121811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:10.121811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:10.121811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:10.122070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:10.122418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:10.123595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:10.201878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:10.212786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:10.216401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:10.218746 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-53399eaa-9d9c-4f64-826d-ebf1d3f99489 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.112114 Oct 25 03:38:10.219156 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3160/6211] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:10 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:11.245344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:11.246003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:11.258673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:11.259234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:11.259593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:11.260630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:11.261274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:11.261988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:11.346379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:11.355193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:11.356649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:11.357951 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f5beb9d-4570-4d24-b9c7-1b745684687e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.116701 Oct 25 03:38:11.359014 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3052/6212] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:11 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:12.393825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:12.395094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:12.398054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=48 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:12.403472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:12.404408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:12.405064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:12.405981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:12.406447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:12.406879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:12.497212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:12.507374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:12.509283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:12.510691 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-42f19e2f-3888-4bc6-b26f-b43b164b9290 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.121178 Oct 25 03:38:12.522562 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3161/6213] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:12 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:13.542583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:13.543389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:13.552136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:13.554625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:13.556873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:13.559341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:13.559983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:13.562824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:13.699266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:13.710518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:13.711990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:13.713177 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a3fe2459-3e5d-4d45-864d-ff6176e9641b tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.174746 Oct 25 03:38:13.714719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3053/6214] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:13 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:14.742093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:14.742912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:14.751414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:14.752479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:14.753059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:14.753903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:14.754432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:14.755075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:14.843275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:14.852026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:14.853895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:14.855941 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-020bacb6-2461-47eb-9f22-a70720d72a0d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1408 microversion: 2.54 time: 0.117331 Oct 25 03:38:14.869969 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3162/6215] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:14 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:15.889796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:15.890618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:15.898089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:15.898505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:15.898941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:15.899642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:15.900092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:15.900944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:16.034172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:16.046236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:16.048179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:16.050254 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56acfd2d-7278-4ea5-831f-f3c66cb53d76 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1414 microversion: 2.54 time: 0.170258 Oct 25 03:38:16.051139 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3054/6216] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:15 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:17.076855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:17.077486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:17.084465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:17.084980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:17.085412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:17.086335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:17.086945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:17.087542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:17.090741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:17.188286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:17.197602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:17.199854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:17.202944 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7222445-61f3-4599-bc16-07ca2d3d9640 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1414 microversion: 2.54 time: 0.129654 Oct 25 03:38:17.204400 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3163/6217] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:17 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:18.240810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:18.244078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:18.254685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:18.256849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:18.257767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:18.258470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:18.259427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:18.260313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:18.260997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:18.377915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:18.393554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:18.395377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:18.396848 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e222647-ab0a-4bef-9f17-eeeb77aba02e tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1414 microversion: 2.54 time: 0.166343 Oct 25 03:38:18.397499 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3055/6218] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:18 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 25 03:38:18.877203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:18.880977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:18.892152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:18.892787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:18.894421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:18.895284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:18.895761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:18.896531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:18.960020 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-96ca7f42-508f-4625-811c-d3be71cceeca tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161/action" status: 200 len: 24563 microversion: 2.1 time: 0.087046 Oct 25 03:38:18.962448 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3164/6219] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:38:18 2022] POST /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161/action => generated 24563 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:38:19.427425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:19.428048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:19.436147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:19.436955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:19.437807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:19.438685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:19.439326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:19.440073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:19.536306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:19.548797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:19.550822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:19.552436 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-605be776-b35e-4d72-94cd-6d3b62ceccbb tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1399 microversion: 2.54 time: 0.129394 Oct 25 03:38:19.568273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3056/6220] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:19 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1399 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:19.581664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8fce5bed-4be5-48b8-b686-9bd7aced7384 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '.version_select at 0x7efd336b54c0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:19.630628 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8fce5bed-4be5-48b8-b686-9bd7aced7384 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1476477765" status: 204 len: 0 microversion: 2.54 time: 0.053410 Oct 25 03:38:19.631226 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3165/6221] 10.222.0.36 () {60 vars in 1319 bytes} [Tue Oct 25 03:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1476477765 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:38:19.647500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:19.648098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:19.655819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:19.656614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:19.657450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:19.658420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:19.659070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:19.659725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:19.723530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:38:19.891399 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b020342b-0ccb-4501-a481-924b13df1c8d tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "DELETE /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 204 len: 0 microversion: 2.54 time: 0.247379 Oct 25 03:38:19.898045 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3057/6222] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Oct 25 03:38:19 2022] DELETE /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 25 03:38:19.905118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:19.906065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:19.923545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:19.923945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:19.924399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:19.925271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:19.925774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:19.940894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:20.671008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:20.681763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:20.687788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:20.693925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4821f01f-a7e2-43f7-bf4a-625495aac37f tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1405 microversion: 2.54 time: 0.794915 Oct 25 03:38:20.699816 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3166/6223] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:19 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1405 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:21.723603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:21.726932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:21.736961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:21.737802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:21.738500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:21.739359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:21.739967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:21.740570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:21.862807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:21.876074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:21.877823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:21.879056 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db8a5a5f-f365-4158-9928-19079a26484a tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1405 microversion: 2.54 time: 0.159964 Oct 25 03:38:21.879624 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3058/6224] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:21 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:22.911254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:22.911881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:22.920739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:22.921196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:22.922011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:22.923719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:22.924199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:22.924670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:22.966176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:22.967466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:22.967917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:22.968375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lazy-loading 'fault' on Instance uuid 257aabcd-1ba2-4333-bb6c-e70dc3b568bd {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:38:23.025128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:23.046084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:23.047802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4532c702d3fa4abe8e22838dca0ff892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb051b5b5de46dd81f24f2bc18ed450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:23.049022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5df22fee-242e-4ce0-a433-482a47343442 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 200 len: 1410 microversion: 2.54 time: 0.141673 Oct 25 03:38:23.051854 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3167/6225] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:22 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 1410 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 25 03:38:24.081400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:24.082962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] [instance: 257aabcd-1ba2-4333-bb6c-e70dc3b568bd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:24.089943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:24.090797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:24.091682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:24.092692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:24.093389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:24.094072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:24.108840 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] HTTP exception thrown: Instance 257aabcd-1ba2-4333-bb6c-e70dc3b568bd could not be found. Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Request method failure captured: Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd HTTP/1.1 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1oDkhKtT_v3055lY-PP5IsCH-AZEXYmQCGArzK7avU5qWcup5x2n2ik-ZtTd5laUTLGueo8tKr-GAB239tPvo7eXkjxEZxK695QIJr_7Mdm6RXKlUanN98ZrCw7UgCLEDxb-moGX2J_z7VEkAsp7QbCIuTCY5xHWRsmuPXURr96lk4 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Openstack-Nova-Api-Version: 2.54 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: dbb051b5b5de46dd81f24f2bc18ed450 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerShowV254Test-1941560140 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbb051b5b5de46dd81f24f2bc18ed450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dbb051b5b5de46dd81f24f2bc18ed450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dbb051b5b5de46dd81f24f2bc18ed450", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dbb051b5b5de46dd81f24f2bc18ed450"}]}] Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerShowV254Test-1941560140 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: dbb051b5b5de46dd81f24f2bc18ed450 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerShowV254Test-1941560140 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerShowV254Test-1941560140-project Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4532c702d3fa4abe8e22838dca0ff892 Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerShowV254Test-1941560140-project Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 257aabcd-1ba2-4333-bb6c-e70dc3b568bd could not be found. Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '257aabcd-1ba2-4333-bb6c-e70dc3b568bd'} Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257aabcd-1ba2-4333-bb6c-e70dc3b568bd could not be found. Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257aabcd-1ba2-4333-bb6c-e70dc3b568bd could not be found. Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:38:24.110897 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:24.115104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:38:24.115104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:38:24.115104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:38:24.115104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:38:24.115104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:38:24.115104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257aabcd-1ba2-4333-bb6c-e70dc3b568bd could not be found. Oct 25 03:38:24.115104 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:24.116855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] Returning 404 to user: Instance 257aabcd-1ba2-4333-bb6c-e70dc3b568bd could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:38:24.118606 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5fdb6eb7-2c21-4282-bdf6-245cc21b6f35 tempest-ServerShowV254Test-1941560140 tempest-ServerShowV254Test-1941560140-project] 10.222.0.36 "GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd" status: 404 len: 111 microversion: 2.54 time: 0.041080 Oct 25 03:38:24.123370 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3059/6226] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Oct 25 03:38:24 2022] GET /compute/v2.1/servers/257aabcd-1ba2-4333-bb6c-e70dc3b568bd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:38:25.002023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-968802465", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b3a7cd81-74f6-4340-a79d-f6aa3609c966", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:25.123667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:38:25.694658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:38:25.695333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:38:25.696534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:38:25.697195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:38:25.697849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:38:25.723696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:25.724719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:25.738332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:25.740445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:25.745149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:25.746050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:25.773443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:38:25.782944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:38:25.899000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:38:25.903260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3a7cd81-74f6-4340-a79d-f6aa3609c966',volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:38:26.207276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d25a99c6-07d1-446b-90a7-8eccc3ca59c8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209921 Oct 25 03:38:26.208919 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3168/6227] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:38:26.221059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6bf83803-cec8-4d14-a8b4-a957ba1678f6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:26.221698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6bf83803-cec8-4d14-a8b4-a957ba1678f6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:26.305382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6bf83803-cec8-4d14-a8b4-a957ba1678f6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:26.313499 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6bf83803-cec8-4d14-a8b4-a957ba1678f6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1056 microversion: 2.1 time: 0.096210 Oct 25 03:38:26.315631 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3060/6228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:26 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1056 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:27.342618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:27.343256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:27.353791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:27.354507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:27.355598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:27.356321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:27.356913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:27.358141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:27.440567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:27.451333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d9710abd-409c-4ca8-8e9c-e88701176d29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1154 microversion: 2.1 time: 0.114637 Oct 25 03:38:27.452674 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3169/6229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:27 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1154 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:28.485759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:28.486367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:28.509085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:28.510128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:28.510835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:28.511833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:28.512064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:28.512797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:28.517494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:28.604754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:28.614821 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e205862-02fd-402d-a634-49f42ac9e943 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1172 microversion: 2.1 time: 0.134221 Oct 25 03:38:28.615410 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3061/6230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:28 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1172 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:38:29.647286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:29.647997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:29.661272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:29.663125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:29.663125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:29.663125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:29.663349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:29.670790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:30.010693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:30.022288 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef7fe482-455b-43d9-aaf3-61ad25118129 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1214 microversion: 2.1 time: 0.385997 Oct 25 03:38:30.025777 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3170/6231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:29 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1214 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:30.163568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:30.168686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:30.176952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:30.178398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:30.179117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:30.182612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:30.183322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:30.184531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:30.276094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f747337d-8df3-43ee-9bf5-919d53fa6845 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "POST /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161/action" status: 200 len: 32635 microversion: 2.1 time: 0.116201 Oct 25 03:38:30.280624 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3062/6232] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:38:30 2022] POST /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161/action => generated 32635 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:38:30.308171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0ec499fd-ec80-4f5c-8b7b-9cb720adbeb9 req-dbf70d30-4674-4e97-b389-72d809ddd150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1fb076-0245-4ed9-90ad-be8378b42c3a", "tag": "a09b88b5-a604-4eb8-a6d4-f4b5bed07f08"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:30.325400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0ec499fd-ec80-4f5c-8b7b-9cb720adbeb9 req-dbf70d30-4674-4e97-b389-72d809ddd150 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:30.327806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0ec499fd-ec80-4f5c-8b7b-9cb720adbeb9 req-dbf70d30-4674-4e97-b389-72d809ddd150 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:30.329930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0ec499fd-ec80-4f5c-8b7b-9cb720adbeb9 req-dbf70d30-4674-4e97-b389-72d809ddd150 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:30.357991 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0ec499fd-ec80-4f5c-8b7b-9cb720adbeb9 req-dbf70d30-4674-4e97-b389-72d809ddd150 service nova] Creating event network-changed:a09b88b5-a604-4eb8-a6d4-f4b5bed07f08 for instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a on n-h2-862355-1 Oct 25 03:38:30.366970 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0ec499fd-ec80-4f5c-8b7b-9cb720adbeb9 req-dbf70d30-4674-4e97-b389-72d809ddd150 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063063 Oct 25 03:38:30.369429 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3171/6233] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:38:31.060931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:31.062166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:31.075310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:31.075877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:31.076709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:31.077623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:31.078167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:31.078873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:31.653542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:31.668596 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-657b6f65-c508-4ca1-bb04-ab3efd7b07cb tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1214 microversion: 2.1 time: 0.613001 Oct 25 03:38:31.669318 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3063/6234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:31 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1214 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:32.543077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:32.544389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:32.557837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:32.558638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:32.559764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:32.562147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:32.563133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:32.564188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:32.566647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-59b89199-ff7e-4967-aabd-e1193b797184 req-4a754697-123a-4cce-be35-af2a44fd9a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f114a840-5e96-4cc5-bc6e-bd921b437161", "tag": "07267830-84d0-4d01-92e7-66835fe94d27"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:32.587409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-59b89199-ff7e-4967-aabd-e1193b797184 req-4a754697-123a-4cce-be35-af2a44fd9a9a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:32.588182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-59b89199-ff7e-4967-aabd-e1193b797184 req-4a754697-123a-4cce-be35-af2a44fd9a9a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:32.590075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-59b89199-ff7e-4967-aabd-e1193b797184 req-4a754697-123a-4cce-be35-af2a44fd9a9a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:32.609512 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-59b89199-ff7e-4967-aabd-e1193b797184 req-4a754697-123a-4cce-be35-af2a44fd9a9a service nova] Creating event network-changed:07267830-84d0-4d01-92e7-66835fe94d27 for instance f114a840-5e96-4cc5-bc6e-bd921b437161 on n-h1-862355-1 Oct 25 03:38:32.626034 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-59b89199-ff7e-4967-aabd-e1193b797184 req-4a754697-123a-4cce-be35-af2a44fd9a9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063021 Oct 25 03:38:32.628439 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3064/6235] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:38:32.648769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:38:32.694954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:32.695668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:32.705431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:32.710040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:32.710802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:32.711839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:32.713755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:32.714446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:32.807500 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73543a79-4c9a-4966-bb16-11fd51e5d9db tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 204 len: 0 microversion: 2.1 time: 0.268525 Oct 25 03:38:32.808928 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3172/6236] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:38:32 2022] DELETE /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:38:32.826617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:32.829591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:32.843325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:32.846619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:32.847318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:32.848731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:32.849404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:32.849885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:33.134992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:33.152286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:33.152445 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb35bb0b-9c8c-4184-835b-c7090be0a0b2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1214 microversion: 2.1 time: 0.458187 Oct 25 03:38:33.153275 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3065/6237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:32 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1214 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:33.163137 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5a5a40c4-1a06-48e1-9995-0b6ed4c52327 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1670 microversion: 2.1 time: 0.347337 Oct 25 03:38:33.164225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3173/6238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:32 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1670 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:34.176421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:34.177606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:34.188069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:34.189413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:34.203556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:34.204289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:34.204948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:34.207610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:34.208613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:34.209097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:34.209540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:34.209888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:34.212722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:34.214499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:34.215683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:34.218346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:34.460716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:34.472883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d7ba0c24-33d4-4286-a803-99e866d7e387 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1670 microversion: 2.1 time: 0.289501 Oct 25 03:38:34.478844 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3174/6239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:34 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:38:34.644032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:34.665458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07e5d775-17fe-4445-88ff-b3921ce3f4ef tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1214 microversion: 2.1 time: 0.491725 Oct 25 03:38:34.667229 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3066/6240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:34 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1214 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:35.221940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ec548154-37b4-41b2-a4bc-6560013ee886 req-6bbc7f7f-10b8-4ea4-9d8b-d320ba1e714c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f114a840-5e96-4cc5-bc6e-bd921b437161", "name": "network-vif-deleted", "tag": "07267830-84d0-4d01-92e7-66835fe94d27"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:35.246079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ec548154-37b4-41b2-a4bc-6560013ee886 req-6bbc7f7f-10b8-4ea4-9d8b-d320ba1e714c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:35.246738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ec548154-37b4-41b2-a4bc-6560013ee886 req-6bbc7f7f-10b8-4ea4-9d8b-d320ba1e714c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:35.247456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ec548154-37b4-41b2-a4bc-6560013ee886 req-6bbc7f7f-10b8-4ea4-9d8b-d320ba1e714c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:35.280855 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ec548154-37b4-41b2-a4bc-6560013ee886 req-6bbc7f7f-10b8-4ea4-9d8b-d320ba1e714c service nova] Creating event network-vif-deleted:07267830-84d0-4d01-92e7-66835fe94d27 for instance f114a840-5e96-4cc5-bc6e-bd921b437161 on n-h1-862355-1 Oct 25 03:38:35.290311 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ec548154-37b4-41b2-a4bc-6560013ee886 req-6bbc7f7f-10b8-4ea4-9d8b-d320ba1e714c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071941 Oct 25 03:38:35.292333 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3175/6241] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:38:35.505728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:35.507031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:35.523009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:35.524104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:35.524762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:35.525708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:35.526497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:35.527269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:35.571635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:35.572583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:35.573251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:35.573801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lazy-loading 'fault' on Instance uuid f114a840-5e96-4cc5-bc6e-bd921b437161 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:38:35.646304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b962a4e0844dbfa0493777365cf6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0eb7ddb59f543ee965a20283f1c1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:35.656916 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dcf1fdf1-f9c5-4800-b77b-2cb91ea73e83 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 200 len: 1339 microversion: 2.1 time: 0.155484 Oct 25 03:38:35.663292 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3067/6242] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:35 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:38:35.691551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:35.691551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:35.703589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:35.704093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:35.704536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:35.706220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:35.706707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:35.707400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:35.761931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:35.797552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:35.930039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:35.950210 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea5cc726-e155-4381-856b-490737ace1b8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.265262 Oct 25 03:38:35.952011 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3176/6243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:35 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:36.682987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:36.683634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] [instance: f114a840-5e96-4cc5-bc6e-bd921b437161] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:36.686825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:36.693195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:36.693762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:36.694172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:36.694873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:36.695330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:36.695760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:36.711793 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] HTTP exception thrown: Instance f114a840-5e96-4cc5-bc6e-bd921b437161 could not be found. Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Request method failure captured: Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 HTTP/1.1 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1lJ4PaPaMKipyEDPjtXPqLJgzKyri4OVuu-rV_WIuEyoIRXIH4Fu9BzQK4ADNE9s_yFYxGCk0R5ldr3Z3kc-4JQJV9THeEVoLTh5yXYRfz-THkyZTOVWFHStgmnowN86Qci7FeezfvVR92w4JfbH3npaAVYyUlgM8HWA89pI8Zn_A4 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: b0eb7ddb59f543ee965a20283f1c1487 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0eb7ddb59f543ee965a20283f1c1487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0eb7ddb59f543ee965a20283f1c1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b0eb7ddb59f543ee965a20283f1c1487", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b0eb7ddb59f543ee965a20283f1c1487"}]}] Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: b0eb7ddb59f543ee965a20283f1c1487 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestNetworkBasicOps-2114969983 Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestNetworkBasicOps-2114969983-project Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 65b962a4e0844dbfa0493777365cf6cd Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestNetworkBasicOps-2114969983-project Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance f114a840-5e96-4cc5-bc6e-bd921b437161 could not be found. Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'f114a840-5e96-4cc5-bc6e-bd921b437161'} Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f114a840-5e96-4cc5-bc6e-bd921b437161 could not be found. Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f114a840-5e96-4cc5-bc6e-bd921b437161 could not be found. Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:38:36.713737 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f114a840-5e96-4cc5-bc6e-bd921b437161 could not be found. Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Returning 404 to user: Instance f114a840-5e96-4cc5-bc6e-bd921b437161 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c5df2382-1ef9-4241-b7f2-74bcee0739c8 tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161" status: 404 len: 111 microversion: 2.1 time: 0.036009 Oct 25 03:38:36.718423 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3068/6244] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:36 2022] GET /compute/v2.1/servers/f114a840-5e96-4cc5-bc6e-bd921b437161 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:38:36.895936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3479208-6d5a-42a0-9bcd-d03e9b84384f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] Calling method '.version_select at 0x7efd32011430>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:36.918483 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3479208-6d5a-42a0-9bcd-d03e9b84384f tempest-TestNetworkBasicOps-2114969983 tempest-TestNetworkBasicOps-2114969983-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1644843836" status: 202 len: 0 microversion: 2.1 time: 0.026040 Oct 25 03:38:36.928378 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3177/6245] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 25 03:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1644843836 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:38:36.984324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:36.985287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:36.994658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:36.995406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:36.996070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:36.997028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:36.997862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:36.998486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:37.239963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:37.250748 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-80bda1f3-7464-4fcd-8efa-80a09be9bda4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.272363 Oct 25 03:38:37.251399 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3069/6246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:36 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:38.277251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:38.278049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:38.288754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:38.289611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:38.290201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:38.291160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:38.291733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:38.292533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:38.447143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:38.455719 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6ca0c8a-9472-4b1f-96d8-6e818332d612 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.182987 Oct 25 03:38:38.458050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3178/6247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:38 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:39.481038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:39.483081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:39.493010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:39.493795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:39.494434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:39.504996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:39.505807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:39.506409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:40.092589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:40.118603 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5d0d5d6b-520e-4dc0-b7b7-9cc6657a8665 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.640252 Oct 25 03:38:40.119238 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3070/6248] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:39 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:41.143932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:41.145300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:41.154625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:41.155609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:41.155739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:41.156713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:41.157534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:41.158225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:41.453154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:41.480992 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e874f76-9aac-434b-9827-fe579dd009f9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.341354 Oct 25 03:38:41.493729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3179/6249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:41 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:42.509959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:42.510575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:42.518328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:42.518823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:42.519257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:42.519963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:42.520815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:42.521302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:42.744545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:42.753125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0ddd20c-ea49-46f1-af26-cc49de5fe652 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.246971 Oct 25 03:38:42.754766 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3071/6250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:42 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:43.778015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:43.779354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:43.782497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:43.788745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:43.789971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:43.790963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:43.792027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:43.792897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:43.793536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:43.992342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:44.008800 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-85dad854-5412-4f5a-b9f3-97ee0635a615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.234689 Oct 25 03:38:44.009702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3180/6251] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:43 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:45.035266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:45.036961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:45.046005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:45.046737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:45.047742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:45.048958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:45.049634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:45.050312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:45.248943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:45.258615 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35489879-a875-4e85-83bd-d707a3e5ea50 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.229804 Oct 25 03:38:45.259268 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3072/6252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:45 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:45.880193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f045d98-ef5a-4623-a26e-0dabbd9ddc12 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Action: 'create', calling method: .version_select at 0x7efd31fe53a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-444327658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCynNgPrr8370ulaUqf49v9zjkW8HSodx/gkN5PQ9mcDURYv9Vccpq0t+3d7u535FhdV61Qu7donEg0nOHXKk6PziMEENFxwvnUmH7SvZL+MV4cxtMxHi+ZJ6+ejYBhE0A=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:45.895805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6f045d98-ef5a-4623-a26e-0dabbd9ddc12 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Getting quotas for project c717eb2194cc4f648ccbc804ba1a7a32. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:38:45.901832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6f045d98-ef5a-4623-a26e-0dabbd9ddc12 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Getting quotas for user 4f0a8c9405354ba3965cf5805f818f1f and project c717eb2194cc4f648ccbc804ba1a7a32. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:38:45.927741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f045d98-ef5a-4623-a26e-0dabbd9ddc12 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.291212 Oct 25 03:38:45.934628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3181/6253] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:38:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:38:46.284953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:46.286384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:46.293414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:46.293870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:46.294594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:46.296123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:46.296599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:46.297856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:46.462536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:46.476190 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6c93ba0-8073-4c52-a2db-1b6e33a3c023 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.197078 Oct 25 03:38:46.476792 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3073/6254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:46 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:46.596307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e521dc0c-c356-40d8-be53-ee24ab636fc9 req-31aad650-e37f-4630-80ce-9b881311ae62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1fb076-0245-4ed9-90ad-be8378b42c3a", "name": "network-vif-plugged", "status": "completed", "tag": "a09b88b5-a604-4eb8-a6d4-f4b5bed07f08"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:46.614766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e521dc0c-c356-40d8-be53-ee24ab636fc9 req-31aad650-e37f-4630-80ce-9b881311ae62 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:46.615393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e521dc0c-c356-40d8-be53-ee24ab636fc9 req-31aad650-e37f-4630-80ce-9b881311ae62 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:46.615928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e521dc0c-c356-40d8-be53-ee24ab636fc9 req-31aad650-e37f-4630-80ce-9b881311ae62 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:46.632770 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e521dc0c-c356-40d8-be53-ee24ab636fc9 req-31aad650-e37f-4630-80ce-9b881311ae62 service nova] Creating event network-vif-plugged:a09b88b5-a604-4eb8-a6d4-f4b5bed07f08 for instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a on n-h2-862355-1 Oct 25 03:38:46.643554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e521dc0c-c356-40d8-be53-ee24ab636fc9 req-31aad650-e37f-4630-80ce-9b881311ae62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052373 Oct 25 03:38:46.645035 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3182/6255] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:38:47.502829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:47.504204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:47.511723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:47.512638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:47.513942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:47.515047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:47.515736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:47.516178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:47.677611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:47.689253 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-65542a2b-99f4-41d8-9436-c942409ee34d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1202 microversion: 2.1 time: 0.193112 Oct 25 03:38:47.702437 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3074/6256] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:47 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1202 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:48.714132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:48.716575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:48.726245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:48.727108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:48.728247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:48.729216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:48.729927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:48.730578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:48.737057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:48.968660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:48.979859 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7741f37d-d071-4d5d-9a27-4399f8444227 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1388 microversion: 2.1 time: 0.270669 Oct 25 03:38:48.980466 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3183/6257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:48 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1388 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:49.010102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:49.011135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:49.015701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:49.032635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:49.033445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:49.034885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:49.039353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:49.041608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:49.043677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:49.502608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:49.514467 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f05c5942-7fe1-4f42-9331-3c22534b96c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1388 microversion: 2.1 time: 0.510343 Oct 25 03:38:49.515419 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3075/6258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:49 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1388 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:49.540974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:49.542334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:49.568506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:49.569410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:49.571643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:49.572609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:49.573703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:49.577256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:49.771949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:49.782252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4dbbd762-a60b-450b-8ff7-f6a66bb9bab5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1388 microversion: 2.1 time: 0.247283 Oct 25 03:38:49.782886 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3184/6259] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:49 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1388 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:49.806118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:49.806939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:49.815326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:49.817885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:49.818716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:49.820154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:49.821010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:49.821661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:49.853560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:38:49.982502 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aed190cf-2911-46cc-a878-20dac0966312 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 204 len: 0 microversion: 2.1 time: 0.180048 Oct 25 03:38:49.986504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3076/6260] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:38:49 2022] DELETE /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:38:50.000211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:50.000211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:50.003711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:50.004297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:50.004809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:50.005755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:50.006285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:50.007027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:50.202344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:50.224314 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e22a146-91e4-40c7-9c80-bc9e73082214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1394 microversion: 2.1 time: 0.226043 Oct 25 03:38:50.225885 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3185/6261] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:49 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1394 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:38:51.258717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:51.259445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:51.276592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:51.277347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:51.277928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:51.279148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:51.279442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:51.279875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:51.307971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:51.702239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:51.723679 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-501dc534-fbf8-4a5f-ae85-8da7f3fe0ce1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1394 microversion: 2.1 time: 0.468772 Oct 25 03:38:51.724913 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3077/6262] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:51 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1394 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:52.527502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c158e23b-2b3c-4738-9869-4c4b7f5a4de2 req-1c386614-f062-4f12-8c16-cb2edffaa3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1fb076-0245-4ed9-90ad-be8378b42c3a", "name": "network-vif-deleted", "tag": "a09b88b5-a604-4eb8-a6d4-f4b5bed07f08"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:52.552803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c158e23b-2b3c-4738-9869-4c4b7f5a4de2 req-1c386614-f062-4f12-8c16-cb2edffaa3c5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:52.553562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c158e23b-2b3c-4738-9869-4c4b7f5a4de2 req-1c386614-f062-4f12-8c16-cb2edffaa3c5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:52.554163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c158e23b-2b3c-4738-9869-4c4b7f5a4de2 req-1c386614-f062-4f12-8c16-cb2edffaa3c5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:52.583206 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c158e23b-2b3c-4738-9869-4c4b7f5a4de2 req-1c386614-f062-4f12-8c16-cb2edffaa3c5 service nova] Creating event network-vif-deleted:a09b88b5-a604-4eb8-a6d4-f4b5bed07f08 for instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a on n-h2-862355-1 Oct 25 03:38:52.589867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c158e23b-2b3c-4738-9869-4c4b7f5a4de2 req-1c386614-f062-4f12-8c16-cb2edffaa3c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066116 Oct 25 03:38:52.595772 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3186/6263] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:38:52.751692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:52.752314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:52.774843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:52.775632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:52.776237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:52.777141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:52.777787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:52.779286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:52.894595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:52.906576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-36a97fca-fba5-4961-a13a-42828e1dcbc2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1187 microversion: 2.1 time: 0.160986 Oct 25 03:38:52.907192 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3078/6264] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:52 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:53.932585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:53.933302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:53.965327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:53.965945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:53.966431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:53.967122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:53.967590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:53.969596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:54.168443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:54.192545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0275aa0b-917f-4ded-8336-4c3781b5a75c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1187 microversion: 2.1 time: 0.263763 Oct 25 03:38:54.198887 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3187/6265] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:53 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1187 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:55.218115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:55.219014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:55.228070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:55.229323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:55.230063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:55.231067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:55.232395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:55.233173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:55.384708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:55.400405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3dbf9df4-feb7-484a-8f63-2a6d6cd4fc4a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1187 microversion: 2.1 time: 0.188165 Oct 25 03:38:55.404577 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3079/6266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:55 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1187 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:55.518221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-548373673-access_point-598275476", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "e107df31-1a43-4f3d-8903-120426108058"}], "key_name": "tempest-TestSecurityGroupsBasicOps-444327658", "security_groups": [{"name": "tempest-secgroup_access--276688442"}, {"name": "tempest-secgroup_general--1687781244"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:38:55.765204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] validate_networks() for [('e107df31-1a43-4f3d-8903-120426108058', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:38:55.909603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:38:56.427323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:56.427895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:56.439594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:56.440337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:56.441173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:56.442285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:56.442910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:56.443526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:56.534591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:56.544748 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73383790-0961-4b3a-9ada-138ba3a5bedd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1187 microversion: 2.1 time: 0.121822 Oct 25 03:38:56.546064 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3080/6267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:56 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:56.929030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:38:56.929494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:38:56.930089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:38:56.930677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:38:56.931364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:38:56.951189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:56.951721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:56.952172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:56.952907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:56.953369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:56.954062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:56.989155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Getting quotas for project c717eb2194cc4f648ccbc804ba1a7a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:38:57.007916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Getting quotas for user 4f0a8c9405354ba3965cf5805f818f1f and project c717eb2194cc4f648ccbc804ba1a7a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:38:57.029970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:38:57.032336 n-d-862355-1 devstack@n-api.service[120562]: WARNING nova.utils [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-548373673-access_point-598275476 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-548373673-acc Oct 25 03:38:57.033154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:38:57.111948 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0c4d0a0a-a786-4337-8c4e-58645f6b7feb tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.599386 Oct 25 03:38:57.119713 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3188/6268] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:38:55 2022] POST /compute/v2.1/servers => generated 457 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:38:57.144659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a669ef6-c756-4508-8253-0c56c0564986 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:57.145417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1a669ef6-c756-4508-8253-0c56c0564986 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:57.337003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a669ef6-c756-4508-8253-0c56c0564986 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:57.359528 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a669ef6-c756-4508-8253-0c56c0564986 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1292 microversion: 2.1 time: 0.237332 Oct 25 03:38:57.360760 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3081/6269] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:57 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1292 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:57.571845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:57.572461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:57.589455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:57.590262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:57.593339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:57.594428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:57.595932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:57.596382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:57.768887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:57.781972 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a49094e6-d86b-4582-a443-349582ba4c10 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1187 microversion: 2.1 time: 0.213329 Oct 25 03:38:57.785819 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3189/6270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:57 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1187 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:58.389395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c052db9d-caec-4ca4-b7e6-0eb66acc5f0d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:58.390124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c052db9d-caec-4ca4-b7e6-0eb66acc5f0d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:58.518259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c052db9d-caec-4ca4-b7e6-0eb66acc5f0d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:58.531642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c052db9d-caec-4ca4-b7e6-0eb66acc5f0d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1292 microversion: 2.1 time: 0.147781 Oct 25 03:38:58.533004 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3082/6271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:58 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1292 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:38:58.812620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:58.814410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:58.827254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:58.828169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:58.829072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:58.830115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:58.830821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:58.831529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:58.963694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:58.973602 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-186fd8a0-5a12-4af1-a588-523653bda0a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1187 microversion: 2.1 time: 0.169278 Oct 25 03:38:58.976355 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3190/6272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:58 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:38:59.565248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:38:59.565901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:38:59.577186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:59.577701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:59.578159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:59.579146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:38:59.579777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:38:59.580362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:38:59.676673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:38:59.684433 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1007e010-3fe1-44f3-858a-33d7610bb308 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1362 microversion: 2.1 time: 0.131230 Oct 25 03:38:59.687427 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3083/6273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:59 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1362 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:00.007537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:00.008230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:00.023091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:00.023959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:00.025381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:00.026693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:00.027407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:00.028021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:00.197236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:00.229485 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7bb2864f-8e1f-4250-998e-f75ed83fa96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 200 len: 1187 microversion: 2.1 time: 0.229998 Oct 25 03:39:00.232356 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3191/6274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:38:59 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 1187 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:00.719454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:00.720838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:00.729880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:00.730733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:00.732183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:00.733363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:00.734228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:00.735255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.054859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:01.065504 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77982897-4cfd-41f5-b2d7-0a97d87b2d03 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1469 microversion: 2.1 time: 0.358619 Oct 25 03:39:01.067415 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3084/6275] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:00 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:39:01.267597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:01.271545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0e1fb076-0245-4ed9-90ad-be8378b42c3a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:01.290853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.291646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.293488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.295126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.295593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.296296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.314223 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a could not be found. Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a HTTP/1.1 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a could not be found. Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0e1fb076-0245-4ed9-90ad-be8378b42c3a'} Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a could not be found. Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a could not be found. Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:01.316494 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.320566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:01.320566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:01.320566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:01.320566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:39:01.320566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:39:01.320566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a could not be found. Oct 25 03:39:01.320566 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.322555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 0e1fb076-0245-4ed9-90ad-be8378b42c3a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:39:01.324076 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cc3211fb-1f2e-417c-8150-c66bce117e69 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a" status: 404 len: 111 microversion: 2.1 time: 0.072365 Oct 25 03:39:01.327282 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3192/6276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:01 2022] GET /compute/v2.1/servers/0e1fb076-0245-4ed9-90ad-be8378b42c3a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:39:01.402776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:01.403344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:01.410841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.411617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.411743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.412472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.412934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.414635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.464285 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd6ae7d8-7434-4cd8-802a-4e7e1f452109 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d/ips" status: 200 len: 150 microversion: 2.1 time: 0.065486 Oct 25 03:39:01.465733 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3085/6277] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:39:01 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d/ips => generated 150 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:01.480004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f0f07ca-129a-4048-86cd-aab40e925ebe"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:01.483154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:01.494994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.497811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.498419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.502460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.502949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.503573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.614257 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Invalid volume: volume 6f0f07ca-129a-4048-86cd-aab40e925ebe is already attached to instances: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d/os-volume_attachments HTTP/1.1 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 74 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: {"volumeAttachment": {"volumeId": "6f0f07ca-129a-4048-86cd-aab40e925ebe"}} Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid volume: volume 6f0f07ca-129a-4048-86cd-aab40e925ebe is already attached to instances: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '15ab2e52-4220-4274-8fae-b3279cb9495d', 'body': {'volumeAttachment': {'volumeId': '6f0f07ca-129a-4048-86cd-aab40e925ebe'}}} Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6f0f07ca-129a-4048-86cd-aab40e925ebe is already attached to instances: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:39:01.616100 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6f0f07ca-129a-4048-86cd-aab40e925ebe is already attached to instances: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6f0f07ca-129a-4048-86cd-aab40e925ebe is already attached to instances: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 400 to user: Invalid volume: volume 6f0f07ca-129a-4048-86cd-aab40e925ebe is already attached to instances: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9f6c46aa-9085-43c9-b9b0-02dfd788337f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142422 Oct 25 03:39:01.621413 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3193/6278] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:39:01 2022] POST /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:39:01.630743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:01.631248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:01.646236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.648074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.652203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.654127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.654824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.655467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.684811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:39:01.768608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-65a81cce-5095-4c02-8a58-2245ca9146a4 req-3ef948a9-3fe5-4a35-b08c-ca368f3dba08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7335ffc3-43ba-4925-9ab9-6d91db345b54", "tag": "7b667178-0af8-4c09-8201-342026b3c43d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:01.781512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-65a81cce-5095-4c02-8a58-2245ca9146a4 req-3ef948a9-3fe5-4a35-b08c-ca368f3dba08 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.783107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-65a81cce-5095-4c02-8a58-2245ca9146a4 req-3ef948a9-3fe5-4a35-b08c-ca368f3dba08 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.783496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-65a81cce-5095-4c02-8a58-2245ca9146a4 req-3ef948a9-3fe5-4a35-b08c-ca368f3dba08 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.804812 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-65a81cce-5095-4c02-8a58-2245ca9146a4 req-3ef948a9-3fe5-4a35-b08c-ca368f3dba08 service nova] Creating event network-changed:7b667178-0af8-4c09-8201-342026b3c43d for instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 on n-h1-862355-1 Oct 25 03:39:01.824047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-65a81cce-5095-4c02-8a58-2245ca9146a4 req-3ef948a9-3fe5-4a35-b08c-ca368f3dba08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059382 Oct 25 03:39:01.828895 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3194/6279] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:01.834451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-83170cf5-2539-47d5-8dcc-dfa8c839f40f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 204 len: 0 microversion: 2.1 time: 0.208039 Oct 25 03:39:01.835156 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3086/6280] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:39:01 2022] DELETE /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:39:01.845718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:01.846672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:01.863080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.864342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.866222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:01.867080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:01.868994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:01.870330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:02.074812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:02.083461 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5cf64a34-3e17-4ea2-b432-bd7fafa2741a tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1681 microversion: 2.1 time: 0.243120 Oct 25 03:39:02.084895 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3195/6281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:01 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:02.092132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:02.093113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:02.102758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:02.103565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:02.104210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:02.105125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:02.105833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:02.107834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:02.446785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:02.460230 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-02828bbb-4918-48be-ac9c-fae4fab30831 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1469 microversion: 2.1 time: 0.372560 Oct 25 03:39:02.468837 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3087/6282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:02 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:39:03.108222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:03.108874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:03.118155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:03.118637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:03.119071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:03.119778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:03.120231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:03.120652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:03.284816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:03.295023 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-efb38a5a-1ee1-4cfa-a9b0-c632fcf88506 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1681 microversion: 2.1 time: 0.190674 Oct 25 03:39:03.296609 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3196/6283] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:03 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:03.485972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:03.486706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:03.500724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:03.503872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:03.504765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:03.507757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:03.509033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:03.510581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:03.968952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:03.979434 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9fa88082-98eb-42bd-9b70-69bb5f75f93e tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1469 microversion: 2.1 time: 0.498813 Oct 25 03:39:03.994852 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3088/6284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:03 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1469 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:04.322364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:04.324488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:04.342796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:04.343440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:04.344115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:04.344908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:04.345488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:04.346086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:04.446582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:04.459713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ca47f75-a4f7-4052-b7d7-5c2304bd0336 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1614 microversion: 2.1 time: 0.143139 Oct 25 03:39:04.460903 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3197/6285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:04 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1614 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:05.005769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:05.008232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-58fdf843-b6ec-4ace-a234-550298f59bcb req-84d064ed-4142-4cc2-8e4f-6e3100b6e0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ab2e52-4220-4274-8fae-b3279cb9495d", "name": "network-vif-deleted", "tag": "046e57f5-868b-47e4-aafa-a43f412934ff"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:05.013221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:05.046996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:05.049134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:05.055468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:05.061399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:05.062066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:05.063893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:05.077380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-58fdf843-b6ec-4ace-a234-550298f59bcb req-84d064ed-4142-4cc2-8e4f-6e3100b6e0e2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:05.078082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-58fdf843-b6ec-4ace-a234-550298f59bcb req-84d064ed-4142-4cc2-8e4f-6e3100b6e0e2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:05.091877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-58fdf843-b6ec-4ace-a234-550298f59bcb req-84d064ed-4142-4cc2-8e4f-6e3100b6e0e2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:05.137913 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-58fdf843-b6ec-4ace-a234-550298f59bcb req-84d064ed-4142-4cc2-8e4f-6e3100b6e0e2 service nova] Creating event network-vif-deleted:046e57f5-868b-47e4-aafa-a43f412934ff for instance 15ab2e52-4220-4274-8fae-b3279cb9495d on n-h2-862355-1 Oct 25 03:39:05.162448 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-58fdf843-b6ec-4ace-a234-550298f59bcb req-84d064ed-4142-4cc2-8e4f-6e3100b6e0e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166340 Oct 25 03:39:05.172120 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3089/6286] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:05.424543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:05.435952 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-04558a9b-fc88-4d77-be18-00c8177854a5 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1469 microversion: 2.1 time: 0.435190 Oct 25 03:39:05.450984 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3198/6287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:04 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1469 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:39:05.483806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:05.485449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:05.498426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:05.499436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:05.500590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:05.504293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:05.505095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:05.505762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:05.585603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:05.585851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:05.586544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:05.587185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lazy-loading 'fault' on Instance uuid 15ab2e52-4220-4274-8fae-b3279cb9495d {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:39:05.667107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:05.678542 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-feecd894-00d1-49dd-8a07-8ab51ebbaba5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 200 len: 1331 microversion: 2.1 time: 0.198948 Oct 25 03:39:05.687421 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3090/6288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:05 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 1331 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:06.461929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:06.462571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:06.473425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:06.473962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:06.481965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:06.484624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:06.485829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:06.486285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:06.715254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:06.716485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:06.751133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:06.753261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:06.755433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:06.758570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:06.767996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:06.769459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:06.838304 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d HTTP/1.1 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '15ab2e52-4220-4274-8fae-b3279cb9495d'} Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:06.843436 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:39:06.848970 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1cbf324-7ed6-471c-a925-4d44e9e8a56e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 404 len: 111 microversion: 2.1 time: 0.134022 Oct 25 03:39:06.850088 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3091/6289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:06 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:39:06.862612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-acb00429-516e-410c-8cbc-6f761a4a5400 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '.version_select at 0x7efd32321790>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:06.909292 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-acb00429-516e-410c-8cbc-6f761a4a5400 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815319781" status: 202 len: 0 microversion: 2.1 time: 0.052928 Oct 25 03:39:06.911390 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3092/6290] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:39:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815319781 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:39:06.956204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:06.975974 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8b6b48b-b812-4493-8724-2f76a5051086 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1469 microversion: 2.1 time: 0.518889 Oct 25 03:39:06.982559 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3199/6291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:06 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1469 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:07.042577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f02aba74-c315-4770-9251-684a93fe019c req-bf72ca16-1a31-41fb-9db0-c3ee64380ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7335ffc3-43ba-4925-9ab9-6d91db345b54", "name": "network-vif-plugged", "status": "completed", "tag": "7b667178-0af8-4c09-8201-342026b3c43d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:07.064595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f02aba74-c315-4770-9251-684a93fe019c req-bf72ca16-1a31-41fb-9db0-c3ee64380ac4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:07.065415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f02aba74-c315-4770-9251-684a93fe019c req-bf72ca16-1a31-41fb-9db0-c3ee64380ac4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:07.066605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f02aba74-c315-4770-9251-684a93fe019c req-bf72ca16-1a31-41fb-9db0-c3ee64380ac4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:07.103831 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f02aba74-c315-4770-9251-684a93fe019c req-bf72ca16-1a31-41fb-9db0-c3ee64380ac4 service nova] Creating event network-vif-plugged:7b667178-0af8-4c09-8201-342026b3c43d for instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 on n-h1-862355-1 Oct 25 03:39:07.127862 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f02aba74-c315-4770-9251-684a93fe019c req-bf72ca16-1a31-41fb-9db0-c3ee64380ac4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086164 Oct 25 03:39:07.129892 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3093/6292] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:08.000730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:08.001354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:08.006857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:08.007831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:08.010420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:08.011192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:08.011854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:08.012844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:08.013608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:08.014361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:08.609009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:08.622786 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-620a4c89-2a02-4879-9c4b-79e5707b1f69 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1469 microversion: 2.1 time: 0.625397 Oct 25 03:39:08.623486 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3200/6293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:07 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1469 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:08.689125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:08.694357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:08.694859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:08.701793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:08.702511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:08.703107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:08.704086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:08.705251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:08.705885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:08.819513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lazy-loading 'services' on Instance uuid fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:39:08.925515 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-311dbc39-c237-4a8c-a020-e4bc56926f6f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments/6f0f07ca-129a-4048-86cd-aab40e925ebe" status: 202 len: 0 microversion: 2.1 time: 0.238502 Oct 25 03:39:08.926345 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3094/6294] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:39:08 2022] DELETE /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments/6f0f07ca-129a-4048-86cd-aab40e925ebe => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:39:08.935388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:08.938130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:08.949571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:08.951001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:08.951816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:08.973168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:08.973915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:08.974392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:09.064735 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6baf7f7b-bbb9-49d1-8268-38d7d2fed995 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133699 Oct 25 03:39:09.066114 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3201/6295] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:39:08 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:09.504400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-83553630", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2590dff6-dad9-4ab7-95a9-8b2dbf904350", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:09.575772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:39:09.647373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:09.647999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:09.660235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:09.660734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:09.661177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:09.661921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:09.662379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:09.662817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:09.701186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:10.057239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:10.076713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-255f31ec-1008-49f4-92a5-db244478442d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1641 microversion: 2.1 time: 0.432227 Oct 25 03:39:10.077666 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3202/6296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:09 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1641 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:10.096198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:10.099573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:10.119188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.120431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.120846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:10.121581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.123479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.123927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:10.204624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:39:10.206094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:39:10.206906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:39:10.207524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:39:10.208844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:39:10.225197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.225956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.230967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:10.232788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.233853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.234471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:10.259799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:39:10.268766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:39:10.397863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:39:10.401657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2590dff6-dad9-4ab7-95a9-8b2dbf904350',volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:39:10.594611 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4066f675-003a-4b8a-8503-97f0a0bfd315 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.514786 Oct 25 03:39:10.597349 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3203/6297] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:39:10 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 197 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:10.602938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:10.603766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:10.610750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.611459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.612153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:10.613045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.613826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.614530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:10.670009 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60d7137f-a719-4e1b-baf4-9741485dc0da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170536 Oct 25 03:39:10.677439 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3095/6298] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:39:10.683241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6bd63f9a-6ee8-466f-8131-3295fb06ceab tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:10.684794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6bd63f9a-6ee8-466f-8131-3295fb06ceab tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:10.788409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6bd63f9a-6ee8-466f-8131-3295fb06ceab tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:10.791282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:10.798064 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6bd63f9a-6ee8-466f-8131-3295fb06ceab tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1055 microversion: 2.1 time: 0.118772 Oct 25 03:39:10.801736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cbada14e-0a6b-467b-ad07-b098960e979b tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1641 microversion: 2.1 time: 0.202922 Oct 25 03:39:10.802928 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3204/6299] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:10 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1641 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:10.818879 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3096/6300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:10 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1055 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:10.829768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:10.830474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:10.837078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.840349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.841436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:10.843657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:10.844146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:10.844581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:11.204565 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-099fd383-fb0a-43b6-b850-8b170414ca3a tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1792 microversion: 2.1 time: 0.379236 Oct 25 03:39:11.207103 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3205/6301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:10 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1792 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:11.609507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:11.617869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:11.632085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:11.632916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:11.633945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:11.636581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:11.652363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:11.657443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:11.784053 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4cdd151-9f91-47ec-a841-77e39ecf6ea3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177959 Oct 25 03:39:11.784955 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3097/6302] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:39:11 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:11.825713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:11.826707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:11.838491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:11.839917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:11.840454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:11.842946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:11.844104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:11.844734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:11.951782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:11.960384 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2764f74-db09-4ab9-b657-33f984b730c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1153 microversion: 2.1 time: 0.138291 Oct 25 03:39:11.961081 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3206/6303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:11 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1153 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:12.813223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:12.817200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:12.832582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:12.833079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:12.836966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:12.837831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:12.838318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:12.842648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:12.883559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:12.927612 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e28908d-b583-4dd3-b209-414332deef60 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121371 Oct 25 03:39:12.928940 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3098/6304] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:39:12 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:12.984708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:12.985449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:13.013621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:13.014398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:13.015075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:13.017464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:13.018137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:13.018668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:13.171456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:13.190521 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9f7152a-d941-4dc3-ae19-803910eb6bf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1171 microversion: 2.1 time: 0.210311 Oct 25 03:39:13.191781 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3207/6305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:12 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1171 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:13.942347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:13.945543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:13.957361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:13.958757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:13.959428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:13.960880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:13.961636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:13.962539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:14.015897 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b424971a-f17a-4bdd-aa45-fd4709050439 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074474 Oct 25 03:39:14.021451 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3099/6306] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:39:13 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:14.220067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:14.220702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:14.223766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:14.234024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:14.237459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:14.241590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:14.242558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:14.243952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:14.245840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:14.395131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-54f77ea1-fb08-415d-b942-85e995a1de75 req-7936bfb4-51f7-46d1-930d-5ac1729a2a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7335ffc3-43ba-4925-9ab9-6d91db345b54", "tag": "7b667178-0af8-4c09-8201-342026b3c43d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:14.416020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-54f77ea1-fb08-415d-b942-85e995a1de75 req-7936bfb4-51f7-46d1-930d-5ac1729a2a15 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:14.416511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-54f77ea1-fb08-415d-b942-85e995a1de75 req-7936bfb4-51f7-46d1-930d-5ac1729a2a15 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:14.416939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-54f77ea1-fb08-415d-b942-85e995a1de75 req-7936bfb4-51f7-46d1-930d-5ac1729a2a15 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:14.443167 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-54f77ea1-fb08-415d-b942-85e995a1de75 req-7936bfb4-51f7-46d1-930d-5ac1729a2a15 service nova] Creating event network-changed:7b667178-0af8-4c09-8201-342026b3c43d for instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 on n-h1-862355-1 Oct 25 03:39:14.451782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-54f77ea1-fb08-415d-b942-85e995a1de75 req-7936bfb4-51f7-46d1-930d-5ac1729a2a15 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060244 Oct 25 03:39:14.452975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3100/6307] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:39:15.030562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:15.032908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:15.051603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:15.052449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:15.054150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:15.056759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:15.057398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:15.061233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:15.092675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:15.106634 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c0fd9f8c-19a5-4932-936d-04c62bd77929 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1213 microversion: 2.1 time: 0.890673 Oct 25 03:39:15.108704 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3208/6308] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:14 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1213 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:15.131775 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15074607-a19d-4ac2-89d8-b41c1935e1ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106687 Oct 25 03:39:15.132684 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3101/6309] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:39:15 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:15.807940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7265edd6-935a-4806-aab5-3f5ad83e4fa7 req-0901a5c0-f4bc-4953-8222-16b4d51c27d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc41cc4f-dd67-4097-9c62-41c652df988e", "tag": "3242fbfc-f0dc-4a1b-bbfd-612f99c81f4d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:15.829935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7265edd6-935a-4806-aab5-3f5ad83e4fa7 req-0901a5c0-f4bc-4953-8222-16b4d51c27d5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:15.829935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7265edd6-935a-4806-aab5-3f5ad83e4fa7 req-0901a5c0-f4bc-4953-8222-16b4d51c27d5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:15.830171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7265edd6-935a-4806-aab5-3f5ad83e4fa7 req-0901a5c0-f4bc-4953-8222-16b4d51c27d5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:15.849483 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7265edd6-935a-4806-aab5-3f5ad83e4fa7 req-0901a5c0-f4bc-4953-8222-16b4d51c27d5 service nova] Creating event network-changed:3242fbfc-f0dc-4a1b-bbfd-612f99c81f4d for instance cc41cc4f-dd67-4097-9c62-41c652df988e on n-h2-862355-1 Oct 25 03:39:15.863641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7265edd6-935a-4806-aab5-3f5ad83e4fa7 req-0901a5c0-f4bc-4953-8222-16b4d51c27d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059394 Oct 25 03:39:15.864541 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3209/6310] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:16.130530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:16.131706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:16.143098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.144457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.146813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:16.147564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:16.148335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.148810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.149244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:16.150358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:16.158358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.159511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.160189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:16.161127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.161993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.162638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:16.227640 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5375bae0-e301-4b65-8346-10d0d715faf1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085697 Oct 25 03:39:16.229669 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3210/6311] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:39:16 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 25 03:39:16.506985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:16.508716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:16.516072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.517505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.519197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:16.520347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.520975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.521568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:16.584764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:39:16.657526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:16.672883 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3cc3dfc3-8568-4980-954a-f4ffdcf98d46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1213 microversion: 2.1 time: 0.545840 Oct 25 03:39:16.674932 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3102/6312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:16 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1213 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:16.760904 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f784d9e1-6e6f-4bf4-8be3-8222052fce34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 204 len: 0 microversion: 2.1 time: 0.260452 Oct 25 03:39:16.761911 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3211/6313] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:39:16 2022] DELETE /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:39:16.770706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:16.771927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:16.795110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.796001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.796655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:16.797992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:16.804233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:16.804904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:17.132102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:17.149951 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cdff9a6-b3f1-4c97-8fa4-97fedfda1c64 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1680 microversion: 2.1 time: 0.382748 Oct 25 03:39:17.166952 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3103/6314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:16 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1680 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:17.705572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:17.707203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:17.740468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:17.741581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:17.748383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:17.749488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:17.750415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:17.751600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:18.055363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:18.064315 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7e262c8-25a6-4ffd-8a0a-8cae55a58f48 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1213 microversion: 2.1 time: 0.365747 Oct 25 03:39:18.085265 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3212/6315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:17 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1213 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:18.176052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:18.176729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:18.194906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:18.203329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:18.203983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:18.205348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:18.206001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:18.209441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:18.720576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:18.733325 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5153953b-b61d-479e-9e4c-19667764db47 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1680 microversion: 2.1 time: 0.561313 Oct 25 03:39:18.741620 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3104/6316] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:18 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1680 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:19.092368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:19.093653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:19.109965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:19.111391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:19.112005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:19.113026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:19.114353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:19.114962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:19.328543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:19.345357 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7219ea10-6f52-48c5-b9b3-d68bdde27618 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1213 microversion: 2.1 time: 0.256029 Oct 25 03:39:19.346881 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3213/6317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:19 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1213 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:19.762480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:19.763113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:19.766981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:19.781308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:19.781308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:19.781308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:19.781308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:19.791082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:19.791870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:19.949253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:19.962427 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7ebc25dc-323b-4870-bffc-609d119d0e0b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 200 len: 1614 microversion: 2.1 time: 0.205169 Oct 25 03:39:19.963031 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3105/6318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:19 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 1614 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:39:20.032819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6dcad1e0-b950-4dd5-a3f4-cb8dda836eb2 req-18d10d68-e04b-440c-aed9-107e245ee4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc02d7c8-0307-47e9-9acd-0bb9cd64cb39", "name": "network-vif-deleted", "tag": "d80aec0d-d250-4ab6-a987-dc24b4fa3a3b"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:20.045497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6dcad1e0-b950-4dd5-a3f4-cb8dda836eb2 req-18d10d68-e04b-440c-aed9-107e245ee4a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:20.046376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6dcad1e0-b950-4dd5-a3f4-cb8dda836eb2 req-18d10d68-e04b-440c-aed9-107e245ee4a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:20.046974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6dcad1e0-b950-4dd5-a3f4-cb8dda836eb2 req-18d10d68-e04b-440c-aed9-107e245ee4a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:20.070236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6dcad1e0-b950-4dd5-a3f4-cb8dda836eb2 req-18d10d68-e04b-440c-aed9-107e245ee4a7 service nova] Creating event network-vif-deleted:d80aec0d-d250-4ab6-a987-dc24b4fa3a3b for instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 on n-h1-862355-1 Oct 25 03:39:20.085924 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6dcad1e0-b950-4dd5-a3f4-cb8dda836eb2 req-18d10d68-e04b-440c-aed9-107e245ee4a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058424 Oct 25 03:39:20.086628 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3214/6319] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:20.371085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:20.372929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:20.390560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:20.396029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:20.397252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:20.397990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:20.407568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:20.408758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:20.409453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:20.704937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:20.725097 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93f15b64-b963-443b-92c3-c8a3f082ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1213 microversion: 2.1 time: 0.356426 Oct 25 03:39:20.726533 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3106/6320] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:20 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1213 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:20.991095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:20.991980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:21.024016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:21.024628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:21.025152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:21.027276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:21.028339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:21.030298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:21.049275 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 HTTP/1.1 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'fc02d7c8-0307-47e9-9acd-0bb9cd64cb39'} Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:21.051806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:39:21.056747 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fb3cc534-ce59-4a7a-ac50-046fe6fd659d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 404 len: 111 microversion: 2.1 time: 0.069951 Oct 25 03:39:21.057624 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3215/6321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:20 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:39:21.067640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-62982605-52df-46ba-8ca4-973147f1bf3b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '.version_select at 0x7efd32369700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:21.085465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:21.100811 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-62982605-52df-46ba-8ca4-973147f1bf3b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671402907" status: 202 len: 0 microversion: 2.1 time: 0.037964 Oct 25 03:39:21.103743 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3107/6322] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671402907 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:39:21.753425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:21.756410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:21.773989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:21.775349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:21.776402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:21.780118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:21.780752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:21.782201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:22.105280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:22.122223 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3280e5f4-be42-4f92-a1d4-2dc67657f2e1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1213 microversion: 2.1 time: 0.377519 Oct 25 03:39:22.130780 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3216/6323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:21 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1213 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:22.234259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d1a2805e-34bc-4a35-b991-d566321fd1c3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: .version_select at 0x7efd32331550>, body: {"keypair": {"name": "tempest-keypair-559406180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORWBBo/BGFc/FLzZOy/eIiJjvMeOZppE6vl+bxVVSKTyl5kl1nsuHgnud+knR6QlgzhibMryymhOe82w/yqMuBrZcW8cjrgU586wL9FSe7Sj5BGQp9/AMOhXxAwuGEHmQ=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:22.274763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d1a2805e-34bc-4a35-b991-d566321fd1c3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:39:22.282589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d1a2805e-34bc-4a35-b991-d566321fd1c3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:39:22.319777 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d1a2805e-34bc-4a35-b991-d566321fd1c3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090919 Oct 25 03:39:22.320423 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3108/6324] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:39:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:23.150787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:23.151333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:23.164314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:23.165303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:23.166314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:23.169008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:23.171197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:23.173413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:23.396682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:23.411442 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc1a0be5-7cce-4a1e-ab34-27aa1a4d5f87 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.265578 Oct 25 03:39:23.412772 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3217/6325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:23 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:24.032561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-800235380", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe069d9f-9479-42aa-b1da-5e77a91badbd"}], "security_groups": [{"name": "tempest-securitygroup--1098051942"}], "key_name": "tempest-keypair-559406180", "user_data": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:24.155083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] validate_networks() for [('fe069d9f-9479-42aa-b1da-5e77a91badbd', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:39:24.436218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:24.437577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:24.444155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:24.444655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:24.445103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:24.445846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:24.446511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:24.447105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:24.607603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:39:24.608097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:39:24.610796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:39:24.612202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:39:24.612942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:39:24.625153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:24.625951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:24.626566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:24.627495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:24.628133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:24.629312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:24.637286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:24.646411 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4fb407d0-65f2-4e2d-9088-a95ea81d3cda tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.214698 Oct 25 03:39:24.660984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:39:24.661949 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3218/6326] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:24 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:24.675397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:39:24.701728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:39:24.704147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:39:24.759075 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b70e8427-7b24-41bd-867c-875eac1d416c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.732473 Oct 25 03:39:24.759743 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3109/6327] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:39:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:39:24.777478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47b99d8b-1bc2-4963-abe4-41e885c58df9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:24.788686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47b99d8b-1bc2-4963-abe4-41e885c58df9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:24.864577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-47b99d8b-1bc2-4963-abe4-41e885c58df9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:24.875874 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47b99d8b-1bc2-4963-abe4-41e885c58df9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1240 microversion: 2.1 time: 0.107133 Oct 25 03:39:24.877590 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3219/6328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:24 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:25.677290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:25.678956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:25.687261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:25.687921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:25.688630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:25.689631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:25.690241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:25.691063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:25.850667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:25.859180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ff27e165-7742-4af6-8125-a3f133126621 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.187863 Oct 25 03:39:25.860076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3110/6329] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:25 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:25.903474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:25.904427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:25.915982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:25.916821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:25.917533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:25.919233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:25.919916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:25.920572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:25.942576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:26.073259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:26.082505 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f4ee834-2448-48e5-bb7f-4ccf89c3f7dc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1292 microversion: 2.1 time: 0.184999 Oct 25 03:39:26.084147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3220/6330] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:25 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1292 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:26.883870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:26.884943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:26.894988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:26.899246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:26.899744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:26.900486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:26.900968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:26.901402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:27.110599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:27.111360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:27.119376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:27.120129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:27.120755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:27.121954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:27.122656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:27.123282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:27.202022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:27.212214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-783275d5-7d75-40c5-94ad-87d288798b1f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1298 microversion: 2.1 time: 0.107423 Oct 25 03:39:27.227605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:27.229272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3221/6331] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:27 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:27.263622 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-990d159d-475b-4ecf-ad7c-e64a5a125816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.383187 Oct 25 03:39:27.265355 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3111/6332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:26 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:28.237036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:28.237998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:28.245226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:28.245908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:28.246501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:28.247570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:28.248161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:28.248698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:28.289865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:28.290682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:28.299823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:28.300435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:28.300959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:28.301765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:28.302307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:28.302814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:28.505909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:28.519609 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65568100-d8e4-4700-8665-b507f860e643 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.286704 Oct 25 03:39:28.520461 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3222/6333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:28 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:28.525460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bde5a215-b105-4810-ae3f-9a52e5bde049 req-7d77aa02-dd3b-4298-85c9-2c209ea8d56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9b6f26-1be9-4f8f-8a27-a071354de168", "tag": "c013715d-b73e-4600-bb7c-60c564b04dda"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:28.535973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bde5a215-b105-4810-ae3f-9a52e5bde049 req-7d77aa02-dd3b-4298-85c9-2c209ea8d56e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:28.536728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bde5a215-b105-4810-ae3f-9a52e5bde049 req-7d77aa02-dd3b-4298-85c9-2c209ea8d56e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:28.537335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bde5a215-b105-4810-ae3f-9a52e5bde049 req-7d77aa02-dd3b-4298-85c9-2c209ea8d56e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:28.550683 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bde5a215-b105-4810-ae3f-9a52e5bde049 req-7d77aa02-dd3b-4298-85c9-2c209ea8d56e service nova] Creating event network-changed:c013715d-b73e-4600-bb7c-60c564b04dda for instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 on n-h1-862355-1 Oct 25 03:39:28.556046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bde5a215-b105-4810-ae3f-9a52e5bde049 req-7d77aa02-dd3b-4298-85c9-2c209ea8d56e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034176 Oct 25 03:39:28.556933 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3223/6334] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:28.607812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:28.617696 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d247021-6985-40cf-bce8-f9dcdb691572 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.332861 Oct 25 03:39:28.618943 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3112/6335] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:28 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:29.547812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:29.548614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:29.556152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:29.556757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:29.557210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:29.558040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:29.558506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:29.559679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:29.644083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:29.645746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:29.658239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:29.658981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:29.659512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:29.660476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:29.661232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:29.661656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:29.721912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:29.734672 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-189f7270-47bc-4250-919a-860fb74b5cc5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.192822 Oct 25 03:39:29.735290 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3224/6336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:29 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:29.906654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:29.915516 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3f8d057-569a-46de-aea6-60dbb3b2bfdf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.278890 Oct 25 03:39:29.916213 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3113/6337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:29 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:30.758541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:30.759242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:30.767344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:30.768468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:30.768972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:30.769893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:30.770354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:30.770782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:30.913915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:30.922428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4f56b23c-9048-4f5b-8187-d0cd12ff27e6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.168722 Oct 25 03:39:30.923287 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3225/6338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:30 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:30.940086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:30.940778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:30.948338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:30.948839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:30.949409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:30.950820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:30.951292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:30.951728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:31.115992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:31.127527 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f8943e64-77a6-453e-9f5e-58849e802391 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.191340 Oct 25 03:39:31.128120 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3114/6339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:30 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:31.948226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:31.948226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:31.955885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:31.956464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:31.956825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:31.957542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:31.958056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:31.958490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:32.150726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:32.152940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:32.163060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:32.163598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:32.164003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:32.166844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:32.167371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:32.169621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:32.176220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:32.187377 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88cb3708-9797-4635-aa70-c36fbccff0cb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.243860 Oct 25 03:39:32.188685 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3226/6340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:31 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:32.467023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:32.475670 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cce183d0-58e1-4edf-9ac6-1b48689f0f9f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.328875 Oct 25 03:39:32.476624 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3115/6341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:32 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:39:33.211951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:33.212599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:33.231759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:33.234424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:33.234904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:33.235642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:33.236120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:33.236561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:33.447170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:33.465388 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c1327b9-40cd-4ce2-9d50-3bba205a1afa tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.257771 Oct 25 03:39:33.467048 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3227/6342] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:33 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:33.503388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:33.504245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:33.512692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:33.513345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:33.514174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:33.515242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:33.516216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:33.516875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:33.733023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:33.742477 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ebf15de0-c8c2-425f-a314-5d9662cf3173 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.247135 Oct 25 03:39:33.743055 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3116/6343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:33 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:34.491400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:34.492747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:34.504288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:34.506162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:34.506859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:34.507902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:34.508595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:34.509471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:34.687241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:34.696584 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d9cf475-92a5-4c66-83fe-b9e5891c64df tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.211887 Oct 25 03:39:34.698152 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3228/6344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:34 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:34.751855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d1899926-145e-4048-84cc-5c9f13910550 req-a28406bb-dd71-4df9-9fc4-fadf2d26e7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc41cc4f-dd67-4097-9c62-41c652df988e", "name": "network-vif-plugged", "status": "completed", "tag": "3242fbfc-f0dc-4a1b-bbfd-612f99c81f4d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:34.758390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:34.760182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:34.766239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:34.767378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:34.775697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d1899926-145e-4048-84cc-5c9f13910550 req-a28406bb-dd71-4df9-9fc4-fadf2d26e7fd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:34.776190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d1899926-145e-4048-84cc-5c9f13910550 req-a28406bb-dd71-4df9-9fc4-fadf2d26e7fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:34.776626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d1899926-145e-4048-84cc-5c9f13910550 req-a28406bb-dd71-4df9-9fc4-fadf2d26e7fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:34.777338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:34.778469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:34.779105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:34.779798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:34.780287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:34.780793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:34.792387 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d1899926-145e-4048-84cc-5c9f13910550 req-a28406bb-dd71-4df9-9fc4-fadf2d26e7fd service nova] Creating event network-vif-plugged:3242fbfc-f0dc-4a1b-bbfd-612f99c81f4d for instance cc41cc4f-dd67-4097-9c62-41c652df988e on n-h2-862355-1 Oct 25 03:39:34.799102 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d1899926-145e-4048-84cc-5c9f13910550 req-a28406bb-dd71-4df9-9fc4-fadf2d26e7fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050981 Oct 25 03:39:34.800300 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3117/6345] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:34.871924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:35.097755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:35.124163 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb38d207-9c8e-4c12-b227-8f6939d7896f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.358526 Oct 25 03:39:35.125047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3229/6346] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:34 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:35.721845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:35.722888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:35.736787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:35.737656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:35.738411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:35.740049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:35.740861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:35.741632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:35.900478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:35.910974 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a21c2cdf-38b7-4f5a-be3a-85f0af4bd382 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.194139 Oct 25 03:39:35.911884 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3118/6347] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:35 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:36.149111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:36.150148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:36.158568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:36.159157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:36.159680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:36.160477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:36.161029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:36.161550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:36.325880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:36.340910 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5806745e-f4c3-4b0b-8541-9aff41c982aa tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1201 microversion: 2.1 time: 0.195094 Oct 25 03:39:36.343374 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3230/6348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:36 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1201 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:36.821426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-6748db7c-3bbe-4caa-8de8-8a80b79b1f22 req-fe84a9db-31b2-469d-888b-a8d3e80c2a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9b6f26-1be9-4f8f-8a27-a071354de168", "name": "network-vif-plugged", "status": "completed", "tag": "c013715d-b73e-4600-bb7c-60c564b04dda"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:36.832876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6748db7c-3bbe-4caa-8de8-8a80b79b1f22 req-fe84a9db-31b2-469d-888b-a8d3e80c2a42 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:36.833356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6748db7c-3bbe-4caa-8de8-8a80b79b1f22 req-fe84a9db-31b2-469d-888b-a8d3e80c2a42 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:36.834027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6748db7c-3bbe-4caa-8de8-8a80b79b1f22 req-fe84a9db-31b2-469d-888b-a8d3e80c2a42 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:36.841695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:36.848215 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-6748db7c-3bbe-4caa-8de8-8a80b79b1f22 req-fe84a9db-31b2-469d-888b-a8d3e80c2a42 service nova] Creating event network-vif-plugged:c013715d-b73e-4600-bb7c-60c564b04dda for instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 on n-h1-862355-1 Oct 25 03:39:36.854289 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-6748db7c-3bbe-4caa-8de8-8a80b79b1f22 req-fe84a9db-31b2-469d-888b-a8d3e80c2a42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036506 Oct 25 03:39:36.854911 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3119/6349] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:36.935353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:36.935989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:36.954919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:36.955430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:36.956067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:36.957892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:36.959540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:36.960156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:37.132545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:37.141731 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-24bea1cc-3e2a-4736-a718-4b54452989a9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.210799 Oct 25 03:39:37.142907 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3231/6350] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:36 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:37.368125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:37.372891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:37.379743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:37.380284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:37.380734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:37.381463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:37.381949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:37.382542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:37.547822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:37.556398 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-85525c5a-a030-45e6-88d0-e81f1a95531f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1388 microversion: 2.1 time: 0.193113 Oct 25 03:39:37.570423 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3120/6351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:37 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1388 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:37.579284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:37.579916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:37.586763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:37.587260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:37.587703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:37.588407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:37.588866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:37.589298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:37.803656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:37.813443 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-57381d36-418f-4b03-9c09-aa901f9def9e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1388 microversion: 2.1 time: 0.238151 Oct 25 03:39:37.814016 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3232/6352] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:37 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1388 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:37.838465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:37.839999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:37.847157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:37.847654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:37.848099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:37.848802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:37.849385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:37.850084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:38.168854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:38.169896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:38.179528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:38.180294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:38.180909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:38.181921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:38.182747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:38.183592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:38.185374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:38.198611 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee630e85-dfef-455b-8d52-ded8ac118428 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1388 microversion: 2.1 time: 0.364491 Oct 25 03:39:38.200044 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3121/6353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:37 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1388 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:38.225398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:38.226605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:38.235108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:38.237119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:38.237822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:38.238981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:38.239979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:38.240665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:38.272700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:39:38.410305 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc0e8808-2456-432e-bbe4-365594d53a40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 204 len: 0 microversion: 2.1 time: 0.190368 Oct 25 03:39:38.413634 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3122/6354] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:39:38 2022] DELETE /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:39:38.426855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:38.428079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:38.436178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:38.439961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:38.440576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:38.441921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:38.442751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:38.443471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:38.444122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:38.447935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-43f538ff-90c6-4b1b-80c8-736529058893 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1366 microversion: 2.1 time: 0.283912 Oct 25 03:39:38.449139 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3233/6355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:38 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:38.653657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:38.665045 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08c2f60f-2617-4682-95ed-fbf0596c5587 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1394 microversion: 2.1 time: 0.245694 Oct 25 03:39:38.684888 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3123/6356] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:38 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1394 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:39.470973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:39.472167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:39.481353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:39.482174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:39.482769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:39.483656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:39.484110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:39.484729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:39.667894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:39.683222 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8aebfc6a-2afc-4c4d-a523-1255d49862d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1556 microversion: 2.1 time: 0.215699 Oct 25 03:39:39.685481 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3234/6357] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:39 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:39.727822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:39.731332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:39.736987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:39.737709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:39.741909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:39.742785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:39.743552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:39.744364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:39.745041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:39.745175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:39.745771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:39.745965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:39.747388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:39.747627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:39.748242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:39.748855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:39.857095 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f6bd269-d905-439e-9c81-60add7b4973c tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129832 Oct 25 03:39:39.858277 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3235/6358] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:39:39 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:40.118724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:40.126957 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b8a31a4-56f0-462f-9c36-771491cb6068 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1394 microversion: 2.1 time: 0.418829 Oct 25 03:39:40.127764 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3124/6359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:39 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1394 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:41.150125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:41.151448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:41.173295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:41.177219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:41.177700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:41.178500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:41.178974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:41.179410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:41.301482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:41.323823 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12db3b33-f25c-4d5f-b0be-282668b3bcf0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1186 microversion: 2.1 time: 0.175458 Oct 25 03:39:41.324684 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3125/6360] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:41 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1186 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:39:41.333587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4af32379-395c-4968-8845-b175e87676d3 req-bb2ae266-cc51-475a-83cb-1437c6afed49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc41cc4f-dd67-4097-9c62-41c652df988e", "name": "network-vif-deleted", "tag": "3242fbfc-f0dc-4a1b-bbfd-612f99c81f4d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:41.353051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4af32379-395c-4968-8845-b175e87676d3 req-bb2ae266-cc51-475a-83cb-1437c6afed49 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:41.353545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4af32379-395c-4968-8845-b175e87676d3 req-bb2ae266-cc51-475a-83cb-1437c6afed49 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:41.354021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4af32379-395c-4968-8845-b175e87676d3 req-bb2ae266-cc51-475a-83cb-1437c6afed49 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:41.386982 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4af32379-395c-4968-8845-b175e87676d3 req-bb2ae266-cc51-475a-83cb-1437c6afed49 service nova] Creating event network-vif-deleted:3242fbfc-f0dc-4a1b-bbfd-612f99c81f4d for instance cc41cc4f-dd67-4097-9c62-41c652df988e on n-h2-862355-1 Oct 25 03:39:41.398669 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4af32379-395c-4968-8845-b175e87676d3 req-bb2ae266-cc51-475a-83cb-1437c6afed49 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453816 Oct 25 03:39:41.412316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3236/6361] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:42.350902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:42.352423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:42.374648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:42.375127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:42.375817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:42.376779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:42.377442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:42.378162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:42.568877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:42.591036 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8aed12fd-8a4a-4d95-b7c7-8c09c6c3cf1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1186 microversion: 2.1 time: 0.244623 Oct 25 03:39:42.593135 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3126/6362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:42 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1186 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:43.424819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-87a18e8b-61b0-4b68-836c-7d29324c2081 req-b00befb8-696c-4d22-bc6c-56215b420191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9b6f26-1be9-4f8f-8a27-a071354de168", "tag": "c013715d-b73e-4600-bb7c-60c564b04dda"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:43.447540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87a18e8b-61b0-4b68-836c-7d29324c2081 req-b00befb8-696c-4d22-bc6c-56215b420191 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:43.448033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87a18e8b-61b0-4b68-836c-7d29324c2081 req-b00befb8-696c-4d22-bc6c-56215b420191 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:43.448466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-87a18e8b-61b0-4b68-836c-7d29324c2081 req-b00befb8-696c-4d22-bc6c-56215b420191 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:43.472066 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-87a18e8b-61b0-4b68-836c-7d29324c2081 req-b00befb8-696c-4d22-bc6c-56215b420191 service nova] Creating event network-changed:c013715d-b73e-4600-bb7c-60c564b04dda for instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 on n-h1-862355-1 Oct 25 03:39:43.489451 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-87a18e8b-61b0-4b68-836c-7d29324c2081 req-b00befb8-696c-4d22-bc6c-56215b420191 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069867 Oct 25 03:39:43.490603 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3237/6363] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:39:43.619666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:43.620866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:43.649401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:43.650926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:43.653228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:43.654812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:43.655956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:43.656995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:43.786156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:43.807408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c6ac221-d232-4c0e-b5fa-01c49ad32e21 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1186 microversion: 2.1 time: 0.192175 Oct 25 03:39:43.824303 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3127/6364] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:43 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1186 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:44.836456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:44.837561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:44.839122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:44.845446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:44.846025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:44.846466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:44.847549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:44.847679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:44.848032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:44.944095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:44.956214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6978f556-3f9a-49e3-84f4-962b0790f354 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1186 microversion: 2.1 time: 0.125294 Oct 25 03:39:44.956817 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3238/6365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:44 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1186 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:45.989813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:45.991081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:46.005735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:46.013946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:46.016659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:46.019997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:46.021511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:46.022022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:46.126638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:39:46.137426 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a58d0bde-cd5a-433c-8de8-2bd30002ec40 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 200 len: 1186 microversion: 2.1 time: 0.157616 Oct 25 03:39:46.138643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3128/6366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:45 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 1186 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:39:47.164106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:39:47.165332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: cc41cc4f-dd67-4097-9c62-41c652df988e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:39:47.176358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:47.176853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:47.177465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:47.179250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:39:47.179721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:39:47.180157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:39:47.194093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance cc41cc4f-dd67-4097-9c62-41c652df988e could not be found. Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e HTTP/1.1 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance cc41cc4f-dd67-4097-9c62-41c652df988e could not be found. Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'cc41cc4f-dd67-4097-9c62-41c652df988e'} Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc41cc4f-dd67-4097-9c62-41c652df988e could not be found. Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc41cc4f-dd67-4097-9c62-41c652df988e could not be found. Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:39:47.195766 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc41cc4f-dd67-4097-9c62-41c652df988e could not be found. Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance cc41cc4f-dd67-4097-9c62-41c652df988e could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-620f7dba-26e1-40c6-a58c-71c27271771a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e" status: 404 len: 111 microversion: 2.1 time: 0.038004 Oct 25 03:39:47.201334 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3239/6367] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:39:47 2022] GET /compute/v2.1/servers/cc41cc4f-dd67-4097-9c62-41c652df988e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:39:58.963050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1783355442", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "63f5b986-2627-4058-9a43-3c2b03b0ed09"}], "key_name": "tempest-TestSecurityGroupsBasicOps-444327658", "security_groups": []}, "os:scheduler_hints": {"different_host": ["7335ffc3-43ba-4925-9ab9-6d91db345b54"]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:39:59.007292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:59.009208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:39:59.061781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] validate_networks() for [('63f5b986-2627-4058-9a43-3c2b03b0ed09', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:40:00.290007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:40:00.290760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:40:00.290928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:40:00.292110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:40:00.292747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:40:00.312611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:00.313113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:00.313564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:00.314315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:00.319798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:00.321746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:00.350810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Getting quotas for project c717eb2194cc4f648ccbc804ba1a7a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:40:00.361383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Getting quotas for user 4f0a8c9405354ba3965cf5805f818f1f and project c717eb2194cc4f648ccbc804ba1a7a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:40:00.380010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:40:00.383717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:40:00.507934 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-107a7074-2268-4fcd-93ce-c71e8afa1a32 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.551513 Oct 25 03:40:00.513871 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3129/6368] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:39:58 2022] POST /compute/v2.1/servers => generated 361 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:40:00.523511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ac92aff-ca8e-4d42-b017-f13eeb25efc9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:00.525181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ac92aff-ca8e-4d42-b017-f13eeb25efc9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:00.544750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:00.548398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=99 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:00.695381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ac92aff-ca8e-4d42-b017-f13eeb25efc9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:00.717569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ac92aff-ca8e-4d42-b017-f13eeb25efc9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1241 microversion: 2.1 time: 0.199015 Oct 25 03:40:00.720408 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3240/6369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:00 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1241 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:01.750606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:01.751999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:01.764601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:01.766180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:01.767511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:01.769214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:01.772362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:01.774213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:02.080463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:02.089795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7104d04-1a43-4777-a3ad-fef2266920b8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1237 microversion: 2.1 time: 0.344733 Oct 25 03:40:02.091002 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3130/6370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:01 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1237 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:03.114395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:03.115162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:03.129435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:03.130331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:03.130855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:03.131694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:03.133766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:03.134463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:03.253657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:03.272468 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56cf4934-d764-4a13-a618-406eae75d294 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.161833 Oct 25 03:40:03.286298 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3241/6371] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:03 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:04.304358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:04.306251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:04.320662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:04.322277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:04.323839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:04.326130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:04.327030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:04.328032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:04.460492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:04.489443 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e71331da-7722-496b-8fbb-cc78bfd05db8 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.189708 Oct 25 03:40:04.493732 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3131/6372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:04 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:04.753364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-68371e5f-5dfb-4268-90b1-218d4fdb8ff1 req-1b103160-0ad2-423d-9ecc-0148d0147f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c251bf6-09c9-435c-91e5-e635ffabb5ee", "tag": "0b336635-c6bf-4734-a996-c7d337249691"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:04.782021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-68371e5f-5dfb-4268-90b1-218d4fdb8ff1 req-1b103160-0ad2-423d-9ecc-0148d0147f04 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:04.782802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-68371e5f-5dfb-4268-90b1-218d4fdb8ff1 req-1b103160-0ad2-423d-9ecc-0148d0147f04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:04.783408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-68371e5f-5dfb-4268-90b1-218d4fdb8ff1 req-1b103160-0ad2-423d-9ecc-0148d0147f04 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:04.795687 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-68371e5f-5dfb-4268-90b1-218d4fdb8ff1 req-1b103160-0ad2-423d-9ecc-0148d0147f04 service nova] Creating event network-changed:0b336635-c6bf-4734-a996-c7d337249691 for instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee on n-h2-862355-1 Oct 25 03:40:04.802058 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-68371e5f-5dfb-4268-90b1-218d4fdb8ff1 req-1b103160-0ad2-423d-9ecc-0148d0147f04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058922 Oct 25 03:40:04.803224 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3242/6373] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:40:05.522932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:05.523888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:05.533394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:05.533928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:05.534554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:05.535700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:05.536171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:05.536613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:05.647677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:05.656684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2122412813", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "001f87c3-b3b4-49c4-90e5-afad26cb5682"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:05.672549 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cdd67fa6-6406-49f1-9a58-0ea76bbb7d23 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.160849 Oct 25 03:40:05.673721 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3243/6374] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:05 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:05.727904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] validate_networks() for [('001f87c3-b3b4-49c4-90e5-afad26cb5682', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:40:06.216507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:40:06.217241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:40:06.218038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:40:06.218529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:40:06.219021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:40:06.228503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:06.228996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:06.229437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:06.230346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:06.231798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:06.232235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:06.250322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Getting quotas for project 628a454378f34b0dbf92d9f844e109cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:40:06.255620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Getting quotas for user c2339dc29ff34bbbab5ccfcb1ecfff1e and project 628a454378f34b0dbf92d9f844e109cb. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:40:06.268653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:40:06.270932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:40:06.320820 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66761711-ab13-40d8-9dae-9e366da913df tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876455 Oct 25 03:40:06.321650 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3132/6375] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:40:06.333334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9dd2c227-849d-4324-97ce-640da9a756f8 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:06.333994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9dd2c227-849d-4324-97ce-640da9a756f8 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:06.419880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9dd2c227-849d-4324-97ce-640da9a756f8 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:06.428852 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9dd2c227-849d-4324-97ce-640da9a756f8 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1214 microversion: 2.1 time: 0.099668 Oct 25 03:40:06.429845 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3244/6376] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:06 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:06.702164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:06.703551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:06.714386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:06.730712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:06.733987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:06.735557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:06.740678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:06.740678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:06.909889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:06.926867 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4ffbd5fb-2db4-4978-b1ae-515508e9c999 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.224480 Oct 25 03:40:06.928414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3133/6377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:06 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:07.452058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:07.452687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:07.469074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:07.470796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:07.472052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:07.474780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:07.477258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:07.478121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:07.648811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:07.662743 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3478b935-8dc7-4736-b5c4-0e6c2932fc5f tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1266 microversion: 2.1 time: 0.215397 Oct 25 03:40:07.667293 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3245/6378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:07 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:07.955015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:07.956743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:07.969151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:07.971919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:07.972726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:07.977352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:07.978267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:07.979338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:08.222374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:08.233782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b5a31dce-e938-46fc-b4c8-e6fd1213488a tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.284263 Oct 25 03:40:08.255470 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3134/6379] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:07 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:08.692090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:08.696763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:08.707051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:08.707841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:08.708495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:08.709382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:08.710663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:08.711278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:08.821244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:08.831887 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b1ab24d-4a1c-4b41-bee3-0d1b0af758d3 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1272 microversion: 2.1 time: 0.145308 Oct 25 03:40:08.836953 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3246/6380] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:08 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:09.261075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:09.261638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:09.270388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:09.270891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:09.271338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:09.272058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:09.272521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:09.272981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:09.421713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:09.430952 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81b8b981-bf97-4457-8b00-f97e08121876 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.174103 Oct 25 03:40:09.432356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3135/6381] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:09 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:09.858926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:09.860577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:09.868031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:09.869278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:09.870060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:09.871563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:09.872240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:09.872915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:10.059017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:10.072745 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d941def1-ac8b-4a9a-91c8-58ba5f622626 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1314 microversion: 2.1 time: 0.220438 Oct 25 03:40:10.073629 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3247/6382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:09 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:10.124136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-41e0f0f5-20da-49e7-b953-9b3b03432e62 req-3c965b8f-66bd-462c-a418-7a7638ec9798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4", "tag": "45019bab-250c-449c-bb9d-8dbe9db4705e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:10.139701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-41e0f0f5-20da-49e7-b953-9b3b03432e62 req-3c965b8f-66bd-462c-a418-7a7638ec9798 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:10.140945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-41e0f0f5-20da-49e7-b953-9b3b03432e62 req-3c965b8f-66bd-462c-a418-7a7638ec9798 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:10.141947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-41e0f0f5-20da-49e7-b953-9b3b03432e62 req-3c965b8f-66bd-462c-a418-7a7638ec9798 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:10.159164 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-41e0f0f5-20da-49e7-b953-9b3b03432e62 req-3c965b8f-66bd-462c-a418-7a7638ec9798 service nova] Creating event network-changed:45019bab-250c-449c-bb9d-8dbe9db4705e for instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 on n-h1-862355-1 Oct 25 03:40:10.168333 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-41e0f0f5-20da-49e7-b953-9b3b03432e62 req-3c965b8f-66bd-462c-a418-7a7638ec9798 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048231 Oct 25 03:40:10.170696 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3136/6383] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:10.456578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:10.457763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:10.464994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:10.465871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:10.466588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:10.467530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:10.467989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:10.468627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:10.584817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:10.595333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cacad35d-897b-4c15-8741-b836ac307440 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.143749 Oct 25 03:40:10.596640 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3248/6384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:10 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:10.755813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c6926e0e-acb7-46be-b226-df4d9ecab7f4 req-f8ac90bb-1a4a-4489-ba60-9b7db33c0b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c251bf6-09c9-435c-91e5-e635ffabb5ee", "name": "network-vif-plugged", "status": "completed", "tag": "0b336635-c6bf-4734-a996-c7d337249691"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:10.766504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c6926e0e-acb7-46be-b226-df4d9ecab7f4 req-f8ac90bb-1a4a-4489-ba60-9b7db33c0b63 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:10.768821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c6926e0e-acb7-46be-b226-df4d9ecab7f4 req-f8ac90bb-1a4a-4489-ba60-9b7db33c0b63 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:10.768821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c6926e0e-acb7-46be-b226-df4d9ecab7f4 req-f8ac90bb-1a4a-4489-ba60-9b7db33c0b63 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:10.779723 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c6926e0e-acb7-46be-b226-df4d9ecab7f4 req-f8ac90bb-1a4a-4489-ba60-9b7db33c0b63 service nova] Creating event network-vif-plugged:0b336635-c6bf-4734-a996-c7d337249691 for instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee on n-h2-862355-1 Oct 25 03:40:10.793238 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c6926e0e-acb7-46be-b226-df4d9ecab7f4 req-f8ac90bb-1a4a-4489-ba60-9b7db33c0b63 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042555 Oct 25 03:40:10.794735 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3137/6385] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:11.097471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:11.098676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:11.106124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:11.106584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:11.107543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:11.108229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:11.108900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:11.109349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:11.293505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:11.303892 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65096aaa-5104-49dc-a878-11bc0905691e tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1314 microversion: 2.1 time: 0.210660 Oct 25 03:40:11.304589 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3249/6386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:11 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:11.624491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:11.633908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:11.655152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:11.656495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:11.657555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:11.660725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:11.676026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:11.677183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:11.850663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:11.861523 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bdabc766-10b2-4a6f-b89f-113bdc30417f tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1299 microversion: 2.1 time: 0.243552 Oct 25 03:40:11.863089 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3138/6387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:11 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:12.328942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:12.329907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:12.338783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:12.340505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:12.340603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:12.341454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:12.342018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:12.342559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:12.573290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:12.582386 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a24cb4d0-120c-496f-8386-52c2b7113db2 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1314 microversion: 2.1 time: 0.258575 Oct 25 03:40:12.583466 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3250/6388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:12 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:12.890910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:12.892171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:12.899498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:12.900270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:12.900884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:12.901807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:12.903152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:12.904164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.021301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:13.031263 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73a798b3-8450-41da-adb8-17f7d67f50aa tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1472 microversion: 2.1 time: 0.144449 Oct 25 03:40:13.032179 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3139/6389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:12 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1472 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:13.055029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:13.055803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:13.062953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.063888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.064772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.065868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.069623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.070304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.174870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:13.182934 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f21b895-f727-4508-b38e-a6a3dff77eb1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1472 microversion: 2.1 time: 0.132107 Oct 25 03:40:13.183823 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3251/6390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:13 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1472 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:13.205330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:13.205969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:13.211943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.212435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.212871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.213816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.214274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.215455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.340689 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73d6fc7c-6ad5-43e3-bcc9-b2a8b5a2ae4d tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1623 microversion: 2.1 time: 0.138849 Oct 25 03:40:13.341935 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3140/6391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:13 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1623 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:13.368350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:13.369626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:13.379014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.379770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.380428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.381300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.381945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.382545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.563635 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b0ffce0-4a29-436b-8cbd-295e11b944d1 tempest-TestSecurityGroupsBasicOps-1517766861 tempest-TestSecurityGroupsBasicOps-1517766861-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1910 microversion: 2.1 time: 0.201235 Oct 25 03:40:13.564223 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3252/6392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:13 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1910 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:13.606085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:13.606573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:13.616121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.616642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.617078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.617849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.618492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.618926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.669500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:13.670046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:13.676805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.677316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.679835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.680643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.681126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.681571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.719491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:40:13.818486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:13.829025 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b3a2b6cb-faca-4891-9030-8b41d58ac6bc tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1314 microversion: 2.1 time: 0.228311 Oct 25 03:40:13.831346 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3141/6393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:13 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:13.854970 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-602c7aea-c299-419d-bd86-60d94ce114d1 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 204 len: 0 microversion: 2.1 time: 0.189619 Oct 25 03:40:13.855630 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3253/6394] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:40:13 2022] DELETE /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:40:13.866818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:13.867675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:13.875389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.876136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.876909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.877939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:13.878597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:13.879268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:13.974867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:13.986230 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d9fe9ba-91e2-4e3e-8960-193a2253d2f0 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1478 microversion: 2.1 time: 0.125410 Oct 25 03:40:13.986856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3142/6395] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:13 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1478 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:14.860745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:14.862662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:14.874093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:14.876329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:14.877333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:14.878343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:14.879300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:14.879956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:14.999938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b6170ad1-f929-4ad0-bc77-f1369b6e49a5 req-65878420-1f7f-4d65-95aa-278c458a36d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4", "name": "network-vif-plugged", "status": "completed", "tag": "45019bab-250c-449c-bb9d-8dbe9db4705e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:15.026836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b6170ad1-f929-4ad0-bc77-f1369b6e49a5 req-65878420-1f7f-4d65-95aa-278c458a36d9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:15.030572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b6170ad1-f929-4ad0-bc77-f1369b6e49a5 req-65878420-1f7f-4d65-95aa-278c458a36d9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:15.031040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b6170ad1-f929-4ad0-bc77-f1369b6e49a5 req-65878420-1f7f-4d65-95aa-278c458a36d9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:15.049649 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b6170ad1-f929-4ad0-bc77-f1369b6e49a5 req-65878420-1f7f-4d65-95aa-278c458a36d9 service nova] Creating event network-vif-plugged:45019bab-250c-449c-bb9d-8dbe9db4705e for instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 on n-h1-862355-1 Oct 25 03:40:15.055598 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b6170ad1-f929-4ad0-bc77-f1369b6e49a5 req-65878420-1f7f-4d65-95aa-278c458a36d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060066 Oct 25 03:40:15.057091 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3143/6396] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:15.063822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:15.065291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:15.088594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:15.089393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:15.090685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:15.092607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:15.113985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:15.119449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:15.253548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:15.265282 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-304cba27-cba2-46df-8e78-07916cd2d249 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1478 microversion: 2.1 time: 0.206616 Oct 25 03:40:15.270599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3144/6397] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:15 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1478 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:15.679019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:15.689938 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a7aed59-2acf-4ced-9001-118ee81ffa18 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1314 microversion: 2.1 time: 0.837707 Oct 25 03:40:15.690546 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3254/6398] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:14 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:16.151546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:16.152242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:16.182090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:16.182618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:16.183214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:16.185462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:16.188435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:16.188909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:16.212569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-76f6ddc2-81fb-4867-b4d7-02fe111080c6 req-b85ac93a-2ed5-460a-9ace-c0529b60cdac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c251bf6-09c9-435c-91e5-e635ffabb5ee", "name": "network-vif-deleted", "tag": "0b336635-c6bf-4734-a996-c7d337249691"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:16.225560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76f6ddc2-81fb-4867-b4d7-02fe111080c6 req-b85ac93a-2ed5-460a-9ace-c0529b60cdac service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:16.226170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76f6ddc2-81fb-4867-b4d7-02fe111080c6 req-b85ac93a-2ed5-460a-9ace-c0529b60cdac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:16.226859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-76f6ddc2-81fb-4867-b4d7-02fe111080c6 req-b85ac93a-2ed5-460a-9ace-c0529b60cdac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:16.232812 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e50110b4-05ce-4555-b962-4ff4faf687e2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/ips" status: 200 len: 149 microversion: 2.1 time: 0.084270 Oct 25 03:40:16.239839 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3145/6399] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:40:16 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:16.252658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-76f6ddc2-81fb-4867-b4d7-02fe111080c6 req-b85ac93a-2ed5-460a-9ace-c0529b60cdac service nova] Creating event network-vif-deleted:0b336635-c6bf-4734-a996-c7d337249691 for instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee on n-h2-862355-1 Oct 25 03:40:16.258021 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-76f6ddc2-81fb-4867-b4d7-02fe111080c6 req-b85ac93a-2ed5-460a-9ace-c0529b60cdac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050313 Oct 25 03:40:16.259450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3255/6400] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:40:16.294535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:16.295262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:16.310765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:16.311812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:16.313505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:16.314036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:16.314484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:16.315217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:16.315660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:16.316093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:16.443306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:16.451917 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2e5388ea-8358-4aa0-9b0e-93cdb9f2a01d tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 200 len: 1326 microversion: 2.1 time: 0.161428 Oct 25 03:40:16.458354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3146/6401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:16 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 1326 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:16.724385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:16.725115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:16.727216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:16.739163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:16.739898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:16.740122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:16.740819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:16.741738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:16.755117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:16.988506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:16.998474 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e35d4748-0ea1-48fe-85d1-2c526cde8823 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1497 microversion: 2.1 time: 0.280986 Oct 25 03:40:16.999161 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3256/6402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:16 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:17.484570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:17.486152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 4c251bf6-09c9-435c-91e5-e635ffabb5ee] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:17.494877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:17.496282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:17.496989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:17.497961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:17.498700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:17.499507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:17.520673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] HTTP exception thrown: Instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee could not be found. Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Request method failure captured: Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee HTTP/1.1 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1pEvUT2ZnpwZnD1ErLKoAnrF3LiwEG96Oq4XTdHIL_-XQrNgUVuKMptDVxwBt0HTpUf3X5-jxscxBFW70dcbJRx8r71N1YBS-Siw4XwaAdDIGEpCzC0Dpb7P-lM0--GH_dqybfIUe6LkP0WpJhT814HNqAAzS-7BwpX_glODxXgiYs Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: c717eb2194cc4f648ccbc804ba1a7a32 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-548373673 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c717eb2194cc4f648ccbc804ba1a7a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c717eb2194cc4f648ccbc804ba1a7a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c717eb2194cc4f648ccbc804ba1a7a32", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c717eb2194cc4f648ccbc804ba1a7a32"}]}] Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestSecurityGroupsBasicOps-548373673 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: c717eb2194cc4f648ccbc804ba1a7a32 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-548373673 Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestSecurityGroupsBasicOps-548373673-project Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 4f0a8c9405354ba3965cf5805f818f1f Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestSecurityGroupsBasicOps-548373673-project Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee could not be found. Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '4c251bf6-09c9-435c-91e5-e635ffabb5ee'} Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee could not be found. Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee could not be found. Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:17.523664 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee could not be found. Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:17.529433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Returning 404 to user: Instance 4c251bf6-09c9-435c-91e5-e635ffabb5ee could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:40:17.532735 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7ff3a68a-7514-4bf5-984d-13ca4f57eccf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee" status: 404 len: 111 microversion: 2.1 time: 0.052993 Oct 25 03:40:17.533394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3147/6403] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:17 2022] GET /compute/v2.1/servers/4c251bf6-09c9-435c-91e5-e635ffabb5ee => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:40:18.869627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3a728a-e900-4c69-a639-106ac67139aa"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:18.872938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:18.891642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:18.896916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:18.897551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:18.898463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:18.899171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:18.899831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:19.120396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:19.350536 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1353f23c-cbc6-4c29-ac64-8fc56f5b2bcc tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484747 Oct 25 03:40:19.360656 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3257/6404] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:40:18 2022] POST /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:21.306777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:21.307256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:21.325222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:21.325762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:21.326285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:21.327019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:21.327702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:21.328353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:21.343129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1708917360", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "00eeb7a8-a70a-457a-b734-80068155f5ae", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:21.374051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:40:21.430278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:21.530497 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e54bddab-5e74-415c-af43-37ac7366f125 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 204 len: 0 microversion: 2.1 time: 0.227252 Oct 25 03:40:21.533582 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3148/6405] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:40:21 2022] DELETE /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:40:21.545458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:21.546511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:21.554122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:21.555151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:21.555785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:21.556693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:21.557336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:21.558067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:21.579027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:40:21.821039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:21.832540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ef3c384a-78bf-47ea-b0f2-5cc38641c6e4 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1503 microversion: 2.1 time: 0.294477 Oct 25 03:40:21.834241 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3149/6406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:21 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:22.652515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:40:22.654441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:40:22.655167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:40:22.655775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:40:22.656383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:40:22.669017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:22.669800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:22.670439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:22.671920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:22.672883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:22.673808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:22.698115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:40:22.707866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:40:22.724908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:40:22.727350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='00eeb7a8-a70a-457a-b734-80068155f5ae',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:40:22.828327 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-027b293c-dfd4-4661-8f03-b4d05e3c57d2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.489037 Oct 25 03:40:22.830485 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3258/6407] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 03:40:22.842818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e73b7ad-beef-453f-9696-b4f4df85c293 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:22.843434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5e73b7ad-beef-453f-9696-b4f4df85c293 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:22.860810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:22.861698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:22.882961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:22.884710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:22.888187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:22.891237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:22.893284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:22.894556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:23.180338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:23.190087 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cfde8a9-718b-4d90-a624-d76920cc6076 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1503 microversion: 2.1 time: 0.337335 Oct 25 03:40:23.191335 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3259/6408] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:22 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1503 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:40:23.487708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5e73b7ad-beef-453f-9696-b4f4df85c293 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:23.498559 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e73b7ad-beef-453f-9696-b4f4df85c293 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1057 microversion: 2.1 time: 0.660641 Oct 25 03:40:23.499447 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3150/6409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:22 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1057 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:24.215470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:24.216688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:24.233256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:24.234156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:24.234845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:24.235781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:24.237876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:24.238547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:24.546750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:24.548098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:24.563314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:24.564369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:24.564903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:24.565710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:24.566263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:24.566774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:24.674683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2339dc29ff34bbbab5ccfcb1ecfff1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628a454378f34b0dbf92d9f844e109cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:24.696143 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-daeb1974-309f-46f5-9e70-41c4a727f0a9 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 200 len: 1503 microversion: 2.1 time: 0.485166 Oct 25 03:40:24.702755 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3260/6410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:24 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 1503 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:24.781397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:24.806947 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b021746-33e1-4095-851e-8d86116bcfee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1109 microversion: 2.1 time: 0.264070 Oct 25 03:40:24.807867 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3151/6411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:24 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1109 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:40:24.821852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-97ed9084-0cf1-4a0f-b5c6-2702d9464e67 req-77283f2e-d8ee-4490-b659-3dd4da102524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4", "name": "network-vif-deleted", "tag": "45019bab-250c-449c-bb9d-8dbe9db4705e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:24.837689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-97ed9084-0cf1-4a0f-b5c6-2702d9464e67 req-77283f2e-d8ee-4490-b659-3dd4da102524 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:24.840669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-97ed9084-0cf1-4a0f-b5c6-2702d9464e67 req-77283f2e-d8ee-4490-b659-3dd4da102524 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:24.841206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-97ed9084-0cf1-4a0f-b5c6-2702d9464e67 req-77283f2e-d8ee-4490-b659-3dd4da102524 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:24.864488 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-97ed9084-0cf1-4a0f-b5c6-2702d9464e67 req-77283f2e-d8ee-4490-b659-3dd4da102524 service nova] Creating event network-vif-deleted:45019bab-250c-449c-bb9d-8dbe9db4705e for instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 on n-h1-862355-1 Oct 25 03:40:24.872240 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-97ed9084-0cf1-4a0f-b5c6-2702d9464e67 req-77283f2e-d8ee-4490-b659-3dd4da102524 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064163 Oct 25 03:40:24.886201 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3261/6412] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:25.727888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:25.729166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] [instance: 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:25.747910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:25.749445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:25.750111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:25.751008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:25.751629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:25.752730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:25.786800 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] HTTP exception thrown: Instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 could not be found. Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Request method failure captured: Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 HTTP/1.1 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1qSAH7KOcgiEO33LJgZ0WDnxfl7ira6z52ZOYcNjIzjZN31PlLgz1f9RRDKGNIG7ZyWa8ZkrerSLY6aDUJa-pw8Fhij9C4YOXRvyPlQtq7OHZoJToh7HAazhF4W7htHlxFbSjDgr8dLbFPdTdPz8QNMCBteEFajaguFFoydnscUZP0 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 628a454378f34b0dbf92d9f844e109cb Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-VolumesActionsTest-1487720092 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/628a454378f34b0dbf92d9f844e109cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/628a454378f34b0dbf92d9f844e109cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_628a454378f34b0dbf92d9f844e109cb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/628a454378f34b0dbf92d9f844e109cb"}]}] Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-VolumesActionsTest-1487720092 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 628a454378f34b0dbf92d9f844e109cb Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-VolumesActionsTest-1487720092 Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-VolumesActionsTest-1487720092-project Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: c2339dc29ff34bbbab5ccfcb1ecfff1e Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-VolumesActionsTest-1487720092-project Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 could not be found. Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4'} Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 could not be found. Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 could not be found. Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:25.788740 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 could not be found. Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] Returning 404 to user: Instance 3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e1393803-7264-439a-8eb0-50ea837f9439 tempest-VolumesActionsTest-1487720092 tempest-VolumesActionsTest-1487720092-project] 10.222.0.36 "GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4" status: 404 len: 111 microversion: 2.1 time: 0.067389 Oct 25 03:40:25.793985 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3152/6413] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:25 2022] GET /compute/v2.1/servers/3b7e9508-fbe3-4541-b5d0-271ab5d8c8a4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:40:25.835948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:25.837046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:25.851554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:25.858650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:25.860890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:25.861914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:25.863533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:25.871314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:26.001575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:26.016934 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf5405f8-015e-48b3-8d43-837f35b8717a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1127 microversion: 2.1 time: 0.186023 Oct 25 03:40:26.018076 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3262/6414] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:25 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1127 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:26.587064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:26.587491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:26.602146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:26.602643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:26.605600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:26.609027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:26.609510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:26.609978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:26.715765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:40:26.732992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d1f579df-08ee-4c2a-823d-bb6d2e3ef54e req-6f046fa4-be22-4491-b8dd-669270058e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7335ffc3-43ba-4925-9ab9-6d91db345b54", "tag": "7b667178-0af8-4c09-8201-342026b3c43d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:26.768564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d1f579df-08ee-4c2a-823d-bb6d2e3ef54e req-6f046fa4-be22-4491-b8dd-669270058e82 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:26.769337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d1f579df-08ee-4c2a-823d-bb6d2e3ef54e req-6f046fa4-be22-4491-b8dd-669270058e82 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:26.769998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d1f579df-08ee-4c2a-823d-bb6d2e3ef54e req-6f046fa4-be22-4491-b8dd-669270058e82 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:26.797279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d1f579df-08ee-4c2a-823d-bb6d2e3ef54e req-6f046fa4-be22-4491-b8dd-669270058e82 service nova] Creating event network-changed:7b667178-0af8-4c09-8201-342026b3c43d for instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 on n-h1-862355-1 Oct 25 03:40:26.813502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d1f579df-08ee-4c2a-823d-bb6d2e3ef54e req-6f046fa4-be22-4491-b8dd-669270058e82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100789 Oct 25 03:40:26.815513 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3263/6415] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:27.014098 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01fd42c4-756b-4f8e-b638-53270a07dbf2 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 204 len: 0 microversion: 2.1 time: 0.430672 Oct 25 03:40:27.014739 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3153/6416] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:40:26 2022] DELETE /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:40:27.025118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:27.026613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:27.040059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:27.041376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:27.047286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:27.051993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:27.053296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:27.055215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:27.056236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:27.060113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:27.061894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:27.062475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:27.063733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:27.069342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:27.069928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:27.070384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:27.263106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:27.279536 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4fcb0218-f817-4fb2-9500-01dc9de15852 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1127 microversion: 2.1 time: 0.242436 Oct 25 03:40:27.299730 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3154/6417] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:27 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1127 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:40:27.531013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:27.546364 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50e9710b-4348-48e0-9f6e-b172d4315fd9 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1765 microversion: 2.1 time: 0.526438 Oct 25 03:40:27.557970 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3264/6418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:27 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1765 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:28.310712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:28.312272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:28.330473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:28.334014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:28.334789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:28.337245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:28.340622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:28.341311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:28.594939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:28.597899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:28.637779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:28.639958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:28.640421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:28.641161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:28.641611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:28.642082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:28.665823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:28.676666 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e49aff62-9ae1-49bc-a917-8d702250a647 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.376812 Oct 25 03:40:28.682400 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3155/6419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:28 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:29.172380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:29.182696 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5705890-c2b5-433d-a7da-e54814eac9df tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1765 microversion: 2.1 time: 0.606024 Oct 25 03:40:29.197862 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3265/6420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:28 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1765 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:40:29.532297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-58fc3c44-1d54-43a0-a57a-1d09d43a1ecb req-bbc7a96f-fd44-4936-bcc4-2b2a50242fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3684f3-4116-430e-b8ab-aa5b8153cc85", "tag": "ad0bf4d9-fd5d-4da4-af43-47d628e83462"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:29.549494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:29.552483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-58fc3c44-1d54-43a0-a57a-1d09d43a1ecb req-bbc7a96f-fd44-4936-bcc4-2b2a50242fa1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:29.553360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-58fc3c44-1d54-43a0-a57a-1d09d43a1ecb req-bbc7a96f-fd44-4936-bcc4-2b2a50242fa1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:29.554181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-58fc3c44-1d54-43a0-a57a-1d09d43a1ecb req-bbc7a96f-fd44-4936-bcc4-2b2a50242fa1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:29.587536 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-58fc3c44-1d54-43a0-a57a-1d09d43a1ecb req-bbc7a96f-fd44-4936-bcc4-2b2a50242fa1 service nova] Creating event network-changed:ad0bf4d9-fd5d-4da4-af43-47d628e83462 for instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 on n-h2-862355-1 Oct 25 03:40:29.595099 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-58fc3c44-1d54-43a0-a57a-1d09d43a1ecb req-bbc7a96f-fd44-4936-bcc4-2b2a50242fa1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067267 Oct 25 03:40:29.596575 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3156/6421] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:29.671211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ae147d36-ca6c-40a8-adef-b35fb96f493c req-b55c36b3-cdb6-494e-8d93-59b2eb963eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7335ffc3-43ba-4925-9ab9-6d91db345b54", "name": "network-vif-deleted", "tag": "7b667178-0af8-4c09-8201-342026b3c43d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:29.697079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ae147d36-ca6c-40a8-adef-b35fb96f493c req-b55c36b3-cdb6-494e-8d93-59b2eb963eac service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:29.697576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ae147d36-ca6c-40a8-adef-b35fb96f493c req-b55c36b3-cdb6-494e-8d93-59b2eb963eac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:29.700690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ae147d36-ca6c-40a8-adef-b35fb96f493c req-b55c36b3-cdb6-494e-8d93-59b2eb963eac service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:29.709989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:29.710908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:29.730559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:29.731118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:29.731668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:29.732641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:29.733160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:29.733825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:29.735048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ae147d36-ca6c-40a8-adef-b35fb96f493c req-b55c36b3-cdb6-494e-8d93-59b2eb963eac service nova] Creating event network-vif-deleted:7b667178-0af8-4c09-8201-342026b3c43d for instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 on n-h1-862355-1 Oct 25 03:40:29.747437 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ae147d36-ca6c-40a8-adef-b35fb96f493c req-b55c36b3-cdb6-494e-8d93-59b2eb963eac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097409 Oct 25 03:40:29.748073 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3266/6422] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:29.994333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:30.012262 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3072d712-029d-48dd-9a11-774fa6315073 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.310369 Oct 25 03:40:30.013538 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3157/6423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:29 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:30.211887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:30.213217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:30.226772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:30.227267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:30.227716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:30.228437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:30.228900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:30.229335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:30.309458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:30.310228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:30.310827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:30.311447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lazy-loading 'fault' on Instance uuid 7335ffc3-43ba-4925-9ab9-6d91db345b54 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:40:30.447791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a8c9405354ba3965cf5805f818f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c717eb2194cc4f648ccbc804ba1a7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:30.457738 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a37b8ce3-0059-42b1-8fbc-a225553cd246 tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 200 len: 1382 microversion: 2.1 time: 0.250802 Oct 25 03:40:30.465010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3267/6424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:30 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 1382 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:31.041507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:31.043478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:31.051586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:31.052331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:31.052985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:31.053976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:31.054668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:31.055329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:31.328595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:31.340597 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7af54413-1247-43db-a5a8-60908d7eeef2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.305122 Oct 25 03:40:31.354131 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3158/6425] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:31 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:31.491850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:31.493188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] [instance: 7335ffc3-43ba-4925-9ab9-6d91db345b54] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:31.497541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:31.519145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:31.519713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:31.520565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:31.529000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:31.529951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:31.530421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:31.575535 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] HTTP exception thrown: Instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 could not be found. Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Request method failure captured: Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 HTTP/1.1 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1pEvUT2ZnpwZnD1ErLKoAnrF3LiwEG96Oq4XTdHIL_-XQrNgUVuKMptDVxwBt0HTpUf3X5-jxscxBFW70dcbJRx8r71N1YBS-Siw4XwaAdDIGEpCzC0Dpb7P-lM0--GH_dqybfIUe6LkP0WpJhT814HNqAAzS-7BwpX_glODxXgiYs Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: c717eb2194cc4f648ccbc804ba1a7a32 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-548373673 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c717eb2194cc4f648ccbc804ba1a7a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c717eb2194cc4f648ccbc804ba1a7a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c717eb2194cc4f648ccbc804ba1a7a32", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c717eb2194cc4f648ccbc804ba1a7a32"}]}] Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestSecurityGroupsBasicOps-548373673 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: c717eb2194cc4f648ccbc804ba1a7a32 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-548373673 Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestSecurityGroupsBasicOps-548373673-project Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 4f0a8c9405354ba3965cf5805f818f1f Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestSecurityGroupsBasicOps-548373673-project Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 could not be found. Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '7335ffc3-43ba-4925-9ab9-6d91db345b54'} Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 could not be found. Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 could not be found. Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:31.578008 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:31.584259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:31.584259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:31.584259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:31.584259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:40:31.584259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:40:31.584259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 could not be found. Oct 25 03:40:31.584259 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:31.586655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Returning 404 to user: Instance 7335ffc3-43ba-4925-9ab9-6d91db345b54 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:40:31.587929 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f487d6ff-8f71-43ae-bbaf-452ba06aadcf tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54" status: 404 len: 111 microversion: 2.1 time: 0.101027 Oct 25 03:40:31.606264 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3268/6426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:31 2022] GET /compute/v2.1/servers/7335ffc3-43ba-4925-9ab9-6d91db345b54 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:40:32.375508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:32.376864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:32.408063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:32.408558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:32.418737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:32.419739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:32.420207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:32.427425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:32.964085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:32.976699 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f4200b4-5fe2-43b4-a41e-ca70196e3b02 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.612871 Oct 25 03:40:32.998890 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3159/6427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:32 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:34.032285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:34.033037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:34.043163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:34.046017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:34.057366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:34.062398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:34.062866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:34.063600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:34.064280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:34.064867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:34.523226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:34.537941 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e552866-cb49-4ad0-a2c8-695533b0f75d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.521516 Oct 25 03:40:34.541450 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3269/6428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:34 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:34.795753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3a728a-e900-4c69-a639-106ac67139aa"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:34.800967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:34.811979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:34.814806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:34.815634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:34.816241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:34.817495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:34.818176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:34.819496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:35.075450 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Invalid volume: volume 1f3a728a-e900-4c69-a639-106ac67139aa is already attached to instances: 6e9b6f26-1be9-4f8f-8a27-a071354de168 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments HTTP/1.1 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 74 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: {"volumeAttachment": {"volumeId": "1f3a728a-e900-4c69-a639-106ac67139aa"}} Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: exception: Invalid volume: volume 1f3a728a-e900-4c69-a639-106ac67139aa is already attached to instances: 6e9b6f26-1be9-4f8f-8a27-a071354de168 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'server_id': '6e9b6f26-1be9-4f8f-8a27-a071354de168', 'body': {'volumeAttachment': {'volumeId': '1f3a728a-e900-4c69-a639-106ac67139aa'}}} Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f3a728a-e900-4c69-a639-106ac67139aa is already attached to instances: 6e9b6f26-1be9-4f8f-8a27-a071354de168 Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:40:35.077386 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f3a728a-e900-4c69-a639-106ac67139aa is already attached to instances: 6e9b6f26-1be9-4f8f-8a27-a071354de168 Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f3a728a-e900-4c69-a639-106ac67139aa is already attached to instances: 6e9b6f26-1be9-4f8f-8a27-a071354de168 Oct 25 03:40:35.082061 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:40:35.085990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 400 to user: Invalid volume: volume 1f3a728a-e900-4c69-a639-106ac67139aa is already attached to instances: 6e9b6f26-1be9-4f8f-8a27-a071354de168 {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:40:35.087088 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3bc3dfa6-9035-4611-9da3-c87864b076b3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.296168 Oct 25 03:40:35.094673 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3160/6429] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:40:34 2022] POST /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 174 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 03:40:35.191453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:35.192033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:35.205374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:35.208172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:35.210078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:35.211138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:35.211814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:35.212454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:35.371989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lazy-loading 'services' on Instance uuid 6e9b6f26-1be9-4f8f-8a27-a071354de168 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:40:35.554876 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fdc6c6f3-a21b-424a-bb98-f291dc275962 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments/1f3a728a-e900-4c69-a639-106ac67139aa" status: 202 len: 0 microversion: 2.1 time: 0.369965 Oct 25 03:40:35.566230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:35.567005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:35.571500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3270/6430] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:40:35 2022] DELETE /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments/1f3a728a-e900-4c69-a639-106ac67139aa => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:40:35.580306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:35.581299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:35.583825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:35.586842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:35.594279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:35.597456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:35.611027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:35.617819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:35.642139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:35.643847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:35.644315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:35.645057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:35.645526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:35.645989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:35.716936 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91ff7f3d-308b-402b-8623-94837a10d657 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143456 Oct 25 03:40:35.717783 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3271/6431] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:35 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:36.085093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:36.105623 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e9d7398-60a6-4932-8b74-eadd2f878b0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.543357 Oct 25 03:40:36.106308 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3161/6432] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:35 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:36.735169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:36.739272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:36.757736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:36.763166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:36.765667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:36.769373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:36.772956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:36.773692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:36.888511 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7011d92-12c7-4681-881f-35558650880f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158988 Oct 25 03:40:36.892458 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3272/6433] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:36 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:37.161837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:37.162837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:37.197260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:37.231433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:37.236264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:37.243046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:37.246346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:37.247505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:37.870691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:37.883126 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-79d29eac-82c0-4eb5-ad21-512bcd8954a8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.739218 Oct 25 03:40:37.886615 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3162/6434] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:37 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:37.904612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:37.906765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:37.926216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:37.926955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:37.928069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:37.937776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:37.938668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:37.939382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:38.020980 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4fe35300-f660-4eca-97a3-d8f2c7ea1a55 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116364 Oct 25 03:40:38.022357 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3273/6435] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:37 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:38.912985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:38.922278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:38.948129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:38.949435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:38.953799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:38.954652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:38.955157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:38.955580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:39.035827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:39.039692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:39.059397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:39.060399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:39.061658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:39.065569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:39.066891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:39.069797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:39.134771 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7557fdec-2d3f-44d3-8cc6-5350e47a87f5 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104307 Oct 25 03:40:39.135386 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3274/6436] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:39 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:40:39.357853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf1e1f9f-a264-4b40-b2c5-cf289297f4ee tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] Calling method '.version_select at 0x7efd31ffaf70>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:39.422865 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf1e1f9f-a264-4b40-b2c5-cf289297f4ee tempest-TestSecurityGroupsBasicOps-548373673 tempest-TestSecurityGroupsBasicOps-548373673-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-444327658" status: 202 len: 0 microversion: 2.1 time: 0.068659 Oct 25 03:40:39.424399 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3275/6437] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:40:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-444327658 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:40:39.497170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:39.511308 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e0804d04-c2bd-43b0-8025-b7e9da69a8a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.603880 Oct 25 03:40:39.514589 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3163/6438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:38 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:40.149550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:40.152834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:40.160941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:40.161740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:40.162556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:40.163610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:40.164240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:40.164895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:40.211175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:40.215239 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1cfd21e3-d29d-40aa-8a12-f74870982fec tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071361 Oct 25 03:40:40.217229 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3276/6439] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:40 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:40.539271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:40.539879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:40.552778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:40.553272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:40.553724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:40.554624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:40.556095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:40.556686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:40.842224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:40.861535 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-470b98e5-3393-4b87-80b7-32d20ce03e11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.325964 Oct 25 03:40:40.879777 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3164/6440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:40 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:41.229947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:41.233650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:41.256971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:41.257728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:41.260142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:41.263180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:41.264608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:41.266748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:41.361143 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d5ad47e3-90b4-4fb5-b846-fe38ba0ed705 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136385 Oct 25 03:40:41.368650 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3277/6441] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:41 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:41.890513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:41.891188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:41.905995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:41.910363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:41.912070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:41.913791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:41.916183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:41.916784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:41.956890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:42.191260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:42.200787 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0e91d15-a7ae-48e1-8fa3-cb2e3d4b5a9c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.315673 Oct 25 03:40:42.202321 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3165/6442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:41 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:42.374618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:42.377257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:42.401192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:42.406399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:42.408488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:42.409485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:42.409997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:42.412605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:42.449332 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8fff844-115c-42eb-9a18-e068ca9b512b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080179 Oct 25 03:40:42.450673 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3278/6443] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:42 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:43.225510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:43.230492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:43.253083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.254932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.256552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:43.257779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.260473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.262729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:43.463701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:43.467682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:43.479980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.485639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.486447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:43.490498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.491248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.492530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:43.539440 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e707b69f-aa35-4d6d-b762-5d30efc96290 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081110 Oct 25 03:40:43.540852 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3279/6444] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:40:43 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:40:43.596335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:43.609034 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41eaca78-99b0-478b-acf1-603c48f23fee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.387332 Oct 25 03:40:43.628420 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3166/6445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:43 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:43.683913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:43.685464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:43.693746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.694279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.695170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:43.696157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.696693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.697315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:43.730286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:40:43.911140 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5263fa23-d911-4113-86d4-6309a5add95b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 204 len: 0 microversion: 2.1 time: 0.231579 Oct 25 03:40:43.921902 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3280/6446] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:40:43 2022] DELETE /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:40:43.922346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:43.923185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:43.938482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.940630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.942465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:43.945565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:43.946081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:43.946526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:44.218234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:44.231015 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-035b074b-242e-4fea-8b5b-bc6ad1868196 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1680 microversion: 2.1 time: 0.313335 Oct 25 03:40:44.248000 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3167/6447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:43 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1680 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:44.634669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:44.635799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:44.643185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:44.643680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:44.644158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:44.644908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:44.645371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:44.645828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:45.072780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:45.082127 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ab039e8-cac8-44b0-a115-dc400f9ba688 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.451947 Oct 25 03:40:45.083452 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3281/6448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:44 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:45.259208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:45.259915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:45.269258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:45.269781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:45.270298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:45.271003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:45.271457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:45.271880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:45.466810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:45.478111 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc973718-ed4a-4aa6-8469-efe60c3c937f tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1680 microversion: 2.1 time: 0.223037 Oct 25 03:40:45.479336 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3168/6449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:45 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:46.111592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:46.112875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:46.120341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:46.120839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:46.121693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:46.122627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:46.123470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:46.124487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:46.349202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:46.360478 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92b52dcc-9964-4f72-962d-7cebc78cfb64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.252579 Oct 25 03:40:46.366319 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3282/6450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:46 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:46.501356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:46.502165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:46.518054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:46.518765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:46.519329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:46.520178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:46.522248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:46.522803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:46.690270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:46.706393 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4786ca03-1c9d-42df-a891-4485f16f5cbe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1612 microversion: 2.1 time: 0.208897 Oct 25 03:40:46.707106 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3169/6451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:46 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1612 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:46.920770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d24791f5-591a-4dcd-8265-d7170b2a62ad req-5c55ca31-8cae-4e74-94ad-c0bc5345da20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9b6f26-1be9-4f8f-8a27-a071354de168", "name": "network-vif-deleted", "tag": "c013715d-b73e-4600-bb7c-60c564b04dda"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:46.934178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d24791f5-591a-4dcd-8265-d7170b2a62ad req-5c55ca31-8cae-4e74-94ad-c0bc5345da20 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:46.934924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d24791f5-591a-4dcd-8265-d7170b2a62ad req-5c55ca31-8cae-4e74-94ad-c0bc5345da20 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:46.935491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d24791f5-591a-4dcd-8265-d7170b2a62ad req-5c55ca31-8cae-4e74-94ad-c0bc5345da20 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:46.956648 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d24791f5-591a-4dcd-8265-d7170b2a62ad req-5c55ca31-8cae-4e74-94ad-c0bc5345da20 service nova] Creating event network-vif-deleted:c013715d-b73e-4600-bb7c-60c564b04dda for instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 on n-h1-862355-1 Oct 25 03:40:46.966967 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d24791f5-591a-4dcd-8265-d7170b2a62ad req-5c55ca31-8cae-4e74-94ad-c0bc5345da20 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050148 Oct 25 03:40:46.968335 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3283/6452] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:47.389175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:47.390075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:47.408407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:47.410598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:47.411193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:47.415257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:47.415852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:47.418469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:47.733527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:47.735147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:47.752400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:47.753719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:47.755863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:47.757903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:47.758473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:47.760085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:47.798246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:47.810963 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43624e90-a3aa-49c4-b1bd-ad7cb6289717 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1169 microversion: 2.1 time: 0.427787 Oct 25 03:40:47.811633 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3170/6453] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:47 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1169 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:47.854471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:47.856131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:47.857102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:47.857998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lazy-loading 'fault' on Instance uuid 6e9b6f26-1be9-4f8f-8a27-a071354de168 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:40:47.958852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:47.978319 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-25e3c2a2-ea34-4af3-a9cc-4a5089271504 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 200 len: 1330 microversion: 2.1 time: 0.251031 Oct 25 03:40:47.980578 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3284/6454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:47 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 1330 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:48.840782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:48.841386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:48.854317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:48.855707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:48.856152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:48.856879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:48.862134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:48.863077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:49.006541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:49.008034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:49.022400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:49.026157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:49.027384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:49.027980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:49.028560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:49.029004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:49.048989 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 HTTP/1.1 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6e9b6f26-1be9-4f8f-8a27-a071354de168'} Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:40:49.053023 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:40:49.057482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:40:49.060192 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-416050c5-17d3-4320-982e-c21cb1745cb8 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 404 len: 111 microversion: 2.1 time: 0.056572 Oct 25 03:40:49.061510 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3285/6455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:48 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:40:49.070592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47043a70-efd0-4192-ace8-8933cf715cf7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '.version_select at 0x7efd3266f1f0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:49.086934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:49.103307 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47043a70-efd0-4192-ace8-8933cf715cf7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559406180" status: 202 len: 0 microversion: 2.1 time: 0.037192 Oct 25 03:40:49.103848 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa871488-a743-40ab-b9ea-fd76897877dc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1215 microversion: 2.1 time: 0.271530 Oct 25 03:40:49.113663 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3171/6457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:48 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:49.121083 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3286/6457] 10.222.0.36 () {58 vars in 1218 bytes} [Tue Oct 25 03:40:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559406180 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:40:49.771155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0835be81-58e3-415d-bcc0-92599be83bbb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: .version_select at 0x7efd32312820>, body: {"keypair": {"name": "tempest-keypair-2056326947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVoqBO82AAB18b8JfxTyUO06krsEymKi9FJ1K8u8qTIk/dysadINz47UNhTw9anXo5Cq7SXr2V+qL7J5P1J/fmJlxvtDfjH0JYMpwcCS8xoUeihoQMtFyZV/c5qNN3m/w=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:49.787712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0835be81-58e3-415d-bcc0-92599be83bbb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:40:49.793529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0835be81-58e3-415d-bcc0-92599be83bbb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:40:49.817786 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0835be81-58e3-415d-bcc0-92599be83bbb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050344 Oct 25 03:40:49.818507 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3172/6458] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:40:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:50.128441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:50.128917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:50.147967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:50.148664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:50.149271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:50.150180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:50.150802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:50.151783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:50.353529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:50.364420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f615116c-a182-4fe9-8eb6-eab45a30f8e5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.239754 Oct 25 03:40:50.365725 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3287/6459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:50 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:51.368165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097890825", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe069d9f-9479-42aa-b1da-5e77a91badbd"}], "security_groups": [{"name": "tempest-securitygroup--1818566275"}], "key_name": "tempest-keypair-2056326947", "user_data": "}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:51.390251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:51.391621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:51.400459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:51.401177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:51.401885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:51.402877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:51.403501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:51.404095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:51.484855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] validate_networks() for [('fe069d9f-9479-42aa-b1da-5e77a91badbd', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:40:51.568013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:51.579499 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63192d4b-ec37-434f-8b70-a0bcd151da09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.193965 Oct 25 03:40:51.581161 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3288/6460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:51 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:40:51.898859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:40:51.899291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:40:51.899941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:40:51.900355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:40:51.900771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:40:51.914492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:51.914983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:51.915423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:51.916160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:51.916618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:51.917147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:51.941331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:40:51.956840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Getting quotas for user 0031f94e3a74408f91818ab09bae8b6b and project 71acd87e536048c0a961cf00e88bb477. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:40:51.968013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:40:51.970614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:40:52.020194 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e1d02857-e716-4d10-8eba-f3913f422200 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.657476 Oct 25 03:40:52.021193 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3173/6461] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:40:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:40:52.040289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4bb3267b-2b2e-429b-a5cb-c937cc067a68 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:52.041436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4bb3267b-2b2e-429b-a5cb-c937cc067a68 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:52.101010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4bb3267b-2b2e-429b-a5cb-c937cc067a68 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:52.113016 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4bb3267b-2b2e-429b-a5cb-c937cc067a68 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1242 microversion: 2.1 time: 0.083642 Oct 25 03:40:52.117720 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3289/6462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:52 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:52.610117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:52.611332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:52.618156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:52.618850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:52.619460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:52.621005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:52.621644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:52.622256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:52.787958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:52.796753 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13c60a3e-e190-4aad-b04a-267e07e4e1c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.196820 Oct 25 03:40:52.797576 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3174/6463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:52 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:53.138114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:53.138759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:53.150430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:53.150829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:53.154334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:53.155728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:53.157432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:53.157911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:53.283036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:53.303079 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b7b39340-4902-4571-9b9e-df1ca22bfa34 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1294 microversion: 2.1 time: 0.170466 Oct 25 03:40:53.313729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3290/6464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:53 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:53.822560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:53.823698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:53.841446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:53.844601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:53.845732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:53.848170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:53.849797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:53.850376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:54.270541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:54.282397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2fa69fb8-1a05-46bf-b2a9-8719f582b214 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.465421 Oct 25 03:40:54.296251 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3175/6465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:53 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:54.331392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:54.333022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:54.343976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:54.344878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:54.345409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:54.346931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:54.348568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:54.349305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:54.451838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:54.462933 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89d7f75e-aa5b-4225-aebe-29ced29db8fe tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1300 microversion: 2.1 time: 0.135992 Oct 25 03:40:54.469754 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3291/6466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:54 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:40:55.313244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:55.314979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:55.322052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:55.322502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:55.322939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:55.323754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:55.324345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:55.324593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:55.490625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:55.491355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:55.499000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:55.499602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:55.500354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:55.501197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:55.501910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:55.502568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:55.532488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:55.549654 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-625c7ca9-de49-4c73-84af-dd3f923bd3ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.244239 Oct 25 03:40:55.550291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3176/6467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:55 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:55.579455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e007cb8e-e6ac-49b3-8c5f-b69a05814467 req-26b8c869-47cd-4fbd-9bbd-9cd273e459ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5e0644-b8c5-47ee-bd42-44b49d3a80db", "tag": "01d5a7f5-dc3e-49b7-911c-48caa2798b6e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:40:55.592462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e007cb8e-e6ac-49b3-8c5f-b69a05814467 req-26b8c869-47cd-4fbd-9bbd-9cd273e459ed service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:55.593058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e007cb8e-e6ac-49b3-8c5f-b69a05814467 req-26b8c869-47cd-4fbd-9bbd-9cd273e459ed service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:55.593570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e007cb8e-e6ac-49b3-8c5f-b69a05814467 req-26b8c869-47cd-4fbd-9bbd-9cd273e459ed service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:55.607125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e007cb8e-e6ac-49b3-8c5f-b69a05814467 req-26b8c869-47cd-4fbd-9bbd-9cd273e459ed service nova] Creating event network-changed:01d5a7f5-dc3e-49b7-911c-48caa2798b6e for instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db on n-h1-862355-1 Oct 25 03:40:55.612435 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e007cb8e-e6ac-49b3-8c5f-b69a05814467 req-26b8c869-47cd-4fbd-9bbd-9cd273e459ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040032 Oct 25 03:40:55.613129 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3177/6468] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:40:55.718622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:55.746565 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd696248-71cd-45dd-8eb1-adbf95dcf383 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.259272 Oct 25 03:40:55.747584 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3292/6469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:55 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:56.579214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:56.581397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:56.588581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:56.589276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:56.589940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:56.590662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:56.591124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:56.591666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:56.750490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:56.771169 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f344a98-2410-4a91-ab88-148e239c1567 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.199468 Oct 25 03:40:56.771370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:56.771866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:56.775715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3178/6470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:56 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:56.785567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:56.787975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:56.788833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:56.789563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:56.790049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:56.791267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:57.012467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:57.023168 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67fc9e5c-0541-471c-86b9-f329c92d6129 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.258007 Oct 25 03:40:57.024039 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3293/6471] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:56 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:40:57.801200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:57.801916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:57.809702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:57.810251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:57.810829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:57.811651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:57.812252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:57.812785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:57.986684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:57.996598 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0549dbdd-30c9-471b-aad1-01dc7614c517 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.199666 Oct 25 03:40:57.997528 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3179/6472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:57 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:58.048011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:58.049186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:58.056639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:58.057235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:58.057914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:58.058729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:58.059527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:58.060197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:58.201895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:58.205611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:40:58.211035 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7266d899-f072-49c4-a3f5-f8b65c9d7141 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.167031 Oct 25 03:40:58.211630 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3294/6473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:58 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:59.019869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:59.020986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:59.029008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:59.029826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:59.030432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:59.031301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:59.031908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:59.032517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:59.210413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:59.220186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0407e1fa-33ec-41a7-b874-1ae7169de1ee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.204083 Oct 25 03:40:59.236145 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3180/6474] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:59 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:40:59.236576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:40:59.236576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:40:59.243060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:59.243537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:59.243982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:59.245384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:40:59.245384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:40:59.249987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:40:59.471779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:40:59.480373 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e94e396-b448-4718-98ae-5ffc1e161aed tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.249676 Oct 25 03:40:59.481739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3295/6475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:40:59 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:00.244227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:00.244818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:00.248377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:00.254435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:00.254937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:00.255377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:00.256281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:00.256739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:00.257168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:00.409691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:00.418461 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba0358d6-8fc7-445b-974a-8980f1bb7719 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.178281 Oct 25 03:41:00.419052 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3181/6476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:00 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:00.504984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:00.505950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:00.513804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:00.514406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:00.515105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:00.516054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:00.516574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:00.517008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:00.662374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:00.671824 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-627f800e-0613-4880-ac69-c63f07bbdfca tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.171296 Oct 25 03:41:00.672720 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3296/6477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:00 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:00.936445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3ff4f580-460f-4f5a-86ba-77e7521bb1c8 req-f6e0d840-713e-4eb4-98f0-05b7ac10508e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3684f3-4116-430e-b8ab-aa5b8153cc85", "name": "network-vif-plugged", "status": "completed", "tag": "ad0bf4d9-fd5d-4da4-af43-47d628e83462"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:00.948007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3ff4f580-460f-4f5a-86ba-77e7521bb1c8 req-f6e0d840-713e-4eb4-98f0-05b7ac10508e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:00.950371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3ff4f580-460f-4f5a-86ba-77e7521bb1c8 req-f6e0d840-713e-4eb4-98f0-05b7ac10508e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:00.950971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3ff4f580-460f-4f5a-86ba-77e7521bb1c8 req-f6e0d840-713e-4eb4-98f0-05b7ac10508e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:00.966439 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3ff4f580-460f-4f5a-86ba-77e7521bb1c8 req-f6e0d840-713e-4eb4-98f0-05b7ac10508e service nova] Creating event network-vif-plugged:ad0bf4d9-fd5d-4da4-af43-47d628e83462 for instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 on n-h2-862355-1 Oct 25 03:41:00.971763 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3ff4f580-460f-4f5a-86ba-77e7521bb1c8 req-f6e0d840-713e-4eb4-98f0-05b7ac10508e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040880 Oct 25 03:41:00.972422 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3182/6478] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:01.442511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:01.443343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:01.450622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:01.451241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:01.451794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:01.452602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:01.453168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:01.453773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:01.590281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:01.599153 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-970ac6ac-f8b1-46f9-8545-17188a43f54c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1203 microversion: 2.1 time: 0.160553 Oct 25 03:41:01.599746 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3297/6479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:01 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:01.696386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:01.706102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:01.714099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:01.716892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:01.718750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:01.719070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:01.719566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:01.720017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:01.887302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:01.903148 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b98a972-2a97-4a83-86ce-f88a23a0cecb tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.211709 Oct 25 03:41:01.903868 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3183/6480] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:01 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:02.623256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:02.624509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:02.630054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:02.633435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:02.633962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:02.634392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:02.635310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:02.636472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:02.637053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:02.848209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:02.859625 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-35c34a43-7ba3-4367-bac7-56d08831dfc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1389 microversion: 2.1 time: 0.241188 Oct 25 03:41:02.875088 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3298/6481] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:02 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1389 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:02.884643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:02.886858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:02.893193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:02.894437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:02.897549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:02.898320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:02.898972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:02.899892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:02.901078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:02.901859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:02.928740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:02.929660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:02.938503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:02.939293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:02.939952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:02.940855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:02.941476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:02.942091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.112827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:03.123048 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7ecd47b5-bbf8-4a60-86b6-3e2090d77ce9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1389 microversion: 2.1 time: 0.242115 Oct 25 03:41:03.138405 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3184/6482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:02 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:03.146528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-060a27c8-0773-4131-b0c7-d51279298c2e req-e491938c-210e-49a3-a9e1-c5dda2cf928e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5e0644-b8c5-47ee-bd42-44b49d3a80db", "name": "network-vif-plugged", "status": "completed", "tag": "01d5a7f5-dc3e-49b7-911c-48caa2798b6e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:03.159339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-060a27c8-0773-4131-b0c7-d51279298c2e req-e491938c-210e-49a3-a9e1-c5dda2cf928e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:03.160125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-060a27c8-0773-4131-b0c7-d51279298c2e req-e491938c-210e-49a3-a9e1-c5dda2cf928e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:03.160732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-060a27c8-0773-4131-b0c7-d51279298c2e req-e491938c-210e-49a3-a9e1-c5dda2cf928e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.165215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:03.175272 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-060a27c8-0773-4131-b0c7-d51279298c2e req-e491938c-210e-49a3-a9e1-c5dda2cf928e service nova] Creating event network-vif-plugged:01d5a7f5-dc3e-49b7-911c-48caa2798b6e for instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db on n-h1-862355-1 Oct 25 03:41:03.180839 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-060a27c8-0773-4131-b0c7-d51279298c2e req-e491938c-210e-49a3-a9e1-c5dda2cf928e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040974 Oct 25 03:41:03.182715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3185/6483] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:03.189771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:03.190740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:03.204616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:03.209187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:03.210459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.211572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:03.212677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:03.213344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.558612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:03.568055 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c67c732-e87b-42a9-8d3a-802445c92c0b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1389 microversion: 2.1 time: 0.382826 Oct 25 03:41:03.569357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3186/6484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:03 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1389 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:03.581056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:03.592906 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c43d313c-8393-482c-b73c-5d31c2119792 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.668915 Oct 25 03:41:03.593504 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3299/6485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:02 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:03.668279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:03.668772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:03.674952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:03.675437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:03.675908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.676671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:03.677055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:03.677481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.704552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:41:03.785330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-22bb065c-c8bd-4a84-ac14-b3aa52be58b0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 204 len: 0 microversion: 2.1 time: 0.120402 Oct 25 03:41:03.786136 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3187/6486] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:41:03 2022] DELETE /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:41:03.795630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:03.796255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:03.803378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:03.803912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:03.804373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.805241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:03.805753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:03.806189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:03.947133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:03.955794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17d31890-631f-4629-a6ac-c757d2870386 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1395 microversion: 2.1 time: 0.164277 Oct 25 03:41:03.956691 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3300/6487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:03 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:04.621856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:04.622649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:04.640734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:04.641796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:04.642407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:04.643620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:04.644239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:04.644873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:04.840018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:04.848607 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2cd7e53b-4c73-4e7b-82bf-fd4db4da2100 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1368 microversion: 2.1 time: 0.231945 Oct 25 03:41:04.849209 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3188/6488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:04 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:04.980894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:04.982501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:04.992456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:04.993995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:04.994502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:04.995702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:04.996580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:04.997247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:04.997909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:05.181305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:05.192768 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8771e2cd-fe56-4859-853a-82b54efe5ea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1395 microversion: 2.1 time: 0.216609 Oct 25 03:41:05.193538 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3301/6489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:04 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1395 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:05.873086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:05.874431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:05.888702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:05.889742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:05.890397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:05.891346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:05.892046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:05.892645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:06.036636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8ca8e0dd-bc8e-4e1c-97d1-e729ca54809e req-cab293f4-405b-4f51-8dad-e89b95a7d6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3684f3-4116-430e-b8ab-aa5b8153cc85", "name": "network-vif-deleted", "tag": "ad0bf4d9-fd5d-4da4-af43-47d628e83462"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:06.072326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8ca8e0dd-bc8e-4e1c-97d1-e729ca54809e req-cab293f4-405b-4f51-8dad-e89b95a7d6c4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:06.073153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8ca8e0dd-bc8e-4e1c-97d1-e729ca54809e req-cab293f4-405b-4f51-8dad-e89b95a7d6c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:06.076433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8ca8e0dd-bc8e-4e1c-97d1-e729ca54809e req-cab293f4-405b-4f51-8dad-e89b95a7d6c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:06.092966 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8ca8e0dd-bc8e-4e1c-97d1-e729ca54809e req-cab293f4-405b-4f51-8dad-e89b95a7d6c4 service nova] Creating event network-vif-deleted:ad0bf4d9-fd5d-4da4-af43-47d628e83462 for instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 on n-h2-862355-1 Oct 25 03:41:06.112521 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8ca8e0dd-bc8e-4e1c-97d1-e729ca54809e req-cab293f4-405b-4f51-8dad-e89b95a7d6c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080013 Oct 25 03:41:06.116295 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3302/6490] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:41:06.193253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:06.207459 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f9b947c4-4f5a-468d-9141-5859093a16d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1559 microversion: 2.1 time: 0.333786 Oct 25 03:41:06.208120 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3189/6491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:05 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1559 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:06.232036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:06.233436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:06.249822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:06.252067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:06.252772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:06.254572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:06.255348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:06.256272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:06.259708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:06.260358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:06.277646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:06.295063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:06.296108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:06.298231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:06.303438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:06.304646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:06.408190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:06.418988 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b96cebbf-5f1e-48f5-a9a3-44f7a2e1ff11 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1188 microversion: 2.1 time: 0.195570 Oct 25 03:41:06.421377 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3303/6492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:06 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1188 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:06.448977 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e0489da1-08a5-4a5b-b8b7-46ce9aac7fc3 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204858 Oct 25 03:41:06.450347 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3190/6493] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:41:06 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:07.447327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:07.448601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:07.459932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:07.460725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:07.466623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:07.469493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:07.480179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:07.487366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:07.695728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:07.705344 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f35f696b-fce5-4353-b988-9fa672b3c9c2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1188 microversion: 2.1 time: 0.263694 Oct 25 03:41:07.707862 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3304/6494] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:07 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1188 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:08.731705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:08.733053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:08.749285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:08.750596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:08.751973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:08.756834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:08.758242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:08.760366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:08.777728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-268349fe-8b18-4a8d-9b35-e8644e258df7 req-b6703c79-dc3e-4da8-80b2-9666eb9fd318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5e0644-b8c5-47ee-bd42-44b49d3a80db", "tag": "01d5a7f5-dc3e-49b7-911c-48caa2798b6e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:08.815969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-268349fe-8b18-4a8d-9b35-e8644e258df7 req-b6703c79-dc3e-4da8-80b2-9666eb9fd318 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:08.816463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-268349fe-8b18-4a8d-9b35-e8644e258df7 req-b6703c79-dc3e-4da8-80b2-9666eb9fd318 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:08.816899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-268349fe-8b18-4a8d-9b35-e8644e258df7 req-b6703c79-dc3e-4da8-80b2-9666eb9fd318 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:08.852181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-268349fe-8b18-4a8d-9b35-e8644e258df7 req-b6703c79-dc3e-4da8-80b2-9666eb9fd318 service nova] Creating event network-changed:01d5a7f5-dc3e-49b7-911c-48caa2798b6e for instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db on n-h1-862355-1 Oct 25 03:41:08.866127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:08.889556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-268349fe-8b18-4a8d-9b35-e8644e258df7 req-b6703c79-dc3e-4da8-80b2-9666eb9fd318 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118073 Oct 25 03:41:08.891875 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-22182ba2-9ace-413f-800a-5b6207ddee28 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1188 microversion: 2.1 time: 0.164315 Oct 25 03:41:08.896137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3305/6495] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:41:08.897880 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3191/6496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:08 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1188 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:09.924566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:09.925240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:09.942564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:09.952146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:09.952832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:09.953781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:09.962356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:09.963065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:10.087668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:10.111721 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1c28e58-7fb4-4879-b860-2e6c3b1aa095 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1188 microversion: 2.1 time: 0.191645 Oct 25 03:41:10.112639 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3306/6497] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:09 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1188 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:11.138011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:11.138736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:11.146253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:11.146750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:11.147192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:11.147901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:11.148362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:11.148794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:11.220890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:11.231501 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f28fa10-c74c-4a8f-b48d-cd058d9af29f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1188 microversion: 2.1 time: 0.098797 Oct 25 03:41:11.247398 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3192/6498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:11 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:12.265204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:12.267123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:12.285464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:12.286286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:12.287191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:12.294809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:12.295645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:12.296307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:12.404377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:12.414570 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46f75847-a952-411a-aa36-68a43ef0cd60 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 200 len: 1188 microversion: 2.1 time: 0.160686 Oct 25 03:41:12.415170 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3307/6499] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:12 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 1188 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:13.438586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:13.439124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:13.446554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:13.447047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:13.447486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:13.448535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:13.449503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:13.449503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:13.464610 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 HTTP/1.1 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0b3684f3-4116-430e-b8ab-aa5b8153cc85'} Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:13.466477 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e022746-aefa-4784-9e22-87ea7afeeb5a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 404 len: 111 microversion: 2.1 time: 0.033532 Oct 25 03:41:13.472860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3193/6500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:13 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:41:15.675521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:15.676080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:15.684797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:15.685624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:15.686103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:15.686825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:15.687295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:15.687731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:15.708992 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 HTTP/1.1 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0b3684f3-4116-430e-b8ab-aa5b8153cc85'} Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:41:15.710725 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:41:15.715979 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44cc1a43-7f1d-4580-bdc9-a3a3df3ee61b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 404 len: 111 microversion: 2.1 time: 0.041940 Oct 25 03:41:15.717157 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3308/6501] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:41:15 2022] DELETE /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:41:15.721158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:15.721875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 0b3684f3-4116-430e-b8ab-aa5b8153cc85] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:15.730553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:15.731629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:15.732509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:15.733460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:15.734315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:15.735040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:15.752322 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 HTTP/1.1 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0b3684f3-4116-430e-b8ab-aa5b8153cc85'} Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:15.754555 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:15.759860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 0b3684f3-4116-430e-b8ab-aa5b8153cc85 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:41:15.760992 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b4de13f9-c6b3-43d0-b04e-5637366530e2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85" status: 404 len: 111 microversion: 2.1 time: 0.042725 Oct 25 03:41:15.765485 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3194/6502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:15 2022] GET /compute/v2.1/servers/0b3684f3-4116-430e-b8ab-aa5b8153cc85 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:41:26.428233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1961777391", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "915c793c-4af4-454a-be71-9357f90cb515"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:26.437837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=15 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:26.438950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=72 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:26.486190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] validate_networks() for [('915c793c-4af4-454a-be71-9357f90cb515', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:41:26.853387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:41:26.853971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:41:26.854476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:41:26.855047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:41:26.855573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:41:26.864836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:26.865320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:26.865807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:26.866543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:26.866994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:26.867419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:26.887537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Getting quotas for project ceaa60dc7f8d49298ee9ef48d5745292. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:41:26.893579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Getting quotas for user 8ed539e416f547759226c77ee4ba4a8b and project ceaa60dc7f8d49298ee9ef48d5745292. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:41:26.907357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:41:26.909664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:41:26.959096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-691e982e-5cd5-4d98-8535-f4d2046a0f73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535046 Oct 25 03:41:26.960320 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3309/6503] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:41:26.971692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb4691cd-4b87-4f57-862f-8ba5fb9ef0d7 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:26.973014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb4691cd-4b87-4f57-862f-8ba5fb9ef0d7 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:26.977579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:26.978496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:27.059772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb4691cd-4b87-4f57-862f-8ba5fb9ef0d7 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:27.068243 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb4691cd-4b87-4f57-862f-8ba5fb9ef0d7 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1214 microversion: 2.1 time: 0.100445 Oct 25 03:41:27.068860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3195/6504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:26 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:28.092815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:28.093671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:28.105287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:28.106162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:28.107401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:28.108453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:28.109048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:28.110488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:28.225430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:28.246789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ef75d99-39cf-447c-a89f-6f4bb26fc7f3 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1284 microversion: 2.1 time: 0.158838 Oct 25 03:41:28.258171 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3310/6505] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:28 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:29.274189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:29.274878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:29.283471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:29.284307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:29.284997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:29.286010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:29.287049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:29.287754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:29.451436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:29.459347 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c34c5e91-4068-496d-95e9-e6ebda1bae49 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1314 microversion: 2.1 time: 0.191169 Oct 25 03:41:29.459921 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3196/6506] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:29 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:29.592020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c53ed380-46ab-4fac-a0b6-66d3dd125a23 req-accec81e-7309-46ed-b2df-8eb4b832663d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329e3efc-6170-401e-bc3f-db2211e402d7", "tag": "95f4d96b-c9fe-4b76-ba73-88d448ab342d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:29.603636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c53ed380-46ab-4fac-a0b6-66d3dd125a23 req-accec81e-7309-46ed-b2df-8eb4b832663d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:29.604698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c53ed380-46ab-4fac-a0b6-66d3dd125a23 req-accec81e-7309-46ed-b2df-8eb4b832663d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:29.605475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c53ed380-46ab-4fac-a0b6-66d3dd125a23 req-accec81e-7309-46ed-b2df-8eb4b832663d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:29.617075 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c53ed380-46ab-4fac-a0b6-66d3dd125a23 req-accec81e-7309-46ed-b2df-8eb4b832663d service nova] Creating event network-changed:95f4d96b-c9fe-4b76-ba73-88d448ab342d for instance 329e3efc-6170-401e-bc3f-db2211e402d7 on n-h2-862355-1 Oct 25 03:41:29.625490 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c53ed380-46ab-4fac-a0b6-66d3dd125a23 req-accec81e-7309-46ed-b2df-8eb4b832663d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037903 Oct 25 03:41:29.626139 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3311/6507] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:30.483325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:30.484066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:30.491077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:30.491643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:30.492093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:30.492804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:30.493267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:30.493718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:30.628774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:30.639686 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fc52bf8f-0221-495c-ab2f-e4de2bc17102 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1314 microversion: 2.1 time: 0.160238 Oct 25 03:41:30.640462 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3197/6508] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:30 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:31.664094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:31.664739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:31.671589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:31.672068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:31.672500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:31.673186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:31.673634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:31.674340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:31.830756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:31.840445 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-19f35a32-aa08-49d9-aae1-9a6766c10e71 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1314 microversion: 2.1 time: 0.181366 Oct 25 03:41:31.841048 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3312/6509] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:31 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:32.864126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:32.864749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:32.872305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:32.872796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:32.873235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:32.874139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:32.875025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:32.875025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:33.015330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:33.023694 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1f10829c-e161-417c-849c-3230efa721e0 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1314 microversion: 2.1 time: 0.163453 Oct 25 03:41:33.024278 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3198/6510] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:32 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:34.046991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:34.047652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:34.054485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:34.054976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:34.055420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:34.056149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:34.056612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:34.057117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:34.191899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:34.200226 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c86eca60-fbc4-4768-bcf0-bc7a16753c09 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1314 microversion: 2.1 time: 0.157367 Oct 25 03:41:34.200810 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3313/6511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:34 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:35.054345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d8fc022f-dbb8-45d6-8903-872be128f662 req-d8b0bcb5-f4ae-4105-8adf-2f79e65f860c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3efc-6170-401e-bc3f-db2211e402d7", "name": "network-vif-plugged", "status": "completed", "tag": "95f4d96b-c9fe-4b76-ba73-88d448ab342d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:35.065362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d8fc022f-dbb8-45d6-8903-872be128f662 req-d8b0bcb5-f4ae-4105-8adf-2f79e65f860c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:35.065888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d8fc022f-dbb8-45d6-8903-872be128f662 req-d8b0bcb5-f4ae-4105-8adf-2f79e65f860c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:35.066321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d8fc022f-dbb8-45d6-8903-872be128f662 req-d8b0bcb5-f4ae-4105-8adf-2f79e65f860c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:35.078743 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d8fc022f-dbb8-45d6-8903-872be128f662 req-d8b0bcb5-f4ae-4105-8adf-2f79e65f860c service nova] Creating event network-vif-plugged:95f4d96b-c9fe-4b76-ba73-88d448ab342d for instance 329e3efc-6170-401e-bc3f-db2211e402d7 on n-h2-862355-1 Oct 25 03:41:35.083745 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d8fc022f-dbb8-45d6-8903-872be128f662 req-d8b0bcb5-f4ae-4105-8adf-2f79e65f860c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033115 Oct 25 03:41:35.084351 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3199/6512] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:35.223435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:35.224674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:35.231825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:35.232318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:35.232758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:35.233466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:35.233981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:35.234416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:35.368160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:35.378167 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b5f1055-9fca-47f4-a5ec-7b0d89d0a6fd tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1314 microversion: 2.1 time: 0.158544 Oct 25 03:41:35.379084 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3314/6513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:35 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:36.404458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:36.405193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:36.412987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:36.413481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:36.413960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:36.414676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:36.415169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:36.415604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:36.559816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:36.568108 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cecf6bde-da8a-4ae6-ae29-484bf488c4d8 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1314 microversion: 2.1 time: 0.169326 Oct 25 03:41:36.569310 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3200/6514] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:36 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:37.592531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:37.593115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:37.595989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:37.596769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:37.603270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:37.603811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:37.604259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:37.605112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:37.605573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:37.606034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:37.744190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:37.752049 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1229d0ee-bcd4-478e-93dd-182648818f8d tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1497 microversion: 2.1 time: 0.164120 Oct 25 03:41:37.752647 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3315/6515] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:37 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:37.946245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1404824145", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "283d8526-c6b6-45ac-ad9d-44b679eda290", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:37.957957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:38.014889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:41:38.138805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:38.139625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:38.145869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:38.146367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:38.146834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:38.147540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:38.147997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:38.148423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:38.174890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:41:38.255898 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd5b8699-3532-45de-96fd-cfeb111f6f61 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "DELETE /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 204 len: 0 microversion: 2.1 time: 0.121345 Oct 25 03:41:38.256718 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3316/6516] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:41:38 2022] DELETE /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 03:41:38.267146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:38.267853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:38.275529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:38.276383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:38.276841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:38.277568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:38.278077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:38.278501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:38.403396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:41:38.403827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:41:38.404305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:41:38.404721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:41:38.405141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:41:38.414298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:38.414786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:38.415234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:38.415970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:38.416480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:38.416913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:38.420743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:38.429073 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56155368-907a-4407-8e91-a45c876144c5 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1503 microversion: 2.1 time: 0.166277 Oct 25 03:41:38.429765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3317/6517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:38 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:38.435764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:41:38.440978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:41:38.500264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:41:38.502455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='283d8526-c6b6-45ac-ad9d-44b679eda290',volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:41:38.634320 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73e68b98-7c07-44b1-aad8-9e5b5fc13816 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691814 Oct 25 03:41:38.634888 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3201/6518] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:41:38.647458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1cf6d5a6-65f3-4a78-bc75-f4c2e9bc3017 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:38.648070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1cf6d5a6-65f3-4a78-bc75-f4c2e9bc3017 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:38.720326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1cf6d5a6-65f3-4a78-bc75-f4c2e9bc3017 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:38.727835 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1cf6d5a6-65f3-4a78-bc75-f4c2e9bc3017 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1071 microversion: 2.1 time: 0.085059 Oct 25 03:41:38.728425 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3318/6519] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:38 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1071 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:39.453223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:39.453804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:39.460105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:39.460588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:39.461020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:39.461773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:39.462227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:39.462686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:39.596338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:39.605147 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b114bb8c-7c3b-4b76-a270-4404a0949c8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1503 microversion: 2.1 time: 0.156853 Oct 25 03:41:39.605729 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3202/6520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:39 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:39.751602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:39.752413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:39.760754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:39.761550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:39.762287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:39.763180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:39.763721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:39.764363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:39.847266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:39.857410 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f1412cef-e39e-4ea9-b044-c4fec6c5535d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1177 microversion: 2.1 time: 0.110299 Oct 25 03:41:39.858824 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3319/6521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:39 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1177 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:40.214433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-b21ac1fb-7dc7-4070-8538-d934b51766d2 req-ea88a316-7df2-4e96-934e-02d6bee2d42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329e3efc-6170-401e-bc3f-db2211e402d7", "name": "network-vif-deleted", "tag": "95f4d96b-c9fe-4b76-ba73-88d448ab342d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:40.227661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b21ac1fb-7dc7-4070-8538-d934b51766d2 req-ea88a316-7df2-4e96-934e-02d6bee2d42d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:40.228529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b21ac1fb-7dc7-4070-8538-d934b51766d2 req-ea88a316-7df2-4e96-934e-02d6bee2d42d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:40.229852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-b21ac1fb-7dc7-4070-8538-d934b51766d2 req-ea88a316-7df2-4e96-934e-02d6bee2d42d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:40.242847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-b21ac1fb-7dc7-4070-8538-d934b51766d2 req-ea88a316-7df2-4e96-934e-02d6bee2d42d service nova] Creating event network-vif-deleted:95f4d96b-c9fe-4b76-ba73-88d448ab342d for instance 329e3efc-6170-401e-bc3f-db2211e402d7 on n-h2-862355-1 Oct 25 03:41:40.248561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-b21ac1fb-7dc7-4070-8538-d934b51766d2 req-ea88a316-7df2-4e96-934e-02d6bee2d42d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038561 Oct 25 03:41:40.249902 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3203/6522] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:40.629582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:40.631306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:40.641244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:40.641815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:40.642211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:40.642945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:40.643412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:40.643852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:40.697279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:40.711065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:40.713817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:40.715394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lazy-loading 'fault' on Instance uuid 329e3efc-6170-401e-bc3f-db2211e402d7 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:41:40.777671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:40.786903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91c0aba6-4727-4111-8c05-2ea20472f644 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 200 len: 1304 microversion: 2.1 time: 0.161183 Oct 25 03:41:40.787873 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3320/6523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:40 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:40.883843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:40.884812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:40.892220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:40.892798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:40.893328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:40.894370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:40.894997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:40.895428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:41.158196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:41.166116 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c006280b-d650-4b09-9844-3731abe32399 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1229 microversion: 2.1 time: 0.287733 Oct 25 03:41:41.168040 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3204/6524] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:40 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1229 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:41.392527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7c7e17a1-6815-4311-8384-e5a12cefa9e8 req-bfde4b03-aec5-4ddb-9799-fa78213161ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9264f0f9-a5af-4783-9fab-387d26d12d4b", "tag": "efc7db8e-4cf6-4b7a-85f7-2dea71646762"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:41.403075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7c7e17a1-6815-4311-8384-e5a12cefa9e8 req-bfde4b03-aec5-4ddb-9799-fa78213161ba service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:41.403770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7c7e17a1-6815-4311-8384-e5a12cefa9e8 req-bfde4b03-aec5-4ddb-9799-fa78213161ba service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:41.404408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7c7e17a1-6815-4311-8384-e5a12cefa9e8 req-bfde4b03-aec5-4ddb-9799-fa78213161ba service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:41.417264 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7c7e17a1-6815-4311-8384-e5a12cefa9e8 req-bfde4b03-aec5-4ddb-9799-fa78213161ba service nova] Creating event network-changed:efc7db8e-4cf6-4b7a-85f7-2dea71646762 for instance 9264f0f9-a5af-4783-9fab-387d26d12d4b on n-h1-862355-1 Oct 25 03:41:41.422420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7c7e17a1-6815-4311-8384-e5a12cefa9e8 req-bfde4b03-aec5-4ddb-9799-fa78213161ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034276 Oct 25 03:41:41.423234 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3321/6525] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:41.813646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:41.814201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 329e3efc-6170-401e-bc3f-db2211e402d7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:41.820341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:41.820822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:41.821331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:41.822053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:41.822701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:41.823756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:41.838122 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] HTTP exception thrown: Instance 329e3efc-6170-401e-bc3f-db2211e402d7 could not be found. Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Request method failure captured: Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 HTTP/1.1 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1rktOUchB7c5DEc8mCY_9CYQRw34bzLalqAl9OWrbwmionQndvPNdiUpm1AdInz-hETFUSI_1_qv342ukXiSVAUj_UcHTKldxQQXTYxXq55KSfvQqeD8g32EBWXUiLDCMd57UeWuQLHkVSl3W24TeUMemDyK4g58J-gkFo3DcFBxKY Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: ceaa60dc7f8d49298ee9ef48d5745292 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-VolumesActionsTest-1207712284 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ceaa60dc7f8d49298ee9ef48d5745292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ceaa60dc7f8d49298ee9ef48d5745292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ceaa60dc7f8d49298ee9ef48d5745292", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ceaa60dc7f8d49298ee9ef48d5745292"}]}] Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-VolumesActionsTest-1207712284 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: ceaa60dc7f8d49298ee9ef48d5745292 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-VolumesActionsTest-1207712284 Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-VolumesActionsTest-1207712284-project Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 8ed539e416f547759226c77ee4ba4a8b Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-VolumesActionsTest-1207712284-project Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 329e3efc-6170-401e-bc3f-db2211e402d7 could not be found. Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '329e3efc-6170-401e-bc3f-db2211e402d7'} Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329e3efc-6170-401e-bc3f-db2211e402d7 could not be found. Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329e3efc-6170-401e-bc3f-db2211e402d7 could not be found. Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:41.840587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329e3efc-6170-401e-bc3f-db2211e402d7 could not be found. Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Returning 404 to user: Instance 329e3efc-6170-401e-bc3f-db2211e402d7 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e6d046cf-7220-4cd9-a327-74b32c2595b2 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7" status: 404 len: 111 microversion: 2.1 time: 0.032411 Oct 25 03:41:41.845587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3205/6526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:41 2022] GET /compute/v2.1/servers/329e3efc-6170-401e-bc3f-db2211e402d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:41:41.900224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1480879469", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "915c793c-4af4-454a-be71-9357f90cb515"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:41.973393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] validate_networks() for [('915c793c-4af4-454a-be71-9357f90cb515', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:41:42.191981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:42.193204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:42.202176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:42.203033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:42.203626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:42.204493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:42.205105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:42.206515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:42.371532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:41:42.372270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:41:42.372983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:41:42.373745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:41:42.374172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:41:42.384497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:42.385024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:42.386650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:42.387618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:42.388085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:42.388516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:42.409488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Getting quotas for project ceaa60dc7f8d49298ee9ef48d5745292. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:41:42.416033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Getting quotas for user 8ed539e416f547759226c77ee4ba4a8b and project ceaa60dc7f8d49298ee9ef48d5745292. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:41:42.430929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:42.433955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:41:42.436587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:41:42.443138 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-287f283b-4914-471a-bb1b-4fe01af412b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1229 microversion: 2.1 time: 0.254928 Oct 25 03:41:42.458231 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3206/6527] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:42 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1229 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:42.487925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5143b3e5-2dcb-4c23-836b-90df5e68fc73 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592875 Oct 25 03:41:42.488894 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3322/6528] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:41:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:41:42.499661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee4afa33-651d-4c29-abc5-f63d812e78c4 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:42.501372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ee4afa33-651d-4c29-abc5-f63d812e78c4 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:42.560979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee4afa33-651d-4c29-abc5-f63d812e78c4 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:42.570373 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee4afa33-651d-4c29-abc5-f63d812e78c4 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1214 microversion: 2.1 time: 0.074530 Oct 25 03:41:42.575552 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3207/6529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:42 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:43.468359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:43.469551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:43.478057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:43.479853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:43.480765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:43.481922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:43.482702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:43.483330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:43.597002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:43.600084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:43.611297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:43.612135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:43.613084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:43.614034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:43.614697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:43.615695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:43.712588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:43.721577 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fdad1ff0-075b-41b6-96c3-9eb622e703b9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1284 microversion: 2.1 time: 0.130790 Oct 25 03:41:43.722576 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3208/6530] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:43 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:43.724766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:43.736744 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56c2f4f8-de02-4cc5-bed8-19685460ac41 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1229 microversion: 2.1 time: 0.273438 Oct 25 03:41:43.737413 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3323/6531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:43 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1229 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:43.929845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:43.930706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:43.938254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:43.939291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:43.939953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:43.940999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:43.941667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:43.942374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:43.970578 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a818bb9-45d6-4950-8950-4106233187d9 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/ips" status: 200 len: 151 microversion: 2.1 time: 0.246701 Oct 25 03:41:43.971398 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3209/6532] 10.222.0.36 () {58 vars in 1248 bytes} [Tue Oct 25 03:41:43 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/ips => generated 151 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:44.746503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:44.747835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:44.762018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:44.763685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:44.769980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:44.772843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:44.774668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:44.775387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:44.776967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:44.777708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:44.778404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:44.779093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:44.779745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:44.780667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:44.784283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:44.784968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:44.968282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:44.976642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91c59cd7-1f76-407e-b57a-d14d9cc1fb46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1229 microversion: 2.1 time: 0.219431 Oct 25 03:41:44.991805 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3210/6533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:44 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1229 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:45.058332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:45.068302 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1a04b0f5-c7a6-4444-a521-0e9b3a3be727 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1314 microversion: 2.1 time: 0.326591 Oct 25 03:41:45.069384 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3324/6534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:44 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:45.273832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-bfb81674-464e-4072-8fe9-cd5bf9b86c18 req-76cd2592-ee55-4704-94c7-c694b304b636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79af85ff-ab02-4b75-9969-f7ca1d4fd5ac", "tag": "1c61410c-7c56-4b97-acea-e47a3c743ae3"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:45.284281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bfb81674-464e-4072-8fe9-cd5bf9b86c18 req-76cd2592-ee55-4704-94c7-c694b304b636 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:45.284772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bfb81674-464e-4072-8fe9-cd5bf9b86c18 req-76cd2592-ee55-4704-94c7-c694b304b636 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:45.285209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bfb81674-464e-4072-8fe9-cd5bf9b86c18 req-76cd2592-ee55-4704-94c7-c694b304b636 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:45.308509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-bfb81674-464e-4072-8fe9-cd5bf9b86c18 req-76cd2592-ee55-4704-94c7-c694b304b636 service nova] Creating event network-changed:1c61410c-7c56-4b97-acea-e47a3c743ae3 for instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac on n-h2-862355-1 Oct 25 03:41:45.315269 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-bfb81674-464e-4072-8fe9-cd5bf9b86c18 req-76cd2592-ee55-4704-94c7-c694b304b636 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045287 Oct 25 03:41:45.316744 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3211/6535] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:45.358517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29692f9b-1261-4494-b9e1-fdeae8f820bc"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:45.361125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:45.368980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:45.369609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:45.371025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:45.371970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:45.372541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:45.373071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:45.988002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:46.001717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:46.002418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:46.006332 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f520b2f3-4d9f-4fec-9948-b7d6bf5008a7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "POST /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651052 Oct 25 03:41:46.012959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3325/6536] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:41:45 2022] POST /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 194 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:46.028189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:46.028699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:46.029140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:46.032132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:46.032604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:46.033046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:46.095675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:46.096492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:46.102902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:46.103414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:46.104384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:46.105287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:46.105779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:46.106215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:46.190651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:46.199375 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e6dd6900-cf83-46fd-9461-28d5b98d057f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.202453 Oct 25 03:41:46.199974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3212/6537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:45 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:46.250371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:46.258217 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eed36982-5839-4cb8-a31e-6823c50c80bc tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1314 microversion: 2.1 time: 0.167351 Oct 25 03:41:46.258801 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3326/6538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:46 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:47.223493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:47.224221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:47.231162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:47.231653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:47.232099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:47.232798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:47.233269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:47.233723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:47.282471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:47.283035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:47.289661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:47.290179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:47.290623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:47.291424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:47.291885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:47.292507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:47.391371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:47.408182 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1be47895-7b28-4abe-b421-e21b81dd3050 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.188490 Oct 25 03:41:47.410050 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3213/6539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:47 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:47.445335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:47.455725 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf1f4deb-4825-4c9a-8f50-14ec84739d06 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1314 microversion: 2.1 time: 0.177074 Oct 25 03:41:47.456422 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3327/6540] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:47 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:48.433077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:48.433778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:48.437797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:48.442171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:48.442653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:48.443092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:48.443830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:48.444290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:48.444715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:48.479493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:48.481470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:48.488610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:48.489774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:48.490472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:48.491419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:48.492108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:48.492882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:48.597495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:48.606670 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81a9309e-77b7-4d28-846d-8ed2ae910a80 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.177706 Oct 25 03:41:48.617788 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3214/6541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:48 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:48.639027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:48.646853 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-54f669dc-a6f1-490d-92e3-baf0b49a53ad tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1314 microversion: 2.1 time: 0.172177 Oct 25 03:41:48.647429 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3328/6542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:48 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:49.630747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:49.631488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:49.639322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:49.639800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:49.640246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:49.640946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:49.641407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:49.641873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:49.672359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:49.673047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:49.680324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:49.680856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:49.681296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:49.682616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:49.683141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:49.683577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:49.796695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:49.805593 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a03f698-c71d-4712-86f3-eb8c8ae2a36b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.178746 Oct 25 03:41:49.806463 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3215/6543] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:49 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:49.832167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:49.840468 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d04550a9-218a-4687-8c27-3ffcb3ce2101 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1314 microversion: 2.1 time: 0.172113 Oct 25 03:41:49.841049 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3329/6544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:49 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:50.829274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:50.829986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:50.836716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:50.837205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:50.837641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:50.838448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:50.839024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:50.839355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:50.864611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:50.865528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:50.873613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:50.874267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:50.875369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:50.876188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:50.877830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:50.878379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:50.985170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:50.994217 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b222b268-e9a7-4e9b-ba46-c58a0c58f31c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.168714 Oct 25 03:41:50.995590 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3216/6545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:50 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:51.053568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:51.063390 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8649aec-e914-42d3-9cbf-d35ab53477a1 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1314 microversion: 2.1 time: 0.203317 Oct 25 03:41:51.064202 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3330/6546] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:50 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:51.086958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-102b2ea0-8a43-4d0a-9240-2d395a4ffed1 req-047c6cb3-fe48-47a3-ade9-13314499563e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79af85ff-ab02-4b75-9969-f7ca1d4fd5ac", "name": "network-vif-plugged", "status": "completed", "tag": "1c61410c-7c56-4b97-acea-e47a3c743ae3"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:51.099658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-102b2ea0-8a43-4d0a-9240-2d395a4ffed1 req-047c6cb3-fe48-47a3-ade9-13314499563e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:51.100152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-102b2ea0-8a43-4d0a-9240-2d395a4ffed1 req-047c6cb3-fe48-47a3-ade9-13314499563e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:51.100591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-102b2ea0-8a43-4d0a-9240-2d395a4ffed1 req-047c6cb3-fe48-47a3-ade9-13314499563e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:51.105254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:51.113539 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-102b2ea0-8a43-4d0a-9240-2d395a4ffed1 req-047c6cb3-fe48-47a3-ade9-13314499563e service nova] Creating event network-vif-plugged:1c61410c-7c56-4b97-acea-e47a3c743ae3 for instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac on n-h2-862355-1 Oct 25 03:41:51.118892 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-102b2ea0-8a43-4d0a-9240-2d395a4ffed1 req-047c6cb3-fe48-47a3-ade9-13314499563e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Oct 25 03:41:51.119556 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3217/6547] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:52.020724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:52.021358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:52.029063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:52.029570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:52.030052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:52.030777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:52.031246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:52.031687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:52.086985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:52.087737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:52.096073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:52.096578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:52.097028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:52.098664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:52.098664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:52.098664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:52.176434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:52.184851 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b404ee37-4dd7-4fc6-b1e4-66937d9bc44d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.168053 Oct 25 03:41:52.185468 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3331/6548] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:52 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:52.489615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:52.497384 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e092e439-5966-4275-8831-1bd5cb55af8f tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1314 microversion: 2.1 time: 0.414764 Oct 25 03:41:52.498010 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3218/6549] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:52 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:53.208463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:53.209077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:53.211084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:53.211783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:53.219098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:53.219586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:53.220021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:53.220710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:53.221161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:53.221585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:53.355261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:53.363186 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2cb18b3-4582-42d3-bd5f-ad6752c2add9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.159033 Oct 25 03:41:53.363774 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3332/6550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:53 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:53.520479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:53.521844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:53.523252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:53.529766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:53.530254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:53.530690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:53.531390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:53.531848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:53.532281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:53.664583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:53.672558 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-264dc80f-1fc4-476d-9412-b0dc119fb297 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1497 microversion: 2.1 time: 0.156048 Oct 25 03:41:53.673076 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3219/6551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:53 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:54.100339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:54.100846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:54.107109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:54.107593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:54.108042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:54.108745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:54.109186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:54.109615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:54.134458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:41:54.210716 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-714a0cf7-0b7f-43ee-8d59-37019b35812a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "DELETE /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 204 len: 0 microversion: 2.1 time: 0.113842 Oct 25 03:41:54.211368 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3333/6552] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:41:54 2022] DELETE /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:41:54.220668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:54.221311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:54.227380 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:54.227863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:54.228300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:54.229702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:54.230355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:54.230787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:54.361462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:54.369778 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b2c9231-909f-4374-a9eb-4fb09c8608a9 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1503 microversion: 2.1 time: 0.152692 Oct 25 03:41:54.370277 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3220/6553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:54 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:54.387723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:54.388425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:54.395180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:54.395666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:54.396100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:54.396785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:54.397237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:54.397659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:54.528243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:54.536164 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b389c7c-f104-49f0-9e73-75fa4644b67f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.153212 Oct 25 03:41:54.536756 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3334/6554] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:54 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:55.393466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:55.394134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:55.401782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:55.402126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:55.402562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:55.403258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:55.403715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:55.404144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:55.439770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-069b5964-527b-4543-a0ff-834d7d7e6d5f req-282970ce-55b2-4697-a894-16890b810c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9264f0f9-a5af-4783-9fab-387d26d12d4b", "name": "network-vif-plugged", "status": "completed", "tag": "efc7db8e-4cf6-4b7a-85f7-2dea71646762"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:55.452520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-069b5964-527b-4543-a0ff-834d7d7e6d5f req-282970ce-55b2-4697-a894-16890b810c44 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:55.453024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-069b5964-527b-4543-a0ff-834d7d7e6d5f req-282970ce-55b2-4697-a894-16890b810c44 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:55.453432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-069b5964-527b-4543-a0ff-834d7d7e6d5f req-282970ce-55b2-4697-a894-16890b810c44 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:55.465709 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-069b5964-527b-4543-a0ff-834d7d7e6d5f req-282970ce-55b2-4697-a894-16890b810c44 service nova] Creating event network-vif-plugged:efc7db8e-4cf6-4b7a-85f7-2dea71646762 for instance 9264f0f9-a5af-4783-9fab-387d26d12d4b on n-h1-862355-1 Oct 25 03:41:55.470652 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-069b5964-527b-4543-a0ff-834d7d7e6d5f req-282970ce-55b2-4697-a894-16890b810c44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Oct 25 03:41:55.471430 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3335/6555] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:55.561321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:55.561990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:55.565161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:55.569568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:55.570069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:55.570518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:55.571228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:55.571981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:55.573335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:55.590997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:55.601120 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-10934ca8-b716-43b6-8b27-cacbbf031d70 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1503 microversion: 2.1 time: 0.211506 Oct 25 03:41:55.602517 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3221/6556] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:55 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:55.813245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:55.820935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-74192f24-d64d-46f3-a897-58fad760fcc4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1217 microversion: 2.1 time: 0.264743 Oct 25 03:41:55.821532 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3336/6557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:55 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:41:56.138489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ff6ef9ff-d8f1-490e-9df3-141fdecf92db req-cfc88734-0132-4443-9219-d0051853122d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79af85ff-ab02-4b75-9969-f7ca1d4fd5ac", "name": "network-vif-deleted", "tag": "1c61410c-7c56-4b97-acea-e47a3c743ae3"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:56.147785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ff6ef9ff-d8f1-490e-9df3-141fdecf92db req-cfc88734-0132-4443-9219-d0051853122d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:56.148352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ff6ef9ff-d8f1-490e-9df3-141fdecf92db req-cfc88734-0132-4443-9219-d0051853122d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:56.148805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ff6ef9ff-d8f1-490e-9df3-141fdecf92db req-cfc88734-0132-4443-9219-d0051853122d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:56.161234 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ff6ef9ff-d8f1-490e-9df3-141fdecf92db req-cfc88734-0132-4443-9219-d0051853122d service nova] Creating event network-vif-deleted:1c61410c-7c56-4b97-acea-e47a3c743ae3 for instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac on n-h2-862355-1 Oct 25 03:41:56.166136 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ff6ef9ff-d8f1-490e-9df3-141fdecf92db req-cfc88734-0132-4443-9219-d0051853122d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032393 Oct 25 03:41:56.167282 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3222/6558] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:56.625305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:56.625909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:56.633116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:56.633609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:56.634078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:56.635426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:56.635902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:56.636443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:56.671759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:56.672259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:56.672702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:56.673158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lazy-loading 'fault' on Instance uuid 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:41:56.723685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed539e416f547759226c77ee4ba4a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa60dc7f8d49298ee9ef48d5745292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:56.731369 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6d5e4cb6-e247-4b29-820a-be34af0f1213 tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 200 len: 1304 microversion: 2.1 time: 0.110129 Oct 25 03:41:56.731959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3337/6559] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:56 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:56.844232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:56.844934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:56.851187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:56.851966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:56.852412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:56.853108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:56.854141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:56.854596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:56.992586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:57.001870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b959cfb2-a522-4a24-bb25-7ba0efef2615 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1404 microversion: 2.1 time: 0.162667 Oct 25 03:41:57.002452 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3223/6560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:56 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:57.024517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:57.025143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:57.031167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:57.031661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:57.032104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:57.032804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:57.033265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:57.033716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:57.169023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:41:57.178024 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-67ac2b94-fa6a-4218-8dcc-8120020334cd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1404 microversion: 2.1 time: 0.157353 Oct 25 03:41:57.178645 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3338/6561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:57 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:41:57.200586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-980364974"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:57.203004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:57.204952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:57.211283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:57.211772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:57.212223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:57.213768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:57.214377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:57.214664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:57.309812 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Attempting to quiesce instance before volume snapshot. Oct 25 03:41:57.367592 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 25 03:41:57.436770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Creating snapshot from volume 283d8526-c6b6-45ac-ad9d-44b679eda290. {{(pid=120563) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 25 03:41:57.754919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:57.756139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] [instance: 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:57.762748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:57.763239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:57.763676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:57.764382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:57.764841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:57.765448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:57.780349 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] HTTP exception thrown: Instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac could not be found. Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Request method failure captured: Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac HTTP/1.1 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1rktOUchB7c5DEc8mCY_9CYQRw34bzLalqAl9OWrbwmionQndvPNdiUpm1AdInz-hETFUSI_1_qv342ukXiSVAUj_UcHTKldxQQXTYxXq55KSfvQqeD8g32EBWXUiLDCMd57UeWuQLHkVSl3W24TeUMemDyK4g58J-gkFo3DcFBxKY Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: ceaa60dc7f8d49298ee9ef48d5745292 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesActionsTest-1207712284 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ceaa60dc7f8d49298ee9ef48d5745292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ceaa60dc7f8d49298ee9ef48d5745292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ceaa60dc7f8d49298ee9ef48d5745292", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ceaa60dc7f8d49298ee9ef48d5745292"}]}] Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesActionsTest-1207712284 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: ceaa60dc7f8d49298ee9ef48d5745292 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesActionsTest-1207712284 Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesActionsTest-1207712284-project Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 8ed539e416f547759226c77ee4ba4a8b Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesActionsTest-1207712284-project Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac could not be found. Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '79af85ff-ab02-4b75-9969-f7ca1d4fd5ac'} Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac could not be found. Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac could not be found. Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:41:57.782928 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac could not be found. Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:41:57.788813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] Returning 404 to user: Instance 79af85ff-ab02-4b75-9969-f7ca1d4fd5ac could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:41:57.789887 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-924bedbd-4261-4439-9da0-4733d447ce3a tempest-VolumesActionsTest-1207712284 tempest-VolumesActionsTest-1207712284-project] 10.222.0.36 "GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac" status: 404 len: 111 microversion: 2.1 time: 0.038212 Oct 25 03:41:57.795641 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3339/6562] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:41:57 2022] GET /compute/v2.1/servers/79af85ff-ab02-4b75-9969-f7ca1d4fd5ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:41:58.007214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:58.007993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:58.015121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:58.016104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:58.016553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:58.017312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:58.017742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:58.018176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:58.108375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lazy-loading 'services' on Instance uuid 8f5e0644-b8c5-47ee-bd42-44b49d3a80db {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:41:58.215074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1c9db40f-e305-4d77-83ad-e8cfe45e45d2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments/29692f9b-1261-4494-b9e1-fdeae8f820bc" status: 202 len: 0 microversion: 2.1 time: 0.211447 Oct 25 03:41:58.216236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3340/6563] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:41:58 2022] DELETE /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments/29692f9b-1261-4494-b9e1-fdeae8f820bc => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:41:58.227847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:58.232403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:58.244409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:58.246183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:58.247372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:58.248490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:58.249436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:58.250394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:58.278923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:41:58.317207 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e523f7a0-e703-4ce9-a1b6-88d72e6b4a49 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095989 Oct 25 03:41:58.318254 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3341/6564] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:41:58 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:41:58.514808 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e866011-b8e6-4f56-a0e7-cde03d180180 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b/action" status: 202 len: 0 microversion: 2.1 time: 1.318282 Oct 25 03:41:58.515451 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3224/6565] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:41:57 2022] POST /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b/action => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 03:41:59.331267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:41:59.334625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:41:59.343016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:59.343946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:59.344738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:59.345736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:41:59.346416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:41:59.347063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:41:59.386575 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8d7a0aaa-7964-4056-8f72-941ffdb6e75b tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059572 Oct 25 03:41:59.387276 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3342/6566] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:41:59 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:41:59.714001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-772608632", "imageRef": "b7abe24b-4758-4a32-b72c-9ac0fcf02fc0", "flavorRef": "452", "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:41:59.780336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:42:00.302534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:42:00.302977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:42:00.303472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:42:00.304097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:42:00.304894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:42:00.335780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:00.339207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:00.340158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:00.341241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:00.343477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:00.343779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:00.392781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:42:00.399119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:00.406458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:00.410577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:42:00.422718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:00.423652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:00.424881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:00.426002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:00.426708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:00.427387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:00.430521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:42:00.434150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='977e6537-40ad-455b-b190-329f7b7d1677',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:42:00.499275 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fa94293-e630-47f5-8afd-88fd9980693d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104033 Oct 25 03:42:00.500211 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3343/6567] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:42:00 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:42:00.545387 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-31d06201-f5d7-4234-8fb0-00fa0003e193 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837293 Oct 25 03:42:00.546695 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3225/6568] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:42:00.564797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1ffee49-44e8-4262-b7ab-febaed81126f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:00.566129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1ffee49-44e8-4262-b7ab-febaed81126f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:00.645129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1ffee49-44e8-4262-b7ab-febaed81126f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:00.656423 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1ffee49-44e8-4262-b7ab-febaed81126f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1229 microversion: 2.1 time: 0.099411 Oct 25 03:42:00.657620 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3344/6569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:00 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:01.514084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:01.517095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:01.532359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:01.533263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:01.534661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:01.536812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:01.538951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:01.539596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:01.602197 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e83184b-5864-4d0b-90a7-7e57b5ed5cf6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093328 Oct 25 03:42:01.603038 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3226/6570] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:42:01 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:01.683441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:01.684739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:01.699213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:01.700410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:01.704765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:01.706181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:01.707098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:01.707878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:01.821294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:01.831191 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-884e1f8b-a0cd-47c5-a6dd-0b314cfed1a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1281 microversion: 2.1 time: 0.154984 Oct 25 03:42:01.831913 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3345/6571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:01 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:02.616842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:02.620447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:02.635637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:02.636567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:02.637502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:02.638511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:02.639191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:02.639844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:02.673994 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-31bdcde9-dc4f-48ed-9bd4-2e7d8bba4f1d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062465 Oct 25 03:42:02.675516 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3227/6572] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:42:02 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:02.858695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:02.859955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:02.872803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:02.875178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:02.877956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:02.878920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:02.881589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:02.882257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:03.043723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:03.054540 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7a8612b-9c00-4a9c-8a02-90a2c9fb1819 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1299 microversion: 2.1 time: 0.201882 Oct 25 03:42:03.066334 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3346/6573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:02 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:03.688041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:03.691425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:03.707616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:03.710261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:03.710961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:03.712103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:03.715708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:03.716609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:03.782989 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ccb43513-3a80-453b-9ef9-33e86a65e23d tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099537 Oct 25 03:42:03.784185 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3228/6574] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:42:03 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:04.080078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:04.080862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:04.094487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:04.095136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:04.095788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:04.096605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:04.097171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:04.097912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:04.402370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:04.417787 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a561444d-9042-4240-8566-a27fa45193e9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.341656 Oct 25 03:42:04.419362 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3347/6575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:04 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:04.713487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-9b4f2f24-6201-444b-8aa1-c3037acecd98 req-bf75467b-b233-4d1d-88ac-d0b7f9674e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af6997d-81a5-435f-8db2-fa9dad586109", "tag": "b4e849a2-f9bd-4abd-b66c-bdac960ee659"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:04.739891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9b4f2f24-6201-444b-8aa1-c3037acecd98 req-bf75467b-b233-4d1d-88ac-d0b7f9674e1c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:04.740504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9b4f2f24-6201-444b-8aa1-c3037acecd98 req-bf75467b-b233-4d1d-88ac-d0b7f9674e1c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:04.741211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-9b4f2f24-6201-444b-8aa1-c3037acecd98 req-bf75467b-b233-4d1d-88ac-d0b7f9674e1c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:04.761902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-9b4f2f24-6201-444b-8aa1-c3037acecd98 req-bf75467b-b233-4d1d-88ac-d0b7f9674e1c service nova] Creating event network-changed:b4e849a2-f9bd-4abd-b66c-bdac960ee659 for instance 5af6997d-81a5-435f-8db2-fa9dad586109 on n-h2-862355-1 Oct 25 03:42:04.779286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-9b4f2f24-6201-444b-8aa1-c3037acecd98 req-bf75467b-b233-4d1d-88ac-d0b7f9674e1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069858 Oct 25 03:42:04.780325 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3229/6576] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:04.796312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:04.801967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:04.828253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:04.828762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:04.829212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:04.830588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:04.831059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:04.831497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:04.906791 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ecc08967-4937-4fcb-b0f4-5990e9ad6fcf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102204 Oct 25 03:42:04.907499 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3348/6577] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:42:04 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:05.450173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:05.450896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:05.461075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:05.461486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:05.462534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:05.463836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:05.464314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:05.464757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:05.689116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:05.699392 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-53e04c27-e5fb-4eea-ad2e-79458cb2be2d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.254462 Oct 25 03:42:05.700422 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3230/6578] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:05 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:05.921643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:05.924966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:05.946685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:05.948998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:05.950169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:05.953967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:05.954976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:05.955502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:06.035908 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-701122a9-4914-49c6-b59c-4d67d994d5e1 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120369 Oct 25 03:42:06.043189 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3349/6579] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 03:42:05 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 03:42:06.131069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:06.131635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:06.148372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:06.149771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:06.151210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:06.154542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:06.155579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:06.156423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:06.207140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:42:06.367395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6259748-0e34-4936-9849-67f812016fa0 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 204 len: 0 microversion: 2.1 time: 0.240427 Oct 25 03:42:06.370048 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3231/6580] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:42:06 2022] DELETE /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:42:06.381162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:06.382501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:06.392353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:06.393133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:06.393958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:06.394929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:06.395827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:06.396531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:06.599406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:06.607574 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a916382e-3634-4078-b1e7-7b4317875c52 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1684 microversion: 2.1 time: 0.232936 Oct 25 03:42:06.608630 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3350/6581] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:06 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1684 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:06.729445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:06.729445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:06.742580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:06.743113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:06.745158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:06.764684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:06.766993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:06.769281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:07.046385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:07.059076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:07.063573 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d9104331-39b2-4a28-ac8d-6db1609599fe tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.339732 Oct 25 03:42:07.065170 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3232/6582] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:06 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:07.632485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:07.633161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:07.664423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:07.665292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:07.666114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:07.671152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:07.671821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:07.672278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:08.108087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:08.108799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:08.124785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:08.128860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:08.130399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:08.135578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:08.136547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:08.137479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:08.289183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:08.302560 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7c39bf5d-6b9a-4e95-9f83-d1bca4b292ee tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1684 microversion: 2.1 time: 0.674266 Oct 25 03:42:08.303185 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3351/6583] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:07 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1684 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:08.718435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:08.733024 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d7afe3b-13da-486a-bfdb-6b061fe1e20c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.632576 Oct 25 03:42:08.749705 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3233/6584] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:08 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:09.329827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:09.330497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:09.338484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:09.340187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:09.340633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:09.341365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:09.342122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:09.342289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:09.438174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:09.446630 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-402dfd94-5d38-4693-8c2d-b82a2e8d27ce tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1616 microversion: 2.1 time: 0.120962 Oct 25 03:42:09.447265 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3352/6585] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:09 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1616 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:09.771748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:09.772528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:09.783449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:09.785372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:09.794404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9519bed2-f6e0-4f74-9b7f-df815cab7f4a req-ed42c32a-9fd9-4e5d-90e1-e90e9412a359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5e0644-b8c5-47ee-bd42-44b49d3a80db", "name": "network-vif-deleted", "tag": "01d5a7f5-dc3e-49b7-911c-48caa2798b6e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:09.804745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:09.807442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:09.811467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:09.812155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:09.846093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9519bed2-f6e0-4f74-9b7f-df815cab7f4a req-ed42c32a-9fd9-4e5d-90e1-e90e9412a359 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:09.847300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9519bed2-f6e0-4f74-9b7f-df815cab7f4a req-ed42c32a-9fd9-4e5d-90e1-e90e9412a359 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:09.849434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9519bed2-f6e0-4f74-9b7f-df815cab7f4a req-ed42c32a-9fd9-4e5d-90e1-e90e9412a359 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:09.912984 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9519bed2-f6e0-4f74-9b7f-df815cab7f4a req-ed42c32a-9fd9-4e5d-90e1-e90e9412a359 service nova] Creating event network-vif-deleted:01d5a7f5-dc3e-49b7-911c-48caa2798b6e for instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db on n-h1-862355-1 Oct 25 03:42:09.939838 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9519bed2-f6e0-4f74-9b7f-df815cab7f4a req-ed42c32a-9fd9-4e5d-90e1-e90e9412a359 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150104 Oct 25 03:42:09.942966 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3353/6586] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:10.358156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:10.395849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:10.423878 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21d29f7f-f9a9-4e3c-a62a-1df2b64b611c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.658651 Oct 25 03:42:10.441715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3234/6587] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:09 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:10.473900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:10.474592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:10.488772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:10.495374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:10.499166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:10.499926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:10.504164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:10.504679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:10.557878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:10.558825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:10.560380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:10.562226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lazy-loading 'fault' on Instance uuid 8f5e0644-b8c5-47ee-bd42-44b49d3a80db {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:42:10.628959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0031f94e3a74408f91818ab09bae8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71acd87e536048c0a961cf00e88bb477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:10.651184 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca35213b-0219-4ac1-bbde-b2444c568fe2 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 200 len: 1332 microversion: 2.1 time: 0.178951 Oct 25 03:42:10.666556 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3354/6588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:10 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 1332 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:11.461313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:11.462115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:11.470940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:11.481137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:11.481565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:11.482079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:11.482784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:11.483251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:11.483673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:11.687224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:11.692147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:11.692779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:11.709284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:11.709823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:11.710285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:11.711007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:11.711448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:11.711878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:11.717196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:11.744751 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a40d1bfa-5b15-49e1-99a9-f4644aa984e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.288726 Oct 25 03:42:11.746555 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3235/6589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:11 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:11.771238 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db HTTP/1.1 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8f5e0644-b8c5-47ee-bd42-44b49d3a80db'} Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:11.773373 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d5c42683-f774-405e-b1b8-43193a94a769 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 404 len: 111 microversion: 2.1 time: 0.088483 Oct 25 03:42:11.780429 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3355/6590] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:11 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:42:11.790274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f27d5fb2-f58a-4cb0-b143-9e8bacc57c91 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '.version_select at 0x7efd32250e50>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:11.859897 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f27d5fb2-f58a-4cb0-b143-9e8bacc57c91 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056326947" status: 202 len: 0 microversion: 2.1 time: 0.077368 Oct 25 03:42:11.867214 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3236/6591] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056326947 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 25 03:42:12.775235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:12.776968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:12.791684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:12.792199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:12.792625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:12.793341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:12.794719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:12.795365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:13.245192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:13.260172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d21f59a-232b-4744-9173-35f8fab69335 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.487006 Oct 25 03:42:13.278729 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3356/6592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:12 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:14.295625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:14.297346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:14.311838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:14.313520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:14.314196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:14.315464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:14.316229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:14.317969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:14.571140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:14.590738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55596774-f8a7-4fe8-a4c2-04b96d6584a2 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.301187 Oct 25 03:42:14.606585 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3237/6593] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:14 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:15.622232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:15.623713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:15.650787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:15.652598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:15.653586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:15.658974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:15.659703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:15.660184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:15.913354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:15.934697 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73c9b380-27ba-4ed2-8a54-2359a401438b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.316131 Oct 25 03:42:15.935366 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3357/6594] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:15 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:16.961168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:16.961990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:16.977810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:16.980028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:16.980805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:16.981805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:16.982529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:16.983184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:17.189862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:17.199840 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3aff981d-2a04-4c07-afda-cdc666205c38 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.244138 Oct 25 03:42:17.200809 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3238/6595] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:16 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:17.764311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:17.764850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:17.781344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:17.781908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:17.782355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:17.783079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:17.783558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:17.783969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:17.801052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db HTTP/1.1 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8f5e0644-b8c5-47ee-bd42-44b49d3a80db'} Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:17.802957 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.807336 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.809492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:17.810627 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d6d919b-0c36-415a-b815-67f201a82ec6 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 404 len: 111 microversion: 2.1 time: 0.050272 Oct 25 03:42:17.814579 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3358/6596] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:42:17 2022] DELETE /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:42:17.819992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:17.821164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 8f5e0644-b8c5-47ee-bd42-44b49d3a80db] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:17.830270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:17.831146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:17.831821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:17.832631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:17.833179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:17.833921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:17.851626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db HTTP/1.1 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '8f5e0644-b8c5-47ee-bd42-44b49d3a80db'} Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:17.854895 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 8f5e0644-b8c5-47ee-bd42-44b49d3a80db could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91479caa-e859-4afc-897e-0ab655716152 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db" status: 404 len: 111 microversion: 2.1 time: 0.040703 Oct 25 03:42:17.862732 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3239/6597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:17 2022] GET /compute/v2.1/servers/8f5e0644-b8c5-47ee-bd42-44b49d3a80db => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:42:18.226258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:18.227487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:18.240727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:18.242993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:18.244661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:18.247359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:18.248473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:18.250059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:18.553311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:18.564433 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-95bee1ae-96dc-4982-bfb6-16f3b6e626ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.343503 Oct 25 03:42:18.565176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3359/6598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:18 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:19.589840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:19.591644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:19.615031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:19.615549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:19.616013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:19.624584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:19.625197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:19.625672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:19.851137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:19.862090 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a3b3e5d9-7eac-40d9-850e-047c97c6f897 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.277169 Oct 25 03:42:19.862965 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3240/6599] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:19 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:20.888224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:20.889696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:20.898274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:20.899125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:20.899808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:20.901699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:20.902421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:20.903068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:20.938674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:21.070124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:21.080923 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-281fc75d-9ad6-4a45-a816-74c6c370d50a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.197817 Oct 25 03:42:21.083178 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3360/6600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:20 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:22.109809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:22.110845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:22.124831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.126700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.127369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.128923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.129490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.131243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.398689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:22.411485 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f9bb468-9fa2-441e-9887-6221071fdfb6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.306020 Oct 25 03:42:22.428357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3241/6601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:22 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:22.494729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:22.496034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:22.515412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.516257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.516962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.517887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.518290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.518819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.548237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 HTTP/1.1 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '6e9b6f26-1be9-4f8f-8a27-a071354de168'} Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:22.550382 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.555797 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.561860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:22.564188 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-04871648-7e9a-4fb2-b91c-0e4504ba7b5e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 404 len: 111 microversion: 2.1 time: 0.073624 Oct 25 03:42:22.570593 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3361/6602] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:42:22 2022] DELETE /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:42:22.574851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:22.575870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 6e9b6f26-1be9-4f8f-8a27-a071354de168] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:22.586260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.590017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.590629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.598660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.599263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.599844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.630259 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 HTTP/1.1 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '6e9b6f26-1be9-4f8f-8a27-a071354de168'} Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.638092 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 6e9b6f26-1be9-4f8f-8a27-a071354de168 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:22.643642 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa31c66e-8ed0-480f-9289-ebf3763e87b7 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168" status: 404 len: 111 microversion: 2.1 time: 0.069816 Oct 25 03:42:22.649492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:22.651414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:22.658428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.658925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.660118 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3242/6603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:22 2022] GET /compute/v2.1/servers/6e9b6f26-1be9-4f8f-8a27-a071354de168 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:42:22.660897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.662155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.662779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.664663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.686271 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d HTTP/1.1 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '15ab2e52-4220-4274-8fae-b3279cb9495d'} Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:22.688140 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.692905 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.695520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:22.696578 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d675c35c-e4ae-42b4-9cc0-1f2e75413a20 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 404 len: 111 microversion: 2.1 time: 0.051474 Oct 25 03:42:22.705709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:22.706621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: 15ab2e52-4220-4274-8fae-b3279cb9495d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:22.718304 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3362/6604] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:42:22 2022] DELETE /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:42:22.722911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.725588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.726848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.728833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:22.730283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:22.732405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:22.749691 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d HTTP/1.1 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '15ab2e52-4220-4274-8fae-b3279cb9495d'} Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:22.751518 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.755780 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:22.755780 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:22.755780 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:22.755780 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:22.755780 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:22.755780 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. Oct 25 03:42:22.755780 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:22.760468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance 15ab2e52-4220-4274-8fae-b3279cb9495d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:22.763866 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc0801ed-6aeb-420c-90c8-296d2510d480 tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d" status: 404 len: 111 microversion: 2.1 time: 0.060231 Oct 25 03:42:22.783128 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3243/6605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:22 2022] GET /compute/v2.1/servers/15ab2e52-4220-4274-8fae-b3279cb9495d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:42:23.438273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:23.439215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:23.445698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:23.446478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:23.447675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:23.448676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:23.449354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:23.449999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:23.613129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:23.622589 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8de42533-47ea-4460-9ee2-708d8140ddd4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.188083 Oct 25 03:42:23.623548 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3363/6606] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:23 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:24.649107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:24.651597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:24.660706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:24.662294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:24.663161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:24.664419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:24.665250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:24.666371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:24.874649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:24.885916 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce95278a-44aa-4a1d-8b68-caebdf077c23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.241864 Oct 25 03:42:24.886683 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3244/6607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:24 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:25.920256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:25.921657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:25.931426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=61 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:25.933745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:25.934416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:25.935089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:25.935893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:25.936482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:25.937173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:26.115804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:26.127526 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80c96c2b-6e2c-431c-ae98-1898b2852038 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1341 microversion: 2.1 time: 0.212406 Oct 25 03:42:26.128214 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3364/6608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:25 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1341 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:42:27.153656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:27.154394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:27.161893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:27.162519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:27.162945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:27.163677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:27.164281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:27.164677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:27.328063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:27.339218 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f10dda2-209d-4032-9d16-048448c9a41e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.189221 Oct 25 03:42:27.339218 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3245/6609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:27 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:27.354439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:27.355798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:27.364465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:27.364924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:27.365477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:27.366376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:27.367094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:27.367663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:27.388503 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 HTTP/1.1 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'fc02d7c8-0307-47e9-9acd-0bb9cd64cb39'} Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:27.390530 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.395975 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.397260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:27.398755 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3378abb8-2a4d-4c89-a0e2-3e9392954bdf tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 404 len: 111 microversion: 2.1 time: 0.050739 Oct 25 03:42:27.399568 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3365/6610] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:42:27 2022] DELETE /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:42:27.408670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:27.409311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] [instance: fc02d7c8-0307-47e9-9acd-0bb9cd64cb39] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:27.411240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:27.419238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:27.420044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:27.420732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:27.421808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:27.422469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:27.423303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:27.443778 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] HTTP exception thrown: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Request method failure captured: Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 HTTP/1.1 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1mtl_tzYiUDhHDQdVH9JThUqxJ5PhY0z_WSNJiSyiFyVLw1QYVVDNB0a67AKlm2TgdOSVe61okEI8VwYk5pbk4bzRus7b4m4Zt5cwgdXs0zvDGNpR8ptHVtCwHZkSMC13wXaWHWRzZX6LXV95fRkUdUdFVfRdWt8Qo2ClqUtF1__Rw Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/71acd87e536048c0a961cf00e88bb477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_71acd87e536048c0a961cf00e88bb477", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/71acd87e536048c0a961cf00e88bb477"}]}] Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 71acd87e536048c0a961cf00e88bb477 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-324328091 Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 0031f94e3a74408f91818ab09bae8b6b Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-AttachVolumeNegativeTest-324328091-project Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'fc02d7c8-0307-47e9-9acd-0bb9cd64cb39'} Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:27.445693 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] Returning 404 to user: Instance fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:27.452343 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd007b47-5024-48dc-b04b-8eb17d60c29e tempest-AttachVolumeNegativeTest-324328091 tempest-AttachVolumeNegativeTest-324328091-project] 10.222.0.36 "GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39" status: 404 len: 111 microversion: 2.1 time: 0.045418 Oct 25 03:42:27.453828 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3246/6611] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:27 2022] GET /compute/v2.1/servers/fc02d7c8-0307-47e9-9acd-0bb9cd64cb39 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:42:28.366428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:28.368167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:28.376540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:28.377571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:28.378238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:28.378961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:28.379533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:28.379976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:28.932861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:28.941890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8981e6ae-9cb5-493e-b134-54d7d3707077 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.580468 Oct 25 03:42:28.943352 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3366/6612] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:28 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:42:29.968609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:29.969501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:29.994436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:29.995721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:29.998559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:30.000266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:30.003092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:30.003710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:30.334595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:30.346159 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a12808f-d386-4d38-860b-4a41991fbaae tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.382473 Oct 25 03:42:30.347389 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3247/6613] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:29 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:31.372311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:31.373056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:31.382720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:31.383588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:31.385759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:31.387598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:31.391412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:31.391881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:31.592263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:31.605333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b09dcc3-02cc-4869-a869-c51b8b1c54ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.237207 Oct 25 03:42:31.606549 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3367/6614] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:31 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:32.095057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c5e177b5-974a-49fe-8f22-1611f8a0894e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: .version_select at 0x7efd3b81ec10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-291329036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjktsV/EUfXwEnKwbDCIMbg1QvJTHaMYCmYoM98qcH6VBzE8GxM2V99mYGz3ZvVP8i1x1N5loBi80vyLg9DZmWAG8UNMxogJw/vT9uKgH9odUt+pLNr3indIJxvI06XHw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:32.112052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c5e177b5-974a-49fe-8f22-1611f8a0894e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:42:32.119239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-c5e177b5-974a-49fe-8f22-1611f8a0894e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:42:32.145771 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c5e177b5-974a-49fe-8f22-1611f8a0894e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.243609 Oct 25 03:42:32.146154 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3248/6615] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:42:31 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:32.631113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:32.632549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:32.642492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:32.643219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:32.643727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:32.644434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:32.644889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:32.645445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:32.813531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:32.826551 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6efb5363-78aa-4337-887d-9749ccc83e23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.200143 Oct 25 03:42:32.827418 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3368/6616] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:32 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:33.852621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:33.854104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:33.860652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:33.861114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:33.861649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:33.862512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:33.862985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:33.863618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:34.037180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:34.047298 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07b3ed52-18ba-40d5-99bc-6b6a00ccc729 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.199634 Oct 25 03:42:34.048180 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3249/6617] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:33 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:34.762073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56fc9896-0543-48ce-838d-178b09b644ab tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd329f0ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:34.812154 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56fc9896-0543-48ce-838d-178b09b644ab tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b1720fc0-8889-427e-be7b-7d0c16ae9a53" status: 200 len: 350 microversion: 2.1 time: 0.054045 Oct 25 03:42:34.812747 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3369/6618] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:42:34 2022] GET /compute/v2.1/os-volumes/b1720fc0-8889-427e-be7b-7d0c16ae9a53 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:35.084196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:35.085343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:35.096502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:35.097562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:35.098271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:35.100005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:35.100584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:35.101264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:35.301786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:35.343910 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2293612-3999-41aa-b5ff-b42dd1b33d86 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.274054 Oct 25 03:42:35.344599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3250/6619] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:35 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:36.369209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:36.369966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:36.384829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:36.385383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:36.385895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:36.386672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:36.387204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:36.387892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:36.565861 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:36.578267 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-58d50ecd-1465-4ffd-9e13-00b1fe75b382 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.213878 Oct 25 03:42:36.579708 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3370/6620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:36 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:37.366530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e25d472-1681-488a-98c3-58ea0e6afbba tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd32f098b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:37.499560 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e25d472-1681-488a-98c3-58ea0e6afbba tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/62735999-5a69-48e2-afcd-a9146dd58762" status: 200 len: 351 microversion: 2.1 time: 0.142195 Oct 25 03:42:37.508251 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3251/6621] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:42:37 2022] GET /compute/v2.1/os-volumes/62735999-5a69-48e2-afcd-a9146dd58762 => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:37.605020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:37.606374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:37.627166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:37.628157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:37.628984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:37.630130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:37.631019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:37.636882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:37.639339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b1b91c88-9779-4cc6-bea0-945a233356ac req-694b2055-bfd3-4e66-9450-0ce726e0e371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af6997d-81a5-435f-8db2-fa9dad586109", "name": "network-vif-plugged", "status": "completed", "tag": "b4e849a2-f9bd-4abd-b66c-bdac960ee659"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:37.651732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b1b91c88-9779-4cc6-bea0-945a233356ac req-694b2055-bfd3-4e66-9450-0ce726e0e371 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:37.652321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b1b91c88-9779-4cc6-bea0-945a233356ac req-694b2055-bfd3-4e66-9450-0ce726e0e371 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:37.652965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b1b91c88-9779-4cc6-bea0-945a233356ac req-694b2055-bfd3-4e66-9450-0ce726e0e371 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:37.682848 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b1b91c88-9779-4cc6-bea0-945a233356ac req-694b2055-bfd3-4e66-9450-0ce726e0e371 service nova] Creating event network-vif-plugged:b4e849a2-f9bd-4abd-b66c-bdac960ee659 for instance 5af6997d-81a5-435f-8db2-fa9dad586109 on n-h2-862355-1 Oct 25 03:42:37.705898 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b1b91c88-9779-4cc6-bea0-945a233356ac req-694b2055-bfd3-4e66-9450-0ce726e0e371 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330130 Oct 25 03:42:37.707517 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3371/6622] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:42:37.954560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:37.966519 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e7d3e1c6-fdfe-454c-a7b2-3fa57ea06c00 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.365965 Oct 25 03:42:37.969218 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3252/6623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:37 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:38.996192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:38.996912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:39.009757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:39.010266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:39.010710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:39.011435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:39.033915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:39.034759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:39.315416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:39.331303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55b22e8f-61f9-4702-b781-799ffaa75120 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1375 microversion: 2.1 time: 0.340975 Oct 25 03:42:39.332445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3372/6624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:38 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1375 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:39.728017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1186923677", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "f7eb9b53-55e4-48bb-a838-23b570f970b8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-291329036", "security_groups": [{"name": "tempest-secgroup-smoke-1858677751"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:39.853714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] validate_networks() for [('f7eb9b53-55e4-48bb-a838-23b570f970b8', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:42:40.193549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-df99fe3b-9fdb-485f-956a-94b4c97c51a9 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd329f0a60>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.258768 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-df99fe3b-9fdb-485f-956a-94b4c97c51a9 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/86d9ae6f-846e-4774-a8bf-b6ff8afccd4a" status: 200 len: 351 microversion: 2.1 time: 0.068481 Oct 25 03:42:40.261820 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3373/6625] 10.222.0.36 () {58 vars in 1245 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/os-volumes/86d9ae6f-846e-4774-a8bf-b6ff8afccd4a => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:40.273950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73c5f18e-7631-4066-92f7-e564a509469a tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd3814ec10>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.280764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:42:40.281391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:42:40.282020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:42:40.282633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:42:40.283218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:42:40.294412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.295048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.295637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.296448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.297324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.297935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.305665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=88 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:40.320313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:42:40.329619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:42:40.343241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:42:40.347199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:42:40.371267 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73c5f18e-7631-4066-92f7-e564a509469a tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100959 Oct 25 03:42:40.372092 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3374/6626] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:40.377030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.377657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:40.386971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.387471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.387937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.388662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.389106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.389546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.440856 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93785fdf-f37a-4d8a-b17d-21ef1b9dc70e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713864 Oct 25 03:42:40.442400 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3253/6627] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:42:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:42:40.453954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3fa223b7-fba1-4a1c-8e6f-2835ad311daa tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd301bcca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.569983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:40.583140 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-20cf6998-bd8f-453d-acd0-26bbf14169a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1561 microversion: 2.1 time: 0.209654 Oct 25 03:42:40.585135 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3375/6628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1561 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:40.594395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2762653b-d39c-4119-9a33-22666ff80b47 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.595134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2762653b-d39c-4119-9a33-22666ff80b47 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:40.614043 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3fa223b7-fba1-4a1c-8e6f-2835ad311daa tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.169958 Oct 25 03:42:40.615118 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3254/6629] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:40.622995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.625223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:40.644531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.645400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.646606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.647567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.648298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.648953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.671733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2762653b-d39c-4119-9a33-22666ff80b47 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:40.680252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2762653b-d39c-4119-9a33-22666ff80b47 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1266 microversion: 2.1 time: 0.093799 Oct 25 03:42:40.695248 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3376/6630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:40.703152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9bb5d5b0-3cb7-4337-8926-2a9f1ed096b9 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd3814ed30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.805244 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9bb5d5b0-3cb7-4337-8926-2a9f1ed096b9 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.108652 Oct 25 03:42:40.809776 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3377/6631] 10.222.0.36 () {58 vars in 1134 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:40.820992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:40.823428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-716e0de9-2cb3-4ec0-80cc-31051036a60d tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd336100d0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.831641 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2dfa20b-01d8-4bf0-a61f-b7dcdc44626b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1561 microversion: 2.1 time: 0.214671 Oct 25 03:42:40.832834 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3255/6632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:40.937105 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-716e0de9-2cb3-4ec0-80cc-31051036a60d tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.120084 Oct 25 03:42:40.937714 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3378/6633] 10.222.0.36 () {58 vars in 1167 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:40.944436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.945066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:40.951119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da8c68a9-3578-49cc-af40-034b218c02d6 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd31fe5550>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:40.954894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.955532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.955991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.956704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:40.957170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:40.957606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:40.992857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:42:41.060265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da8c68a9-3578-49cc-af40-034b218c02d6 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.112860 Oct 25 03:42:41.061046 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3379/6634] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Oct 25 03:42:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:42:41.078441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dc4014ee-13c7-494f-adfe-09d12219fef4 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd33610ee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:41.105706 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b6d6efa6-1ca1-496a-82d5-6de4f1505e85 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 204 len: 0 microversion: 2.1 time: 0.164566 Oct 25 03:42:41.106629 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3256/6635] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:42:40 2022] DELETE /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:42:41.116875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:41.117632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:41.125626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:41.126311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:41.126764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:41.127489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:41.128022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:41.128452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:41.197278 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dc4014ee-13c7-494f-adfe-09d12219fef4 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.123898 Oct 25 03:42:41.198472 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3380/6636] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:42:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:42:41.213955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f31d8312-f2a6-43f3-b519-a344f8b116a2 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd32d4bee0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:41.327805 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f31d8312-f2a6-43f3-b519-a344f8b116a2 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.119165 Oct 25 03:42:41.328715 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3381/6637] 10.222.0.36 () {58 vars in 1188 bytes} [Tue Oct 25 03:42:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:41.336697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:41.343600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-25b49748-9a9e-4d08-9aa2-050541451b33 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] Calling method '.version_select at 0x7efd329f0820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:41.345530 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a8f30d56-50e5-4bdb-bc41-2f68e0c9c64b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1567 microversion: 2.1 time: 0.234459 Oct 25 03:42:41.346375 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3257/6638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:41 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:41.445575 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-25b49748-9a9e-4d08-9aa2-050541451b33 tempest-VolumesTestJSON-2047418349 tempest-VolumesTestJSON-2047418349-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.105725 Oct 25 03:42:41.449783 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3382/6639] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Oct 25 03:42:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:41.715324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:41.722583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:41.732301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:41.733776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:41.734300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:41.735092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:41.735648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:41.736152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:41.820768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:41.831380 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b7025cbc-9619-45af-9046-1c6fbc7252af tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1318 microversion: 2.1 time: 0.124347 Oct 25 03:42:41.832178 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3258/6640] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:41 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:42.372862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:42.373364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:42.384860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:42.385453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:42.385953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:42.386693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:42.388144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:42.388592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:42.618280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:42.628584 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8b74674-1869-4278-bcfc-6b84e9a8a964 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1567 microversion: 2.1 time: 0.262785 Oct 25 03:42:42.644205 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3383/6641] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:42 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:42.857882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:42.858977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:42.866286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:42.867165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:42.867858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:42.870497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:42.871168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:42.873079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:43.174292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:43.186689 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3aebf8f8-a71c-4634-9af8-fdbc8411e6b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1392 microversion: 2.1 time: 0.333039 Oct 25 03:42:43.202421 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3259/6642] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:42 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1392 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:43.508658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2fd0ac8a-7e7f-4329-b0ee-aee288ea5a2e req-e7075235-66eb-4398-b9e9-9d1237a48c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af6997d-81a5-435f-8db2-fa9dad586109", "name": "network-vif-deleted", "tag": "b4e849a2-f9bd-4abd-b66c-bdac960ee659"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:43.537932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2fd0ac8a-7e7f-4329-b0ee-aee288ea5a2e req-e7075235-66eb-4398-b9e9-9d1237a48c05 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:43.539557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2fd0ac8a-7e7f-4329-b0ee-aee288ea5a2e req-e7075235-66eb-4398-b9e9-9d1237a48c05 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:43.541242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2fd0ac8a-7e7f-4329-b0ee-aee288ea5a2e req-e7075235-66eb-4398-b9e9-9d1237a48c05 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:43.570222 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2fd0ac8a-7e7f-4329-b0ee-aee288ea5a2e req-e7075235-66eb-4398-b9e9-9d1237a48c05 service nova] Creating event network-vif-deleted:b4e849a2-f9bd-4abd-b66c-bdac960ee659 for instance 5af6997d-81a5-435f-8db2-fa9dad586109 on n-h2-862355-1 Oct 25 03:42:43.586261 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2fd0ac8a-7e7f-4329-b0ee-aee288ea5a2e req-e7075235-66eb-4398-b9e9-9d1237a48c05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090092 Oct 25 03:42:43.586946 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3384/6643] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:43.662171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:43.663077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:43.671543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:43.672473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:43.673163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:43.674654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:43.675730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:43.677957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:43.843077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:43.853336 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42cb7570-38ea-4d84-859a-dd66754bf24e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1360 microversion: 2.1 time: 0.196622 Oct 25 03:42:43.854567 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3260/6644] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:43 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1360 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:44.186557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9b6da459-36d3-4da0-bfd0-29d9bdebe89b req-87860241-fe88-4cc4-bfbb-8631e84e25da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:44.199722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9b6da459-36d3-4da0-bfd0-29d9bdebe89b req-87860241-fe88-4cc4-bfbb-8631e84e25da service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:44.201586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9b6da459-36d3-4da0-bfd0-29d9bdebe89b req-87860241-fe88-4cc4-bfbb-8631e84e25da service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:44.202135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9b6da459-36d3-4da0-bfd0-29d9bdebe89b req-87860241-fe88-4cc4-bfbb-8631e84e25da service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:44.211402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:44.212144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:44.218798 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9b6da459-36d3-4da0-bfd0-29d9bdebe89b req-87860241-fe88-4cc4-bfbb-8631e84e25da service nova] Creating event network-changed:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h1-862355-1 Oct 25 03:42:44.222406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:44.223110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:44.223766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:44.224905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:44.225844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:44.226528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:44.228919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9b6da459-36d3-4da0-bfd0-29d9bdebe89b req-87860241-fe88-4cc4-bfbb-8631e84e25da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047636 Oct 25 03:42:44.230208 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3385/6645] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:44.508122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:44.522885 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7017d159-4d4b-408b-97e4-5f1dd046336d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1392 microversion: 2.1 time: 0.315444 Oct 25 03:42:44.523506 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3261/6646] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:44 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1392 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:42:44.877069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:44.877876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:44.886334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:44.887084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:44.887749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:44.888718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:44.889348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:44.889977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:44.971256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:44.983505 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9a4e8552-82e7-49b4-9bae-49adcace419b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1360 microversion: 2.1 time: 0.110616 Oct 25 03:42:44.984544 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3386/6647] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:44 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1360 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:45.546730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:45.547372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:45.555308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:45.555844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:45.556840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:45.557559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:45.558186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:45.558646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:45.709412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:45.725536 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b282f0a-6827-47da-8a98-19ae0ef54719 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1392 microversion: 2.1 time: 0.181311 Oct 25 03:42:45.727519 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3262/6648] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:45 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:46.008436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:46.010075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:46.023598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:46.024108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:46.025249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:46.026526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:46.027194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:46.027891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:46.103552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:46.112121 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c4570f6-954d-4658-9de1-30241e351e2e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1360 microversion: 2.1 time: 0.107603 Oct 25 03:42:46.112714 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3387/6649] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:46 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1360 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:46.751580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:46.753018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:46.765037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:46.765892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:46.766607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:46.767910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:46.768545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:46.769146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:46.938569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:46.948561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bae20203-f125-451f-b6ac-da629e9e2d2f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1392 microversion: 2.1 time: 0.201102 Oct 25 03:42:46.949435 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3263/6650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:46 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:47.137467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:47.138728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:47.146167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:47.146708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:47.147221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:47.147935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:47.148401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:47.148843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:47.240507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:47.251336 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1f13d49-80ee-46de-ac6f-c72da0b09557 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1360 microversion: 2.1 time: 0.118815 Oct 25 03:42:47.252138 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3388/6651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:47 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1360 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:47.983164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:47.986850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:47.997795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:47.998698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:47.999382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:48.001129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:48.002532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:48.003187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:48.255692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:48.266681 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9249b9cf-d4c7-4488-8339-366d80169104 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1392 microversion: 2.1 time: 0.296928 Oct 25 03:42:48.270127 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3264/6652] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:47 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:48.280788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:48.282064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:48.293003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:48.298346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:48.299055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:48.300878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:48.301513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:48.302154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:48.455094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:48.468341 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a6eb805e-0903-48f1-9278-e23cac6637a9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 200 len: 1360 microversion: 2.1 time: 0.191606 Oct 25 03:42:48.469495 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3389/6653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:48 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 1360 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:49.303118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:49.304646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:49.312364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:49.313207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:49.313943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:49.315112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:49.315962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:49.316633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:49.497237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:49.499279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:49.519776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:49.521381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:49.525865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:49.528601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:49.532687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:49.533637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:49.579889 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 HTTP/1.1 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5af6997d-81a5-435f-8db2-fa9dad586109'} Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:42:49.597223 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:49.604194 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:42:49.604194 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:42:49.604194 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:42:49.604194 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:42:49.604194 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:42:49.604194 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:42:49.604194 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:42:49.605215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:42:49.609568 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1cf05978-0803-4601-9312-e6d89623b31f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 404 len: 111 microversion: 2.1 time: 0.117815 Oct 25 03:42:49.612084 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3390/6654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:49 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:42:49.846038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-fa608462-f8a0-4a58-ba7c-f3b5ccff4974 req-028a694f-971a-48f9-bd85-4b15f0e4f245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "name": "network-vif-plugged", "status": "completed", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:49.866376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fa608462-f8a0-4a58-ba7c-f3b5ccff4974 req-028a694f-971a-48f9-bd85-4b15f0e4f245 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:49.870279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fa608462-f8a0-4a58-ba7c-f3b5ccff4974 req-028a694f-971a-48f9-bd85-4b15f0e4f245 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:49.871178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fa608462-f8a0-4a58-ba7c-f3b5ccff4974 req-028a694f-971a-48f9-bd85-4b15f0e4f245 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:49.903963 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-fa608462-f8a0-4a58-ba7c-f3b5ccff4974 req-028a694f-971a-48f9-bd85-4b15f0e4f245 service nova] Creating event network-vif-plugged:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h1-862355-1 Oct 25 03:42:49.918277 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-fa608462-f8a0-4a58-ba7c-f3b5ccff4974 req-028a694f-971a-48f9-bd85-4b15f0e4f245 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076830 Oct 25 03:42:49.920689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:49.920950 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3391/6655] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:42:49.931130 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a28e50b-568a-447e-9f00-6b08ac2c677d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1392 microversion: 2.1 time: 0.631685 Oct 25 03:42:49.931869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3265/6656] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:49 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1392 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:50.958472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:50.959373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:50.963492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:50.971805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:50.972520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:50.973125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:50.974174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:50.975313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:50.976579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:50.981266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:51.154754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:51.164180 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a1adb29d-569a-414a-af16-4eaee5d691d2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1392 microversion: 2.1 time: 0.210318 Oct 25 03:42:51.164920 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3392/6657] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:50 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:52.191266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:52.191903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:52.194188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:52.195868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:52.202765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:52.203415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:52.203996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:52.204895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:52.205427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:52.205971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:52.372620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:52.382959 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9a13af6-a469-4842-9417-9545b81b5f62 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1565 microversion: 2.1 time: 0.194595 Oct 25 03:42:52.384387 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3266/6658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:52 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1565 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:52.408576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:52.409882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:52.418509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:52.419905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:52.420461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:52.421410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:52.422007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:52.422583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:52.575941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:52.584056 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-482ec694-6754-4480-8e2f-7b9b5365c2b1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1565 microversion: 2.1 time: 0.179847 Oct 25 03:42:52.584660 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3393/6659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:52 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:55.143133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:55.143908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:55.151518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:55.152150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:55.152794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:55.153968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:55.154495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:55.155155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:55.182936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:42:55.281380 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-272bc306-d2b8-4e8a-b016-764dd0c52c06 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 204 len: 0 microversion: 2.1 time: 0.141520 Oct 25 03:42:55.282002 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3267/6660] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:42:55 2022] DELETE /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:42:55.291070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:55.291606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:55.299184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:55.300105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:55.300972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:55.301930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:55.302768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:55.304115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:55.374577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:55.375308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:55.384432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:55.385233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:55.386094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:55.387038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:55.387795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:55.388529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:55.396063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:55.465311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:55.476440 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-464ae0f0-5c46-4a5a-909b-7996154b375b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1410 microversion: 2.1 time: 0.189961 Oct 25 03:42:55.477406 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3394/6661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:55 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1410 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:42:55.582304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:55.591709 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3270c56-e81a-472a-bc2e-e8a1c462ab09 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1565 microversion: 2.1 time: 0.222937 Oct 25 03:42:55.599953 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3268/6662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:55 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1565 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:55.759840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-52ea6445-12b4-45b5-9dcd-71e7cbb5fb9e req-3dd4722f-ffda-417d-9f3c-0773fec46459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:55.769767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52ea6445-12b4-45b5-9dcd-71e7cbb5fb9e req-3dd4722f-ffda-417d-9f3c-0773fec46459 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:55.770479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52ea6445-12b4-45b5-9dcd-71e7cbb5fb9e req-3dd4722f-ffda-417d-9f3c-0773fec46459 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:55.770920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-52ea6445-12b4-45b5-9dcd-71e7cbb5fb9e req-3dd4722f-ffda-417d-9f3c-0773fec46459 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:55.782528 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-52ea6445-12b4-45b5-9dcd-71e7cbb5fb9e req-3dd4722f-ffda-417d-9f3c-0773fec46459 service nova] Creating event network-changed:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h1-862355-1 Oct 25 03:42:55.787628 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-52ea6445-12b4-45b5-9dcd-71e7cbb5fb9e req-3dd4722f-ffda-417d-9f3c-0773fec46459 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308345 Oct 25 03:42:55.788421 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3395/6663] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:56.505479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:56.507298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:56.515233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:56.515828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:56.516332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:56.517067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:56.517775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:56.518230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:56.741656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:56.750858 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e13a48e-2f84-4268-aab5-3287ec473be9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1410 microversion: 2.1 time: 0.250027 Oct 25 03:42:56.751445 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3269/6664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:56 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1410 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:57.776439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:57.778315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:57.785526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=48 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:42:57.788511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:57.789265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:57.789864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:57.791036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:57.791612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:57.792419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:57.802941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-108782f0-8361-4645-afe2-726296aa083f req-2373bcd6-0195-49bf-9156-946c2c4e2830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9264f0f9-a5af-4783-9fab-387d26d12d4b", "name": "network-vif-deleted", "tag": "efc7db8e-4cf6-4b7a-85f7-2dea71646762"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:42:57.825418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-108782f0-8361-4645-afe2-726296aa083f req-2373bcd6-0195-49bf-9156-946c2c4e2830 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:57.826544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-108782f0-8361-4645-afe2-726296aa083f req-2373bcd6-0195-49bf-9156-946c2c4e2830 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:57.827339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-108782f0-8361-4645-afe2-726296aa083f req-2373bcd6-0195-49bf-9156-946c2c4e2830 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:57.845914 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-108782f0-8361-4645-afe2-726296aa083f req-2373bcd6-0195-49bf-9156-946c2c4e2830 service nova] Creating event network-vif-deleted:efc7db8e-4cf6-4b7a-85f7-2dea71646762 for instance 9264f0f9-a5af-4783-9fab-387d26d12d4b on n-h1-862355-1 Oct 25 03:42:57.850947 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-108782f0-8361-4645-afe2-726296aa083f req-2373bcd6-0195-49bf-9156-946c2c4e2830 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052876 Oct 25 03:42:57.852183 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3270/6665] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:42:57.868644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:57.877235 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bda50b56-6506-48e0-afdf-cdada95a8fa5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1202 microversion: 2.1 time: 0.106460 Oct 25 03:42:57.893671 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3396/6666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:57 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:42:58.901382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:42:58.902196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:42:58.909849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:58.910442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:58.910910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:58.911854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:42:58.912423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:42:58.912779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:42:58.985210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:42:58.994630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c2eb963-80c4-44bb-b466-0eee549583bf tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1202 microversion: 2.1 time: 0.097864 Oct 25 03:42:58.995240 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3271/6667] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:42:58 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:00.020801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:00.021882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:00.032835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:00.040522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:00.040988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:00.042176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:00.042953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:00.048348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:00.130685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:00.140420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f040da11-cb88-4aad-aeeb-1a6a85189a54 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1202 microversion: 2.1 time: 0.123357 Oct 25 03:43:00.141030 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3397/6668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:00 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1202 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:01.164448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:01.165247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:01.168314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:01.174275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:01.174698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:01.175537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:01.176248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:01.176904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:01.177513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:01.252214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:01.262084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8d115034-357b-4d29-8624-1eaf72a3ae23 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1202 microversion: 2.1 time: 0.101520 Oct 25 03:43:01.262763 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3272/6669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:01 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1202 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:02.286591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:02.287333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:02.294772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:02.295351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:02.295865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:02.296715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:02.297249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:02.297877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:02.334610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:02.335196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:02.335969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:02.336502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lazy-loading 'fault' on Instance uuid 9264f0f9-a5af-4783-9fab-387d26d12d4b {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:43:02.385561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:02.396541 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4a784800-c121-48f6-9232-2ba7b93c4cea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 200 len: 1207 microversion: 2.1 time: 0.114473 Oct 25 03:43:02.397525 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3398/6670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:02 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 1207 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:03.420393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:03.420934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:03.428465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:03.428963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:03.429415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:03.430175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:03.431145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:03.431821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:03.445844 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b HTTP/1.1 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9264f0f9-a5af-4783-9fab-387d26d12d4b'} Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:03.448396 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ed72fec-0690-4f70-b93a-5979b4964dfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 404 len: 111 microversion: 2.1 time: 0.033489 Oct 25 03:43:03.454002 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3273/6671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:03 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:43:05.606182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:05.607532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:05.616109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:05.616832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:05.617580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:05.621145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:05.621710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:05.622368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:05.640181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 HTTP/1.1 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5af6997d-81a5-435f-8db2-fa9dad586109'} Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:43:05.641918 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.646507 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.650671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:43:05.651615 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ead4d78-ce09-43a4-9187-7d437720e875 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 404 len: 111 microversion: 2.1 time: 0.050280 Oct 25 03:43:05.652136 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3399/6672] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:43:05 2022] DELETE /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:43:05.660939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:05.661705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 5af6997d-81a5-435f-8db2-fa9dad586109] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:05.669279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:05.669896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:05.670420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:05.671258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:05.671862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:05.672386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:05.687069 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 HTTP/1.1 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '5af6997d-81a5-435f-8db2-fa9dad586109'} Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:05.688833 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 5af6997d-81a5-435f-8db2-fa9dad586109 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb2c4ef2-fd40-4cb6-8a46-0af0d418cdc3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109" status: 404 len: 111 microversion: 2.1 time: 0.033281 Oct 25 03:43:05.697060 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3274/6673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:05 2022] GET /compute/v2.1/servers/5af6997d-81a5-435f-8db2-fa9dad586109 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:43:06.431004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:06.431004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:06.434202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:06.434693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:06.435135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:06.435840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:06.436302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:06.436732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:06.451404 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b HTTP/1.1 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9264f0f9-a5af-4783-9fab-387d26d12d4b'} Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:43:06.452977 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91149e4b-dea9-4c6f-b770-a4555c118144 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 404 len: 111 microversion: 2.1 time: 0.032222 Oct 25 03:43:06.458870 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3400/6674] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:43:06 2022] DELETE /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:43:06.463168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:06.463794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 9264f0f9-a5af-4783-9fab-387d26d12d4b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:06.469720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:06.470228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:06.470684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:06.471395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:06.471869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:06.472312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:06.486415 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b HTTP/1.1 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9264f0f9-a5af-4783-9fab-387d26d12d4b'} Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:43:06.487959 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 9264f0f9-a5af-4783-9fab-387d26d12d4b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7d5804a0-e894-40ed-ab4c-39f9e21d8b33 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b" status: 404 len: 111 microversion: 2.1 time: 0.030126 Oct 25 03:43:06.496509 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3275/6675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:06 2022] GET /compute/v2.1/servers/9264f0f9-a5af-4783-9fab-387d26d12d4b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:43:06.567825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c34a48eb-b9f9-498c-81e9-f9f5b714318d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: .version_select at 0x7efd3814ed30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-303901269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9MXpIzbNU9yXojgASDd7DVy0NW4C4BnRoC+PmHJi1fvyXlnWe5HqfnnNSQjThy3W+yHMDFZoPPb8TY3ppeQ4taeRkBczyiLgooDklx29SshKWvY+4+kWpLjYIRiwevhQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:06.584102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c34a48eb-b9f9-498c-81e9-f9f5b714318d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:43:06.590477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c34a48eb-b9f9-498c-81e9-f9f5b714318d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:43:06.617169 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c34a48eb-b9f9-498c-81e9-f9f5b714318d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053176 Oct 25 03:43:06.624555 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3401/6676] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:43:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:43:16.881164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:16.884586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:16.891660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:16.892390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=31 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:16.893909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:16.894548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:16.895224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:16.896228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:16.897514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:16.898156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:16.967268 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b25c521-47bb-4fb0-85d5-94cb78614743 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action" status: 200 len: 24572 microversion: 2.1 time: 0.090993 Oct 25 03:43:16.968340 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3276/6677] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:43:16 2022] POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action => generated 24572 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:43:24.561290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=43 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:24.562206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:24.563515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:24.570176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1476086567", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-303901269", "security_groups": [{"name": "tempest-secgroup-smoke-1413309307"}], "block_device_mapping_v2": [{"uuid": "2b4bf2b6-6beb-454f-bd08-c6e2dcf03c80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:24.707775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:43:25.106974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:43:25.107387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:43:25.107899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:43:25.108486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:43:25.108950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:43:25.118431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:25.119201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:25.119640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:25.121022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:25.121022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:25.121499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:25.142404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:43:25.148002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:43:25.210489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:43:25.213272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b4bf2b6-6beb-454f-bd08-c6e2dcf03c80',volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:43:25.375353 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b8150f0a-4b48-4396-a2fd-0bc745f4f29d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.815683 Oct 25 03:43:25.376190 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3402/6678] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:43:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:43:25.388108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e8cd92b-f544-4f3e-8619-49ba7cf920d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:25.388825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e8cd92b-f544-4f3e-8619-49ba7cf920d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:25.460872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e8cd92b-f544-4f3e-8619-49ba7cf920d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:25.470354 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e8cd92b-f544-4f3e-8619-49ba7cf920d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1094 microversion: 2.1 time: 0.086324 Oct 25 03:43:25.470812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3277/6679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:25 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:26.494664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:26.495820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:26.503927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:26.504418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:26.504892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:26.505595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:26.506076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:26.506535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:26.598982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:26.611013 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d179b6f4-81d8-4c95-b0df-8dec3b14d7a3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1210 microversion: 2.1 time: 0.122130 Oct 25 03:43:26.611841 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3403/6680] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:26 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:27.635374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:27.635996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:27.638997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:27.645280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:27.647278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:27.647810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:27.648787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:27.650277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:27.651006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:27.851699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:27.860103 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a76a1ff2-aec6-486b-a03a-9c521b3dc9d4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1278 microversion: 2.1 time: 0.229145 Oct 25 03:43:27.874479 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3278/6681] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:27 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:28.016139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:28.016738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:28.031475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:28.032461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:28.033093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:28.043533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:28.044747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:28.044892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-225d263c-80a5-4a71-9aee-995fc7c8a302 req-1d54bc47-8abc-46d9-aa4d-ed0f6bb1a5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cbc6447-7752-4831-b6b0-738226465f0b", "tag": "86253737-116f-4056-b7f2-5602eb5e4959"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:28.046461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:28.069791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-225d263c-80a5-4a71-9aee-995fc7c8a302 req-1d54bc47-8abc-46d9-aa4d-ed0f6bb1a5fc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:28.070477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-225d263c-80a5-4a71-9aee-995fc7c8a302 req-1d54bc47-8abc-46d9-aa4d-ed0f6bb1a5fc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:28.071032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-225d263c-80a5-4a71-9aee-995fc7c8a302 req-1d54bc47-8abc-46d9-aa4d-ed0f6bb1a5fc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:28.090721 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-225d263c-80a5-4a71-9aee-995fc7c8a302 req-1d54bc47-8abc-46d9-aa4d-ed0f6bb1a5fc service nova] Creating event network-changed:86253737-116f-4056-b7f2-5602eb5e4959 for instance 8cbc6447-7752-4831-b6b0-738226465f0b on n-h2-862355-1 Oct 25 03:43:28.104895 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-225d263c-80a5-4a71-9aee-995fc7c8a302 req-1d54bc47-8abc-46d9-aa4d-ed0f6bb1a5fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065454 Oct 25 03:43:28.106346 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3279/6682] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:43:28.585658 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aeec4763-bf77-40bb-96dd-9095734177eb tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1835 microversion: 2.1 time: 0.573678 Oct 25 03:43:28.594875 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3404/6683] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:28 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1835 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:28.612960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:28.613704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:28.621948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:28.622486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:28.622940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:28.624017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:28.624662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:28.625278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:28.851340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:28.859987 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-68686666-2cd4-46e5-8fc4-c3364cfa6da3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1684 microversion: 2.1 time: 0.251254 Oct 25 03:43:28.860687 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3280/6684] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:28 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1684 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:28.887515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:28.889309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:28.900470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:28.901114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:28.901763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:28.902925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:28.903490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:28.904155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:28.992383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:28.995584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:29.003318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:29.004213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:29.005252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:29.006877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:29.007702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:29.008544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:29.073044 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4812eec-c196-46f5-b3d3-ad144809822e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action" status: 200 len: 32642 microversion: 2.1 time: 0.085321 Oct 25 03:43:29.073963 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3281/6685] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:43:28 2022] POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:43:29.179951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:29.196131 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6a33eb3-898d-44ad-8d1f-af155280bc6e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1278 microversion: 2.1 time: 0.315447 Oct 25 03:43:29.199670 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3405/6686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:28 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:29.236608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:29.237327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:29.248375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:29.249887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:29.250033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:29.250849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:29.251402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:29.251923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:29.301094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '694f06a2e312491594f2314b4e5f75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e0e449e80747cbb1f0ebf0ca0c2cf3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:29.301831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] flavor_id is None. Assuming migration. {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 25 03:43:29.302247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:43:29.671045 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-81540e10-e310-46e0-b711-a19ab910e00e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.438569 Oct 25 03:43:29.671862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3282/6687] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:43:29 2022] POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:43:29.680184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:29.681436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:29.687504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:29.688220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:29.689144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:29.689598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:29.690092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:29.690530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:29.858695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:29.876890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-36b9bd0e-149f-461e-be7f-81c177424a70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1693 microversion: 2.1 time: 0.198451 Oct 25 03:43:29.877506 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3406/6688] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:29 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:30.222464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:30.223728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:30.232056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:30.233139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:30.233886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:30.235077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:30.235950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:30.236822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:30.477469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:30.490870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-814803cf-d1b0-466d-a5ad-7b9ce48df3c7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1278 microversion: 2.1 time: 0.272249 Oct 25 03:43:30.502304 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3283/6689] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:30 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1278 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:30.902069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:30.902763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:30.913056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:30.913864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:30.914751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:30.916226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:30.917959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:30.918631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:31.126246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:31.140046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a92238e1-4e5c-40d2-b438-00347ba62222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1693 microversion: 2.1 time: 0.242226 Oct 25 03:43:31.141554 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3407/6690] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:30 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1693 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:31.514299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:31.515558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:31.523013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:31.523754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:31.524840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:31.527120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:31.527781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:31.528437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:31.955547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:31.968084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8da3678d-26b3-4162-837a-3fa35a62af1e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1278 microversion: 2.1 time: 0.457582 Oct 25 03:43:31.972709 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3284/6691] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:31 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1278 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:32.170575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:32.172297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:32.180087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:32.181646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:32.182057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:32.182959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:32.183427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:32.183865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:32.396242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:32.404736 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f55623e0-aa33-4fa4-89d4-502df3880a41 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1693 microversion: 2.1 time: 0.239680 Oct 25 03:43:32.406702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3408/6692] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:32 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1693 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:32.994611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:32.995987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:33.005294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:33.006217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:33.006835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:33.007725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:33.009089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:33.010691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:33.250332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:33.260356 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e20fa638-d59b-4f2c-b9f5-e68637c6c062 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.271782 Oct 25 03:43:33.271094 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3285/6693] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:32 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:33.429319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:33.430235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:33.438337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:33.438944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:33.439446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:33.440220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:33.440771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:33.441257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:33.697984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:33.707555 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f81dd079-10ef-4c7b-bd60-43a967464df3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.282061 Oct 25 03:43:33.708666 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3409/6694] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:33 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:34.284462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:34.285181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:34.292185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:34.292689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:34.293140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:34.293897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:34.294370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:34.294873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:34.548001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:34.557029 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e41f2d34-293d-4303-baa1-e15e4bb70b3d tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.276587 Oct 25 03:43:34.557850 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3286/6695] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:34 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:34.732160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:34.732827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:34.739810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:34.740526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:34.740975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:34.741733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:34.742201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:34.742637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:34.878091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:34.886847 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff5acad4-6c83-4acd-8bf4-53cf68e994e0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.158780 Oct 25 03:43:34.887456 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3410/6696] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:34 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:35.580311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:35.581501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:35.584445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:35.591056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:35.591833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:35.592371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:35.593116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:35.593667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:35.594212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:35.778460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:35.786725 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2b6219e-9b41-4790-b90b-fa69a5d53b19 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.210407 Oct 25 03:43:35.787312 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3287/6697] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:35 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:35.909904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:35.910466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:35.912309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:35.913039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:35.920130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:35.920631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:35.921122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:35.921877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:35.922343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:35.922779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:36.065970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:36.074448 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca108e64-645e-4e53-a745-d655b07f209c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.168534 Oct 25 03:43:36.075050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3411/6698] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:35 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:36.811103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:36.811735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:36.818613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:36.819114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:36.819571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:36.820288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:36.820886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:36.821824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:36.974049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:36.982478 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec19aa3f-50d3-43a3-bda4-64aac0f872c1 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.175369 Oct 25 03:43:36.983264 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3288/6699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:36 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:37.098164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:37.098807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:37.106105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:37.106586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:37.107022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:37.107714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:37.108169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:37.108591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:37.674399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:37.683535 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c8e358da-b426-41ca-9ed3-d683f5a1f6cb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.589310 Oct 25 03:43:37.684132 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3412/6700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:37 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:38.017414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:38.018147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:38.027413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:38.027917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:38.028369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:38.029086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:38.029555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:38.030022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:38.171745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:38.179876 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4326e098-ff63-400c-aad1-a58e56f0b130 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.173338 Oct 25 03:43:38.181428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3289/6701] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:38 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:38.708729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:38.710343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:38.718823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:38.719344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:38.720057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:38.720780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:38.721447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:38.722086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:38.917378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:38.926891 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b6f79d9a-7415-4796-8b6f-4b06a8cc13ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.222590 Oct 25 03:43:38.927569 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3413/6702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:38 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:39.205099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:39.205805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:39.215196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:39.215722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:39.216482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:39.217419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:39.218120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:39.219164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:39.442594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:39.452185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14706d9b-c6a5-4ccd-9a69-716ef5d18a37 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.251933 Oct 25 03:43:39.452788 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3290/6703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:39 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:39.951219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:39.952056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:39.960049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:39.960586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:39.961147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:39.962576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:39.963107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:39.963606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:40.185542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:40.193738 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-adf13470-6e7e-4769-8f19-cbcfb9f91b97 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.246680 Oct 25 03:43:40.194330 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3414/6704] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:39 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:40.476617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:40.477925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:40.484969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:40.485413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:40.485953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:40.486729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:40.487191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:40.487642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:40.634400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:40.642777 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b9bd5ea9-e6e8-41fd-8ee5-27cf5073c96e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.171155 Oct 25 03:43:40.643361 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3291/6705] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:40 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:41.218640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:41.219355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:41.226454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:41.227020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:41.227532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:41.228464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:41.228993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:41.229513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:41.372248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:41.380802 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7898750f-8871-4ffb-b5e5-9ff3f4ba7e77 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.166106 Oct 25 03:43:41.381406 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3415/6706] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:41 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:43:41.667807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:41.668456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:41.676173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:41.676937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:41.677398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:41.678151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:41.678631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:41.679080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:41.841966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:41.850408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03fd3030-5e82-42e3-be44-9219731bde29 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.187414 Oct 25 03:43:41.851193 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3292/6707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:41 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:43:42.409385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:42.410208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:42.418039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:42.418539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:42.418988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:42.419701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:42.420162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:42.420603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:42.569478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:42.578229 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5d2f8e3c-9f2e-47c5-8d26-b4ebade2a7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.175128 Oct 25 03:43:42.578824 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3416/6708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:42 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:42.873927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:42.874455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:42.881337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:42.881871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:42.882402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:42.883029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:42.884079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:42.884527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:43.029283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:43.034568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:43.040757 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bfbbdb2e-1c6e-4484-baba-1f15229a0cf3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.170802 Oct 25 03:43:43.041351 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3293/6709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:42 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:43.601870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:43.603192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:43.610061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:43.610564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:43.611011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:43.611737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:43.612206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:43.612642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:43.630432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-641bf1d0-6597-40dd-ad4d-ec7d923b079b req-d4341856-2aa2-4b32-840f-e175898cd095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbc6447-7752-4831-b6b0-738226465f0b", "name": "network-vif-plugged", "status": "completed", "tag": "86253737-116f-4056-b7f2-5602eb5e4959"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:43.648248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-641bf1d0-6597-40dd-ad4d-ec7d923b079b req-d4341856-2aa2-4b32-840f-e175898cd095 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:43.649800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-641bf1d0-6597-40dd-ad4d-ec7d923b079b req-d4341856-2aa2-4b32-840f-e175898cd095 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:43.650726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-641bf1d0-6597-40dd-ad4d-ec7d923b079b req-d4341856-2aa2-4b32-840f-e175898cd095 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:43.672407 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-641bf1d0-6597-40dd-ad4d-ec7d923b079b req-d4341856-2aa2-4b32-840f-e175898cd095 service nova] Creating event network-vif-plugged:86253737-116f-4056-b7f2-5602eb5e4959 for instance 8cbc6447-7752-4831-b6b0-738226465f0b on n-h2-862355-1 Oct 25 03:43:43.684050 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-641bf1d0-6597-40dd-ad4d-ec7d923b079b req-d4341856-2aa2-4b32-840f-e175898cd095 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062301 Oct 25 03:43:43.687494 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3294/6710] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:43:43.831364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:43.843240 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-944363ef-9165-438e-ac4d-eda48ab3a238 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.245366 Oct 25 03:43:43.844079 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3417/6711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:43 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:43:44.066610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:44.067367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:44.074117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:44.074819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:44.075343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:44.076147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:44.076837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:44.077294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:44.213641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:44.221704 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e0c2c57-aa9d-4e3c-bd62-086305b7d991 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1266 microversion: 2.1 time: 0.160406 Oct 25 03:43:44.222321 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3295/6712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:44 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:44.869340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:44.870392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:44.877937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:44.878435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:44.878887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:44.879799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:44.880269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:44.880701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:45.045467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:45.054460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-64f5b843-5ebb-45ed-b7f1-6d54b302bf27 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.190888 Oct 25 03:43:45.054938 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3418/6713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:44 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:45.245201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:45.249410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:45.257584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:45.259062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:45.259754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:45.260716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:45.261434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:45.262725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:45.445730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:45.456593 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b828207-55ba-46ae-b439-d2157dee2a53 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1452 microversion: 2.1 time: 0.215851 Oct 25 03:43:45.457262 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3296/6714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:45 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:45.479849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:45.480603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:45.486982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:45.487476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:45.487929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:45.488633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:45.489090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:45.489516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:45.494173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:45.634689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:45.642569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9760ee8f-91bb-4f29-9881-e01f9649fdfd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1452 microversion: 2.1 time: 0.167154 Oct 25 03:43:45.643159 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3419/6715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:45 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:46.078195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:46.078833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:46.085243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:46.085788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:46.086250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:46.088009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:46.088485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:46.088934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:46.333262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:46.345190 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f144c690-99c9-40e6-a4ff-4027a3bed579 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.270472 Oct 25 03:43:46.375858 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3297/6716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:46 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:47.370343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:47.371270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:47.379307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:47.379952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:47.380468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:47.381291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:47.382065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:47.382583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:47.608164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:47.616691 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e23c764-25d7-45bc-8c3d-9cbc9c7971b0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.250203 Oct 25 03:43:47.630489 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3420/6717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:47 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:47.939073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f1164484-1730-4543-adce-26e3fb5f8d2b req-b3f9c07e-167e-4395-b828-bf34bc8699f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cbc6447-7752-4831-b6b0-738226465f0b", "tag": "86253737-116f-4056-b7f2-5602eb5e4959"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:47.944807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=49 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:47.951884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f1164484-1730-4543-adce-26e3fb5f8d2b req-b3f9c07e-167e-4395-b828-bf34bc8699f5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:47.952656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f1164484-1730-4543-adce-26e3fb5f8d2b req-b3f9c07e-167e-4395-b828-bf34bc8699f5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:47.953106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f1164484-1730-4543-adce-26e3fb5f8d2b req-b3f9c07e-167e-4395-b828-bf34bc8699f5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:47.965549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f1164484-1730-4543-adce-26e3fb5f8d2b req-b3f9c07e-167e-4395-b828-bf34bc8699f5 service nova] Creating event network-changed:86253737-116f-4056-b7f2-5602eb5e4959 for instance 8cbc6447-7752-4831-b6b0-738226465f0b on n-h2-862355-1 Oct 25 03:43:47.971081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f1164484-1730-4543-adce-26e3fb5f8d2b req-b3f9c07e-167e-4395-b828-bf34bc8699f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035752 Oct 25 03:43:47.972113 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3298/6718] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:43:48.643404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:48.644482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:48.652079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:48.652731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:48.653379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:48.654166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:48.654857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:48.655623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:48.824197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:48.832356 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34bd956e-033a-4b8c-bb44-7979e3d90788 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.193805 Oct 25 03:43:48.832953 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3421/6719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:48 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:49.857496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:49.859084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:49.866321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:49.866816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:49.867266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:49.869284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:49.869792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:49.870432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:50.026451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:50.041379 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a76b5b8e-3293-478d-81c8-dd4cfa68012e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1698 microversion: 2.1 time: 0.187424 Oct 25 03:43:50.058258 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3299/6720] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:49 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1698 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:50.601163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d589f0bd-9e4f-41ae-9482-f728c9121d3e req-70243a6d-6bb9-4f7d-953f-f84340731b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "name": "network-vif-unplugged", "status": "completed", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:50.619532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d589f0bd-9e4f-41ae-9482-f728c9121d3e req-70243a6d-6bb9-4f7d-953f-f84340731b13 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:50.620108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d589f0bd-9e4f-41ae-9482-f728c9121d3e req-70243a6d-6bb9-4f7d-953f-f84340731b13 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:50.620622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d589f0bd-9e4f-41ae-9482-f728c9121d3e req-70243a6d-6bb9-4f7d-953f-f84340731b13 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:50.635643 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d589f0bd-9e4f-41ae-9482-f728c9121d3e req-70243a6d-6bb9-4f7d-953f-f84340731b13 service nova] Creating event network-vif-unplugged:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h2-862355-1 Oct 25 03:43:50.642239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-d589f0bd-9e4f-41ae-9482-f728c9121d3e req-70243a6d-6bb9-4f7d-953f-f84340731b13 service nova] Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:43:50.660618 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d589f0bd-9e4f-41ae-9482-f728c9121d3e req-70243a6d-6bb9-4f7d-953f-f84340731b13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063589 Oct 25 03:43:50.661909 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3422/6721] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:43:51.068030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:51.068665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:51.076206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:51.076718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:51.077179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:51.078246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:51.078727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:51.079176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:51.248453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:51.256870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc6d8419-80d7-4a4c-a237-fafebacfc10e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1697 microversion: 2.1 time: 0.193120 Oct 25 03:43:51.257969 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3300/6722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:51 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:52.281147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:52.281879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:52.290368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:52.291177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:52.291783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:52.292492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:52.292898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:52.293328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:52.706216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-afa3eafb-9738-4dad-929a-1c082cbf7112 req-152cc7fd-0bd6-478e-960d-4c2e3f0885e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:52.719725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afa3eafb-9738-4dad-929a-1c082cbf7112 req-152cc7fd-0bd6-478e-960d-4c2e3f0885e9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:52.720449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afa3eafb-9738-4dad-929a-1c082cbf7112 req-152cc7fd-0bd6-478e-960d-4c2e3f0885e9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:52.721067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afa3eafb-9738-4dad-929a-1c082cbf7112 req-152cc7fd-0bd6-478e-960d-4c2e3f0885e9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:52.736620 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-afa3eafb-9738-4dad-929a-1c082cbf7112 req-152cc7fd-0bd6-478e-960d-4c2e3f0885e9 service nova] Creating event network-changed:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h2-862355-1 Oct 25 03:43:52.744069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-afa3eafb-9738-4dad-929a-1c082cbf7112 req-152cc7fd-0bd6-478e-960d-4c2e3f0885e9 service nova] Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:43:52.756430 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-afa3eafb-9738-4dad-929a-1c082cbf7112 req-152cc7fd-0bd6-478e-960d-4c2e3f0885e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054430 Oct 25 03:43:52.757299 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3301/6723] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:43:52.814167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:52.825491 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b857d047-e9ba-45c1-93e2-e4fce0b679b9 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1695 microversion: 2.1 time: 0.548581 Oct 25 03:43:52.838265 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3423/6724] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:52 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1695 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:53.862929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:53.863671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:53.871267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:53.871766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:53.872212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:53.872914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:53.873379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:53.873848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:54.020927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:54.029804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c43203fb-a44e-40d2-bce8-65c7617b78b2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1695 microversion: 2.1 time: 0.171062 Oct 25 03:43:54.030393 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3302/6725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:53 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:55.054863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:55.055868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:55.060467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:43:55.064591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:55.065307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:55.065914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:55.066911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:55.067495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:55.068212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:55.322100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:55.335694 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bb4a5199-fb4c-4d22-88da-1896523e2f8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1692 microversion: 2.1 time: 0.285393 Oct 25 03:43:55.337393 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3424/6726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:55 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1692 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:55.361349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:55.362655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:55.372269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:55.373106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:55.373814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:55.374835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:55.375523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:55.376172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:55.456919 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-961b335b-9c1a-4508-82a6-dd87bea0e894 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action" status: 204 len: 0 microversion: 2.1 time: 0.099244 Oct 25 03:43:55.457614 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3303/6727] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:43:55 2022] POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:43:55.468126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:55.468969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:55.476983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:55.477637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:55.478230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:55.479262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:55.480042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:55.480739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:55.743933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:55.764516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5e2c1e6-7931-49c9-aa22-4c41fdde0f1b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1692 microversion: 2.1 time: 0.300759 Oct 25 03:43:55.765522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3425/6728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:55 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1692 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:56.792638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:56.793356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:56.799840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:56.801352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:56.801851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:56.802569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:56.803045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:56.803589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:56.959428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:56.972159 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c737c317-5fa1-40eb-b6ed-08a093155a94 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1692 microversion: 2.1 time: 0.185203 Oct 25 03:43:56.973122 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3304/6729] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:56 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:43:57.629666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b0a32812-85b8-47bc-b488-1126fbf61175 req-e6bc8ef7-f62c-4e07-ae4b-f9ada32d90fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "name": "network-vif-plugged", "status": "completed", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:43:57.643587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b0a32812-85b8-47bc-b488-1126fbf61175 req-e6bc8ef7-f62c-4e07-ae4b-f9ada32d90fd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:57.644079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b0a32812-85b8-47bc-b488-1126fbf61175 req-e6bc8ef7-f62c-4e07-ae4b-f9ada32d90fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:57.644520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b0a32812-85b8-47bc-b488-1126fbf61175 req-e6bc8ef7-f62c-4e07-ae4b-f9ada32d90fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:57.656831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b0a32812-85b8-47bc-b488-1126fbf61175 req-e6bc8ef7-f62c-4e07-ae4b-f9ada32d90fd service nova] Creating event network-vif-plugged:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h2-862355-1 Oct 25 03:43:57.662121 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b0a32812-85b8-47bc-b488-1126fbf61175 req-e6bc8ef7-f62c-4e07-ae4b-f9ada32d90fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036212 Oct 25 03:43:57.662780 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3426/6730] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:43:57.997294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:43:57.997964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:43:58.005521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:58.006156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:58.006663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:58.007467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:43:58.008017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:43:58.009195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:43:58.144417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:43:58.153200 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-524cfa11-da13-4807-88dd-40a298eac166 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1684 microversion: 2.1 time: 0.159909 Oct 25 03:43:58.153835 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3305/6731] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:43:57 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:44:28.392619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:44:28.395038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:44:28.397663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:44:28.398355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=40 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:44:28.405781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:28.406292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:28.406740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:28.407453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:28.407905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:28.408343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:28.466749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0b93f789-96a5-4797-be97-2a9d755f53e3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action" status: 200 len: 24578 microversion: 2.1 time: 0.079592 Oct 25 03:44:28.467358 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3427/6732] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:44:28 2022] POST /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e/action => generated 24578 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:44:44.807730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:44:44.808304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:44:44.810871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=15 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:44:44.811726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:44:44.817534 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:44.818064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:44.818515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:44.819253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:44.819719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:44.820158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:44.957244 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a56b74f-baaa-416c-9bc9-659279ebf060 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1835 microversion: 2.1 time: 0.154343 Oct 25 03:44:44.958399 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3306/6733] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:44:44 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1835 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:44:45.847326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:44:45.848108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:44:45.851212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:44:45.853063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:44:45.859733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:45.860309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:45.861374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:45.862192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:45.862661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:45.863098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:45.896645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:44:46.012428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-16dcac56-fef6-4609-9e56-d874834ca9ba req-7b272a01-df72-41ab-83c1-1280262a08ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:44:46.018115 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-39b7112e-5e8a-43f5-897d-2d0dd672ff68 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 204 len: 0 microversion: 2.1 time: 0.164077 Oct 25 03:44:46.019372 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3428/6734] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:44:45 2022] DELETE /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:44:46.029152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:44:46.031187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:44:46.031866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-16dcac56-fef6-4609-9e56-d874834ca9ba req-7b272a01-df72-41ab-83c1-1280262a08ae service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:46.032579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-16dcac56-fef6-4609-9e56-d874834ca9ba req-7b272a01-df72-41ab-83c1-1280262a08ae service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:46.033207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-16dcac56-fef6-4609-9e56-d874834ca9ba req-7b272a01-df72-41ab-83c1-1280262a08ae service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:46.042858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:46.043524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:46.044058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:46.045719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:46.046453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:46.046984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:46.047860 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-16dcac56-fef6-4609-9e56-d874834ca9ba req-7b272a01-df72-41ab-83c1-1280262a08ae service nova] Creating event network-changed:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h2-862355-1 Oct 25 03:44:46.053563 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-16dcac56-fef6-4609-9e56-d874834ca9ba req-7b272a01-df72-41ab-83c1-1280262a08ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208631 Oct 25 03:44:46.054860 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3307/6735] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:44:46.216168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:44:46.225783 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bf71e509-eced-40e8-bf2d-d7c4acc0eaf1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1690 microversion: 2.1 time: 0.201811 Oct 25 03:44:46.226821 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3429/6736] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:44:46 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:44:47.253755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:44:47.255061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:44:47.264043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:47.264831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:47.265530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:47.266508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:47.267239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:47.267907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:47.421518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:44:47.429756 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4bd4dab8-31d1-4cf6-9f79-20d68aa3d29f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1690 microversion: 2.1 time: 0.181048 Oct 25 03:44:47.431205 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3308/6737] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:44:47 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:44:48.083012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dcbf4f93-040b-4dd0-a0e7-dc1edf1d9377 req-44961d92-358d-4940-9e8a-d7a58e163b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7875ccfa-a5e6-4719-ab74-19ac26283a3e", "name": "network-vif-deleted", "tag": "5c939deb-969d-423c-9ce8-afce6c34c66e"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:44:48.098207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcbf4f93-040b-4dd0-a0e7-dc1edf1d9377 req-44961d92-358d-4940-9e8a-d7a58e163b3d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:48.099000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcbf4f93-040b-4dd0-a0e7-dc1edf1d9377 req-44961d92-358d-4940-9e8a-d7a58e163b3d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:48.099372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcbf4f93-040b-4dd0-a0e7-dc1edf1d9377 req-44961d92-358d-4940-9e8a-d7a58e163b3d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:48.114826 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dcbf4f93-040b-4dd0-a0e7-dc1edf1d9377 req-44961d92-358d-4940-9e8a-d7a58e163b3d service nova] Creating event network-vif-deleted:5c939deb-969d-423c-9ce8-afce6c34c66e for instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e on n-h2-862355-1 Oct 25 03:44:48.121942 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dcbf4f93-040b-4dd0-a0e7-dc1edf1d9377 req-44961d92-358d-4940-9e8a-d7a58e163b3d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043086 Oct 25 03:44:48.122835 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3430/6738] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:44:48.454767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:44:48.455396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:44:48.464043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:48.464556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:48.465017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:48.465740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:48.466363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:48.466891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:48.502842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:48.503350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:48.503806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:48.504281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lazy-loading 'fault' on Instance uuid 7875ccfa-a5e6-4719-ab74-19ac26283a3e {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:44:48.552741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:44:48.560782 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0bcfd6a2-a067-4a01-9f30-79df25ab89d6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 200 len: 1356 microversion: 2.1 time: 0.109993 Oct 25 03:44:48.561358 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3309/6739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:44:48 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:44:49.584301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:44:49.585000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 7875ccfa-a5e6-4719-ab74-19ac26283a3e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:44:49.592244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:49.592668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:49.593114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:49.593829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:44:49.594287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:44:49.594712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:44:49.609078 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] HTTP exception thrown: Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e could not be found. Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Request method failure captured: Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e HTTP/1.1 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1sn7Jqyk8iWGhv8KTU8-HZ4ckbmnIqC7OUVGg9nbBanytbYzmLCBu6ojVNjR80D0kicdrklCDCRrHjiw6Ejgf_qPQBhDc8G0Gx9QKO14FZeMcmLdGHpa5RO8U2zyUH-9Nf5_Fn7LyOKCbnZk3-qnefoKct38XLa3HKTHps3cugo6IY Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_84d9f7a653134b0da86e56f376f0124b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/84d9f7a653134b0da86e56f376f0124b"}]}] Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 329132b9ba734f18ab7270e10d0b7e31 Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e could not be found. Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '7875ccfa-a5e6-4719-ab74-19ac26283a3e'} Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e could not be found. Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e could not be found. Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:44:49.610724 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e could not be found. Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Returning 404 to user: Instance 7875ccfa-a5e6-4719-ab74-19ac26283a3e could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-82755d98-204e-42af-82fc-ea5bfe01e3c1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e" status: 404 len: 111 microversion: 2.1 time: 0.032134 Oct 25 03:44:49.620318 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3431/6740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:44:49 2022] GET /compute/v2.1/servers/7875ccfa-a5e6-4719-ab74-19ac26283a3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:44:54.463610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2faa4b14-ba2b-4524-956c-5482cc9e58e4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '.version_select at 0x7efd334f3700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:44:54.471155 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2faa4b14-ba2b-4524-956c-5482cc9e58e4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [2698d7d8-7098-4280-8304-e045207ae121] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 03:44:55.478186 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [None req-2faa4b14-ba2b-4524-956c-5482cc9e58e4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [2698d7d8-7098-4280-8304-e045207ae121] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 36412. Oct 25 03:44:55.503548 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2faa4b14-ba2b-4524-956c-5482cc9e58e4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-291329036" status: 202 len: 0 microversion: 2.1 time: 1.044065 Oct 25 03:44:55.504064 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3310/6741] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 25 03:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-291329036 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:44:55.534294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bd8882d-6236-49ac-9442-10fc555e787e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: .version_select at 0x7efd32b67ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-23944449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqryIi6444mct1d9AvwatvKtghzVcmqMDh9uclewVasnWeKWzAra29IQNQHJXmQH2lxoCsGsbIhXC//DQEGhv9e4yr+b6caXXWB/wjBWnP368OxdWQWl0V+P+af4XaMKA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:44:55.551521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3bd8882d-6236-49ac-9442-10fc555e787e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:44:55.557766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3bd8882d-6236-49ac-9442-10fc555e787e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:44:55.582641 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3bd8882d-6236-49ac-9442-10fc555e787e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052264 Oct 25 03:44:55.583431 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3432/6742] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:44:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:45:01.845087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=22 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:01.850823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1180085143", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "731e0655-3609-42fc-8a64-bc862e26b3ba"}], "key_name": "tempest-TestNetworkAdvancedServerOps-23944449", "security_groups": [{"name": "tempest-secgroup-smoke-1915622847"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:01.983678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] validate_networks() for [('731e0655-3609-42fc-8a64-bc862e26b3ba', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:45:02.658321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:45:02.659060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:45:02.660081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:45:02.660708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:45:02.661139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:45:02.673003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:02.673514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:02.674002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:02.674808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:02.675230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:02.675681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:02.700972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:45:02.707575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:45:02.726700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:45:02.730072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:45:02.818421 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dc4c71a2-4a0e-424c-9db1-d1a566e56cfa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.972737 Oct 25 03:45:02.821442 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3311/6743] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:45:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:45:02.837264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:02.847860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-be0342ba-728a-4302-aaa8-a2d1a938d9c3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:02.847860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-be0342ba-728a-4302-aaa8-a2d1a938d9c3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:02.970213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-be0342ba-728a-4302-aaa8-a2d1a938d9c3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:02.981634 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-be0342ba-728a-4302-aaa8-a2d1a938d9c3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1265 microversion: 2.1 time: 0.145993 Oct 25 03:45:02.994533 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3433/6744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:02 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:04.020083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:04.021278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:04.031697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:04.032130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:04.032595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:04.033337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:04.033868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:04.034320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:04.108499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:04.116925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb523b4c-de08-4a94-8f44-d94a2df16df7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1317 microversion: 2.1 time: 0.110205 Oct 25 03:45:04.123148 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3312/6745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:04 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1317 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:05.141173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:05.141888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:05.153462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:05.154075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:05.154767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:05.155535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:05.156001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:05.156504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:05.250969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:05.261207 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da8b7643-27e1-4ac8-aef6-062cbcf947e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1323 microversion: 2.1 time: 0.123796 Oct 25 03:45:05.261629 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3434/6746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:05 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1323 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:06.204908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-afdc7980-9085-4913-8621-ba1e953ce670 req-c0c95de8-0d00-4b5b-bce3-172ef126263c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:06.230524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afdc7980-9085-4913-8621-ba1e953ce670 req-c0c95de8-0d00-4b5b-bce3-172ef126263c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:06.231339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afdc7980-9085-4913-8621-ba1e953ce670 req-c0c95de8-0d00-4b5b-bce3-172ef126263c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:06.231965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-afdc7980-9085-4913-8621-ba1e953ce670 req-c0c95de8-0d00-4b5b-bce3-172ef126263c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:06.246861 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-afdc7980-9085-4913-8621-ba1e953ce670 req-c0c95de8-0d00-4b5b-bce3-172ef126263c service nova] Creating event network-changed:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:45:06.253631 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-afdc7980-9085-4913-8621-ba1e953ce670 req-c0c95de8-0d00-4b5b-bce3-172ef126263c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054639 Oct 25 03:45:06.254279 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3313/6747] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:45:06.284752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:06.286091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:06.293664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:06.294424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:06.295316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:06.296033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:06.296674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:06.297117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:06.464250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:06.474611 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e08dd539-d87f-49cf-afb1-73bca5deeb14 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1391 microversion: 2.1 time: 0.193905 Oct 25 03:45:06.494272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3435/6748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:06 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:07.501644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:07.502687 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:07.510126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:07.510634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:07.511089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:07.511996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:07.512481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:07.513074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:07.656821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:07.665768 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7beb55df-519a-40f5-8f6f-9a0361e35203 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1391 microversion: 2.1 time: 0.168818 Oct 25 03:45:07.666488 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3314/6749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:07 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:08.690749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:08.691964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:08.699856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:08.700777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:08.709192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:08.715013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:08.715765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:08.716435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:08.951160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:08.965662 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f260e375-7a18-4495-b1b0-461034d0a53b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1391 microversion: 2.1 time: 0.280204 Oct 25 03:45:08.966610 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3436/6750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:08 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1391 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:09.989938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:09.990565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:09.997953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:09.998485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:09.999085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:09.999658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:10.000317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:10.000951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:10.276016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:10.286069 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee9ca4cf-8cec-4b25-a401-e36825891183 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1391 microversion: 2.1 time: 0.299455 Oct 25 03:45:10.286997 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3315/6751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:09 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1391 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:45:11.310850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:11.312196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:11.318933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:11.319429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:11.319873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:11.320623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:11.321085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:11.321521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:11.464204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:11.472195 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1bd44ac2-3fe6-41ad-89a7-4f8eda370bdf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1391 microversion: 2.1 time: 0.165545 Oct 25 03:45:11.472786 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3437/6752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:11 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:45:12.355459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-0a5cc068-9869-4bd6-9f5e-be5f6631a238 req-b8dcd885-ece2-436b-9096-0ae35a7a31cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "name": "network-vif-plugged", "status": "completed", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:12.382167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0a5cc068-9869-4bd6-9f5e-be5f6631a238 req-b8dcd885-ece2-436b-9096-0ae35a7a31cb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:12.382666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0a5cc068-9869-4bd6-9f5e-be5f6631a238 req-b8dcd885-ece2-436b-9096-0ae35a7a31cb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:12.383696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0a5cc068-9869-4bd6-9f5e-be5f6631a238 req-b8dcd885-ece2-436b-9096-0ae35a7a31cb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:12.406795 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-0a5cc068-9869-4bd6-9f5e-be5f6631a238 req-b8dcd885-ece2-436b-9096-0ae35a7a31cb service nova] Creating event network-vif-plugged:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:45:12.411906 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-0a5cc068-9869-4bd6-9f5e-be5f6631a238 req-b8dcd885-ece2-436b-9096-0ae35a7a31cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072199 Oct 25 03:45:12.412989 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3316/6753] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:45:12.504133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:12.504765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:12.513705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:12.514202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:12.514645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:12.515353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:12.516003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:12.516437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:12.653113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:12.661280 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00a45446-e301-46ed-9411-7556053a2857 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1391 microversion: 2.1 time: 0.170536 Oct 25 03:45:12.662132 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3438/6754] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:12 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:13.683316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:13.684356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:13.696888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:13.697665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:13.705493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:13.706058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:13.706511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:13.707439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:13.707919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:13.708382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:13.866365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:13.874957 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8ee90fdb-0f50-40f5-be7b-e6d5b97352dc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1391 microversion: 2.1 time: 0.192577 Oct 25 03:45:13.875483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3317/6755] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:13 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:14.899535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:14.900111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:14.902123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:14.908401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:14.908827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:14.909268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:14.909995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:14.910455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:14.910883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:15.053882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:15.062234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-49f3072b-ed19-4642-9f7d-70f76e381c0a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1562 microversion: 2.1 time: 0.167322 Oct 25 03:45:15.062932 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3439/6756] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:14 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:15.085482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:15.086987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:15.089834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:15.095321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:15.095916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:15.096453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:15.097255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:15.097844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:15.098369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:15.240722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:15.249405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e04b9d7-9a59-4dfb-857d-f8acb2c27847 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1562 microversion: 2.1 time: 0.167999 Oct 25 03:45:15.250027 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3318/6757] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:15 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:16.909022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:16.910249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:16.912609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-30d62a8a-0a60-4e82-897d-8609690aca12 req-0897abbe-f983-4ad5-aa85-99d493855a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:16.918656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:16.920273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:16.920963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:16.921746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:16.922665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:16.923261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:16.923963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:16.928691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30d62a8a-0a60-4e82-897d-8609690aca12 req-0897abbe-f983-4ad5-aa85-99d493855a1b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:16.930937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30d62a8a-0a60-4e82-897d-8609690aca12 req-0897abbe-f983-4ad5-aa85-99d493855a1b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:16.931582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30d62a8a-0a60-4e82-897d-8609690aca12 req-0897abbe-f983-4ad5-aa85-99d493855a1b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:16.951583 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-30d62a8a-0a60-4e82-897d-8609690aca12 req-0897abbe-f983-4ad5-aa85-99d493855a1b service nova] Creating event network-changed:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:45:16.958829 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-30d62a8a-0a60-4e82-897d-8609690aca12 req-0897abbe-f983-4ad5-aa85-99d493855a1b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050104 Oct 25 03:45:16.959932 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3319/6758] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:45:17.112647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:17.130550 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-764904f3-3a9d-4a28-ba39-e15de5dc5d24 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1562 microversion: 2.1 time: 0.225355 Oct 25 03:45:17.131466 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3440/6759] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:16 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:40.424981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:40.425779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=38 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:40.431910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:40.434511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:40.441930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:40.442437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:40.442897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:40.443627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:40.444104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:40.444554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:40.498717 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03d40aeb-864d-4a28-865d-d0148af6e004 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action" status: 200 len: 24564 microversion: 2.1 time: 0.075400 Oct 25 03:45:40.500320 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3320/6760] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:45:40 2022] POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action => generated 24564 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:45:45.159013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:45.159635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:45.161537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:45.162332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=42 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:45:45.163315 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 03:45:45.163464 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 03:45:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b (ip 10.222.0.36) !!! Oct 25 03:45:45.174642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:45.175143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:45.175594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:45.176307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:45.176775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:45.177203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:45.203921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:45:45.284297 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a30581b-f0fc-40a1-be1f-e96464afd28a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 204 len: 0 microversion: 2.1 time: 0.129780 Oct 25 03:45:45.285093 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3441/6761] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:45:45 2022] DELETE /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:45:45.294789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:45.295512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:45.303394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:45.303915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:45.304354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:45.305587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:45.306289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:45.306531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:45.575344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:45.583245 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-49d3201c-2a73-4d67-b0a3-3176553c669b tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1576 microversion: 2.1 time: 0.293726 Oct 25 03:45:45.583818 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3321/6762] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:45 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:46.609120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:46.609868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:46.616968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:46.618435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:46.618974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:46.619690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:46.620162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:46.620600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:46.825536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:46.833541 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6e8867de-2c71-4026-9dbd-e3424dc72915 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1576 microversion: 2.1 time: 0.228852 Oct 25 03:45:46.834149 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3442/6763] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:46 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:47.858086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:47.858836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:47.866858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:47.867607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:47.868079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:47.868904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:47.869476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:47.870025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:47.935532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:47.947075 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb95cde4-8b96-4e3d-8335-f848be77c3e4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1508 microversion: 2.1 time: 0.092955 Oct 25 03:45:47.948253 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3322/6764] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:47 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1508 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:48.075962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dcefc683-b783-4c92-b285-6dbf7a8f32e2 req-beaad108-2cd0-455b-9248-7082f9dd0598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbc6447-7752-4831-b6b0-738226465f0b", "name": "network-vif-deleted", "tag": "86253737-116f-4056-b7f2-5602eb5e4959"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:48.097632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcefc683-b783-4c92-b285-6dbf7a8f32e2 req-beaad108-2cd0-455b-9248-7082f9dd0598 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:48.104189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcefc683-b783-4c92-b285-6dbf7a8f32e2 req-beaad108-2cd0-455b-9248-7082f9dd0598 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:48.104894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcefc683-b783-4c92-b285-6dbf7a8f32e2 req-beaad108-2cd0-455b-9248-7082f9dd0598 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:48.119770 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dcefc683-b783-4c92-b285-6dbf7a8f32e2 req-beaad108-2cd0-455b-9248-7082f9dd0598 service nova] Creating event network-vif-deleted:86253737-116f-4056-b7f2-5602eb5e4959 for instance 8cbc6447-7752-4831-b6b0-738226465f0b on n-h2-862355-1 Oct 25 03:45:48.125568 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dcefc683-b783-4c92-b285-6dbf7a8f32e2 req-beaad108-2cd0-455b-9248-7082f9dd0598 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053231 Oct 25 03:45:48.126932 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3443/6765] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:45:48.971233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:48.971981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:48.979947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:48.980646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:48.981144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:48.982153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:48.982988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:48.983442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:49.061560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:49.071215 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d9221aef-9edb-4acd-8f80-4051a39e3369 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1225 microversion: 2.1 time: 0.103604 Oct 25 03:45:49.072522 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3323/6766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:48 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:50.098586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:50.099281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:50.107288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:50.107778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:50.108415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:50.109349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:50.109789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:50.110227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:50.177248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:50.187569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3670f98b-b16a-4a93-9fac-31d225f6c3d6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1225 microversion: 2.1 time: 0.093255 Oct 25 03:45:50.188172 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3444/6767] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:50 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:51.210366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:51.219161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:51.227350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:51.227908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:51.228362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:51.229079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:51.229550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:51.230013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:51.301708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:51.313576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2a51e73-6fcd-4e59-aa1f-50ffd6247ac5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1225 microversion: 2.1 time: 0.107181 Oct 25 03:45:51.314492 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3324/6768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:51 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:51.576273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:51.576901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:51.584679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:51.585170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:51.585853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:51.587650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:51.588284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:51.588808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:51.737181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ef41747-9029-46ca-8cc1-463b5fc319fc tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1832 microversion: 2.1 time: 0.164612 Oct 25 03:45:51.738120 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3445/6769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:51 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1832 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:51.762065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:51.762627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:51.768792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:51.769302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:51.769782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:51.770576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:51.771060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:51.771506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:51.925843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:51.935949 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-20d1bf04-b41d-4852-80a1-935f8fbae58d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1681 microversion: 2.1 time: 0.178391 Oct 25 03:45:51.941734 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3325/6770] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:51 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:52.040457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:52.042684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:52.050787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.051298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.051731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.052816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.053282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.053805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.118728 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f2673b5-a15c-4d35-b709-d3e0af2a6e3f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action" status: 200 len: 32632 microversion: 2.1 time: 0.082120 Oct 25 03:45:52.121721 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3446/6771] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:45:52 2022] POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action => generated 32632 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:45:52.311522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:52.312222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:52.320926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.322210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.322679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.323411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.324570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.325147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.341336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:52.342099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:52.349999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.351301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.351788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.352524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.352988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.353417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.367450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '694f06a2e312491594f2314b4e5f75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e0e449e80747cbb1f0ebf0ca0c2cf3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:52.368198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] flavor_id is None. Assuming migration. {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 25 03:45:52.368656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:45:52.446860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:52.455779 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-541febff-5c13-47d0-a5f6-560af78540a5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 200 len: 1225 microversion: 2.1 time: 0.121130 Oct 25 03:45:52.456604 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3447/6772] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:52 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:45:52.516045 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b834692-faf6-4316-9ad2-8f4b5bb59338 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action" status: 202 len: 0 microversion: 2.1 time: 0.203389 Oct 25 03:45:52.517273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3326/6773] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:45:52 2022] POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:45:52.526642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:52.528059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:52.534174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.534912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.535585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.537261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:52.538051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:52.538717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:52.716060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:52.730139 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b08dd09-37f1-48f9-a14b-18dd4034eaf5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1690 microversion: 2.1 time: 0.208107 Oct 25 03:45:52.731818 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3448/6774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:52 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:53.479400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:53.480030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:53.488012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:53.488518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:53.488967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:53.489803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:53.490464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:53.491228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:53.512764 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b HTTP/1.1 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '8cbc6447-7752-4831-b6b0-738226465f0b'} Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:45:53.514554 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:45:53.521473 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0d116219-10d0-43e1-a188-82ae9abefa8a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 404 len: 111 microversion: 2.1 time: 0.041459 Oct 25 03:45:53.525877 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3327/6775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:53 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:45:53.644529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1001611154", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-303901269", "security_groups": [{"name": "tempest-secgroup-smoke-1413309307"}], "block_device_mapping_v2": [{"uuid": "2b4bf2b6-6beb-454f-bd08-c6e2dcf03c80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:53.766186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:53.772405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:53.774478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:45:53.792646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:53.795321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:53.798556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:53.801057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:53.804217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:53.805589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:54.097232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:54.116169 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0007fe21-bd92-4871-a3be-fb319691570d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1690 microversion: 2.1 time: 0.357968 Oct 25 03:45:54.130748 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3328/6776] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:53 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1690 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:54.301866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:45:54.302921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:45:54.303435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:45:54.304729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:45:54.306114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:45:54.316518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:54.317577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:54.318125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:54.319120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:54.319586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:54.320062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:54.339646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:45:54.344916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:45:54.406877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:45:54.409049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b4bf2b6-6beb-454f-bd08-c6e2dcf03c80',volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:45:54.581497 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4c64d7bc-5aa2-45d6-9995-94f66740f084 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.940069 Oct 25 03:45:54.582737 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3449/6777] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:45:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:45:54.600202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0879ff1b-aba4-45e4-bb0b-aaaceac91e0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:54.601541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0879ff1b-aba4-45e4-bb0b-aaaceac91e0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:54.743289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0879ff1b-aba4-45e4-bb0b-aaaceac91e0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:54.753046 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0879ff1b-aba4-45e4-bb0b-aaaceac91e0f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1094 microversion: 2.1 time: 0.161884 Oct 25 03:45:54.754519 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3329/6778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:54 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1094 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:55.142050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:55.143787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:55.155222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:55.156659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:55.157246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:55.160265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:55.160886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:55.161395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:55.314929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:55.323895 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca55e101-efa9-4cb0-8517-e1bdf28f8068 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1690 microversion: 2.1 time: 0.186567 Oct 25 03:45:55.334679 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3450/6779] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:55 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:55.778402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:55.779046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:55.793961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:55.794752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:55.795501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:55.796956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:55.797421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:55.798681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:55.888646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:55.897189 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8a4965e7-d2c3-4675-adb0-5a9dc7d5444e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1210 microversion: 2.1 time: 0.123153 Oct 25 03:45:55.898993 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3330/6780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:55 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:56.348343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:56.348956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:56.357273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:56.358630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:56.359276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:56.360354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:56.360997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:56.361607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:56.623298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:56.631134 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-978cec74-c265-4ff3-8403-2499aee8b2d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.286765 Oct 25 03:45:56.654325 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3451/6781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:56 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:45:56.924445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:56.925109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:56.934487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:56.935260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:56.935947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:56.936932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:56.937711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:56.938423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:57.129488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:57.141330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93596445-08ed-4d8b-8005-451caef660a4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1278 microversion: 2.1 time: 0.222522 Oct 25 03:45:57.142250 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3331/6782] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:56 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:57.455882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9dc6ff00-0dd3-456c-a9ec-bf219496ed09 req-391dcc32-83bf-47e9-b769-4604be883c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882624cc-49e8-4228-85cc-84a4d8e767eb", "tag": "5a205fa0-dd5d-4cea-8f70-0f570838ed4c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:45:57.468776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9dc6ff00-0dd3-456c-a9ec-bf219496ed09 req-391dcc32-83bf-47e9-b769-4604be883c3f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:57.469257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9dc6ff00-0dd3-456c-a9ec-bf219496ed09 req-391dcc32-83bf-47e9-b769-4604be883c3f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:57.469719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9dc6ff00-0dd3-456c-a9ec-bf219496ed09 req-391dcc32-83bf-47e9-b769-4604be883c3f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:57.491078 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9dc6ff00-0dd3-456c-a9ec-bf219496ed09 req-391dcc32-83bf-47e9-b769-4604be883c3f service nova] Creating event network-changed:5a205fa0-dd5d-4cea-8f70-0f570838ed4c for instance 882624cc-49e8-4228-85cc-84a4d8e767eb on n-h2-862355-1 Oct 25 03:45:57.497774 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9dc6ff00-0dd3-456c-a9ec-bf219496ed09 req-391dcc32-83bf-47e9-b769-4604be883c3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045807 Oct 25 03:45:57.498402 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3452/6783] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:45:57.661030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:57.661986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:57.668481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:57.668998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:57.669457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:57.670214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:57.670691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:57.671136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:57.813899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:57.822958 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90d5d661-1125-4d22-affe-93b7982d52ad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.166250 Oct 25 03:45:57.824028 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3332/6784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:57 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:58.165952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:58.166818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:58.174217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:58.174851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:58.175429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:58.176530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:58.177822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:58.178428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:58.415304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:58.424377 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a61ef6e7-7df7-48d8-a5ef-ff766d8f85da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1278 microversion: 2.1 time: 0.263601 Oct 25 03:45:58.425140 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3453/6785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:58 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:58.848396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:58.849094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:58.857752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:58.858359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:58.858894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:58.859673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:58.860212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:58.860716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:58.999713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:59.007734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43b29cd8-5cdf-450b-835f-a14e5daf0dd6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.163548 Oct 25 03:45:59.008812 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3333/6786] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:58 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:45:59.447590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:45:59.448148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:45:59.454994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:59.455472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:59.455909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:59.456651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:45:59.457108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:45:59.457529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:45:59.593875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:45:59.602252 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d7484c7-f24a-4d5a-bdc1-75484f7d4dea tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1278 microversion: 2.1 time: 0.158155 Oct 25 03:45:59.603125 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3454/6787] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:45:59 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:00.032010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:00.032659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:00.040235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:00.040743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:00.041175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:00.041907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:00.042377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:00.042815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:00.181128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:00.189438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b998bf68-c8db-411a-8f69-bb3c7025467c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.161269 Oct 25 03:46:00.190237 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3334/6788] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:00 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:00.624626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:00.625354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:00.632550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:00.633066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:00.633603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:00.634379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:00.634836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:00.635262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:00.780995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:00.790065 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-349564ae-038a-4374-8e4c-ae1c2faf1c46 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1278 microversion: 2.1 time: 0.168464 Oct 25 03:46:00.791086 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3455/6789] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:00 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:01.214441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:01.215099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:01.221940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:01.222448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:01.223115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:01.224229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:01.224712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:01.225156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:01.375540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:01.384479 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2196a0e3-64a9-43cf-ace8-bb70119ccf35 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.174422 Oct 25 03:46:01.385268 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3335/6790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:01 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:01.813979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:01.814598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:01.822134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:01.822620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:01.823058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:01.823754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:01.824209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:01.824634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:01.956789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:01.964783 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-310a648d-c04d-4c6b-9bbf-b81e79b634ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1278 microversion: 2.1 time: 0.154711 Oct 25 03:46:01.965365 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3456/6791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:01 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:02.408647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:02.409310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:02.417365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:02.417908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:02.418368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:02.419116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:02.419595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:02.420041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:02.568500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:02.572235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:02.577710 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4d4f1944-66a6-4107-9292-80556fe0619f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.173301 Oct 25 03:46:02.578577 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3336/6792] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:02 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:02.988447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:02.989273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:03.005264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:03.005890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:03.006542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:03.007487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:03.009697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:03.010215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:03.162813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:03.171989 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7ac41e0e-78c2-4184-a8ce-5c605755411e tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.187500 Oct 25 03:46:03.172582 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3457/6793] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:02 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:03.602696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:03.603270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:03.611062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:03.611566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:03.612021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:03.612741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:03.613212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:03.613656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:03.759201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:03.767070 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c934b325-aae8-4f52-a733-5f04688eb2ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.169405 Oct 25 03:46:03.767654 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3337/6794] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:03 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:04.197868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:04.198536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:04.205526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:04.206042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:04.206477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:04.207171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:04.207628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:04.208050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:04.212683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:04.329968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:04.350614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:04.353259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:04.360278 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77e83f44-76a0-4967-943f-40513a54b8bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.168772 Oct 25 03:46:04.360872 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3458/6795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:04 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:46:04.791722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:04.792382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:04.795145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:04.800785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:04.801292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:04.801774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:04.802499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:04.803225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:04.803671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:04.950040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:04.961376 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a539b58-90b8-46c1-95fa-d037a59a84f4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.173819 Oct 25 03:46:04.963493 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3338/6796] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:04 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:05.384582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:05.385197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:05.395716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:05.396381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:05.396639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:05.397338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:05.397898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:05.398243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:05.549018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:05.558466 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9fba743a-905c-4375-819e-19fcaace5573 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.177752 Oct 25 03:46:05.559110 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3459/6797] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:05 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:05.987700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:05.988481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:06.003242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:06.003755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:06.004219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:06.005073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:06.005712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:06.006778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:06.156060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:06.169463 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e34797f7-4b78-4850-b035-29a63c9c8e50 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.186321 Oct 25 03:46:06.170754 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3339/6798] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:05 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:06.581327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:06.582070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:06.589652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:06.590859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:06.591732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:06.593277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:06.594133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:06.594743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:06.766140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:06.778303 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77800eae-f2b6-4674-a0e9-2439fc055450 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.199719 Oct 25 03:46:06.782365 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3460/6799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:06 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:07.194903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:07.197075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:07.204738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:07.205382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:07.205714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:07.206637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:07.207119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:07.207561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:07.437913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:07.447331 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3b388835-a617-4182-918e-567c62e2cc34 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.256575 Oct 25 03:46:07.448241 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3340/6800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:07 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:07.808090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:07.808731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:07.815798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:07.816299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:07.816750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:07.817467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:07.818160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:07.818631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:07.974098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:07.982693 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d435565b-ea0d-4826-b317-6eab47bbb316 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.178858 Oct 25 03:46:07.983304 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3461/6801] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:07 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:08.444099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1072451170", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "d77e0b21-bb77-4af3-a75a-6c74b8cd77c0"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:08.470900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:08.471527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:08.478466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:08.478959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:08.479403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:08.480104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:08.480563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:08.481009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:08.501563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] validate_networks() for [('d77e0b21-bb77-4af3-a75a-6c74b8cd77c0', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:46:08.620632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:08.628808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6e4d49a0-9da9-43ac-acdf-9c21645feade tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.162001 Oct 25 03:46:08.629531 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3462/6802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:08 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:46:08.858038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:46:08.858483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:46:08.858981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:46:08.859410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:46:08.859872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:46:08.869489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:08.870038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:08.870498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:08.871241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:08.871715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:08.872194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:08.889791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Getting quotas for project 204ddd86bcd94dc3a0af918e22fc0e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:46:08.895050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Getting quotas for user 49e2503fb22a4c03ba141139ead49708 and project 204ddd86bcd94dc3a0af918e22fc0e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:46:08.907826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:46:08.910177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:46:08.956011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-98823951-e1f9-4874-9d23-6d19844a7b34 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515853 Oct 25 03:46:08.956686 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3341/6803] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:46:08.969548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e483366-1e45-49db-b58b-7499a4b3c59b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:08.970227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9e483366-1e45-49db-b58b-7499a4b3c59b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:09.008625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:09.009269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:09.016538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:09.017047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:09.017501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:09.018247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:09.018719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:09.019161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:09.033483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9e483366-1e45-49db-b58b-7499a4b3c59b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:09.041004 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9e483366-1e45-49db-b58b-7499a4b3c59b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1219 microversion: 2.1 time: 0.075721 Oct 25 03:46:09.042417 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3463/6804] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:08 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:09.165504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:09.173754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-946a865b-32f6-4d40-b274-cf39d170cd7a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.170874 Oct 25 03:46:09.174336 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3342/6805] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:09 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:09.652963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:09.653546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:09.661216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:09.661734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:09.662184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:09.662891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:09.663497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:09.664583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:09.813295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:09.821936 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4ce093c3-c435-421b-9bc6-61730dad29a0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.173879 Oct 25 03:46:09.822519 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3464/6806] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:09 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:10.065755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:10.066414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:10.075635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:10.076135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:10.076588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:10.077291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:10.077792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:10.078232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:10.175134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:10.197818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:10.199152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:10.200175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3855ef1b-3bd0-486f-bd05-38567babbb8b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1279 microversion: 2.1 time: 0.139270 Oct 25 03:46:10.213703 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3343/6807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:10 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:10.224455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:10.224968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:10.225408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:10.226262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:10.227252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:10.227684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:10.385038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:10.394182 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c977098-b3f1-4835-b6ea-1a3598a08b0c tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.201569 Oct 25 03:46:10.401720 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3465/6808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:10 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:10.848004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:10.848781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:10.853965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:10.859629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:10.860717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:10.861267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:10.862266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:10.864193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:10.864889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:11.086033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:11.094165 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-595c1a00-ac66-454c-acef-b6638b0e6b7f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.251521 Oct 25 03:46:11.094768 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3344/6809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:10 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:11.227661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:11.228280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:11.235386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:11.235871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:11.236306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:11.237006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:11.237468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:11.237924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:11.378480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:11.389412 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3a234e99-9bd6-48c5-b22b-5be96d9fa51b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.165805 Oct 25 03:46:11.401714 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3466/6810] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:11 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:11.417596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:11.418294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:11.425118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:11.425610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:11.426159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:11.426886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:11.427363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:11.428203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:11.631440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:11.640401 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d80d42b5-6914-4506-b512-373bfaed35ad tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.226882 Oct 25 03:46:11.640986 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3345/6811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:11 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:11.715998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5b1a643b-5313-485a-949d-b48ace4acdcf req-02d4f7bd-1d00-439f-a923-ff4030073f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a63982-5926-4523-a705-098c0997f88a", "tag": "c6145019-ec49-4e0b-9568-79aa0ce3356c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:11.725666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b1a643b-5313-485a-949d-b48ace4acdcf req-02d4f7bd-1d00-439f-a923-ff4030073f41 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:11.726173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b1a643b-5313-485a-949d-b48ace4acdcf req-02d4f7bd-1d00-439f-a923-ff4030073f41 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:11.727129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5b1a643b-5313-485a-949d-b48ace4acdcf req-02d4f7bd-1d00-439f-a923-ff4030073f41 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:11.741057 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5b1a643b-5313-485a-949d-b48ace4acdcf req-02d4f7bd-1d00-439f-a923-ff4030073f41 service nova] Creating event network-changed:c6145019-ec49-4e0b-9568-79aa0ce3356c for instance 71a63982-5926-4523-a705-098c0997f88a on n-h1-862355-1 Oct 25 03:46:11.746928 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5b1a643b-5313-485a-949d-b48ace4acdcf req-02d4f7bd-1d00-439f-a923-ff4030073f41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034723 Oct 25 03:46:11.747540 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3467/6812] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:12.118128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:12.118651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:12.125253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:12.125800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:12.126234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:12.126936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:12.127405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:12.127846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:12.262866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:12.270924 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6d96d737-ea33-420d-beae-f5c95b86049a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1695 microversion: 2.1 time: 0.157733 Oct 25 03:46:12.271514 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3346/6813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:12 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:12.346695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8043f984-1e26-4e75-ac8e-8cb6bea4581b req-e004a407-a155-4d0f-b154-cfd967ab9a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882624cc-49e8-4228-85cc-84a4d8e767eb", "name": "network-vif-plugged", "status": "completed", "tag": "5a205fa0-dd5d-4cea-8f70-0f570838ed4c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:12.357412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8043f984-1e26-4e75-ac8e-8cb6bea4581b req-e004a407-a155-4d0f-b154-cfd967ab9a2c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:12.357921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8043f984-1e26-4e75-ac8e-8cb6bea4581b req-e004a407-a155-4d0f-b154-cfd967ab9a2c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:12.358358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8043f984-1e26-4e75-ac8e-8cb6bea4581b req-e004a407-a155-4d0f-b154-cfd967ab9a2c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:12.379034 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8043f984-1e26-4e75-ac8e-8cb6bea4581b req-e004a407-a155-4d0f-b154-cfd967ab9a2c service nova] Creating event network-vif-plugged:5a205fa0-dd5d-4cea-8f70-0f570838ed4c for instance 882624cc-49e8-4228-85cc-84a4d8e767eb on n-h2-862355-1 Oct 25 03:46:12.384329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8043f984-1e26-4e75-ac8e-8cb6bea4581b req-e004a407-a155-4d0f-b154-cfd967ab9a2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042515 Oct 25 03:46:12.384949 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3468/6814] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:12.418005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:12.418837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:12.425694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:12.426277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:12.427147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:12.428296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:12.429316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:12.429433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:12.663868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:12.665439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:12.671640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:12.672133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:12.672572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:12.673331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:12.673832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:12.674283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:12.789924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:12.801258 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52db1979-9df4-445b-a15d-d9460ebefa33 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.390663 Oct 25 03:46:12.801899 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3347/6815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:12 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:12.844506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:12.853448 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-218dbc66-c84c-4a83-971d-7edac3e138dd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1266 microversion: 2.1 time: 0.193801 Oct 25 03:46:12.854309 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3469/6816] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:12 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:46:13.295089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:13.295664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:13.303222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:13.303773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:13.304215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:13.305244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:13.305753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:13.306207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:13.698092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:13.707482 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-44848de8-0158-40dd-991d-eabf873f0b2d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1694 microversion: 2.1 time: 0.416643 Oct 25 03:46:13.708064 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3348/6817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:13 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1694 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:13.737527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-fd7a53d0-fc25-459c-83a5-8dca51d6d20e req-0ff817ab-58d6-4d59-9b1e-340b98648ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "name": "network-vif-unplugged", "status": "completed", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:13.749559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fd7a53d0-fc25-459c-83a5-8dca51d6d20e req-0ff817ab-58d6-4d59-9b1e-340b98648ddc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:13.750100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fd7a53d0-fc25-459c-83a5-8dca51d6d20e req-0ff817ab-58d6-4d59-9b1e-340b98648ddc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:13.750543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fd7a53d0-fc25-459c-83a5-8dca51d6d20e req-0ff817ab-58d6-4d59-9b1e-340b98648ddc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:13.763424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-fd7a53d0-fc25-459c-83a5-8dca51d6d20e req-0ff817ab-58d6-4d59-9b1e-340b98648ddc service nova] Creating event network-vif-unplugged:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h2-862355-1 Oct 25 03:46:13.768886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-fd7a53d0-fc25-459c-83a5-8dca51d6d20e req-0ff817ab-58d6-4d59-9b1e-340b98648ddc service nova] Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:46:13.780667 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-fd7a53d0-fc25-459c-83a5-8dca51d6d20e req-0ff817ab-58d6-4d59-9b1e-340b98648ddc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048972 Oct 25 03:46:13.781295 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3470/6818] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:13.824520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:13.825172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:13.831185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:13.831991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:13.832649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:13.833369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:13.834035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:13.834676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:13.878135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:13.879091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:13.886176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:13.886880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:13.887348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:13.889556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:13.890085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:13.890607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:13.986904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:13.997752 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2afa6c27-73cd-4e9b-a958-9210a4270ae8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.175086 Oct 25 03:46:13.997752 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3349/6819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:13 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:14.380933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:14.389622 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3355bbb-2970-4e6c-9bb1-14234ecc1309 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1453 microversion: 2.1 time: 0.516134 Oct 25 03:46:14.390253 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3471/6820] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:13 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1453 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:46:14.412094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:14.412811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:14.420489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:14.421656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:14.422273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:14.423054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:14.423594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:14.424099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:14.575011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:14.584210 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14bbf16f-8c02-4678-af94-1bb3d876a1ac tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1453 microversion: 2.1 time: 0.176033 Oct 25 03:46:14.585085 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3350/6821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:14 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:14.733650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:14.735438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:14.746503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:14.747220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:14.747436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:14.748387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:14.748853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:14.749290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:14.965316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:14.974711 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f1093002-958b-4165-b260-783e3329892c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1694 microversion: 2.1 time: 0.245492 Oct 25 03:46:14.975476 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3472/6822] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:14 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:15.019661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:15.020303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:15.026731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:15.027447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:15.027906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:15.028625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:15.029279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:15.029923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:15.311061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:15.319185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55f60757-64d4-4e41-915a-03b4767866e8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.303534 Oct 25 03:46:15.319772 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3351/6823] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:15 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:15.797283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bda06237-87eb-42c0-8e17-302b092cf0ed req-e2d2e5c6-c782-4f9d-a57c-044e6bb32b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:15.803253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:15.809719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bda06237-87eb-42c0-8e17-302b092cf0ed req-e2d2e5c6-c782-4f9d-a57c-044e6bb32b89 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:15.810272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bda06237-87eb-42c0-8e17-302b092cf0ed req-e2d2e5c6-c782-4f9d-a57c-044e6bb32b89 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:15.810561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bda06237-87eb-42c0-8e17-302b092cf0ed req-e2d2e5c6-c782-4f9d-a57c-044e6bb32b89 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:15.823482 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bda06237-87eb-42c0-8e17-302b092cf0ed req-e2d2e5c6-c782-4f9d-a57c-044e6bb32b89 service nova] Creating event network-changed:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h2-862355-1 Oct 25 03:46:15.830218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-bda06237-87eb-42c0-8e17-302b092cf0ed req-e2d2e5c6-c782-4f9d-a57c-044e6bb32b89 service nova] Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:46:15.841248 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bda06237-87eb-42c0-8e17-302b092cf0ed req-e2d2e5c6-c782-4f9d-a57c-044e6bb32b89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047635 Oct 25 03:46:15.842551 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3473/6824] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:16.000714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:16.001355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:16.008869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:16.009626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:16.010108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:16.010841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:16.011318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:16.011763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:16.320399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:16.328300 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51e452f0-9838-4b99-a0c0-5d10f2543ee5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1692 microversion: 2.1 time: 0.331703 Oct 25 03:46:16.328994 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3352/6825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:15 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1692 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:16.344807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:16.345704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:16.352678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:16.353167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:16.353604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:16.354354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:16.354848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:16.355278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:16.498894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:16.509066 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fb01897-7bd0-41a7-84b9-6938630301bc tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.169200 Oct 25 03:46:16.522711 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3474/6826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:16 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:16.716838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-be09e43c-9355-491f-9d72-d20148cc19e1 req-105c930e-18b9-44e7-aba7-9ced60a99402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882624cc-49e8-4228-85cc-84a4d8e767eb", "tag": "5a205fa0-dd5d-4cea-8f70-0f570838ed4c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:16.728205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be09e43c-9355-491f-9d72-d20148cc19e1 req-105c930e-18b9-44e7-aba7-9ced60a99402 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:16.728845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be09e43c-9355-491f-9d72-d20148cc19e1 req-105c930e-18b9-44e7-aba7-9ced60a99402 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:16.729537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-be09e43c-9355-491f-9d72-d20148cc19e1 req-105c930e-18b9-44e7-aba7-9ced60a99402 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:16.741597 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-be09e43c-9355-491f-9d72-d20148cc19e1 req-105c930e-18b9-44e7-aba7-9ced60a99402 service nova] Creating event network-changed:5a205fa0-dd5d-4cea-8f70-0f570838ed4c for instance 882624cc-49e8-4228-85cc-84a4d8e767eb on n-h2-862355-1 Oct 25 03:46:16.748049 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-be09e43c-9355-491f-9d72-d20148cc19e1 req-105c930e-18b9-44e7-aba7-9ced60a99402 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035022 Oct 25 03:46:16.748758 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3353/6827] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:17.354472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:17.355397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:17.362706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:17.363200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:17.363639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:17.364366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:17.364823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:17.365249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:17.505215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:17.513298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33e9746a-c5de-40e5-a1a4-25346fa46196 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1692 microversion: 2.1 time: 0.164584 Oct 25 03:46:17.513917 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3475/6828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:17 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:17.533036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:17.533786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:17.541489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:17.542025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:17.542479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:17.543200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:17.543670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:17.544112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:17.690012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:17.694147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:17.701984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b3a963e-e53d-4691-a942-80f7cac5d669 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.173236 Oct 25 03:46:17.702609 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3354/6829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:17 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:18.536822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:18.538112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:18.546628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.547121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.547749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.548473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.548922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.549529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.652697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-371a4642-085d-4c27-b84c-f10d1efa9635 req-c2f67f94-c29e-4994-a51a-16079aed9152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a63982-5926-4523-a705-098c0997f88a", "name": "network-vif-plugged", "status": "completed", "tag": "c6145019-ec49-4e0b-9568-79aa0ce3356c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:18.668045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-371a4642-085d-4c27-b84c-f10d1efa9635 req-c2f67f94-c29e-4994-a51a-16079aed9152 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.668811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-371a4642-085d-4c27-b84c-f10d1efa9635 req-c2f67f94-c29e-4994-a51a-16079aed9152 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.669430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-371a4642-085d-4c27-b84c-f10d1efa9635 req-c2f67f94-c29e-4994-a51a-16079aed9152 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.686980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-371a4642-085d-4c27-b84c-f10d1efa9635 req-c2f67f94-c29e-4994-a51a-16079aed9152 service nova] Creating event network-vif-plugged:c6145019-ec49-4e0b-9568-79aa0ce3356c for instance 71a63982-5926-4523-a705-098c0997f88a on n-h1-862355-1 Oct 25 03:46:18.692489 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-371a4642-085d-4c27-b84c-f10d1efa9635 req-c2f67f94-c29e-4994-a51a-16079aed9152 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046030 Oct 25 03:46:18.693112 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3355/6830] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:46:18.704641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:18.713369 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-64ccf2da-7a47-4ab5-b679-e469fea50619 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1689 microversion: 2.1 time: 0.180363 Oct 25 03:46:18.725712 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3476/6831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:18 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:18.726070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:18.726917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:18.739252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:18.740058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:18.741455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.746332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.746800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.747081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.747544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.747662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.748020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.748159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.748456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.748756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.749247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.749697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.784069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=100 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:18.875908 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8abc0465-dbdd-43fc-bc07-3f832075e2a8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action" status: 202 len: 0 microversion: 2.1 time: 0.141214 Oct 25 03:46:18.880151 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3477/6832] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:46:18 2022] POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:46:18.880330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:18.887221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:18.888246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:18.894791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.895281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.896337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.897344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:18.897793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:18.899166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:18.903541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:18.971184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:18.979626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-572f61bf-93bd-4422-8554-98da18312df1 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.258189 Oct 25 03:46:18.980493 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3356/6833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:18 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:19.038227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:19.150263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:19.158110 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1377f29c-c797-4396-99e6-8afc416a03b3 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1688 microversion: 2.1 time: 0.276814 Oct 25 03:46:19.158621 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3478/6834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:18 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1688 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:46:20.003453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:20.004083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:20.011322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:20.011832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:20.012286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:20.013008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:20.013483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:20.013956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:20.148251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:20.157115 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9bf80721-82d8-40ee-ac5d-90c69d1d4fb7 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1319 microversion: 2.1 time: 0.157635 Oct 25 03:46:20.157833 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3357/6835] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:19 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:20.182720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:20.183458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:20.190333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:20.190913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:20.191465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:20.192233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:20.192737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:20.193198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:20.356916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:20.364818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b69aeccc-e9e4-4f38-8b78-fa461b9c906a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1688 microversion: 2.1 time: 0.187488 Oct 25 03:46:20.365406 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3479/6836] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:20 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:20.708543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f3eaac19-e91d-43ca-9bb9-7a6cbfa78ed9 req-7949de62-42eb-4409-9da1-cb7f1a167557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "name": "network-vif-plugged", "status": "completed", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:20.718511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f3eaac19-e91d-43ca-9bb9-7a6cbfa78ed9 req-7949de62-42eb-4409-9da1-cb7f1a167557 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:20.718998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f3eaac19-e91d-43ca-9bb9-7a6cbfa78ed9 req-7949de62-42eb-4409-9da1-cb7f1a167557 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:20.719439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f3eaac19-e91d-43ca-9bb9-7a6cbfa78ed9 req-7949de62-42eb-4409-9da1-cb7f1a167557 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:20.731964 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f3eaac19-e91d-43ca-9bb9-7a6cbfa78ed9 req-7949de62-42eb-4409-9da1-cb7f1a167557 service nova] Creating event network-vif-plugged:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h2-862355-1 Oct 25 03:46:20.737260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-f3eaac19-e91d-43ca-9bb9-7a6cbfa78ed9 req-7949de62-42eb-4409-9da1-cb7f1a167557 service nova] Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:46:20.748796 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f3eaac19-e91d-43ca-9bb9-7a6cbfa78ed9 req-7949de62-42eb-4409-9da1-cb7f1a167557 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044018 Oct 25 03:46:20.749394 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3358/6837] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:21.181586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:21.182426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:21.189659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:21.190299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:21.190605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:21.191304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:21.191762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:21.192192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:21.328567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:21.336549 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4b68e8de-340e-4bf1-902d-05b0db40cc5e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1508 microversion: 2.1 time: 0.159907 Oct 25 03:46:21.337135 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3480/6838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:21 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:21.390544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:21.391799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:21.398406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:21.398948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:21.399409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:21.400132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:21.400611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:21.401063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:21.560200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:21.568604 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c8166d3-ad6f-4bbb-9201-98595fbe407d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1688 microversion: 2.1 time: 0.183202 Oct 25 03:46:21.569354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3359/6839] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:21 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:22.312587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3bf81e91-72ed-40fa-94b0-f523fca556d6 req-50dae4d5-cff4-4371-8a57-e6806e1e9b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "name": "network-vif-unplugged", "status": "completed", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:22.324418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3bf81e91-72ed-40fa-94b0-f523fca556d6 req-50dae4d5-cff4-4371-8a57-e6806e1e9b29 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:22.325342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3bf81e91-72ed-40fa-94b0-f523fca556d6 req-50dae4d5-cff4-4371-8a57-e6806e1e9b29 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:22.326235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3bf81e91-72ed-40fa-94b0-f523fca556d6 req-50dae4d5-cff4-4371-8a57-e6806e1e9b29 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:22.339325 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3bf81e91-72ed-40fa-94b0-f523fca556d6 req-50dae4d5-cff4-4371-8a57-e6806e1e9b29 service nova] Creating event network-vif-unplugged:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:46:22.345241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-3bf81e91-72ed-40fa-94b0-f523fca556d6 req-50dae4d5-cff4-4371-8a57-e6806e1e9b29 service nova] Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:46:22.357091 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3bf81e91-72ed-40fa-94b0-f523fca556d6 req-50dae4d5-cff4-4371-8a57-e6806e1e9b29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048255 Oct 25 03:46:22.358351 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3481/6840] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:46:22.592911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:22.594081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:22.603488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:22.604099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:22.607134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:22.608067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:22.608802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:22.609321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:22.908684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:22.922108 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c31a9231-c4da-427e-adf4-ef3c78d42547 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1688 microversion: 2.1 time: 0.333132 Oct 25 03:46:22.922715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3360/6841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:22 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1688 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:23.948830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:23.949533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:23.955817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:23.956306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:23.956950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:23.957660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:23.958142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:23.958573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:24.105483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:24.113309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d940aa9-3acd-496a-997b-43dc969f8654 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1688 microversion: 2.1 time: 0.170379 Oct 25 03:46:24.113925 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3482/6842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:23 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:24.419794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4d8e0f78-f274-4bc6-943f-c2970e96a444 req-3f782986-3f94-45b8-85a9-f2b80647f445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:24.431548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d8e0f78-f274-4bc6-943f-c2970e96a444 req-3f782986-3f94-45b8-85a9-f2b80647f445 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:24.432384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d8e0f78-f274-4bc6-943f-c2970e96a444 req-3f782986-3f94-45b8-85a9-f2b80647f445 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:24.433045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d8e0f78-f274-4bc6-943f-c2970e96a444 req-3f782986-3f94-45b8-85a9-f2b80647f445 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:24.446444 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4d8e0f78-f274-4bc6-943f-c2970e96a444 req-3f782986-3f94-45b8-85a9-f2b80647f445 service nova] Creating event network-changed:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:46:24.451842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-4d8e0f78-f274-4bc6-943f-c2970e96a444 req-3f782986-3f94-45b8-85a9-f2b80647f445 service nova] Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:46:24.466028 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4d8e0f78-f274-4bc6-943f-c2970e96a444 req-3f782986-3f94-45b8-85a9-f2b80647f445 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050401 Oct 25 03:46:24.466807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3361/6843] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:25.137322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:25.138725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:25.149117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:25.150496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:25.151450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:25.152562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:25.153493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:25.154355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:25.406741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:25.420867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4e40f4cf-3bde-409e-8074-3ad6a9bf51b6 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1688 microversion: 2.1 time: 0.287726 Oct 25 03:46:25.436239 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3483/6844] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:25 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1688 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:26.450697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:26.451372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:26.457811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:26.458312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:26.458763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:26.459507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:26.460034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:26.460479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:26.611526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:26.620128 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe6746cb-167e-43b2-aff3-da220cbf3e54 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1681 microversion: 2.1 time: 0.174969 Oct 25 03:46:26.621051 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3362/6845] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:26 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:28.641024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-064979ae-e509-485d-9cf6-92e3c5a5276e req-4021d1c1-7edd-42e4-856b-9748378a7da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "name": "network-vif-plugged", "status": "completed", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:28.653594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-064979ae-e509-485d-9cf6-92e3c5a5276e req-4021d1c1-7edd-42e4-856b-9748378a7da0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:28.654705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-064979ae-e509-485d-9cf6-92e3c5a5276e req-4021d1c1-7edd-42e4-856b-9748378a7da0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:28.655395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-064979ae-e509-485d-9cf6-92e3c5a5276e req-4021d1c1-7edd-42e4-856b-9748378a7da0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:28.668212 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-064979ae-e509-485d-9cf6-92e3c5a5276e req-4021d1c1-7edd-42e4-856b-9748378a7da0 service nova] Creating event network-vif-plugged:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:46:28.673653 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-064979ae-e509-485d-9cf6-92e3c5a5276e req-4021d1c1-7edd-42e4-856b-9748378a7da0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036147 Oct 25 03:46:28.674328 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3484/6846] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:37.742665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3233e4de-266e-45a5-aaba-0b51636f8565", "device": "/dev/sdb"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:37.745769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:37.748674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=37 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:37.749405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=40 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:37.755455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:37.755957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:37.756412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:37.757286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:37.757800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:37.758249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:38.016277 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3954c3e3-3246-44b4-9fdf-749213a8b5d8 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "POST /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277467 Oct 25 03:46:38.022335 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3363/6847] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:46:37 2022] POST /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:50.822466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=27 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:50.823147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:50.828036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:50.830438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:50.839149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:50.839630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:50.840063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:50.840758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:50.841211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:50.841634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:50.896333 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b095dc62-a678-49d7-bb42-8481b72b015e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action" status: 200 len: 63157 microversion: 2.1 time: 0.075944 Oct 25 03:46:50.896989 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3485/6848] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:46:50 2022] POST /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9/action => generated 63157 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:46:57.078723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:57.079457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:46:57.084111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:57.084834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:57.092571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:57.093069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:57.093523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:57.094266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:57.094740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:57.095183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:57.226031 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-08b778f2-347a-4fba-876a-d7114d5a1345 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1832 microversion: 2.1 time: 0.149329 Oct 25 03:46:57.226622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3364/6849] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:57 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1832 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:58.118972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:58.124496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-84d84bbf-7981-479b-950f-bfe045847b7c req-49e5f339-e5e1-40e7-9c32-f52220eb29c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:46:58.126762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:58.143076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:58.145630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-84d84bbf-7981-479b-950f-bfe045847b7c req-49e5f339-e5e1-40e7-9c32-f52220eb29c6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:58.146398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-84d84bbf-7981-479b-950f-bfe045847b7c req-49e5f339-e5e1-40e7-9c32-f52220eb29c6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:58.146542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:58.146936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:58.147495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-84d84bbf-7981-479b-950f-bfe045847b7c req-49e5f339-e5e1-40e7-9c32-f52220eb29c6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:58.147703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:58.148304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:58.148741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:58.161325 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-84d84bbf-7981-479b-950f-bfe045847b7c req-49e5f339-e5e1-40e7-9c32-f52220eb29c6 service nova] Creating event network-changed:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:46:58.167312 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-84d84bbf-7981-479b-950f-bfe045847b7c req-49e5f339-e5e1-40e7-9c32-f52220eb29c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046430 Oct 25 03:46:58.168579 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3365/6850] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:46:58.184149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:46:58.285246 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-47a9ec6e-5351-4519-a7da-a24095e67381 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 204 len: 0 microversion: 2.1 time: 0.170022 Oct 25 03:46:58.286503 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3486/6851] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:46:58 2022] DELETE /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:46:58.296510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:58.303717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:58.310999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:58.311579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:58.312036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:58.312755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:58.313221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:58.318400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:58.495452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:58.504054 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b5ab72b-1bfb-42a2-a5d3-f606247515ee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1687 microversion: 2.1 time: 0.212228 Oct 25 03:46:58.504806 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3366/6852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:58 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1687 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:46:59.529270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:46:59.529939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:46:59.537547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:59.538063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:59.538506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:59.539204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:46:59.539663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:46:59.540095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:46:59.684076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:46:59.692368 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b2830b8-5a49-4533-88e4-60bded406039 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1687 microversion: 2.1 time: 0.167519 Oct 25 03:46:59.692950 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3487/6853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:46:59 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:00.238715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-cca47e25-54c0-48a8-94f9-9c56d9d6bb63 req-a16c5bbc-b750-40ae-bb0e-52892febbafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa00780-a43a-49c6-8c26-cbc2c052abb9", "name": "network-vif-deleted", "tag": "20c97771-f71f-4527-84dd-2e20d8de5229"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:00.254120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cca47e25-54c0-48a8-94f9-9c56d9d6bb63 req-a16c5bbc-b750-40ae-bb0e-52892febbafb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:00.254648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cca47e25-54c0-48a8-94f9-9c56d9d6bb63 req-a16c5bbc-b750-40ae-bb0e-52892febbafb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:00.255096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cca47e25-54c0-48a8-94f9-9c56d9d6bb63 req-a16c5bbc-b750-40ae-bb0e-52892febbafb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:00.268893 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-cca47e25-54c0-48a8-94f9-9c56d9d6bb63 req-a16c5bbc-b750-40ae-bb0e-52892febbafb service nova] Creating event network-vif-deleted:20c97771-f71f-4527-84dd-2e20d8de5229 for instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 on n-h1-862355-1 Oct 25 03:47:00.277035 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-cca47e25-54c0-48a8-94f9-9c56d9d6bb63 req-a16c5bbc-b750-40ae-bb0e-52892febbafb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041498 Oct 25 03:47:00.277650 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3367/6854] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:00.716192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:00.717476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:00.724592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:00.725086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:00.725530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:00.726399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:00.726935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:00.727376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:00.765967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:00.766456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:00.766902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:00.767388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lazy-loading 'fault' on Instance uuid aaa00780-a43a-49c6-8c26-cbc2c052abb9 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:47:00.813309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:00.821395 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d149998-a1bd-4c9e-b805-354caeb70a8d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 200 len: 1355 microversion: 2.1 time: 0.109286 Oct 25 03:47:00.824322 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3488/6855] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:00 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 1355 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:01.851780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:01.852601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: aaa00780-a43a-49c6-8c26-cbc2c052abb9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:01.860705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:01.861204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:01.861669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:01.862412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:01.862884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:01.863334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:01.878437 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] HTTP exception thrown: Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 could not be found. Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Request method failure captured: Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 HTTP/1.1 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1sn7Jqyk8iWGhv8KTU8-HZ4ckbmnIqC7OUVGg9nbBanytbYzmLCBu6ojVNjR80D0kicdrklCDCRrHjiw6Ejgf_qPQBhDc8G0Gx9QKO14FZeMcmLdGHpa5RO8U2zyUH-9Nf5_Fn7LyOKCbnZk3-qnefoKct38XLa3HKTHps3cugo6IY Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_84d9f7a653134b0da86e56f376f0124b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/84d9f7a653134b0da86e56f376f0124b"}]}] Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 329132b9ba734f18ab7270e10d0b7e31 Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 could not be found. Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'aaa00780-a43a-49c6-8c26-cbc2c052abb9'} Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 could not be found. Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 could not be found. Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:47:01.880414 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 could not be found. Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Returning 404 to user: Instance aaa00780-a43a-49c6-8c26-cbc2c052abb9 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1b00c84b-c7f7-4a52-bc03-79d466aff06c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9" status: 404 len: 111 microversion: 2.1 time: 0.035104 Oct 25 03:47:01.887581 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3368/6856] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:01 2022] GET /compute/v2.1/servers/aaa00780-a43a-49c6-8c26-cbc2c052abb9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:47:01.913251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:01.913892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:01.922181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:01.922754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:01.923275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:01.923988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:01.924508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:01.924940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:02.023155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lazy-loading 'services' on Instance uuid 71a63982-5926-4523-a705-098c0997f88a {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:47:02.109735 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00f8a4e9-719f-47a0-a234-bab4bda84d23 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "DELETE /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a/os-volume_attachments/3233e4de-266e-45a5-aaba-0b51636f8565" status: 202 len: 0 microversion: 2.1 time: 0.201355 Oct 25 03:47:02.110295 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3489/6857] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:47:01 2022] DELETE /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a/os-volume_attachments/3233e4de-266e-45a5-aaba-0b51636f8565 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:47:05.720613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5951dd14-d59a-408c-9acd-2247a942905b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '.version_select at 0x7efd33db11f0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:05.755571 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5951dd14-d59a-408c-9acd-2247a942905b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-23944449" status: 202 len: 0 microversion: 2.1 time: 0.042903 Oct 25 03:47:05.761891 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3369/6858] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 25 03:47:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-23944449 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:47:05.794473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-14946dcc-3c3f-4e2f-97b0-045d7469be0e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: .version_select at 0x7efd339e9280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-477719757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC8LhkOSR8lA5TjfgIu3VmSBvxdmerqc591oa8VYOxhku++gUUNdC95P4Keo3FriT27E/GEqtfk4TMAfMTAZziDkww4aFUiKITYuW1hKa6yHTKvw4E+xhtW9aqNFPfKzw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:05.811121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-14946dcc-3c3f-4e2f-97b0-045d7469be0e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:47:05.817193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-14946dcc-3c3f-4e2f-97b0-045d7469be0e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:47:05.842754 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-14946dcc-3c3f-4e2f-97b0-045d7469be0e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053521 Oct 25 03:47:05.843531 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3490/6859] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:47:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:07.624717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:07.625323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:07.631413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:07.631919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:07.632532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:07.633454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:07.633972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:07.634425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:07.660676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:47:07.749948 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6586ed48-b89d-4788-a8dc-877b0314fe64 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "DELETE /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 204 len: 0 microversion: 2.1 time: 0.131262 Oct 25 03:47:07.753696 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3370/6860] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:47:07 2022] DELETE /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:47:07.760219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:07.760958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:07.767650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:07.768142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:07.768576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:07.769277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:07.769753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:07.770179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:08.076923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:08.084798 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0036454b-57af-4596-af10-5d5fa4904842 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1514 microversion: 2.1 time: 0.329622 Oct 25 03:47:08.085292 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3491/6861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:07 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:09.110204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:09.110830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:09.117297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:09.117830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:09.118283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:09.119142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:09.119772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:09.120210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:09.770769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:09.782038 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-49174cf6-ebf6-49a4-a569-f8d65fca429b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1514 microversion: 2.1 time: 0.675709 Oct 25 03:47:09.783438 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3371/6862] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:09 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1514 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:47:10.435910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1f70fb16-2fe8-49bb-b198-7dc62d0b73d4 req-d3038c4d-9ea1-4a1c-8e77-643f737c950a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a63982-5926-4523-a705-098c0997f88a", "name": "network-vif-deleted", "tag": "c6145019-ec49-4e0b-9568-79aa0ce3356c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:10.448648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1f70fb16-2fe8-49bb-b198-7dc62d0b73d4 req-d3038c4d-9ea1-4a1c-8e77-643f737c950a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:10.449533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1f70fb16-2fe8-49bb-b198-7dc62d0b73d4 req-d3038c4d-9ea1-4a1c-8e77-643f737c950a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:10.450183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1f70fb16-2fe8-49bb-b198-7dc62d0b73d4 req-d3038c4d-9ea1-4a1c-8e77-643f737c950a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:10.463421 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1f70fb16-2fe8-49bb-b198-7dc62d0b73d4 req-d3038c4d-9ea1-4a1c-8e77-643f737c950a service nova] Creating event network-vif-deleted:c6145019-ec49-4e0b-9568-79aa0ce3356c for instance 71a63982-5926-4523-a705-098c0997f88a on n-h1-862355-1 Oct 25 03:47:10.471059 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1f70fb16-2fe8-49bb-b198-7dc62d0b73d4 req-d3038c4d-9ea1-4a1c-8e77-643f737c950a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050337 Oct 25 03:47:10.472796 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3492/6863] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:10.809050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:10.809709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:10.816938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:10.817442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:10.817932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:10.819392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:10.819902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:10.820948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:10.868562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:10.869847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:10.870393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:10.870984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lazy-loading 'fault' on Instance uuid 71a63982-5926-4523-a705-098c0997f88a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:47:10.921070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:10.931778 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37e59337-f973-4074-bbea-d201760eb460 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 200 len: 1309 microversion: 2.1 time: 0.126772 Oct 25 03:47:10.933043 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3372/6864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:10 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:11.957713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:11.958402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 71a63982-5926-4523-a705-098c0997f88a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:11.965418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:11.965931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:11.966365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:11.967065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:11.967519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:11.968033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:11.983330 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] HTTP exception thrown: Instance 71a63982-5926-4523-a705-098c0997f88a could not be found. Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Request method failure captured: Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a HTTP/1.1 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1vGJdb27kLvyC7VN67MsPnSn_r7Zp126Gi6s8ZfkhRM-NXWH1DLC6USR9D2ZR6QZBADyqDt8ZVxAMJgyqiNzGch9AjvZtu3oedzeMaX6TWrXMqXe2ktmIztgguICe_pxazwOoF3KJbJNmp2EC4OKJk68Kr4pZQayTbiWBEB7Oy1EY0 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 204ddd86bcd94dc3a0af918e22fc0e58 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1421490588 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/204ddd86bcd94dc3a0af918e22fc0e58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/204ddd86bcd94dc3a0af918e22fc0e58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_204ddd86bcd94dc3a0af918e22fc0e58", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/204ddd86bcd94dc3a0af918e22fc0e58"}]}] Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesSnapshotTestJSON-1421490588 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 204ddd86bcd94dc3a0af918e22fc0e58 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1421490588 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesSnapshotTestJSON-1421490588-project Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 49e2503fb22a4c03ba141139ead49708 Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesSnapshotTestJSON-1421490588-project Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 71a63982-5926-4523-a705-098c0997f88a could not be found. Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '71a63982-5926-4523-a705-098c0997f88a'} Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a63982-5926-4523-a705-098c0997f88a could not be found. Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a63982-5926-4523-a705-098c0997f88a could not be found. Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:47:11.985007 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a63982-5926-4523-a705-098c0997f88a could not be found. Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Returning 404 to user: Instance 71a63982-5926-4523-a705-098c0997f88a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af121f6d-fa48-4e14-a1b7-2c337a1ab1df tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a" status: 404 len: 111 microversion: 2.1 time: 0.034134 Oct 25 03:47:11.990192 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3493/6865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:11 2022] GET /compute/v2.1/servers/71a63982-5926-4523-a705-098c0997f88a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:47:12.586444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1034986067", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "423003a5-5ec2-4724-82bb-4326984ae7bd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-477719757", "security_groups": [{"name": "tempest-secgroup-smoke-1232297855"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:12.749871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] validate_networks() for [('423003a5-5ec2-4724-82bb-4326984ae7bd', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:47:13.201576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:47:13.201576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:47:13.202123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:47:13.202755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:47:13.203251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:47:13.215614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:13.216458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:13.217130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:13.218125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:13.218815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:13.219477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:13.245139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:47:13.252014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:47:13.270103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:47:13.273177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:47:13.345494 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-25e33ad2-8728-4fd2-999c-04fc14ea2f4b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764509 Oct 25 03:47:13.349203 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3373/6866] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:47:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:47:13.359800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1acb40fb-440a-4c0c-8283-0ae07a382647 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:13.361118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1acb40fb-440a-4c0c-8283-0ae07a382647 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:13.500483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1acb40fb-440a-4c0c-8283-0ae07a382647 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:13.508893 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1acb40fb-440a-4c0c-8283-0ae07a382647 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1266 microversion: 2.1 time: 0.153010 Oct 25 03:47:13.528871 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3494/6867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:13 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:14.536759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:14.538044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:14.546667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:14.547178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:14.547627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:14.548355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:14.548826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:14.549267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:14.622171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:14.631273 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-87cf7623-a215-46e8-9e8b-835db6529d70 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1318 microversion: 2.1 time: 0.098464 Oct 25 03:47:14.631863 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3374/6868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:14 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:15.656677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:15.657333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:15.664804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:15.665305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:15.665842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:15.666568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:15.667033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:15.671703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:15.996044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:16.022606 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9bff872b-3290-4833-b4ae-f1a35ecc53bc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1392 microversion: 2.1 time: 0.369736 Oct 25 03:47:16.026187 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3495/6869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:15 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1392 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:16.599008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c69b71f9-f8ba-48ec-8cc6-afe02b3bb532 req-158176ca-7f8a-4de2-8dd5-9d3af7c61230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51224826-c4ad-4223-a45a-15c46c3e8a2b", "tag": "6a35bf07-66d4-4112-9a88-19f1056ea535"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:16.612244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c69b71f9-f8ba-48ec-8cc6-afe02b3bb532 req-158176ca-7f8a-4de2-8dd5-9d3af7c61230 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:16.613191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c69b71f9-f8ba-48ec-8cc6-afe02b3bb532 req-158176ca-7f8a-4de2-8dd5-9d3af7c61230 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:16.613640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c69b71f9-f8ba-48ec-8cc6-afe02b3bb532 req-158176ca-7f8a-4de2-8dd5-9d3af7c61230 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:16.627405 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c69b71f9-f8ba-48ec-8cc6-afe02b3bb532 req-158176ca-7f8a-4de2-8dd5-9d3af7c61230 service nova] Creating event network-changed:6a35bf07-66d4-4112-9a88-19f1056ea535 for instance 51224826-c4ad-4223-a45a-15c46c3e8a2b on n-h1-862355-1 Oct 25 03:47:16.635777 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c69b71f9-f8ba-48ec-8cc6-afe02b3bb532 req-158176ca-7f8a-4de2-8dd5-9d3af7c61230 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039797 Oct 25 03:47:16.636205 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3375/6870] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:17.050027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:17.050773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:17.060579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:17.061175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:17.061701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:17.062620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:17.063156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:17.063661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:17.204577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:17.213227 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c7c379e-5235-4f96-ba2d-1e8069a24e5e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1392 microversion: 2.1 time: 0.168023 Oct 25 03:47:17.213737 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3496/6871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:17 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:18.238821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:18.239487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:18.247280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:18.247788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:18.248243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:18.249143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:18.249613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:18.250325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:18.464037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:18.472131 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b183945c-f4c4-4576-a407-404b77db065c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1392 microversion: 2.1 time: 0.238584 Oct 25 03:47:18.472720 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3376/6872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:18 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:18.906050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1800790106", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "d77e0b21-bb77-4af3-a75a-6c74b8cd77c0"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:18.960336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] validate_networks() for [('d77e0b21-bb77-4af3-a75a-6c74b8cd77c0', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:47:19.309452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:47:19.309923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:47:19.310586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:47:19.311010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:47:19.311434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:47:19.320340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:19.320838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:19.321284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:19.322753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:19.323223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:19.323729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:19.342097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Getting quotas for project 204ddd86bcd94dc3a0af918e22fc0e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:47:19.347858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Getting quotas for user 49e2503fb22a4c03ba141139ead49708 and project 204ddd86bcd94dc3a0af918e22fc0e58. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:47:19.361206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:47:19.363592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:47:19.412388 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af500dea-e8e3-4c07-a685-d238aceab379 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510309 Oct 25 03:47:19.413052 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3497/6873] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:47:19.424439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fcb4b4bc-404e-4d1d-b7d0-01141c14b269 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:19.425072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fcb4b4bc-404e-4d1d-b7d0-01141c14b269 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:19.482302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fcb4b4bc-404e-4d1d-b7d0-01141c14b269 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:19.489252 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fcb4b4bc-404e-4d1d-b7d0-01141c14b269 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1219 microversion: 2.1 time: 0.068758 Oct 25 03:47:19.490168 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3377/6874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:19 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:19.500083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:19.501135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:19.508108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:19.508606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:19.509049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:19.510381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:19.510940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:19.511375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:19.654693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:19.663413 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ebfe70b5-5561-48f4-a8dc-260db529563d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1392 microversion: 2.1 time: 0.167437 Oct 25 03:47:19.664170 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3498/6875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:19 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:20.512655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:20.514138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:20.522426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:20.523079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:20.523813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:20.525005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:20.526127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:20.526857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:20.603778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:20.611666 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01ef93b5-41fc-45bd-af36-112f8749311e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1289 microversion: 2.1 time: 0.103049 Oct 25 03:47:20.612267 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3378/6876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:20 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:20.688764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:20.689652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:20.696584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:20.697660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:20.698139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:20.698844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:20.699330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:20.699755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:20.899549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:20.904226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:20.912702 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-908d165a-f743-4188-b4f7-b1eb2da1258d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1392 microversion: 2.1 time: 0.227801 Oct 25 03:47:20.913765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3499/6877] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:20 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:21.636086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:21.636718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:21.644016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:21.644450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:21.644895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:21.645604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:21.646098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:21.646533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:21.783369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:21.792074 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55176cdf-a0d7-4257-9cab-78c18754687f tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.160428 Oct 25 03:47:21.792663 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3379/6878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:21 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:21.870065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9e6e2f57-a1ab-4e0f-956b-64eb703c06d0 req-a2cde613-7c02-42a9-8816-12883c7f6da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d60f988-66d1-4e34-91f2-9d36ef9fea13", "tag": "680fa7b9-87aa-443f-9477-0f1f62f64cc4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:21.877542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:21.885209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e6e2f57-a1ab-4e0f-956b-64eb703c06d0 req-a2cde613-7c02-42a9-8816-12883c7f6da1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:21.885920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e6e2f57-a1ab-4e0f-956b-64eb703c06d0 req-a2cde613-7c02-42a9-8816-12883c7f6da1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:21.886363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e6e2f57-a1ab-4e0f-956b-64eb703c06d0 req-a2cde613-7c02-42a9-8816-12883c7f6da1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:21.899358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9e6e2f57-a1ab-4e0f-956b-64eb703c06d0 req-a2cde613-7c02-42a9-8816-12883c7f6da1 service nova] Creating event network-changed:680fa7b9-87aa-443f-9477-0f1f62f64cc4 for instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 on n-h2-862355-1 Oct 25 03:47:21.905092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9e6e2f57-a1ab-4e0f-956b-64eb703c06d0 req-a2cde613-7c02-42a9-8816-12883c7f6da1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039176 Oct 25 03:47:21.905735 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3500/6879] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:21.937065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:21.938715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:21.945208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:21.945933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:21.946401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:21.947916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:21.948410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:21.948920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:22.090469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:22.098792 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-06cf2e3f-4038-4970-99b2-1c31f997f58b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1392 microversion: 2.1 time: 0.165776 Oct 25 03:47:22.099310 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3380/6880] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:21 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:47:22.786597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3f21530e-d008-4a9a-8eeb-1989347cb39f req-6ab18c7e-f111-4e82-91c0-93a88706bbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51224826-c4ad-4223-a45a-15c46c3e8a2b", "name": "network-vif-plugged", "status": "completed", "tag": "6a35bf07-66d4-4112-9a88-19f1056ea535"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:22.797412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3f21530e-d008-4a9a-8eeb-1989347cb39f req-6ab18c7e-f111-4e82-91c0-93a88706bbc2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:22.797930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3f21530e-d008-4a9a-8eeb-1989347cb39f req-6ab18c7e-f111-4e82-91c0-93a88706bbc2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:22.798379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3f21530e-d008-4a9a-8eeb-1989347cb39f req-6ab18c7e-f111-4e82-91c0-93a88706bbc2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:22.812276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3f21530e-d008-4a9a-8eeb-1989347cb39f req-6ab18c7e-f111-4e82-91c0-93a88706bbc2 service nova] Creating event network-vif-plugged:6a35bf07-66d4-4112-9a88-19f1056ea535 for instance 51224826-c4ad-4223-a45a-15c46c3e8a2b on n-h1-862355-1 Oct 25 03:47:22.815437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:22.816223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:22.818646 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3f21530e-d008-4a9a-8eeb-1989347cb39f req-6ab18c7e-f111-4e82-91c0-93a88706bbc2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035448 Oct 25 03:47:22.819728 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3501/6881] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:22.823607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:22.824118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:22.824572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:22.825293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:22.825794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:22.826255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:23.027692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:23.035451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4fee8770-73e7-49a3-a752-3f91b983275a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.224020 Oct 25 03:47:23.036036 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3381/6882] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:22 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:47:23.123587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:23.124396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:23.131717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:23.132208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:23.132645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:23.133337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:23.133824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:23.134343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:23.272390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:23.280535 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1caaca87-e81f-4605-90d4-3f0c52ec4bc8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1392 microversion: 2.1 time: 0.161871 Oct 25 03:47:23.281114 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3502/6883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:23 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:24.058701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:24.059384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:24.062100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:24.069665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:24.070154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:24.070610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:24.071333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:24.071891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:24.072324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:24.204147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:24.212161 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c5a0ae8-e55f-486b-a994-e6b91ad5a57c tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.157476 Oct 25 03:47:24.213633 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3382/6884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:24 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:24.304119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:24.304696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:24.311842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:24.312357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:24.312799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:24.313503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:24.313998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:24.314433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:24.450200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:24.457926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-585c69e1-19e4-482c-99fc-4ef64d38d7bd tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1563 microversion: 2.1 time: 0.158051 Oct 25 03:47:24.458500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3503/6885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:24 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:24.481433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:24.482128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:24.488095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:24.488621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:24.489074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:24.489803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:24.490270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:24.490711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:24.633627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:24.637866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:24.643257 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2dc09722-4d91-41eb-9863-fecc3446284e tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1563 microversion: 2.1 time: 0.166263 Oct 25 03:47:24.643849 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3383/6886] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:24 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:25.235926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:25.236560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:25.242836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:25.243322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:25.244372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:25.245174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:25.245631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:25.246079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:25.381213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:25.389127 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f9d28527-a61c-42b0-ac95-4212a3fb855a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.157398 Oct 25 03:47:25.389721 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3504/6887] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:25 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:26.413084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:26.413744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:26.422067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:26.422619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:26.423089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:26.423820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:26.424301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:26.424755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:26.625477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:26.638041 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad04363b-e63e-4c15-a27a-b3571b06ea7a tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.229647 Oct 25 03:47:26.653155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3384/6888] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:26 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:26.672715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:26.673342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:26.687309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-192ac893-bac0-49e6-9e53-eed25797d23f req-848aaabb-f472-47ff-ac1a-4f53dc5b8d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51224826-c4ad-4223-a45a-15c46c3e8a2b", "tag": "6a35bf07-66d4-4112-9a88-19f1056ea535"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:26.691597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:26.692235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:26.693009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:26.693991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:26.694443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:26.695009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:26.697615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-192ac893-bac0-49e6-9e53-eed25797d23f req-848aaabb-f472-47ff-ac1a-4f53dc5b8d92 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:26.698154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-192ac893-bac0-49e6-9e53-eed25797d23f req-848aaabb-f472-47ff-ac1a-4f53dc5b8d92 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:26.698606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-192ac893-bac0-49e6-9e53-eed25797d23f req-848aaabb-f472-47ff-ac1a-4f53dc5b8d92 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:26.711229 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-192ac893-bac0-49e6-9e53-eed25797d23f req-848aaabb-f472-47ff-ac1a-4f53dc5b8d92 service nova] Creating event network-changed:6a35bf07-66d4-4112-9a88-19f1056ea535 for instance 51224826-c4ad-4223-a45a-15c46c3e8a2b on n-h1-862355-1 Oct 25 03:47:26.717980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-192ac893-bac0-49e6-9e53-eed25797d23f req-848aaabb-f472-47ff-ac1a-4f53dc5b8d92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034249 Oct 25 03:47:26.718923 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3385/6889] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:26.867134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:26.876329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9e98a7f5-565c-4d70-b5e9-e7cb9fb2b392 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1563 microversion: 2.1 time: 0.208043 Oct 25 03:47:26.876923 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3505/6890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:26 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:27.664331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:27.665056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:27.667623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:27.673196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:27.673735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:27.674174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:27.674894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:27.675363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:27.675807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:27.814457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:27.824136 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-22ad06de-b5d5-4aae-b4a1-9b7006b530c0 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.164295 Oct 25 03:47:27.824738 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3386/6891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:27 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:28.663867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bdc6ee11-1299-41a2-b6d3-ed3cdc7446ed req-85cdb3c2-b5e3-4a5a-a4e1-110581f027d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d60f988-66d1-4e34-91f2-9d36ef9fea13", "name": "network-vif-plugged", "status": "completed", "tag": "680fa7b9-87aa-443f-9477-0f1f62f64cc4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:28.677182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bdc6ee11-1299-41a2-b6d3-ed3cdc7446ed req-85cdb3c2-b5e3-4a5a-a4e1-110581f027d6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:28.677719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bdc6ee11-1299-41a2-b6d3-ed3cdc7446ed req-85cdb3c2-b5e3-4a5a-a4e1-110581f027d6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:28.678115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bdc6ee11-1299-41a2-b6d3-ed3cdc7446ed req-85cdb3c2-b5e3-4a5a-a4e1-110581f027d6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:28.690846 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bdc6ee11-1299-41a2-b6d3-ed3cdc7446ed req-85cdb3c2-b5e3-4a5a-a4e1-110581f027d6 service nova] Creating event network-vif-plugged:680fa7b9-87aa-443f-9477-0f1f62f64cc4 for instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 on n-h2-862355-1 Oct 25 03:47:28.696107 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bdc6ee11-1299-41a2-b6d3-ed3cdc7446ed req-85cdb3c2-b5e3-4a5a-a4e1-110581f027d6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036700 Oct 25 03:47:28.696761 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3506/6892] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:28.846777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:28.847417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:28.854378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:28.854880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:28.855336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:28.856045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:28.856516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:28.856959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:28.990070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:28.998693 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4d3a3b43-cf11-4468-b121-ca156bdd554e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.156069 Oct 25 03:47:28.999289 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3387/6893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:28 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:30.022650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:30.023358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:30.026569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:30.027275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:30.035127 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:30.035611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:30.036048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:30.036741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:30.037203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:30.042435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:30.181119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:30.189152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f4cc265c-33d6-497f-aa32-70469e74a45b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1319 microversion: 2.1 time: 0.170726 Oct 25 03:47:30.189760 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3507/6894] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:30 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:31.213458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:31.214133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:31.215999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:31.222345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:31.223690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:31.223690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:31.223994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:31.224465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:31.224904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:31.356291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:31.364130 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb69d0ca-cc2c-43b6-907c-77d0dd950ece tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1507 microversion: 2.1 time: 0.155253 Oct 25 03:47:31.364715 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3388/6895] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:31 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:31.387164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a9492b8-a300-443f-a5f4-69b222e6afcd", "device": "/dev/sdb"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:31.389526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:31.396294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:31.396776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:31.397213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:31.397926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:31.398382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:31.398809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:31.638857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6810a3d0-2cf1-45f0-a691-24a924d85133 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "POST /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255661 Oct 25 03:47:31.639670 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3508/6896] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 03:47:31 2022] POST /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:47:50.136377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=5 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:50.137885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=26 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:50.312012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:50.318004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:50.333075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:50.334624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:50.335086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:50.335967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:50.336426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:50.336868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:50.399126 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-696f2403-73eb-402d-9554-9bd268f1208b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action" status: 200 len: 24576 microversion: 2.1 time: 0.264675 Oct 25 03:47:50.399975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3389/6897] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:47:50 2022] POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action => generated 24576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:47:53.280528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:53.282051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:53.283889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=17 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:53.284889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:47:53.291773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:53.292376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:53.292807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:53.293759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:53.294279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:53.294648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:53.384015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lazy-loading 'services' on Instance uuid 9d60f988-66d1-4e34-91f2-9d36ef9fea13 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:47:53.461713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d3db31c1-15fd-434a-8540-cfb96c62db98 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13/os-volume_attachments/0a9492b8-a300-443f-a5f4-69b222e6afcd" status: 202 len: 0 microversion: 2.1 time: 0.186843 Oct 25 03:47:53.466624 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3509/6898] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 03:47:53 2022] DELETE /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13/os-volume_attachments/0a9492b8-a300-443f-a5f4-69b222e6afcd => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:47:55.231118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-447032964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-303901269", "security_groups": [{"name": "tempest-secgroup-smoke-1413309307"}], "block_device_mapping_v2": [{"uuid": "84e21350-63bc-4ca0-8d43-eb44c2206203", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df7553d7-7921-43b0-b1a9-8f362dde378f"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:55.349826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] validate_networks() for [('df7553d7-7921-43b0-b1a9-8f362dde378f', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:47:55.752114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:47:55.752551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:47:55.753039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:47:55.753494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:47:55.753984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:47:55.763623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:55.764129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:55.764578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:55.765326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:55.765832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:55.766446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:55.785842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:47:55.792352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Getting quotas for user 61e64a49b61740dea1df3c46936978fc and project 943b7da2264a430484090abc9f4773a9. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:47:55.852765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:47:55.856230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84e21350-63bc-4ca0-8d43-eb44c2206203',volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:47:55.990056 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cd2224a7-7ecf-43fd-a1e2-5b6d61abca7f tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764145 Oct 25 03:47:55.990889 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3390/6899] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:47:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:47:56.003378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aff5a0fc-9f72-40c4-85d8-025d6e9856f4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:56.004075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aff5a0fc-9f72-40c4-85d8-025d6e9856f4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:56.065238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aff5a0fc-9f72-40c4-85d8-025d6e9856f4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:56.073025 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aff5a0fc-9f72-40c4-85d8-025d6e9856f4 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1093 microversion: 2.1 time: 0.074539 Oct 25 03:47:56.086570 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3510/6900] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:55 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:57.097697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:57.098269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:57.106703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:57.107363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:57.107933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:57.108771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:57.109349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:57.110028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:57.204224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:57.213587 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1e237321-8f06-4304-ab2d-5a4bf6578d9a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1199 microversion: 2.1 time: 0.120895 Oct 25 03:47:57.214227 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3391/6901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:57 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:58.239096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:58.239633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:58.249088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:58.249597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:58.250063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:58.250797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:58.251263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:58.251694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:58.434984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:58.435643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:58.445406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:58.446629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:58.447125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:58.447936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:58.448415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:58.448859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:58.459440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:58.470597 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ea80f3a6-93c5-42b5-98e6-322407cac352 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1277 microversion: 2.1 time: 0.234753 Oct 25 03:47:58.472372 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3511/6902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:58 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:58.492299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:47:58.580221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b968fc61-adaf-4320-b2e3-d12bfe47f20e tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 204 len: 0 microversion: 2.1 time: 0.157731 Oct 25 03:47:58.581125 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3392/6903] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:47:58 2022] DELETE /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:47:58.592639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:58.593510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:58.602118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:58.603491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:58.604087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:58.604773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:58.605397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:58.606059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:58.770614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:58.780822 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d905aa4e-9f15-4a49-9f4c-4e7efdb5c93d tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1513 microversion: 2.1 time: 0.193663 Oct 25 03:47:58.793522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3512/6904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:58 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:47:58.807240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ec6e17ab-a9ca-435b-a95d-a269c1088c15 req-62479d24-87bb-4dec-8e49-316305437d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c55413-c971-4735-85bd-50786d978292", "tag": "75c9998d-ae2f-48f0-a37b-54c131a4caf6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:47:58.817285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec6e17ab-a9ca-435b-a95d-a269c1088c15 req-62479d24-87bb-4dec-8e49-316305437d8a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:58.817829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec6e17ab-a9ca-435b-a95d-a269c1088c15 req-62479d24-87bb-4dec-8e49-316305437d8a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:58.818279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ec6e17ab-a9ca-435b-a95d-a269c1088c15 req-62479d24-87bb-4dec-8e49-316305437d8a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:58.831428 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ec6e17ab-a9ca-435b-a95d-a269c1088c15 req-62479d24-87bb-4dec-8e49-316305437d8a service nova] Creating event network-changed:75c9998d-ae2f-48f0-a37b-54c131a4caf6 for instance 73c55413-c971-4735-85bd-50786d978292 on n-h1-862355-1 Oct 25 03:47:58.837824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ec6e17ab-a9ca-435b-a95d-a269c1088c15 req-62479d24-87bb-4dec-8e49-316305437d8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131371 Oct 25 03:47:58.838456 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3393/6905] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:47:59.495564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:59.496602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:59.503724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:59.504358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:59.504938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:59.505834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:59.506595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:59.507128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:59.648996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:59.658287 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-db45820c-6f1a-42cc-87d0-1ffb93d715ca tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1277 microversion: 2.1 time: 0.167333 Oct 25 03:47:59.659215 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3513/6906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:59 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:47:59.807124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:47:59.807962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:47:59.815203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:59.815706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:59.816162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:59.816883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:47:59.817357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:47:59.817831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:47:59.964760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:47:59.972781 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1a49cf79-b438-43e1-a1ed-8b667dbbc380 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1513 microversion: 2.1 time: 0.170304 Oct 25 03:47:59.973379 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3394/6907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:47:59 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:00.677938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-42f35a29-b86a-467a-90c6-920fc57d038b req-c0aa21ed-156c-457d-b69e-bb236717c10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d60f988-66d1-4e34-91f2-9d36ef9fea13", "name": "network-vif-deleted", "tag": "680fa7b9-87aa-443f-9477-0f1f62f64cc4"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:00.686070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:00.687100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:00.689786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42f35a29-b86a-467a-90c6-920fc57d038b req-c0aa21ed-156c-457d-b69e-bb236717c10a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:00.690283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42f35a29-b86a-467a-90c6-920fc57d038b req-c0aa21ed-156c-457d-b69e-bb236717c10a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:00.690723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-42f35a29-b86a-467a-90c6-920fc57d038b req-c0aa21ed-156c-457d-b69e-bb236717c10a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:00.704237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-42f35a29-b86a-467a-90c6-920fc57d038b req-c0aa21ed-156c-457d-b69e-bb236717c10a service nova] Creating event network-vif-deleted:680fa7b9-87aa-443f-9477-0f1f62f64cc4 for instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 on n-h2-862355-1 Oct 25 03:48:00.712743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:00.713595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:00.714131 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-42f35a29-b86a-467a-90c6-920fc57d038b req-c0aa21ed-156c-457d-b69e-bb236717c10a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038292 Oct 25 03:48:00.714251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:00.714844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:00.715411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:00.717910 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3514/6908] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:48:00.722070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:00.882318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:00.891791 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-63be241d-785d-445d-b74a-df8ddd85aba5 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1277 microversion: 2.1 time: 0.213708 Oct 25 03:48:00.892664 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3395/6909] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:00 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:48:00.997970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:00.998709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:01.004960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.005447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.005938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.006643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.007099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.007532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.041500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.041913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.042353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.042801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lazy-loading 'fault' on Instance uuid 9d60f988-66d1-4e34-91f2-9d36ef9fea13 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:48:01.085657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e2503fb22a4c03ba141139ead49708', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204ddd86bcd94dc3a0af918e22fc0e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:01.093637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef18f5ae-fc6b-4062-8685-940214830d2b tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 200 len: 1309 microversion: 2.1 time: 0.100751 Oct 25 03:48:01.094249 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3515/6910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:00 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:01.402341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:01.402893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:01.408945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.409450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.409941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.410656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.411127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.411572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.557177 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:01.565658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14298b83-95dd-466d-bb9e-0d65660065c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1681 microversion: 2.1 time: 0.167326 Oct 25 03:48:01.566510 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3396/6911] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:01 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:01.668258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:01.670503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:01.676791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.677369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.677923 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.678697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.679491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.679971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.743449 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8491988c-3768-4476-9a2a-bcc344e87816 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action" status: 200 len: 32640 microversion: 2.1 time: 0.079788 Oct 25 03:48:01.750969 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3516/6912] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:48:01 2022] POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action => generated 32640 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:48:01.917091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:01.917847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:01.925256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.925699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.926226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:01.926941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:01.927415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:01.927854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:02.045961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:02.046968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:02.053270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:02.053940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:02.054752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:02.055577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:02.056200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:02.056931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:02.091104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:02.099745 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-204ff740-ecfe-4992-90cc-e35e8ed78333 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1277 microversion: 2.1 time: 0.187911 Oct 25 03:48:02.100342 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3517/6913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:01 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:02.122189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:02.123137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] [instance: 9d60f988-66d1-4e34-91f2-9d36ef9fea13] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:02.129905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:02.130486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:02.131002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:02.131785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:02.132405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:02.132840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:02.149938 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] HTTP exception thrown: Instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 could not be found. Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Request method failure captured: Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 HTTP/1.1 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1vGJdb27kLvyC7VN67MsPnSn_r7Zp126Gi6s8ZfkhRM-NXWH1DLC6USR9D2ZR6QZBADyqDt8ZVxAMJgyqiNzGch9AjvZtu3oedzeMaX6TWrXMqXe2ktmIztgguICe_pxazwOoF3KJbJNmp2EC4OKJk68Kr4pZQayTbiWBEB7Oy1EY0 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 204ddd86bcd94dc3a0af918e22fc0e58 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1421490588 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/204ddd86bcd94dc3a0af918e22fc0e58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/204ddd86bcd94dc3a0af918e22fc0e58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_204ddd86bcd94dc3a0af918e22fc0e58", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/204ddd86bcd94dc3a0af918e22fc0e58"}]}] Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-VolumesSnapshotTestJSON-1421490588 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 204ddd86bcd94dc3a0af918e22fc0e58 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1421490588 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-VolumesSnapshotTestJSON-1421490588-project Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 49e2503fb22a4c03ba141139ead49708 Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-VolumesSnapshotTestJSON-1421490588-project Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 could not be found. Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9d60f988-66d1-4e34-91f2-9d36ef9fea13'} Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 could not be found. Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 could not be found. Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:48:02.152309 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 could not be found. Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] Returning 404 to user: Instance 9d60f988-66d1-4e34-91f2-9d36ef9fea13 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:48:02.156234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3dada85b-432a-4605-9f86-b771a7338a07 tempest-VolumesSnapshotTestJSON-1421490588 tempest-VolumesSnapshotTestJSON-1421490588-project] 10.222.0.36 "GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13" status: 404 len: 111 microversion: 2.1 time: 0.036410 Oct 25 03:48:02.158904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3518/6914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:02 2022] GET /compute/v2.1/servers/9d60f988-66d1-4e34-91f2-9d36ef9fea13 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:48:02.223822 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac24c8fb-6157-4647-80b9-f7714aab630c tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1832 microversion: 2.1 time: 0.319252 Oct 25 03:48:02.224406 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3397/6915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:01 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1832 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:02.257931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:02.260987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:02.267840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:02.268568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:02.268780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:02.269752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:02.270374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:02.270604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:02.313842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lazy-loading 'flavor' on Instance uuid 51224826-c4ad-4223-a45a-15c46c3e8a2b {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:48:02.330973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Going to try to live migrate instance to another host {{(pid=120562) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 25 03:48:03.131391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:03.132800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:03.149354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:03.150700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:03.151333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:03.152266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:03.152921 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:03.153439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:03.330802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:03.349284 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c81c9ca-f71a-458e-a516-ea3029ab49c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.228334 Oct 25 03:48:03.350642 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3398/6916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:03 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:03.965835 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27e4c9f4-0232-4258-989c-24912c1a49c3 tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action" status: 202 len: 0 microversion: 2.1 time: 1.712248 Oct 25 03:48:03.967413 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3519/6917] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:48:02 2022] POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action => generated 0 bytes in 1715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:48:03.976078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:03.976834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:03.985195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:03.985732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:03.987064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:03.988356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:03.988987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:03.989588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:04.161837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:04.171371 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d82c27ce-de58-4e4f-9d93-7c353b79fa49 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.199271 Oct 25 03:48:04.172068 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3399/6918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:03 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:04.382303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:04.383033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:04.393538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:04.394194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:04.394927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:04.395489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:04.396084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:04.396591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:04.628371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:04.648758 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1126fea0-4de7-47d5-86ee-c9e731f605c0 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.270266 Oct 25 03:48:04.664823 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3520/6919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:04 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:48:05.197686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:05.198650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:05.206818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:05.208565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:05.208565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:05.208802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:05.209567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:05.210334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:05.247716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-44cab4be-f97d-473e-8d9c-fd74a71bde69 req-c8f02d1f-b4ce-4842-96cb-5fc48880c7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51224826-c4ad-4223-a45a-15c46c3e8a2b", "name": "network-vif-unplugged", "status": "completed", "tag": "6a35bf07-66d4-4112-9a88-19f1056ea535"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:05.259822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-44cab4be-f97d-473e-8d9c-fd74a71bde69 req-c8f02d1f-b4ce-4842-96cb-5fc48880c7d1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:05.260316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-44cab4be-f97d-473e-8d9c-fd74a71bde69 req-c8f02d1f-b4ce-4842-96cb-5fc48880c7d1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:05.260997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-44cab4be-f97d-473e-8d9c-fd74a71bde69 req-c8f02d1f-b4ce-4842-96cb-5fc48880c7d1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:05.274349 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-44cab4be-f97d-473e-8d9c-fd74a71bde69 req-c8f02d1f-b4ce-4842-96cb-5fc48880c7d1 service nova] Creating event network-vif-unplugged:6a35bf07-66d4-4112-9a88-19f1056ea535 for instance 51224826-c4ad-4223-a45a-15c46c3e8a2b on n-h1-862355-1 Oct 25 03:48:05.280671 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-44cab4be-f97d-473e-8d9c-fd74a71bde69 req-c8f02d1f-b4ce-4842-96cb-5fc48880c7d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038218 Oct 25 03:48:05.281280 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3521/6920] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:48:05.378632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:05.386819 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-554780c3-106d-4768-9579-2f82bf658bad tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.193925 Oct 25 03:48:05.387475 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3400/6921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:05 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:05.674567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:05.675269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:05.691767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:05.692385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:05.692834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:05.693577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:05.694076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:05.694544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:05.849450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:05.865122 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45bd06ff-15e7-45cd-a51e-6ee7611d5937 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.195761 Oct 25 03:48:05.873866 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3522/6922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:05 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:06.412893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:06.413638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:06.416348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:06.417126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:06.424426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:06.424928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:06.425377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:06.426109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:06.426603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:06.427040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:06.573288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:06.581338 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95147d55-a86d-44bf-ae80-a6067f89bf5d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.172642 Oct 25 03:48:06.582021 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3401/6923] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:06 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:06.887476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:06.895441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:06.896982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:06.905283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:06.906190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:06.906799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:06.907569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:06.908070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:06.908509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:07.328508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-659170a6-4cfe-43a8-86c3-6af3cf2a6830 req-04fbeec4-4010-4c88-bc5f-3d6581f5104a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51224826-c4ad-4223-a45a-15c46c3e8a2b", "tag": "6a35bf07-66d4-4112-9a88-19f1056ea535"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:07.343025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-659170a6-4cfe-43a8-86c3-6af3cf2a6830 req-04fbeec4-4010-4c88-bc5f-3d6581f5104a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:07.343853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-659170a6-4cfe-43a8-86c3-6af3cf2a6830 req-04fbeec4-4010-4c88-bc5f-3d6581f5104a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:07.344586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-659170a6-4cfe-43a8-86c3-6af3cf2a6830 req-04fbeec4-4010-4c88-bc5f-3d6581f5104a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:07.360140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-659170a6-4cfe-43a8-86c3-6af3cf2a6830 req-04fbeec4-4010-4c88-bc5f-3d6581f5104a service nova] Creating event network-changed:6a35bf07-66d4-4112-9a88-19f1056ea535 for instance 51224826-c4ad-4223-a45a-15c46c3e8a2b on n-h1-862355-1 Oct 25 03:48:07.360349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:07.366273 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-659170a6-4cfe-43a8-86c3-6af3cf2a6830 req-04fbeec4-4010-4c88-bc5f-3d6581f5104a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042818 Oct 25 03:48:07.368092 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3402/6924] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:48:07.371113 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8a09ff19-f395-4c8a-bf70-1fcbc37e3c64 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.484485 Oct 25 03:48:07.371705 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3523/6925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:06 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:07.607794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:07.608598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:07.615453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:07.616037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:07.616574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:07.617366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:07.617873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:07.618433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:07.900148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:07.909106 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ff0df1c6-8a71-4f8b-b59a-bcb62eb4e9f0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.307677 Oct 25 03:48:07.909949 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3403/6926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:07 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:08.397237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:08.398241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:08.408158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:08.408642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:08.409075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:08.409829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:08.410286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:08.410713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:08.556748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:08.566259 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7aff3af0-87f0-40fe-bb44-a7eae5f9c966 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.173706 Oct 25 03:48:08.566892 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3524/6927] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:08 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:08.940417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:08.941068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:08.948732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:08.949239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:08.949924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:08.950651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:08.951136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:08.951611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:09.101338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:09.109925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5099fdc5-5289-474e-947d-98f6f4ba4de1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.173370 Oct 25 03:48:09.110543 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3404/6928] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:08 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:09.591167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:09.591821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:09.598998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:09.599654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:09.600229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:09.600845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:09.601364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:09.601747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:09.747630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:09.756074 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b395cf5c-a73f-4a37-b349-6ef8758dfd09 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.168924 Oct 25 03:48:09.756949 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3525/6929] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:09 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:10.136836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:10.137567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:10.144735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:10.145234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:10.145704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:10.146431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:10.146890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:10.147328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:10.338195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:10.348425 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9468079-0381-4507-b2d0-15f2a5a16617 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.216143 Oct 25 03:48:10.349393 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3405/6930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:10 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:10.780306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:10.780945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:10.788697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:10.789453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:10.789931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:10.790770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:10.791232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:10.791668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:10.796967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:10.982993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:10.990023 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37807c56-f1d2-4959-8b4f-f8ec05bb1199 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.214003 Oct 25 03:48:11.022811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3526/6931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:10 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:11.377019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:11.378708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:11.388205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:11.389693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:11.389693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:11.391270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:11.391270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:11.391270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:11.396920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:11.565073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:11.575861 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ac934b32-e03e-45ed-ac2f-a06d40798362 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.202762 Oct 25 03:48:11.577171 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3406/6932] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:11 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:12.018854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:12.019472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:12.026348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:12.026961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:12.027659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:12.028350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:12.028809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:12.029236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:12.170530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:12.179789 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e614b7f1-291d-42e4-9c8c-ee2ab82ac886 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.164828 Oct 25 03:48:12.180539 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3527/6933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:12 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:12.601139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:12.602355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:12.610430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:12.610923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:12.611377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:12.612095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:12.612563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:12.613120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:12.757613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:12.766008 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4957b946-188f-4923-bc5c-7058b9710763 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.168723 Oct 25 03:48:12.773306 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3407/6934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:12 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:13.118041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f36a9168-9c77-4ee5-a981-e195264a4000 req-581428de-00d1-439a-a7b6-9468acb5975a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c55413-c971-4735-85bd-50786d978292", "name": "network-vif-plugged", "status": "completed", "tag": "75c9998d-ae2f-48f0-a37b-54c131a4caf6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:13.129075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f36a9168-9c77-4ee5-a981-e195264a4000 req-581428de-00d1-439a-a7b6-9468acb5975a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:13.129789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f36a9168-9c77-4ee5-a981-e195264a4000 req-581428de-00d1-439a-a7b6-9468acb5975a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:13.130226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f36a9168-9c77-4ee5-a981-e195264a4000 req-581428de-00d1-439a-a7b6-9468acb5975a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:13.142016 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f36a9168-9c77-4ee5-a981-e195264a4000 req-581428de-00d1-439a-a7b6-9468acb5975a service nova] Creating event network-vif-plugged:75c9998d-ae2f-48f0-a37b-54c131a4caf6 for instance 73c55413-c971-4735-85bd-50786d978292 on n-h1-862355-1 Oct 25 03:48:13.147213 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f36a9168-9c77-4ee5-a981-e195264a4000 req-581428de-00d1-439a-a7b6-9468acb5975a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130989 Oct 25 03:48:13.151805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3528/6935] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:48:13.203590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:13.204480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:13.213668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:13.217085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:13.217709 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:13.219689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:13.220364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:13.221047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:13.414774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:13.423341 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-590c5bb0-1771-4973-bd52-a7dcb5f96aee tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.223831 Oct 25 03:48:13.424279 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3408/6936] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:13 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:13.790084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:13.791564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:13.809752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:13.810321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:13.810686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:13.811389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:13.811844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:13.812271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:13.948041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:13.955903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1e6a7d60-05c6-4559-859d-d31cf5eab563 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.170302 Oct 25 03:48:13.956517 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3529/6937] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:13 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:14.448573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:14.449209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:14.456096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:14.456604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:14.457050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:14.457795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:14.458270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:14.458718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:14.980732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:14.981365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:14.996021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:14.996793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:14.997402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:14.998371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:14.998979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:14.999588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:15.009957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:15.023023 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57e4358f-37d8-4a37-80b3-8904848a2891 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1265 microversion: 2.1 time: 0.579140 Oct 25 03:48:15.032718 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3409/6938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:14 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1265 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:15.174362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:15.183362 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-976b871b-816c-455a-ab62-dcddf548059c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1691 microversion: 2.1 time: 0.207605 Oct 25 03:48:15.183962 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3530/6939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:14 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1691 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:48:16.047103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:16.047745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:16.055654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.056192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.056856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.057599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.058108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.058761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.208418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:16.213123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:16.213922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:16.222975 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e62090d6-7852-49aa-9d8e-be792454073a tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1451 microversion: 2.1 time: 0.179780 Oct 25 03:48:16.226759 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3410/6940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:16 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:16.227320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.227978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.228817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.229816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.230428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.231011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.250408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:16.251071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:16.259423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.260437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.261009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.262915 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.263523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.264238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.390784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:16.400309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0766323c-1751-452c-95d9-9aa5522cf8eb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1681 microversion: 2.1 time: 0.197064 Oct 25 03:48:16.401112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3531/6941] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:16 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:16.419548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:16.424286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:16.424905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:16.428132 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-09e49821-4ead-4359-ab4c-b447035a0eb3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1451 microversion: 2.1 time: 0.182661 Oct 25 03:48:16.428922 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3411/6942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:16 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:16.431938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.432527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.432969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.433691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.434150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.434577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.586167 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6ee73051-49e7-4cd3-af3a-59954ec4919e tempest-TestNetworkAdvancedServerOps-1886665442 tempest-TestNetworkAdvancedServerOps-1886665442-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1832 microversion: 2.1 time: 0.164612 Oct 25 03:48:16.587889 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3532/6943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:16 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1832 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:48:16.614341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:16.615201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:16.622436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.622944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.623400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.624124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:16.624598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:16.625044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:16.891739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:16.905966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a789dee-a1b4-42aa-be0a-e455748efdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1681 microversion: 2.1 time: 0.296930 Oct 25 03:48:16.906905 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3412/6944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:16 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1681 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:17.046627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:17.049019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:17.062497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:17.063170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:17.063614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:17.064943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:17.065402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:17.066065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:17.128344 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e67c3995-d2d8-416b-a5ec-1ff4dfc2bd8c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action" status: 200 len: 38592 microversion: 2.1 time: 0.086023 Oct 25 03:48:17.129096 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3533/6945] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:48:17 2022] POST /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b/action => generated 38592 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 25 03:48:18.451105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6ca02642-2e9e-42fd-bd3a-cf1786c36cb8 req-676350b1-3d3b-467f-a1f9-f7afea4ee1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51224826-c4ad-4223-a45a-15c46c3e8a2b", "tag": "6a35bf07-66d4-4112-9a88-19f1056ea535"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:18.451776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:18.452151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:18.460036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:18.460557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:18.461020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:18.461976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:18.462613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:18.463235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:18.464351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6ca02642-2e9e-42fd-bd3a-cf1786c36cb8 req-676350b1-3d3b-467f-a1f9-f7afea4ee1c4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:18.465035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6ca02642-2e9e-42fd-bd3a-cf1786c36cb8 req-676350b1-3d3b-467f-a1f9-f7afea4ee1c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:18.465616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6ca02642-2e9e-42fd-bd3a-cf1786c36cb8 req-676350b1-3d3b-467f-a1f9-f7afea4ee1c4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:18.478952 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6ca02642-2e9e-42fd-bd3a-cf1786c36cb8 req-676350b1-3d3b-467f-a1f9-f7afea4ee1c4 service nova] Creating event network-changed:6a35bf07-66d4-4112-9a88-19f1056ea535 for instance 51224826-c4ad-4223-a45a-15c46c3e8a2b on n-h2-862355-1 Oct 25 03:48:18.484256 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6ca02642-2e9e-42fd-bd3a-cf1786c36cb8 req-676350b1-3d3b-467f-a1f9-f7afea4ee1c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037894 Oct 25 03:48:18.485401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3534/6946] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:48:18.503394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:48:18.616302 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11edf063-bfc7-43a3-afe9-b55b77fb463d tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 204 len: 0 microversion: 2.1 time: 0.175011 Oct 25 03:48:18.622389 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3413/6947] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:48:18 2022] DELETE /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:48:18.629573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:18.630585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:18.644027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:18.644582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:18.645101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:18.646190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:18.647422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:18.648067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:18.662562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-371be09b-d6a5-43b3-a10e-ce49fa576523 req-80d739a5-4d98-4fb0-a61f-5c0c954c40d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c55413-c971-4735-85bd-50786d978292", "tag": "75c9998d-ae2f-48f0-a37b-54c131a4caf6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:18.685574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-371be09b-d6a5-43b3-a10e-ce49fa576523 req-80d739a5-4d98-4fb0-a61f-5c0c954c40d3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:18.686120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-371be09b-d6a5-43b3-a10e-ce49fa576523 req-80d739a5-4d98-4fb0-a61f-5c0c954c40d3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:18.686723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-371be09b-d6a5-43b3-a10e-ce49fa576523 req-80d739a5-4d98-4fb0-a61f-5c0c954c40d3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:18.727413 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-371be09b-d6a5-43b3-a10e-ce49fa576523 req-80d739a5-4d98-4fb0-a61f-5c0c954c40d3 service nova] Creating event network-changed:75c9998d-ae2f-48f0-a37b-54c131a4caf6 for instance 73c55413-c971-4735-85bd-50786d978292 on n-h1-862355-1 Oct 25 03:48:18.743254 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-371be09b-d6a5-43b3-a10e-ce49fa576523 req-80d739a5-4d98-4fb0-a61f-5c0c954c40d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084056 Oct 25 03:48:18.744737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3414/6948] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:48:18.956973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:18.966935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aa97fe72-03ff-4f29-aa8f-f1387e1e45a4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1687 microversion: 2.1 time: 0.342987 Oct 25 03:48:18.983837 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3535/6949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:18 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1687 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:19.991368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:19.992098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:20.010775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:20.011441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:20.012249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:20.013251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:20.013985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:20.014864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:20.051228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:20.051723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:20.052172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:20.052639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lazy-loading 'fault' on Instance uuid 51224826-c4ad-4223-a45a-15c46c3e8a2b {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:48:20.103194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:20.111186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14f0c1a6-5cf8-468c-a826-fadbab5edd8a tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 200 len: 1356 microversion: 2.1 time: 0.123971 Oct 25 03:48:20.111804 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3415/6950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:19 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 1356 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:20.501109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2502a7da-bc5e-4a1b-84c1-d34697e51caa req-baa9e0ae-0235-4b45-8704-6f2969cd6684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51224826-c4ad-4223-a45a-15c46c3e8a2b", "name": "network-vif-deleted", "tag": "6a35bf07-66d4-4112-9a88-19f1056ea535"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:20.512105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2502a7da-bc5e-4a1b-84c1-d34697e51caa req-baa9e0ae-0235-4b45-8704-6f2969cd6684 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:20.512592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2502a7da-bc5e-4a1b-84c1-d34697e51caa req-baa9e0ae-0235-4b45-8704-6f2969cd6684 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:20.513033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2502a7da-bc5e-4a1b-84c1-d34697e51caa req-baa9e0ae-0235-4b45-8704-6f2969cd6684 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:20.524436 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-2502a7da-bc5e-4a1b-84c1-d34697e51caa req-baa9e0ae-0235-4b45-8704-6f2969cd6684 service nova] Creating event network-vif-deleted:6a35bf07-66d4-4112-9a88-19f1056ea535 for instance 51224826-c4ad-4223-a45a-15c46c3e8a2b on n-h2-862355-1 Oct 25 03:48:20.529811 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2502a7da-bc5e-4a1b-84c1-d34697e51caa req-baa9e0ae-0235-4b45-8704-6f2969cd6684 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032443 Oct 25 03:48:20.530415 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3536/6951] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:48:21.135233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:21.135858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: 51224826-c4ad-4223-a45a-15c46c3e8a2b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:21.138673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:21.143922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:21.144423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:21.144876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:21.145586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:21.146078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:21.146519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:21.161799 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] HTTP exception thrown: Instance 51224826-c4ad-4223-a45a-15c46c3e8a2b could not be found. Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Request method failure captured: Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b HTTP/1.1 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1sn7Jqyk8iWGhv8KTU8-HZ4ckbmnIqC7OUVGg9nbBanytbYzmLCBu6ojVNjR80D0kicdrklCDCRrHjiw6Ejgf_qPQBhDc8G0Gx9QKO14FZeMcmLdGHpa5RO8U2zyUH-9Nf5_Fn7LyOKCbnZk3-qnefoKct38XLa3HKTHps3cugo6IY Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_84d9f7a653134b0da86e56f376f0124b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/84d9f7a653134b0da86e56f376f0124b"}]}] Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 329132b9ba734f18ab7270e10d0b7e31 Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 51224826-c4ad-4223-a45a-15c46c3e8a2b could not be found. Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '51224826-c4ad-4223-a45a-15c46c3e8a2b'} Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51224826-c4ad-4223-a45a-15c46c3e8a2b could not be found. Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51224826-c4ad-4223-a45a-15c46c3e8a2b could not be found. Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:48:21.163496 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51224826-c4ad-4223-a45a-15c46c3e8a2b could not be found. Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Returning 404 to user: Instance 51224826-c4ad-4223-a45a-15c46c3e8a2b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17ac50e6-de0e-4635-84cc-ad246a638e66 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b" status: 404 len: 111 microversion: 2.1 time: 0.034333 Oct 25 03:48:21.167517 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3416/6952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:21 2022] GET /compute/v2.1/servers/51224826-c4ad-4223-a45a-15c46c3e8a2b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:48:25.172263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-96345062-7943-4d9e-bd82-e0d2bb1e7c5f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '.version_select at 0x7efd327d9b80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:25.185967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=63 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:25.198276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-96345062-7943-4d9e-bd82-e0d2bb1e7c5f tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-477719757" status: 202 len: 0 microversion: 2.1 time: 0.030739 Oct 25 03:48:25.198885 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3537/6953] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 25 03:48:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-477719757 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:48:25.231511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5de8be4-3db3-474e-979e-9bcf385f0c75 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: .version_select at 0x7efd330425e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-427448227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVE6xxeTiVcYdI60H9XkvdMUOC0gybbqo7iKqY1lsFUT4TJZDyTV9j2D/0PqC3eqveN2NyiyZvhCJat23lKeVxrOI/ZnV2ePgE5YW/AajPpkupaYsplNXxlpnVfL5q3OQ=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:25.249452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a5de8be4-3db3-474e-979e-9bcf385f0c75 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:48:25.254974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a5de8be4-3db3-474e-979e-9bcf385f0c75 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:48:25.282038 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5de8be4-3db3-474e-979e-9bcf385f0c75 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055509 Oct 25 03:48:25.283060 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3417/6954] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:48:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:48:31.241891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1936226489", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "47f956ba-93f3-4a61-af2e-f59378790500"}], "key_name": "tempest-TestNetworkAdvancedServerOps-427448227", "security_groups": [{"name": "tempest-secgroup-smoke-636461587"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:31.282139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=50 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:31.451899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] validate_networks() for [('47f956ba-93f3-4a61-af2e-f59378790500', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:48:31.897594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:48:31.901014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:48:31.906682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:48:31.907835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:48:31.912623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:48:31.934874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:31.935453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:31.935805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:31.936546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:31.937013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:31.937514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:31.977214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:48:31.984140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Getting quotas for user 329132b9ba734f18ab7270e10d0b7e31 and project 84d9f7a653134b0da86e56f376f0124b. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:48:31.998953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:48:32.001662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:48:32.064092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3f492938-2bf5-43a2-a05b-ff8cf04b3615 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.822962 Oct 25 03:48:32.071355 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3538/6955] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:48:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:48:32.077971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3325150d-ff9e-420c-a72f-a0a1c9be316b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:32.099769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3325150d-ff9e-420c-a72f-a0a1c9be316b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:32.113293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:32.203256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3325150d-ff9e-420c-a72f-a0a1c9be316b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:32.212042 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3325150d-ff9e-420c-a72f-a0a1c9be316b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1266 microversion: 2.1 time: 0.139124 Oct 25 03:48:32.213828 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3418/6956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:32 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:33.237354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:33.239199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:33.251622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:33.252329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:33.253213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:33.257087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:33.257831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:33.258282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:33.345480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:33.357424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d09b5d49-5e00-4d4d-8ef3-6cc699aa9903 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1318 microversion: 2.1 time: 0.126048 Oct 25 03:48:33.359456 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3539/6957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:33 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1318 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:34.384890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:34.385829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:34.397014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:34.399002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:34.402817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:34.404554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:34.405923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:34.407231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:34.530783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:34.549495 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8a305b1-5107-4916-b120-ab9569077e91 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1324 microversion: 2.1 time: 0.169136 Oct 25 03:48:34.550584 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3419/6958] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:34 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:35.575510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:35.576133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:35.593382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:35.593908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:35.594347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:35.595051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:35.595504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:35.595933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:35.778583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:35.787745 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f48a07f-9333-4cab-99b1-7ec426fcbf39 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1391 microversion: 2.1 time: 0.216536 Oct 25 03:48:35.789746 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3540/6959] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:35 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:35.938291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e47b7150-e744-4635-9b96-01c27078e25c req-f898cdbe-01cc-4715-9155-0b8e9f603565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f544dd94-e2f6-4cdd-b5ca-ec00783649d6", "tag": "f7d58248-a97b-4c28-b05e-0ae7cffa82d6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:35.989449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e47b7150-e744-4635-9b96-01c27078e25c req-f898cdbe-01cc-4715-9155-0b8e9f603565 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:35.990484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e47b7150-e744-4635-9b96-01c27078e25c req-f898cdbe-01cc-4715-9155-0b8e9f603565 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:35.991359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e47b7150-e744-4635-9b96-01c27078e25c req-f898cdbe-01cc-4715-9155-0b8e9f603565 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:36.013458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e47b7150-e744-4635-9b96-01c27078e25c req-f898cdbe-01cc-4715-9155-0b8e9f603565 service nova] Creating event network-changed:f7d58248-a97b-4c28-b05e-0ae7cffa82d6 for instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 on n-h1-862355-1 Oct 25 03:48:36.019131 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e47b7150-e744-4635-9b96-01c27078e25c req-f898cdbe-01cc-4715-9155-0b8e9f603565 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089305 Oct 25 03:48:36.020225 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3420/6960] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:48:36.813868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:36.815511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:36.823090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:36.823689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:36.824204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:36.825027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:36.825579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:36.826361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:36.973457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:36.983178 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6cc78aa8-8757-4b35-9739-b9d3055c2222 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1391 microversion: 2.1 time: 0.172432 Oct 25 03:48:36.990799 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3541/6961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:36 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:38.009429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:38.011077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:38.018515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:38.019017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:38.019502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:38.020220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:38.020778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:38.021258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:38.173756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:38.182624 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2cabe104-be4c-446f-a072-4a4277e34eca tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1391 microversion: 2.1 time: 0.180138 Oct 25 03:48:38.183215 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3421/6962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:38 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:39.206629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:39.207104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:39.215453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:39.216355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:39.217070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:39.217973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:39.218885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:39.219601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:39.368713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:39.377088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c3e5a197-2cb2-4bfb-af8c-0bf2f17a9525 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1391 microversion: 2.1 time: 0.174981 Oct 25 03:48:39.377728 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3542/6963] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:39 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:40.404387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:40.405017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:40.412774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:40.413305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:40.413785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:40.415232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:40.415745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:40.416195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:40.561833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:40.570180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4b04653-8cfe-485a-9bb4-a0d50cac13fc tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1391 microversion: 2.1 time: 0.171432 Oct 25 03:48:40.570785 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3422/6964] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:40 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:41.150215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-733f5eac-67ce-4670-887d-fd41413a2c56 req-4c2f47b9-110c-4d8e-ad78-162717140cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f544dd94-e2f6-4cdd-b5ca-ec00783649d6", "name": "network-vif-plugged", "status": "completed", "tag": "f7d58248-a97b-4c28-b05e-0ae7cffa82d6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:41.162092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-733f5eac-67ce-4670-887d-fd41413a2c56 req-4c2f47b9-110c-4d8e-ad78-162717140cdf service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:41.162581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-733f5eac-67ce-4670-887d-fd41413a2c56 req-4c2f47b9-110c-4d8e-ad78-162717140cdf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:41.163175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-733f5eac-67ce-4670-887d-fd41413a2c56 req-4c2f47b9-110c-4d8e-ad78-162717140cdf service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:41.176083 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-733f5eac-67ce-4670-887d-fd41413a2c56 req-4c2f47b9-110c-4d8e-ad78-162717140cdf service nova] Creating event network-vif-plugged:f7d58248-a97b-4c28-b05e-0ae7cffa82d6 for instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 on n-h1-862355-1 Oct 25 03:48:41.182261 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-733f5eac-67ce-4670-887d-fd41413a2c56 req-4c2f47b9-110c-4d8e-ad78-162717140cdf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036366 Oct 25 03:48:41.182873 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3543/6965] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:48:41.594987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:41.595627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:41.604240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:41.604796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:41.605259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:41.606059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:41.606543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:41.606994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:41.751654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:41.760163 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a1bb3136-951f-4501-a6ba-4acfebb4b618 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1391 microversion: 2.1 time: 0.169433 Oct 25 03:48:41.760752 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3423/6966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:41 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:48:42.781920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:42.782638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:42.788244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:42.788990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:42.797440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:42.797948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:42.798384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:42.799087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:42.799536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:42.799967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:42.945282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:42.954426 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27d97fc2-584d-49bd-ad2c-fa281219d5f5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1563 microversion: 2.1 time: 0.173545 Oct 25 03:48:42.955279 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3544/6967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:42 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:48:42.978019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:48:42.983858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:42.984779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:42.991987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:42.992587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:42.994182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:42.994922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:42.995433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:42.995882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:43.147473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:43.156419 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e577f92-4ac7-4123-b257-d1a117c941c0 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1563 microversion: 2.1 time: 0.179921 Oct 25 03:48:43.157724 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3424/6968] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:42 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:48:45.310535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:48:45.311154 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:48:45.318138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:45.318575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-00261786-8b0a-4e1e-9e31-d0f0d93714bf req-d87f6aa3-e9a6-4f35-a734-d00b8c6150a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f544dd94-e2f6-4cdd-b5ca-ec00783649d6", "tag": "f7d58248-a97b-4c28-b05e-0ae7cffa82d6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:48:45.319036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:45.319284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:45.320003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:45.320466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:45.321338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:45.329444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-00261786-8b0a-4e1e-9e31-d0f0d93714bf req-d87f6aa3-e9a6-4f35-a734-d00b8c6150a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:48:45.330266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-00261786-8b0a-4e1e-9e31-d0f0d93714bf req-d87f6aa3-e9a6-4f35-a734-d00b8c6150a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:48:45.330778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-00261786-8b0a-4e1e-9e31-d0f0d93714bf req-d87f6aa3-e9a6-4f35-a734-d00b8c6150a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:48:45.342340 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-00261786-8b0a-4e1e-9e31-d0f0d93714bf req-d87f6aa3-e9a6-4f35-a734-d00b8c6150a7 service nova] Creating event network-changed:f7d58248-a97b-4c28-b05e-0ae7cffa82d6 for instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 on n-h1-862355-1 Oct 25 03:48:45.347801 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-00261786-8b0a-4e1e-9e31-d0f0d93714bf req-d87f6aa3-e9a6-4f35-a734-d00b8c6150a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033067 Oct 25 03:48:45.348498 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3425/6969] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:48:45.495692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:48:45.504243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-877632a1-9e50-4d96-a2ab-b12d6242083c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1563 microversion: 2.1 time: 0.197527 Oct 25 03:48:45.505394 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3545/6970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:48:45 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:08.819070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:49:08.822652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:08.825145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:08.825840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=34 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:08.833718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:08.834251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:08.834704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:08.835438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:08.835981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:08.836925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:08.893487 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1fceb5ce-4711-4e89-8935-f5dfdf012019 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6/action" status: 200 len: 24571 microversion: 2.1 time: 0.078559 Oct 25 03:49:08.900804 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3426/6971] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:49:08 2022] POST /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6/action => generated 24571 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:49:19.838056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:49:19.840906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:19.844272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:19.844934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=40 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:19.850246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:19.850744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:19.851194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:19.852085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:19.852440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:19.852971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:19.938288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:49:19.938719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:49:19.939200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:49:19.939616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:49:19.940035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:49:19.999443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:20.005523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:20.006536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:20.007223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:20.007702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:20.008689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:20.009130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:20.039919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5f66a15-cd72-4163-ba1c-5c167b5cb372 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6/action" status: 202 len: 1138 microversion: 2.1 time: 0.206476 Oct 25 03:49:20.040908 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3546/6972] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:49:19 2022] POST /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6/action => generated 1138 bytes in 208 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 25 03:49:20.062373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:20.063103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:20.066365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:20.066895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:20.073808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:20.074319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:20.074781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:20.075510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:20.075991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:20.076441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:20.221976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:20.229931 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9da342e2-1b6f-40ca-9fc5-5fcaf1cb7777 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.171953 Oct 25 03:49:20.230533 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3427/6973] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:20 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:21.253926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:21.254655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:21.262478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:21.262963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:21.263406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:21.264150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:21.264548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:21.264974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:21.409383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:21.418236 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cd3c7adb-0deb-4a5c-91b0-0106fe670015 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.168262 Oct 25 03:49:21.418853 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3547/6974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:21 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:22.443770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:22.444312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:22.452565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:22.453068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:22.453525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:22.454345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:22.454824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:22.455266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:22.588199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:22.596155 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b545cf5c-1c0c-4afd-9d27-e037ba42a0d4 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.156774 Oct 25 03:49:22.596739 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3428/6975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:22 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:23.621210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:23.621867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:23.628940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:23.629436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:23.629908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:23.630674 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:23.631138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:23.631571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:23.767279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:23.776226 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70d68c05-aad1-46c7-9861-055b38ce22a1 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.159493 Oct 25 03:49:23.777214 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3548/6976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:23 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:24.801024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:24.801722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:24.809411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:24.809938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:24.810391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:24.811099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:24.811566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:24.812002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:24.957483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:24.966084 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-43c63138-40bd-452c-a11e-c076a47dd92c tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.169076 Oct 25 03:49:24.966794 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3429/6977] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:24 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:25.990405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:25.991026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:25.998528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:25.999024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:25.999470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:26.000177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:26.000641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:26.001077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:26.135791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:26.144340 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2359bbf2-a86a-46ad-aaa2-f33f66f8bb20 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.157845 Oct 25 03:49:26.144930 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3549/6978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:25 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:27.168417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:27.169150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:27.176409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:27.176908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:27.177362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:27.178101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:27.178570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:27.179014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:27.317985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:27.342808 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c38e4276-250f-4d00-acd4-02aacba79d86 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.178249 Oct 25 03:49:27.343504 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3430/6979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:27 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:28.367536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:28.368157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:28.375545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:28.376028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:28.376461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:28.377148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:28.377600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:28.378054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:28.513152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:28.521024 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f5239d7e-83ec-4348-86b6-46485ec89dab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.157462 Oct 25 03:49:28.521624 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3550/6980] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:28 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:29.544890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:29.545530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:29.554462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:29.554969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:29.555679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:29.556474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:29.556947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:29.557395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:29.701209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:29.709117 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c12a965-86a2-45a4-8063-e6c2ba83bfee tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.168483 Oct 25 03:49:29.709709 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3431/6981] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:29 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:30.734485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:30.735106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:30.742040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:30.742521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:30.742953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:30.744213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:30.744677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:30.745105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:30.892205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:30.901158 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6d7b174e-6527-4114-84ff-b807548322b5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.170102 Oct 25 03:49:30.901762 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3551/6982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:30 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:31.924685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:31.925240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:31.932638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:31.933144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:31.933602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:31.934349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:31.934825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:31.935277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:32.082036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:32.090624 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a9a125ba-538f-4daa-8f8b-31b7ea84e897 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.169980 Oct 25 03:49:32.091273 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3432/6983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:31 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:33.114609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:33.115231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:33.122506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:33.122999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:33.123441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:33.124146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:33.124605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:33.125035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:33.261106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:33.269631 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-06226486-f640-4ff7-aac7-d70409c4d728 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.159127 Oct 25 03:49:33.270338 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3552/6984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:33 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:34.293933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:34.294781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:34.301811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:34.302312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:34.302760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:34.303463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:34.303928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:34.304363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:34.439097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:34.448810 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4ab7009-4d2c-4ef7-b77f-72155e7a10e8 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.160172 Oct 25 03:49:34.450213 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3433/6985] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:34 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:35.471918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:35.472543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:35.480286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:35.480776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:35.481215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:35.481943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:35.482411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:35.482844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:35.613761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:35.622390 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-da14a375-8dce-4489-8667-acac1b1b0d2b tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.154433 Oct 25 03:49:35.623072 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3553/6986] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:35 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:36.646268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:36.647244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:36.654573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:36.655075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:36.655533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:36.656247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:36.656718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:36.657165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:36.794743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:36.802600 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a3b29d0c-cc7c-4224-a354-71260dcf66ff tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.160502 Oct 25 03:49:36.803182 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3434/6987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:36 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:37.827447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:37.828059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:37.834889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:37.835344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:37.835779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:37.836471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:37.836924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:37.837991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:37.981329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:37.989668 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f1a79a7d-90ff-4ae8-ac0c-99f7179b82ba tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1691 microversion: 2.1 time: 0.166189 Oct 25 03:49:37.990539 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3554/6988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:37 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:49:39.015841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:39.016475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:39.023206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:39.023699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:39.024150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:39.025494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:39.026323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:39.026763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:39.176246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:39.186607 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fbbce4a8-5283-4d46-9224-84a817286dcf tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1697 microversion: 2.1 time: 0.175645 Oct 25 03:49:39.187203 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3435/6989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:39 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:40.210710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:40.211362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:40.218039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:40.218530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:40.218970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:40.219665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:40.220122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:40.220551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:40.387246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:40.395871 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb4b4a1f-75f5-4484-8b56-74d144dc44ab tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1697 microversion: 2.1 time: 0.189020 Oct 25 03:49:40.396457 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3555/6990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:40 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:41.420793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:41.421434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:41.429438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:41.429987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:41.430837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:41.431752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:41.432197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:41.432647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:41.582080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:41.591473 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6af5c52c-0598-4aa7-9a39-8b04cebedda2 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1682 microversion: 2.1 time: 0.174675 Oct 25 03:49:41.592137 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3436/6991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:41 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:49:41.654731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dd77f6fc-8478-48fe-a780-a55b61f1ef08 req-fff23366-c6aa-425e-8b18-cc4426d7622b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f544dd94-e2f6-4cdd-b5ca-ec00783649d6", "name": "network-vif-unplugged", "status": "completed", "tag": "f7d58248-a97b-4c28-b05e-0ae7cffa82d6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:49:41.672486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dd77f6fc-8478-48fe-a780-a55b61f1ef08 req-fff23366-c6aa-425e-8b18-cc4426d7622b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:41.673339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dd77f6fc-8478-48fe-a780-a55b61f1ef08 req-fff23366-c6aa-425e-8b18-cc4426d7622b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:41.674105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dd77f6fc-8478-48fe-a780-a55b61f1ef08 req-fff23366-c6aa-425e-8b18-cc4426d7622b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:41.692229 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dd77f6fc-8478-48fe-a780-a55b61f1ef08 req-fff23366-c6aa-425e-8b18-cc4426d7622b service nova] Creating event network-vif-unplugged:f7d58248-a97b-4c28-b05e-0ae7cffa82d6 for instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 on n-h1-862355-1 Oct 25 03:49:41.698734 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dd77f6fc-8478-48fe-a780-a55b61f1ef08 req-fff23366-c6aa-425e-8b18-cc4426d7622b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049887 Oct 25 03:49:41.699501 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3556/6992] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:49:43.726976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-71559753-3b32-428d-933d-081a7e760917 req-8298aecc-65f4-4a52-8471-29502bf3c17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f544dd94-e2f6-4cdd-b5ca-ec00783649d6", "name": "network-vif-plugged", "status": "completed", "tag": "f7d58248-a97b-4c28-b05e-0ae7cffa82d6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:49:43.738415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-71559753-3b32-428d-933d-081a7e760917 req-8298aecc-65f4-4a52-8471-29502bf3c17d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:43.738997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-71559753-3b32-428d-933d-081a7e760917 req-8298aecc-65f4-4a52-8471-29502bf3c17d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:43.739452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-71559753-3b32-428d-933d-081a7e760917 req-8298aecc-65f4-4a52-8471-29502bf3c17d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:43.751907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-71559753-3b32-428d-933d-081a7e760917 req-8298aecc-65f4-4a52-8471-29502bf3c17d service nova] Creating event network-vif-plugged:f7d58248-a97b-4c28-b05e-0ae7cffa82d6 for instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 on n-h1-862355-1 Oct 25 03:49:43.757278 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-71559753-3b32-428d-933d-081a7e760917 req-8298aecc-65f4-4a52-8471-29502bf3c17d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034276 Oct 25 03:49:43.758912 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3437/6993] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:49:58.781099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=26 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:58.781939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:58.786420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-786c1080-5423-4c7b-a9ae-7b7a69f60574 req-82a458af-9862-47a3-b2b7-f942fa15d54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c55413-c971-4735-85bd-50786d978292", "tag": "75c9998d-ae2f-48f0-a37b-54c131a4caf6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:49:58.786829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:58.787031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:58.811846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=22 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:58.812600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=62 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:49:58.816650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:58.817407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-786c1080-5423-4c7b-a9ae-7b7a69f60574 req-82a458af-9862-47a3-b2b7-f942fa15d54e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:58.818622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:58.819136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-786c1080-5423-4c7b-a9ae-7b7a69f60574 req-82a458af-9862-47a3-b2b7-f942fa15d54e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:58.819715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:58.820287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-786c1080-5423-4c7b-a9ae-7b7a69f60574 req-82a458af-9862-47a3-b2b7-f942fa15d54e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:58.824412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:58.824970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:58.825411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:58.854143 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-786c1080-5423-4c7b-a9ae-7b7a69f60574 req-82a458af-9862-47a3-b2b7-f942fa15d54e service nova] Creating event network-changed:75c9998d-ae2f-48f0-a37b-54c131a4caf6 for instance 73c55413-c971-4735-85bd-50786d978292 on n-h1-862355-1 Oct 25 03:49:58.859520 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-786c1080-5423-4c7b-a9ae-7b7a69f60574 req-82a458af-9862-47a3-b2b7-f942fa15d54e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077468 Oct 25 03:49:58.860623 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3438/6994] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:49:58.869280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:49:58.984441 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d958d38-7499-4991-8ce0-d9c41e2bb610 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 204 len: 0 microversion: 2.1 time: 0.205024 Oct 25 03:49:58.986068 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3557/6995] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:49:58 2022] DELETE /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:49:58.994880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:49:58.995840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:49:59.002605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:59.003371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:59.003967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:59.004831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:49:59.005443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:49:59.006100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:49:59.206085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:49:59.215577 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bc0d3b66-a54d-445e-9d06-22b6bf065469 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1575 microversion: 2.1 time: 0.225077 Oct 25 03:49:59.222527 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3439/6996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:49:58 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:00.240729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:00.241428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:00.249327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:00.249837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:00.250278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:00.250979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:00.251433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:00.251863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:00.403183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:00.418283 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-09780223-1fce-4b51-bd71-d7467120eea3 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1575 microversion: 2.1 time: 0.181833 Oct 25 03:50:00.418873 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3558/6997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:00 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:01.443214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:01.444402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:01.452837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:01.453347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:01.453842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:01.455317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:01.455814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:01.456264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:01.470671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bb6adc01-5e44-4729-94e0-024eb89fe401 req-b943fd2e-27aa-4efe-bad3-276c73021e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c55413-c971-4735-85bd-50786d978292", "name": "network-vif-deleted", "tag": "75c9998d-ae2f-48f0-a37b-54c131a4caf6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:01.484765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb6adc01-5e44-4729-94e0-024eb89fe401 req-b943fd2e-27aa-4efe-bad3-276c73021e0b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:01.485370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb6adc01-5e44-4729-94e0-024eb89fe401 req-b943fd2e-27aa-4efe-bad3-276c73021e0b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:01.486028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb6adc01-5e44-4729-94e0-024eb89fe401 req-b943fd2e-27aa-4efe-bad3-276c73021e0b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:01.498856 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bb6adc01-5e44-4729-94e0-024eb89fe401 req-b943fd2e-27aa-4efe-bad3-276c73021e0b service nova] Creating event network-vif-deleted:75c9998d-ae2f-48f0-a37b-54c131a4caf6 for instance 73c55413-c971-4735-85bd-50786d978292 on n-h1-862355-1 Oct 25 03:50:01.504065 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bb6adc01-5e44-4729-94e0-024eb89fe401 req-b943fd2e-27aa-4efe-bad3-276c73021e0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037066 Oct 25 03:50:01.504690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3559/6998] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:50:01.564228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:01.573461 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12005327-664a-44ac-a4c6-218b7abddd99 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1389 microversion: 2.1 time: 0.134476 Oct 25 03:50:01.574083 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3440/6999] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:01 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1389 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:02.597992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:02.598618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:02.605756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:02.606262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:02.606709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:02.607420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:02.607886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:02.608563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:02.683694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:02.692026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba4f1e30-0282-4a22-a8c9-0646136b6871 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1224 microversion: 2.1 time: 0.099322 Oct 25 03:50:02.692614 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3560/7000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:02 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:03.716421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:03.717075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:03.723840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:03.724338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:03.724861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:03.725494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:03.726125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:03.726565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:03.813959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:03.823154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e163b83d-10d1-430a-ae54-0b2bfd969eff tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1224 microversion: 2.1 time: 0.111867 Oct 25 03:50:03.824293 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3441/7001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:03 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:04.848516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:04.849160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:04.857352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:04.857880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:04.858366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:04.859076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:04.859901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:04.860338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:04.940279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:04.950671 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-83cb9039-ee1f-4a34-9bb0-840a61f655b9 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1224 microversion: 2.1 time: 0.106139 Oct 25 03:50:04.951434 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3561/7002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:04 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:05.802800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:05.806551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:05.813632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:05.814207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:05.814893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:05.815798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:05.816429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:05.816923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:05.872378 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95f1aaf4-228e-4d02-972e-f77b3da68bbb tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "POST /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6/action" status: 200 len: 24572 microversion: 2.1 time: 0.073283 Oct 25 03:50:05.872976 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3442/7003] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:50:05 2022] POST /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6/action => generated 24572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 03:50:05.978465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:05.979074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:05.986449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:05.986933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:05.987372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:05.988064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:05.988519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:05.988944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:06.028874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:06.029659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:06.030130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:06.030592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lazy-loading 'fault' on Instance uuid 73c55413-c971-4735-85bd-50786d978292 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:50:06.073084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:06.081031 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d1fce55-1283-49f0-a730-435852d2d4e8 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 200 len: 1229 microversion: 2.1 time: 0.106715 Oct 25 03:50:06.081611 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3562/7004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:05 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:07.105880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:07.106632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 73c55413-c971-4735-85bd-50786d978292] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:07.114024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:07.114518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:07.114965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:07.115662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:07.116129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:07.116605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:07.132181 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 73c55413-c971-4735-85bd-50786d978292 could not be found. Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 HTTP/1.1 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 73c55413-c971-4735-85bd-50786d978292 could not be found. Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '73c55413-c971-4735-85bd-50786d978292'} Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c55413-c971-4735-85bd-50786d978292 could not be found. Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c55413-c971-4735-85bd-50786d978292 could not be found. Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:07.133844 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c55413-c971-4735-85bd-50786d978292 could not be found. Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 73c55413-c971-4735-85bd-50786d978292 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ccf3b7b2-1efb-4e79-889e-9b947718acec tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292" status: 404 len: 111 microversion: 2.1 time: 0.034314 Oct 25 03:50:07.137440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3443/7005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:07 2022] GET /compute/v2.1/servers/73c55413-c971-4735-85bd-50786d978292 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:50:13.422469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:13.423070 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:13.425063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-23e4ecdd-f09c-4916-88dc-b602b05a282b req-963c4a85-55a4-4001-87de-3b871186bb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882624cc-49e8-4228-85cc-84a4d8e767eb", "tag": "5a205fa0-dd5d-4cea-8f70-0f570838ed4c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:13.433738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:13.438357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:13.438838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-23e4ecdd-f09c-4916-88dc-b602b05a282b req-963c4a85-55a4-4001-87de-3b871186bb78 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:13.439090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:13.439757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-23e4ecdd-f09c-4916-88dc-b602b05a282b req-963c4a85-55a4-4001-87de-3b871186bb78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:13.440481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-23e4ecdd-f09c-4916-88dc-b602b05a282b req-963c4a85-55a4-4001-87de-3b871186bb78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:13.440685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:13.441239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:13.441913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:13.457011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-23e4ecdd-f09c-4916-88dc-b602b05a282b req-963c4a85-55a4-4001-87de-3b871186bb78 service nova] Creating event network-changed:5a205fa0-dd5d-4cea-8f70-0f570838ed4c for instance 882624cc-49e8-4228-85cc-84a4d8e767eb on n-h2-862355-1 Oct 25 03:50:13.466670 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-23e4ecdd-f09c-4916-88dc-b602b05a282b req-963c4a85-55a4-4001-87de-3b871186bb78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045416 Oct 25 03:50:13.467849 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3444/7006] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:50:13.475899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:50:13.590549 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6685ad3d-6063-45b0-9835-c3a8a280e492 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 204 len: 0 microversion: 2.1 time: 0.171549 Oct 25 03:50:13.591192 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3563/7007] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:50:13 2022] DELETE /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:50:13.601418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:13.603607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:13.610463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:13.611153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:13.611770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:13.612634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:13.613248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:13.613864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:13.778830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:13.786804 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-617d8e37-74f0-419e-8883-c2b556c79dcc tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1578 microversion: 2.1 time: 0.190301 Oct 25 03:50:13.787489 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3445/7008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:13 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:14.812336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:14.813617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:14.824951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:14.825450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:14.826017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:14.826899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:14.827374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:14.827813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:15.024075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:15.033374 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18392fc1-36c0-445c-984b-b0e637a232bd tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1578 microversion: 2.1 time: 0.225450 Oct 25 03:50:15.034268 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3564/7009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:14 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:15.858426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-6ef8ccc3-86ec-41bb-b9bf-2e92827a6c65 req-fc272b16-6816-44a1-a48f-23b768a809f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882624cc-49e8-4228-85cc-84a4d8e767eb", "name": "network-vif-deleted", "tag": "5a205fa0-dd5d-4cea-8f70-0f570838ed4c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:15.868968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6ef8ccc3-86ec-41bb-b9bf-2e92827a6c65 req-fc272b16-6816-44a1-a48f-23b768a809f3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:15.869470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6ef8ccc3-86ec-41bb-b9bf-2e92827a6c65 req-fc272b16-6816-44a1-a48f-23b768a809f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:15.870026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6ef8ccc3-86ec-41bb-b9bf-2e92827a6c65 req-fc272b16-6816-44a1-a48f-23b768a809f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:15.881751 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-6ef8ccc3-86ec-41bb-b9bf-2e92827a6c65 req-fc272b16-6816-44a1-a48f-23b768a809f3 service nova] Creating event network-vif-deleted:5a205fa0-dd5d-4cea-8f70-0f570838ed4c for instance 882624cc-49e8-4228-85cc-84a4d8e767eb on n-h2-862355-1 Oct 25 03:50:15.887046 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-6ef8ccc3-86ec-41bb-b9bf-2e92827a6c65 req-fc272b16-6816-44a1-a48f-23b768a809f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214261 Oct 25 03:50:15.887655 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3446/7010] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:50:16.061157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:16.062395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:16.070546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:16.072503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:16.073114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:16.074007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:16.074607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:16.075178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:16.159031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:16.168670 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bf05bf93-af7b-4824-9684-23ffc60d9449 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1225 microversion: 2.1 time: 0.112863 Oct 25 03:50:16.169266 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3565/7011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:16 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:17.193025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:17.194435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:17.207681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:17.208536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:17.209207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:17.210559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:17.212037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:17.212715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:17.292724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:17.304328 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4eb48ecb-7d39-41da-8cc0-6e9c822f8438 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1225 microversion: 2.1 time: 0.115429 Oct 25 03:50:17.305377 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3447/7012] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:17 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:17.944872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:17.945389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:17.948889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ace22a8c-d66a-4adc-95a6-b592a87db3c1 req-43855fd0-4977-43d0-8bfe-ee995d170bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f544dd94-e2f6-4cdd-b5ca-ec00783649d6", "tag": "f7d58248-a97b-4c28-b05e-0ae7cffa82d6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:17.954025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:17.954730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:17.955418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:17.956284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:17.956898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:17.957485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:17.970854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ace22a8c-d66a-4adc-95a6-b592a87db3c1 req-43855fd0-4977-43d0-8bfe-ee995d170bd3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:17.971460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ace22a8c-d66a-4adc-95a6-b592a87db3c1 req-43855fd0-4977-43d0-8bfe-ee995d170bd3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:17.972002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ace22a8c-d66a-4adc-95a6-b592a87db3c1 req-43855fd0-4977-43d0-8bfe-ee995d170bd3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:17.984905 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ace22a8c-d66a-4adc-95a6-b592a87db3c1 req-43855fd0-4977-43d0-8bfe-ee995d170bd3 service nova] Creating event network-changed:f7d58248-a97b-4c28-b05e-0ae7cffa82d6 for instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 on n-h1-862355-1 Oct 25 03:50:17.991242 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ace22a8c-d66a-4adc-95a6-b592a87db3c1 req-43855fd0-4977-43d0-8bfe-ee995d170bd3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046797 Oct 25 03:50:17.992466 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3448/7013] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:50:18.006456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:50:18.155426 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d45efe2d-9e9f-4ddc-9609-722d79d1cdb5 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 204 len: 0 microversion: 2.1 time: 0.214254 Oct 25 03:50:18.156191 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3566/7014] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:50:17 2022] DELETE /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:50:18.166605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:18.167486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:18.183668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:18.184316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:18.187474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:18.188349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:18.188973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:18.189791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:18.328812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:18.329525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:18.335975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:18.336542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:18.337261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:18.338218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:18.338854 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:18.339449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:18.403230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:18.417610 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8914e663-213f-4b30-af6e-0287bb5685e7 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1688 microversion: 2.1 time: 0.256641 Oct 25 03:50:18.419423 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3449/7015] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:18 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1688 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:18.426800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:18.453831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b126bef-6f66-4e07-8b9c-a690586d87da tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1225 microversion: 2.1 time: 0.129402 Oct 25 03:50:18.455580 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3567/7016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:18 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:50:19.444518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:19.445161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:19.458204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:19.458723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:19.459184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:19.459913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:19.460416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:19.460864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:19.480874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:19.482731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:19.498554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:19.499224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:19.502064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:19.503026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:19.503701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:19.504318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:19.587390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:19.591160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:50:19.596717 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb5e2f48-de3a-4c73-be43-4049182c9916 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1225 microversion: 2.1 time: 0.122412 Oct 25 03:50:19.597247 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3568/7017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:19 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:19.835873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:19.844944 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8bbcadce-7b10-4256-8f2d-1352113d95aa tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1688 microversion: 2.1 time: 0.404353 Oct 25 03:50:19.862136 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3450/7018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:19 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1688 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:20.308151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5aff0410-06fa-494a-b773-a4aaa8ccb790 req-0f220eee-6b45-4914-9756-9d72a3f783f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f544dd94-e2f6-4cdd-b5ca-ec00783649d6", "name": "network-vif-deleted", "tag": "f7d58248-a97b-4c28-b05e-0ae7cffa82d6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:20.330372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5aff0410-06fa-494a-b773-a4aaa8ccb790 req-0f220eee-6b45-4914-9756-9d72a3f783f0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:20.330875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5aff0410-06fa-494a-b773-a4aaa8ccb790 req-0f220eee-6b45-4914-9756-9d72a3f783f0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:20.331327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5aff0410-06fa-494a-b773-a4aaa8ccb790 req-0f220eee-6b45-4914-9756-9d72a3f783f0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:20.348038 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5aff0410-06fa-494a-b773-a4aaa8ccb790 req-0f220eee-6b45-4914-9756-9d72a3f783f0 service nova] Creating event network-vif-deleted:f7d58248-a97b-4c28-b05e-0ae7cffa82d6 for instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 on n-h1-862355-1 Oct 25 03:50:20.353147 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5aff0410-06fa-494a-b773-a4aaa8ccb790 req-0f220eee-6b45-4914-9756-9d72a3f783f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050297 Oct 25 03:50:20.354077 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3569/7019] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:50:20.626229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:20.627471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:20.634700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:20.635208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:20.635663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:20.636401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:20.636873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:20.637319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:20.672236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:20.672765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:20.673206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:20.673692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lazy-loading 'fault' on Instance uuid 882624cc-49e8-4228-85cc-84a4d8e767eb {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:50:20.722487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e64a49b61740dea1df3c46936978fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943b7da2264a430484090abc9f4773a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:20.732307 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5818841c-bd78-4805-b339-aac8f23cb2c6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 200 len: 1230 microversion: 2.1 time: 0.111539 Oct 25 03:50:20.732924 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3451/7020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:20 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:20.874410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:20.875925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:20.888416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:20.888924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:20.890022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:20.890932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:20.891502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:20.892189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:20.935758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:20.936210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:20.936699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:20.937199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lazy-loading 'fault' on Instance uuid f544dd94-e2f6-4cdd-b5ca-ec00783649d6 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:50:20.982112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329132b9ba734f18ab7270e10d0b7e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d9f7a653134b0da86e56f376f0124b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:50:20.990103 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b3162f2-f6a6-4454-9096-8c27cc907487 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 200 len: 1356 microversion: 2.1 time: 0.120908 Oct 25 03:50:20.990691 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3570/7021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:20 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 1356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:50:21.758302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:21.758917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 882624cc-49e8-4228-85cc-84a4d8e767eb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:21.765826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:21.766336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:21.766796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:21.767543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:21.768065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:21.768559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:21.783636 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 882624cc-49e8-4228-85cc-84a4d8e767eb could not be found. Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb HTTP/1.1 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 882624cc-49e8-4228-85cc-84a4d8e767eb could not be found. Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '882624cc-49e8-4228-85cc-84a4d8e767eb'} Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 882624cc-49e8-4228-85cc-84a4d8e767eb could not be found. Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 882624cc-49e8-4228-85cc-84a4d8e767eb could not be found. Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:21.785343 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 882624cc-49e8-4228-85cc-84a4d8e767eb could not be found. Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 882624cc-49e8-4228-85cc-84a4d8e767eb could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7d34f14e-c958-4f3f-84e0-5bc06a5b3769 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb" status: 404 len: 111 microversion: 2.1 time: 0.032812 Oct 25 03:50:21.789167 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3452/7022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:21 2022] GET /compute/v2.1/servers/882624cc-49e8-4228-85cc-84a4d8e767eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:50:22.014610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:22.015239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] [instance: f544dd94-e2f6-4cdd-b5ca-ec00783649d6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:22.022523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:22.023140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:22.023744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:22.025136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:22.025779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:22.026401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:22.042455 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] HTTP exception thrown: Instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 could not be found. Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Request method failure captured: Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 HTTP/1.1 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1sn7Jqyk8iWGhv8KTU8-HZ4ckbmnIqC7OUVGg9nbBanytbYzmLCBu6ojVNjR80D0kicdrklCDCRrHjiw6Ejgf_qPQBhDc8G0Gx9QKO14FZeMcmLdGHpa5RO8U2zyUH-9Nf5_Fn7LyOKCbnZk3-qnefoKct38XLa3HKTHps3cugo6IY Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/84d9f7a653134b0da86e56f376f0124b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_84d9f7a653134b0da86e56f376f0124b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/84d9f7a653134b0da86e56f376f0124b"}]}] Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 84d9f7a653134b0da86e56f376f0124b Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-784702884 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 329132b9ba734f18ab7270e10d0b7e31 Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-784702884-project Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 could not be found. Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'f544dd94-e2f6-4cdd-b5ca-ec00783649d6'} Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 could not be found. Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 could not be found. Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.044671 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 could not be found. Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Returning 404 to user: Instance f544dd94-e2f6-4cdd-b5ca-ec00783649d6 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1fcd234-3b45-4895-a788-ed50f1bff689 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6" status: 404 len: 111 microversion: 2.1 time: 0.035001 Oct 25 03:50:22.049347 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3571/7023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:22 2022] GET /compute/v2.1/servers/f544dd94-e2f6-4cdd-b5ca-ec00783649d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:50:22.265384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:22.265962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:22.272148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:22.272665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:22.273122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:22.274076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:22.274745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:22.275209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:22.290019 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b HTTP/1.1 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '8cbc6447-7752-4831-b6b0-738226465f0b'} Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:50:22.291836 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-484690a4-d75a-4c33-a4c3-48bc28c67cb7 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 404 len: 111 microversion: 2.1 time: 0.031912 Oct 25 03:50:22.298700 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3453/7024] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:50:22 2022] DELETE /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:50:22.302128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:22.302744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] [instance: 8cbc6447-7752-4831-b6b0-738226465f0b] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:50:22.310879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:22.311270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:22.311714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:22.312412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:50:22.312866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:50:22.313289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:50:22.328792 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] HTTP exception thrown: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Request method failure captured: Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b HTTP/1.1 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1onRYT-vWz0VRuOcRWPj4eXIG80zjkvnXogtuP3z8E7njqHf9Uvt_Ezw5bi05WhlGhkx6egmwpWXnLqyOF9bIQZeuRVCwMoL22UllLXU9V8VRKMwr1g6qA8D6eT9b8pfUvF74teMKwxZ4VC4wjsZ0SPMVg3MHZNHcw0QpaUxl-234M Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/943b7da2264a430484090abc9f4773a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_943b7da2264a430484090abc9f4773a9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/943b7da2264a430484090abc9f4773a9"}]}] Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 943b7da2264a430484090abc9f4773a9 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBootPattern-856601378 Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 61e64a49b61740dea1df3c46936978fc Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBootPattern-856601378-project Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '8cbc6447-7752-4831-b6b0-738226465f0b'} Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:50:22.330487 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Returning 404 to user: Instance 8cbc6447-7752-4831-b6b0-738226465f0b could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7170335-25f7-4a88-8bbf-b11aff5da255 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b" status: 404 len: 111 microversion: 2.1 time: 0.033595 Oct 25 03:50:22.334654 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3572/7025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:50:22 2022] GET /compute/v2.1/servers/8cbc6447-7752-4831-b6b0-738226465f0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:50:26.323863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c8ee1280-4ea7-4cbf-a8ed-9c2a5970e395 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] Calling method '.version_select at 0x7efd334fbca0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:26.372653 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c8ee1280-4ea7-4cbf-a8ed-9c2a5970e395 tempest-TestNetworkAdvancedServerOps-784702884 tempest-TestNetworkAdvancedServerOps-784702884-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-427448227" status: 202 len: 0 microversion: 2.1 time: 0.053384 Oct 25 03:50:26.373355 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3454/7026] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 25 03:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-427448227 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:50:27.199110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bb9ec1f8-6fc9-4c53-b638-c039e507eea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] Calling method '.version_select at 0x7efd329f0d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:50:27.222200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bb9ec1f8-6fc9-4c53-b638-c039e507eea6 tempest-TestVolumeBootPattern-856601378 tempest-TestVolumeBootPattern-856601378-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-303901269" status: 202 len: 0 microversion: 2.1 time: 0.027570 Oct 25 03:50:27.223465 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3573/7027] 10.222.0.36 () {58 vars in 1260 bytes} [Tue Oct 25 03:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-303901269 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:50:58.271987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=68 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:50:58.272846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:50:58.275824 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 03:50:58.275962 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 03:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 25 03:50:58.282425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a2187084-c2cb-4736-a054-20a53d16c105 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Action: 'create', calling method: .version_select at 0x7efd33d028b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-673799555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxsutriLweH4HrDRu4SqGPlZbMqjC0SRVr5jtNAdy+u6Sqcg1nTepyD5aK/ZcvTIANw9mv/hdtUt7puLuOeNqzDUIchmn7aIIxFs2Z//8epOvvCyZV1vyJ0Qf2qCVq3ug=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:58.302459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a2187084-c2cb-4736-a054-20a53d16c105 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Getting quotas for project c54554393b354a3498b2b6ac062016fc. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:50:58.309074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a2187084-c2cb-4736-a054-20a53d16c105 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Getting quotas for user b344128b7d904d5bbd1ee10ba9474536 and project c54554393b354a3498b2b6ac062016fc. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:50:58.333471 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a2187084-c2cb-4736-a054-20a53d16c105 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.063321 Oct 25 03:50:58.334135 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3455/7028] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:50:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:50:59.346224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:50:59.347095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:50:59.351103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1492036152", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "081a440b-0301-471e-a0c7-b21ffe7c1942", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-673799555", "security_groups": [{"name": "tempest-secgroup-smoke-1367083183"}], "networks": [{"uuid": "d7a11f94-6f68-4504-9ffa-a397c70e17a9"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:50:59.688544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] validate_networks() for [('d7a11f94-6f68-4504-9ffa-a397c70e17a9', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:51:00.149303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:51:00.149798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:51:00.150269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:51:00.150681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:51:00.151097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:51:00.159962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:00.160454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:00.160891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:00.161623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:00.162128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:00.162536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:00.181422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Getting quotas for project c54554393b354a3498b2b6ac062016fc. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:51:00.186756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Getting quotas for user b344128b7d904d5bbd1ee10ba9474536 and project c54554393b354a3498b2b6ac062016fc. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:51:00.247322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:51:00.249483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='081a440b-0301-471e-a0c7-b21ffe7c1942',volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:51:00.381545 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf59e209-a688-4f64-bc5c-21f65e0abd6b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.037094 Oct 25 03:51:00.382238 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3574/7029] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:50:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:51:00.395105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7318204d-7de2-47cd-8d3a-45662b221a8e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:00.395744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7318204d-7de2-47cd-8d3a-45662b221a8e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:00.516099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7318204d-7de2-47cd-8d3a-45662b221a8e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:00.524902 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7318204d-7de2-47cd-8d3a-45662b221a8e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1098 microversion: 2.1 time: 0.134355 Oct 25 03:51:00.525797 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3456/7030] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:00 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1098 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:01.549589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:01.550155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:01.558702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:01.559185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:01.560267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:01.561037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:01.561520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:01.561994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:01.630031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:01.638276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ff1a90c-a745-4b34-befe-404bb6ae6d15 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1196 microversion: 2.1 time: 0.094011 Oct 25 03:51:01.639116 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3575/7031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:01 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1196 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:02.669752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:02.671156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:02.678079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:02.678580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:02.679207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:02.681611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:02.682120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:02.682729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:02.896242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:02.906085 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c0f80d77-4ee7-4a6c-9046-6e6938c0f7cb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1282 microversion: 2.1 time: 0.240341 Oct 25 03:51:02.906665 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3457/7032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:02 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1282 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:03.194103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-31679b4d-3ad8-4aa5-aa7e-651c1c2f4191 req-a50bbfbf-7a7b-432d-bcbe-4a02c84985d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfef6ab-7a16-4896-99dd-0cbab7a64268", "tag": "cae40f55-6252-4fb0-b8ec-94d6e607c4b0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:51:03.209523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-31679b4d-3ad8-4aa5-aa7e-651c1c2f4191 req-a50bbfbf-7a7b-432d-bcbe-4a02c84985d1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:03.211828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-31679b4d-3ad8-4aa5-aa7e-651c1c2f4191 req-a50bbfbf-7a7b-432d-bcbe-4a02c84985d1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:03.212429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-31679b4d-3ad8-4aa5-aa7e-651c1c2f4191 req-a50bbfbf-7a7b-432d-bcbe-4a02c84985d1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:03.225941 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-31679b4d-3ad8-4aa5-aa7e-651c1c2f4191 req-a50bbfbf-7a7b-432d-bcbe-4a02c84985d1 service nova] Creating event network-changed:cae40f55-6252-4fb0-b8ec-94d6e607c4b0 for instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 on n-h1-862355-1 Oct 25 03:51:03.232162 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-31679b4d-3ad8-4aa5-aa7e-651c1c2f4191 req-a50bbfbf-7a7b-432d-bcbe-4a02c84985d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044892 Oct 25 03:51:03.233299 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3576/7033] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:51:03.929495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:03.930272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:03.937748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:03.938444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:03.938894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:03.939738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:03.940060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:03.940494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:04.171298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:04.182062 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e3e4ef9-923d-45b4-90a2-96d276cb4043 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1282 microversion: 2.1 time: 0.256280 Oct 25 03:51:04.182673 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3458/7034] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:03 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1282 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:05.206054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:05.206682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:05.213112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:05.213630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:05.214091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:05.214785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:05.215239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:05.215665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:05.350517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:05.358571 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dcf35bef-4316-42a8-bfcd-3d1cd3516836 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1282 microversion: 2.1 time: 0.157813 Oct 25 03:51:05.359160 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3577/7035] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:05 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:06.381764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:06.382833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:06.390584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:06.391094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:06.391556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:06.392293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:06.392778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:06.393226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:06.542553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:06.551009 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3d9f3427-9810-4e7e-aa9f-cc6e6bacea84 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1282 microversion: 2.1 time: 0.173280 Oct 25 03:51:06.551621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3459/7036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:06 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:07.574775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:07.575390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:07.582479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:07.582982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:07.583419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:07.584130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:07.584596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:07.585021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:07.750565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:07.759265 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0bfd008b-84b0-4e4d-ab33-6860844addbd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.188292 Oct 25 03:51:07.759870 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3578/7037] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:07 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:08.783675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:08.784306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:08.791862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:08.792355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:08.792828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:08.793819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:08.794282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:08.794719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:08.927864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:08.936128 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b4d8f45f-6329-4971-a3a4-d25d2a58bc8d tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.156405 Oct 25 03:51:08.936707 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3460/7038] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:08 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:09.958632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:09.959302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:09.966014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:09.966497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:09.966931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:09.967617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:09.968073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:09.968498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:10.104072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:10.111763 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b4bda2df-e3f2-42ac-ba39-99032b70cbb9 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.157088 Oct 25 03:51:10.112333 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3579/7039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:09 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:11.134704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:11.135336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:11.138062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:51:11.143768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:11.144267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:11.144755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:11.145466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:11.145961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:11.146407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:11.280078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:11.288242 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e61ea6e6-559a-4d05-8925-691e4598dad0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.157548 Oct 25 03:51:11.289834 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3461/7040] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:11 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:12.311646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:12.312168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:12.314150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:51:12.314822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:51:12.322441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:12.322924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:12.323357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:12.324043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:12.324496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:12.324928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:12.463995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:12.472015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-745ab083-0665-438e-82ee-7bc5f3cc890b tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.164397 Oct 25 03:51:12.472597 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3580/7041] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:12 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:13.495274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:13.495942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:13.502897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:13.503399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:13.503859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:13.504580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:13.505062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:13.505506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:13.640944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:13.649329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-39a03439-16f5-4184-854b-c252c3ed8bc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.158103 Oct 25 03:51:13.649939 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3462/7042] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:13 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:14.672724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:14.673340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:14.681353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:14.682128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:14.682570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:14.683282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:14.683734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:14.684171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:14.821284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:14.829465 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-edd637e4-446e-4f62-a3e3-40e971b60161 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.160659 Oct 25 03:51:14.830152 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3581/7043] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:14 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:15.852557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:15.854166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:15.861079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:15.861572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:15.862051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:15.862777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:15.863250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:15.863686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:15.996741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:16.004884 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d9f0c2c7-e0c0-465b-84a1-66cc379a10d0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.156423 Oct 25 03:51:16.005461 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3463/7044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:15 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:17.028540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:17.029183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:17.036222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:17.036702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:17.037132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:17.037880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:17.038362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:17.039826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:17.168846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:17.176686 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-009d57b2-9d21-4d0e-ad45-a839ec9a5ab0 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.152110 Oct 25 03:51:17.177262 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3582/7045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:17 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:17.814867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-5297d52d-47ac-49dd-a9b7-740ff6615743 req-19e983a2-3ff7-4249-9837-e31b356a74a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfef6ab-7a16-4896-99dd-0cbab7a64268", "name": "network-vif-plugged", "status": "completed", "tag": "cae40f55-6252-4fb0-b8ec-94d6e607c4b0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:51:17.827704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5297d52d-47ac-49dd-a9b7-740ff6615743 req-19e983a2-3ff7-4249-9837-e31b356a74a5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:17.828207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5297d52d-47ac-49dd-a9b7-740ff6615743 req-19e983a2-3ff7-4249-9837-e31b356a74a5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:17.828919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5297d52d-47ac-49dd-a9b7-740ff6615743 req-19e983a2-3ff7-4249-9837-e31b356a74a5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:17.840230 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-5297d52d-47ac-49dd-a9b7-740ff6615743 req-19e983a2-3ff7-4249-9837-e31b356a74a5 service nova] Creating event network-vif-plugged:cae40f55-6252-4fb0-b8ec-94d6e607c4b0 for instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 on n-h1-862355-1 Oct 25 03:51:17.845438 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-5297d52d-47ac-49dd-a9b7-740ff6615743 req-19e983a2-3ff7-4249-9837-e31b356a74a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034269 Oct 25 03:51:17.846166 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3464/7046] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:51:18.199549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:18.200172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:18.207042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:18.207522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:18.207963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:18.208658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:18.209118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:18.209548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:18.344705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:18.352569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c591c068-7846-4c65-bfbe-e3ba66848d77 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1270 microversion: 2.1 time: 0.157076 Oct 25 03:51:18.353698 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3583/7047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:18 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:19.377777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:19.378499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:19.386348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:19.386859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:19.387312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:19.388021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:19.388493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:19.388939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:19.520666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:19.529142 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-243021d2-fe6e-4d9d-82bf-d6db5c2ad972 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1459 microversion: 2.1 time: 0.155748 Oct 25 03:51:19.529753 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3465/7048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:19 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:19.551930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:19.552554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:19.559796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:19.560280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:19.560719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:19.561411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:19.561905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:19.562337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:19.692953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:19.701292 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-933b73e3-f537-4f51-a369-cb337baabc01 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1459 microversion: 2.1 time: 0.153339 Oct 25 03:51:19.701910 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3584/7049] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:19 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:21.678163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4d667c32-2dcf-46c1-83a9-43d50c297a67 req-b89c4f27-48b1-4bae-bcd5-29181b696731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfef6ab-7a16-4896-99dd-0cbab7a64268", "tag": "cae40f55-6252-4fb0-b8ec-94d6e607c4b0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:51:21.689719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d667c32-2dcf-46c1-83a9-43d50c297a67 req-b89c4f27-48b1-4bae-bcd5-29181b696731 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:21.690230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d667c32-2dcf-46c1-83a9-43d50c297a67 req-b89c4f27-48b1-4bae-bcd5-29181b696731 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:21.690685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4d667c32-2dcf-46c1-83a9-43d50c297a67 req-b89c4f27-48b1-4bae-bcd5-29181b696731 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:21.706304 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4d667c32-2dcf-46c1-83a9-43d50c297a67 req-b89c4f27-48b1-4bae-bcd5-29181b696731 service nova] Creating event network-changed:cae40f55-6252-4fb0-b8ec-94d6e607c4b0 for instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 on n-h1-862355-1 Oct 25 03:51:21.711469 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4d667c32-2dcf-46c1-83a9-43d50c297a67 req-b89c4f27-48b1-4bae-bcd5-29181b696731 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037009 Oct 25 03:51:21.712101 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3466/7050] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:51:23.727370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4d4f7d9a-c830-413a-8bb5-6a45a7690343 req-6cd08cb5-f695-4ce7-8cc3-33e9665999c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfef6ab-7a16-4896-99dd-0cbab7a64268", "tag": "cae40f55-6252-4fb0-b8ec-94d6e607c4b0"}, {"name": "network-changed", "server_uuid": "ecfef6ab-7a16-4896-99dd-0cbab7a64268", "tag": "cae40f55-6252-4fb0-b8ec-94d6e607c4b0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:51:23.738499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4d4f7d9a-c830-413a-8bb5-6a45a7690343 req-6cd08cb5-f695-4ce7-8cc3-33e9665999c2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:23.738981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4d4f7d9a-c830-413a-8bb5-6a45a7690343 req-6cd08cb5-f695-4ce7-8cc3-33e9665999c2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:23.739413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4d4f7d9a-c830-413a-8bb5-6a45a7690343 req-6cd08cb5-f695-4ce7-8cc3-33e9665999c2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:23.753916 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4d4f7d9a-c830-413a-8bb5-6a45a7690343 req-6cd08cb5-f695-4ce7-8cc3-33e9665999c2 service nova] Creating event network-changed:cae40f55-6252-4fb0-b8ec-94d6e607c4b0 for instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 on n-h1-862355-1 Oct 25 03:51:23.754460 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4d4f7d9a-c830-413a-8bb5-6a45a7690343 req-6cd08cb5-f695-4ce7-8cc3-33e9665999c2 service nova] Creating event network-changed:cae40f55-6252-4fb0-b8ec-94d6e607c4b0 for instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 on n-h1-862355-1 Oct 25 03:51:23.759690 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4d4f7d9a-c830-413a-8bb5-6a45a7690343 req-6cd08cb5-f695-4ce7-8cc3-33e9665999c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036045 Oct 25 03:51:23.760343 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3585/7051] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:51:54.067030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:51:54.068222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=52 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:51:54.072721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:54.072941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-70f4a40a-97e6-4854-a161-218daeeff8b4 req-f0d1d83d-b041-4c44-817f-f55133b6187c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfef6ab-7a16-4896-99dd-0cbab7a64268", "tag": "cae40f55-6252-4fb0-b8ec-94d6e607c4b0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:51:54.073385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:54.079053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:51:54.079777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=60 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:51:54.080978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:54.081481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:54.087276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-70f4a40a-97e6-4854-a161-218daeeff8b4 req-f0d1d83d-b041-4c44-817f-f55133b6187c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:54.087765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-70f4a40a-97e6-4854-a161-218daeeff8b4 req-f0d1d83d-b041-4c44-817f-f55133b6187c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:54.088210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-70f4a40a-97e6-4854-a161-218daeeff8b4 req-f0d1d83d-b041-4c44-817f-f55133b6187c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:54.091553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:54.092437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:54.093761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:54.094220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:54.101231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-70f4a40a-97e6-4854-a161-218daeeff8b4 req-f0d1d83d-b041-4c44-817f-f55133b6187c service nova] Creating event network-changed:cae40f55-6252-4fb0-b8ec-94d6e607c4b0 for instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 on n-h1-862355-1 Oct 25 03:51:54.106561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-70f4a40a-97e6-4854-a161-218daeeff8b4 req-f0d1d83d-b041-4c44-817f-f55133b6187c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038946 Oct 25 03:51:54.107438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3586/7052] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:51:54.123728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:51:54.217027 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-32ba958e-c97e-4a97-a0f5-7fbbaca50eca tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 204 len: 0 microversion: 2.1 time: 0.152226 Oct 25 03:51:54.218427 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3467/7053] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:51:54 2022] DELETE /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:51:54.228280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:54.228986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:54.238901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:54.239393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:54.239827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:54.240528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:54.241037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:54.241473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:54.386166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:54.394691 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f5a18f4-040a-4308-b43f-64f4c01d37e1 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1584 microversion: 2.1 time: 0.171184 Oct 25 03:51:54.395388 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3587/7054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:54 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1584 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:51:55.420494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:55.421137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:55.428644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:55.429153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:55.429608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:55.430359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:55.430843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:55.431290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:55.633392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:55.641511 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-904dedc3-ca81-4b25-827c-0f1d9de5fbc2 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1584 microversion: 2.1 time: 0.225499 Oct 25 03:51:55.642091 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3468/7055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:55 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1584 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:56.481368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4b72536e-2694-42bd-81aa-8c10b9ce1232 req-0c389a06-5f78-4737-b047-734437425896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfef6ab-7a16-4896-99dd-0cbab7a64268", "name": "network-vif-deleted", "tag": "cae40f55-6252-4fb0-b8ec-94d6e607c4b0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:51:56.494758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4b72536e-2694-42bd-81aa-8c10b9ce1232 req-0c389a06-5f78-4737-b047-734437425896 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:56.494758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4b72536e-2694-42bd-81aa-8c10b9ce1232 req-0c389a06-5f78-4737-b047-734437425896 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:56.494758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4b72536e-2694-42bd-81aa-8c10b9ce1232 req-0c389a06-5f78-4737-b047-734437425896 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:56.506506 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4b72536e-2694-42bd-81aa-8c10b9ce1232 req-0c389a06-5f78-4737-b047-734437425896 service nova] Creating event network-vif-deleted:cae40f55-6252-4fb0-b8ec-94d6e607c4b0 for instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 on n-h1-862355-1 Oct 25 03:51:56.511385 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4b72536e-2694-42bd-81aa-8c10b9ce1232 req-0c389a06-5f78-4737-b047-734437425896 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 Oct 25 03:51:56.512311 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3588/7056] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:51:56.665267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:56.665872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:56.672712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:56.673240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:56.674528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:56.675282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:56.675755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:56.676199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:56.738566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:56.746644 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5d419af-8a4d-478d-9b46-851b06428920 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1229 microversion: 2.1 time: 0.085404 Oct 25 03:51:56.747242 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3469/7057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:56 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:57.772234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:57.773540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:57.779847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:57.780337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:57.780780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:57.781484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:57.781976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:57.782405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:57.849725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:57.857619 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7e2645dd-2e33-4a02-a563-4de5a89458fb tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1229 microversion: 2.1 time: 0.091303 Oct 25 03:51:57.858218 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3589/7058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:57 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:58.881957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:58.882588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:51:58.889383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:58.889929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:58.890389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:58.891260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:51:58.891760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:51:58.892422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:51:58.955801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:51:58.963715 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-05ca7a7a-caaa-475b-9e1f-c4c5448aaddd tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1229 microversion: 2.1 time: 0.085927 Oct 25 03:51:58.964316 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3470/7059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:58 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:51:59.987495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:51:59.988138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:00.000910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:00.001415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:00.002136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:00.002862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:00.003325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:00.004131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:00.069446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:00.077572 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5993b67f-7d20-4c31-9cdd-fa4eff47ce06 tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1229 microversion: 2.1 time: 0.094266 Oct 25 03:52:00.078189 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3590/7060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:51:59 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:01.101567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:01.102221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:01.109190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:01.109753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:01.110159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:01.110856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:01.112450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:01.112893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:01.143805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:01.144288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:01.144733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:01.145185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lazy-loading 'fault' on Instance uuid ecfef6ab-7a16-4896-99dd-0cbab7a64268 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:52:01.190847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b344128b7d904d5bbd1ee10ba9474536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54554393b354a3498b2b6ac062016fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:01.198824 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d4adb471-cb65-4a40-818e-00dfa433fefc tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 200 len: 1234 microversion: 2.1 time: 0.101148 Oct 25 03:52:01.199425 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3471/7061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:01 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:02.223114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:02.223732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] [instance: ecfef6ab-7a16-4896-99dd-0cbab7a64268] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:02.230407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:02.230890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:02.231324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:02.232010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:02.232461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:02.232886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:02.246185 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] HTTP exception thrown: Instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 could not be found. Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Request method failure captured: Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 HTTP/1.1 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1yqW-hS3jIPwmP2DUOhDui-az_j0w2EQc3O4U5C5n-l4G0s2XJBQ_SOPhP7kkpELcaErISm8ThJXB4eGCjUtiwwnjFSNZjNPpTS3Ed8jTeWgHxwsIm05qF3C7vn0WEqsdQlmw0sei5yfHrell0pJyjVoUUfPRgIV7LNVafGzJq8Uww Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: c54554393b354a3498b2b6ac062016fc Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestVolumeBackupRestore-246771238 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c54554393b354a3498b2b6ac062016fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c54554393b354a3498b2b6ac062016fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c54554393b354a3498b2b6ac062016fc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c54554393b354a3498b2b6ac062016fc"}]}] Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestVolumeBackupRestore-246771238 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: c54554393b354a3498b2b6ac062016fc Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestVolumeBackupRestore-246771238 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestVolumeBackupRestore-246771238-project Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: b344128b7d904d5bbd1ee10ba9474536 Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestVolumeBackupRestore-246771238-project Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 could not be found. Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'ecfef6ab-7a16-4896-99dd-0cbab7a64268'} Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 could not be found. Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 could not be found. Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:02.247806 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 could not be found. Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Returning 404 to user: Instance ecfef6ab-7a16-4896-99dd-0cbab7a64268 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bbc703a8-de65-42a0-bb05-c63bd4c8167e tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268" status: 404 len: 111 microversion: 2.1 time: 0.030651 Oct 25 03:52:02.252211 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3591/7062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:02 2022] GET /compute/v2.1/servers/ecfef6ab-7a16-4896-99dd-0cbab7a64268 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:52:02.411944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce248b35-6e05-4542-8130-4329c3a62d0f tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] Calling method '.version_select at 0x7efd332f5550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:02.433441 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce248b35-6e05-4542-8130-4329c3a62d0f tempest-TestVolumeBackupRestore-246771238 tempest-TestVolumeBackupRestore-246771238-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-673799555" status: 202 len: 0 microversion: 2.1 time: 0.026068 Oct 25 03:52:02.433809 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3472/7063] 10.222.0.36 () {58 vars in 1266 bytes} [Tue Oct 25 03:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-673799555 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:52:25.526032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:25.526870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=24 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:25.639881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-486184698", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:25.695945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] validate_networks() for None {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:52:25.964123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:52:25.964547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:52:25.965018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:52:25.965429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:52:25.965882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:52:25.975200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:25.975681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:25.976117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:25.976842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:25.977299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:25.977749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:25.994655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Getting quotas for project 24b19dcbc42647ac9dcf5b46f67f9461. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:52:26.000002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Getting quotas for user 56042633204946af8a35548217248b4f and project 24b19dcbc42647ac9dcf5b46f67f9461. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:52:26.012640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:52:26.014967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:52:26.060323 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b6fc6cb-e7a8-4744-ab1c-6964eb796994 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539602 Oct 25 03:52:26.061158 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3592/7064] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:52:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:52:26.072093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:26.072959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:26.077574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-427ee423-339f-49ac-be55-06823409768d tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:26.078244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-427ee423-339f-49ac-be55-06823409768d tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:26.142612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-427ee423-339f-49ac-be55-06823409768d tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:26.150386 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-427ee423-339f-49ac-be55-06823409768d tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1221 microversion: 2.1 time: 0.080395 Oct 25 03:52:26.151014 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3473/7065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:26 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:27.175373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:27.176015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:27.183063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:27.183548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:27.183988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:27.184679 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:27.185139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:27.185571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:27.254362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:27.262190 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e8b91f25-a334-4de1-8156-b35f32ae6d6a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1273 microversion: 2.1 time: 0.092051 Oct 25 03:52:27.263043 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3593/7066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:27 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:28.287553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:28.288350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:28.295246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:28.296319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:28.296781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:28.297507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:28.298065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:28.298545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:28.855069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:28.863648 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9a7f47e5-e53b-4a3a-95a0-6e0d51822a09 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1321 microversion: 2.1 time: 0.580436 Oct 25 03:52:28.864255 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3474/7067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:28 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:29.236691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0baee447-a182-4903-a84c-9c49253f8157 req-91b0cb70-603d-432d-9536-ae35464529f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a48286d-417c-4835-a65f-fce1967ba1ed", "tag": "6a587d4a-8c77-4e66-b99a-e101ad52f106"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:29.246896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0baee447-a182-4903-a84c-9c49253f8157 req-91b0cb70-603d-432d-9536-ae35464529f9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:29.247378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0baee447-a182-4903-a84c-9c49253f8157 req-91b0cb70-603d-432d-9536-ae35464529f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:29.247864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0baee447-a182-4903-a84c-9c49253f8157 req-91b0cb70-603d-432d-9536-ae35464529f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:29.268817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0baee447-a182-4903-a84c-9c49253f8157 req-91b0cb70-603d-432d-9536-ae35464529f9 service nova] Creating event network-changed:6a587d4a-8c77-4e66-b99a-e101ad52f106 for instance 0a48286d-417c-4835-a65f-fce1967ba1ed on n-h1-862355-1 Oct 25 03:52:29.273741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0baee447-a182-4903-a84c-9c49253f8157 req-91b0cb70-603d-432d-9536-ae35464529f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041720 Oct 25 03:52:29.274350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3594/7068] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:29.886061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:29.886794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:29.893774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:29.894302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:29.894756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:29.895457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:29.895922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:29.896361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:30.028108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:30.036502 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-951ec243-1245-4f06-ad75-a2bc9cb9c409 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1321 microversion: 2.1 time: 0.154381 Oct 25 03:52:30.037090 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3475/7069] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:29 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:31.061552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:31.062292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:31.069161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:31.069658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:31.070130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:31.070838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:31.071300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:31.071730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:31.489166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:31.496915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-39ba269e-f2d5-4225-88b8-76f56a313565 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1321 microversion: 2.1 time: 0.440818 Oct 25 03:52:31.497491 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3595/7070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:31 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:32.519453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:32.520117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:32.527106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:32.527606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:32.528062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:32.528769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:32.529241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:32.529697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:32.659925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:32.667716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-01828767-d98f-4498-b732-df8e3e6c3ff8 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1321 microversion: 2.1 time: 0.152227 Oct 25 03:52:32.668311 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3476/7071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:32 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:33.691257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:33.691877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:33.698603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:33.699093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:33.699539 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:33.700239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:33.700702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:33.701136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:33.830867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:33.838608 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7ba6001a-6f59-4fd0-99e2-a4aa670ceac0 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1321 microversion: 2.1 time: 0.151520 Oct 25 03:52:33.839188 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3596/7072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:33 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:34.066987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-53e53884-b184-4045-a353-de9391734289 req-b093ce24-1142-4b58-8e80-0104b5923a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a48286d-417c-4835-a65f-fce1967ba1ed", "name": "network-vif-plugged", "status": "completed", "tag": "6a587d4a-8c77-4e66-b99a-e101ad52f106"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:34.078950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53e53884-b184-4045-a353-de9391734289 req-b093ce24-1142-4b58-8e80-0104b5923a40 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:34.079536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53e53884-b184-4045-a353-de9391734289 req-b093ce24-1142-4b58-8e80-0104b5923a40 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:34.079955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-53e53884-b184-4045-a353-de9391734289 req-b093ce24-1142-4b58-8e80-0104b5923a40 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:34.091516 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-53e53884-b184-4045-a353-de9391734289 req-b093ce24-1142-4b58-8e80-0104b5923a40 service nova] Creating event network-vif-plugged:6a587d4a-8c77-4e66-b99a-e101ad52f106 for instance 0a48286d-417c-4835-a65f-fce1967ba1ed on n-h1-862355-1 Oct 25 03:52:34.097207 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-53e53884-b184-4045-a353-de9391734289 req-b093ce24-1142-4b58-8e80-0104b5923a40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Oct 25 03:52:34.098158 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3477/7073] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:34.861187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:34.861890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:34.869157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:34.869632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:34.870098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:34.870782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:34.871240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:34.871661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:35.004467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:35.012458 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ffa365b-181a-46b0-b211-9de812302787 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1321 microversion: 2.1 time: 0.155270 Oct 25 03:52:35.013047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3597/7074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:34 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:36.036765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:36.037495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:36.044721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.045222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.045698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.046413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.046889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.047337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.147576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:36.178676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:36.186591 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e49d1cd2-d465-4553-8178-0f7f3f06f838 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1471 microversion: 2.1 time: 0.154442 Oct 25 03:52:36.187165 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3478/7075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:36 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:36.213412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:36.214265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:36.263452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-541b73ba-82e2-4452-872d-029a56b3a6e0 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Calling method '.version_select at 0x7efd33dee8b0>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:36.329637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-541b73ba-82e2-4452-872d-029a56b3a6e0 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/05cdcfeef3b84471a872f4d4544caab6" status: 200 len: 371 microversion: 2.1 time: 0.121668 Oct 25 03:52:36.330241 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3598/7076] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:52:36 2022] GET /compute/v2.1/os-quota-sets/05cdcfeef3b84471a872f4d4544caab6 => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:36.343656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58a352bc-aabc-4c96-a775-98dd286b6baa tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1700175716", "id": 2123381403, "os-flavor-access:is_public": "True"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:36.361346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58a352bc-aabc-4c96-a775-98dd286b6baa tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021422 Oct 25 03:52:36.362458 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3479/7077] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:52:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:36.374469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2123381403"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:36.377032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:36.383980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.384462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.384896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.385592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.386081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.386505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.476008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e97bfd5489d147f68746d13a7d7a40e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cdcfeef3b84471a872f4d4544caab6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:36.481960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1700175716 {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:52:36.489024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.489494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.489947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.490660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.491105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.491524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.512036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Getting quotas for project 24b19dcbc42647ac9dcf5b46f67f9461. Resources: {'ram', 'cores'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:52:36.517158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Getting quotas for user 56042633204946af8a35548217248b4f and project 24b19dcbc42647ac9dcf5b46f67f9461. Resources: {'ram', 'cores'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:52:36.530363 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.compute.api [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] ram quota exceeded for 05cdcfeef3b84471a872f4d4544caab6, tried to resize instance. Oct 25 03:52:36.530900 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Request method failure captured: Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed/action HTTP/1.1 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 39 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV115v7sMmoPMoWVOERrCkMWHZHMkGRN8gGUCoYeQFwt_vo4hv5r4S9UGgAjUW8iYR5RCybFDva1I2p40nClNctsHOryuALIPMpFF8UcAPWaPfM0PMX61_iduFuF_Rtgfs0j8_ksg2upyDOcIFtwYNm2m3y9EPwG95ft6z6bOQi8IEAY Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 05cdcfeef3b84471a872f4d4544caab6 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1034905321 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Role: admin,reader,member Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: admin,reader,member Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05cdcfeef3b84471a872f4d4544caab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05cdcfeef3b84471a872f4d4544caab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05cdcfeef3b84471a872f4d4544caab6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05cdcfeef3b84471a872f4d4544caab6"}]}] Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1034905321 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 05cdcfeef3b84471a872f4d4544caab6 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1034905321 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersAdminNegativeTestJSON-1034905321-project-admin Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: e97bfd5489d147f68746d13a7d7a40e8 Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1034905321-project-admin Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: {"resize": {"flavorRef": "2123381403"}} Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0a48286d-417c-4835-a65f-fce1967ba1ed', 'body': {'resize': {'flavorRef': '2123381403'}}} Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:52:36.532934 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a89ea015-5136-46f7-a090-1bcc347d8978 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed/action" status: 403 len: 118 microversion: 2.1 time: 0.163859 Oct 25 03:52:36.538535 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3599/7078] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:52:36 2022] POST /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:52:36.546714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-04bf610c-cc6f-4b36-a7c0-a47029a11b2f tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:36.564244 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-04bf610c-cc6f-4b36-a7c0-a47029a11b2f tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2123381403" status: 202 len: 0 microversion: 2.1 time: 0.021286 Oct 25 03:52:36.569837 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3480/7079] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:52:36 2022] DELETE /compute/v2.1/flavors/2123381403 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:52:36.574960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3afda672-6331-4991-8adf-cb2170157d4e tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:36.596795 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3afda672-6331-4991-8adf-cb2170157d4e tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025082 Oct 25 03:52:36.597350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3600/7080] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:52:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:36.619465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a1c846d-4408-49c8-b7a8-55448b0f66f7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Calling method '.version_select at 0x7efd331e6310>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:36.694724 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a1c846d-4408-49c8-b7a8-55448b0f66f7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/05cdcfeef3b84471a872f4d4544caab6" status: 200 len: 371 microversion: 2.1 time: 0.079522 Oct 25 03:52:36.695367 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3481/7081] 10.222.0.36 () {58 vars in 1242 bytes} [Tue Oct 25 03:52:36 2022] GET /compute/v2.1/os-quota-sets/05cdcfeef3b84471a872f4d4544caab6 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:36.708289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c98ccebf-a21b-483e-b286-105b4fc4a963 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-986056645", "id": 2074760909, "os-flavor-access:is_public": "True"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:36.726160 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c98ccebf-a21b-483e-b286-105b4fc4a963 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022587 Oct 25 03:52:36.726728 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3601/7082] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:52:36 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:36.739061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2074760909"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:36.741428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:36.747482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.747984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.748439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.749148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.749620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.750087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.940711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e97bfd5489d147f68746d13a7d7a40e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05cdcfeef3b84471a872f4d4544caab6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:36.947072 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-986056645 {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:52:36.953654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.954166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.954613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.955346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:36.956311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:36.956809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:36.978057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Getting quotas for project 24b19dcbc42647ac9dcf5b46f67f9461. Resources: {'ram', 'cores'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:52:36.983035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Getting quotas for user 56042633204946af8a35548217248b4f and project 24b19dcbc42647ac9dcf5b46f67f9461. Resources: {'ram', 'cores'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:52:36.994803 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] cores quota exceeded for 05cdcfeef3b84471a872f4d4544caab6, tried to resize instance. Oct 25 03:52:36.995351 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Request method failure captured: Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed/action HTTP/1.1 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 39 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV115v7sMmoPMoWVOERrCkMWHZHMkGRN8gGUCoYeQFwt_vo4hv5r4S9UGgAjUW8iYR5RCybFDva1I2p40nClNctsHOryuALIPMpFF8UcAPWaPfM0PMX61_iduFuF_Rtgfs0j8_ksg2upyDOcIFtwYNm2m3y9EPwG95ft6z6bOQi8IEAY Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 05cdcfeef3b84471a872f4d4544caab6 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1034905321 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Role: admin,reader,member Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: admin,reader,member Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05cdcfeef3b84471a872f4d4544caab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05cdcfeef3b84471a872f4d4544caab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05cdcfeef3b84471a872f4d4544caab6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05cdcfeef3b84471a872f4d4544caab6"}]}] Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1034905321 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 05cdcfeef3b84471a872f4d4544caab6 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1034905321 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersAdminNegativeTestJSON-1034905321-project-admin Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: e97bfd5489d147f68746d13a7d7a40e8 Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1034905321-project-admin Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: {"resize": {"flavorRef": "2074760909"}} Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0a48286d-417c-4835-a65f-fce1967ba1ed', 'body': {'resize': {'flavorRef': '2074760909'}}} Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:52:36.997438 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93c510da-bde0-4d02-8390-6bd4313f82b7 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed/action" status: 403 len: 113 microversion: 2.1 time: 0.264094 Oct 25 03:52:37.001365 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3482/7083] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:52:36 2022] POST /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed/action => generated 113 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:52:37.007713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-de0e3c40-f7ce-4c8e-881a-0238998e1f57 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:37.024826 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-de0e3c40-f7ce-4c8e-881a-0238998e1f57 tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2074760909" status: 202 len: 0 microversion: 2.1 time: 0.020797 Oct 25 03:52:37.025392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3602/7084] 10.222.0.36 () {58 vars in 1161 bytes} [Tue Oct 25 03:52:37 2022] DELETE /compute/v2.1/flavors/2074760909 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:52:37.033236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-235129c7-075c-4e48-b239-58335cf1183d tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:37.054562 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-235129c7-075c-4e48-b239-58335cf1183d tempest-ServersAdminNegativeTestJSON-1034905321 tempest-ServersAdminNegativeTestJSON-1034905321-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024938 Oct 25 03:52:37.055185 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3483/7085] 10.222.0.36 () {58 vars in 1146 bytes} [Tue Oct 25 03:52:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:37.076454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:37.077183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:37.083977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:37.084461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:37.084900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:37.085588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:37.086130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:37.086499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:37.111061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:52:37.186967 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93fd147b-cf7d-4491-8818-bb363a245133 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 204 len: 0 microversion: 2.1 time: 0.113904 Oct 25 03:52:37.187566 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3603/7086] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:52:37 2022] DELETE /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:52:37.196598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:37.197230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:37.203340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:37.203839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:37.204297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:37.205001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:37.205475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:37.206505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:37.336377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:37.344092 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4047377-ff23-416a-abbd-59373d831c29 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1477 microversion: 2.1 time: 0.151682 Oct 25 03:52:37.344679 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3484/7087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:37 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:38.368822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:38.369450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:38.377279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:38.378354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:38.378790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:38.379503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:38.379965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:38.380395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:38.512212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:38.520271 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f8901cc3-fff8-4b21-8b66-51855bbcd0d6 tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1477 microversion: 2.1 time: 0.155760 Oct 25 03:52:38.520866 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3604/7088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:38 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:39.056485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a53d9fb6-27e6-40c3-8ef1-7fb672e04f50 req-a88bb4c7-40d5-4921-ad82-2f9bad72be9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a48286d-417c-4835-a65f-fce1967ba1ed", "name": "network-vif-deleted", "tag": "6a587d4a-8c77-4e66-b99a-e101ad52f106"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:39.070060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a53d9fb6-27e6-40c3-8ef1-7fb672e04f50 req-a88bb4c7-40d5-4921-ad82-2f9bad72be9a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:39.070565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a53d9fb6-27e6-40c3-8ef1-7fb672e04f50 req-a88bb4c7-40d5-4921-ad82-2f9bad72be9a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:39.071015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a53d9fb6-27e6-40c3-8ef1-7fb672e04f50 req-a88bb4c7-40d5-4921-ad82-2f9bad72be9a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:39.086423 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a53d9fb6-27e6-40c3-8ef1-7fb672e04f50 req-a88bb4c7-40d5-4921-ad82-2f9bad72be9a service nova] Creating event network-vif-deleted:6a587d4a-8c77-4e66-b99a-e101ad52f106 for instance 0a48286d-417c-4835-a65f-fce1967ba1ed on n-h1-862355-1 Oct 25 03:52:39.091520 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a53d9fb6-27e6-40c3-8ef1-7fb672e04f50 req-a88bb4c7-40d5-4921-ad82-2f9bad72be9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039544 Oct 25 03:52:39.092136 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3485/7089] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:39.544692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:39.545355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:39.553262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:39.553799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:39.554246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:39.554954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:39.555414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:39.555980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:39.587540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:39.588131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:39.588492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:39.589036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lazy-loading 'fault' on Instance uuid 0a48286d-417c-4835-a65f-fce1967ba1ed {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:52:39.646766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56042633204946af8a35548217248b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b19dcbc42647ac9dcf5b46f67f9461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:39.654408 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b35ec7e-1991-48ce-b47e-0b374bb5de9a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 200 len: 1311 microversion: 2.1 time: 0.113463 Oct 25 03:52:39.654964 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3605/7090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:39 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:40.679152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:40.679879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] [instance: 0a48286d-417c-4835-a65f-fce1967ba1ed] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:40.686450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:40.686954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:40.687411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:40.688125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:40.688601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:40.689049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:40.703329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] HTTP exception thrown: Instance 0a48286d-417c-4835-a65f-fce1967ba1ed could not be found. Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Request method failure captured: Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed HTTP/1.1 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV114I6YrNx4S711DNeTaRSXjxCNnEDEcO0zqdjmO7XguzSDQSmUlSEakXYUE9uzgGVWdqbBiazxgI3vu41YijSr7HGvXWgmIsvGtyoSIAUx1C1qJ68DpvukFyHHnstpTPHYPcUYR2B_d6bcvvqfXgq1tEyEtgOxKJyMkRNkgJ4qg6pc Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 24b19dcbc42647ac9dcf5b46f67f9461 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1925230371 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/24b19dcbc42647ac9dcf5b46f67f9461"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/24b19dcbc42647ac9dcf5b46f67f9461"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_24b19dcbc42647ac9dcf5b46f67f9461", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/24b19dcbc42647ac9dcf5b46f67f9461"}]}] Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1925230371 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 24b19dcbc42647ac9dcf5b46f67f9461 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1925230371 Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersAdminNegativeTestJSON-1925230371-project Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 56042633204946af8a35548217248b4f Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1925230371-project Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 0a48286d-417c-4835-a65f-fce1967ba1ed could not be found. Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0a48286d-417c-4835-a65f-fce1967ba1ed'} Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a48286d-417c-4835-a65f-fce1967ba1ed could not be found. Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a48286d-417c-4835-a65f-fce1967ba1ed could not be found. Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:40.705002 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a48286d-417c-4835-a65f-fce1967ba1ed could not be found. Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] Returning 404 to user: Instance 0a48286d-417c-4835-a65f-fce1967ba1ed could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1033e55-46fe-41e0-b367-dc2c01c2431a tempest-ServersAdminNegativeTestJSON-1925230371 tempest-ServersAdminNegativeTestJSON-1925230371-project] 10.222.0.36 "GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed" status: 404 len: 111 microversion: 2.1 time: 0.033709 Oct 25 03:52:40.709626 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3486/7091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:40 2022] GET /compute/v2.1/servers/0a48286d-417c-4835-a65f-fce1967ba1ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:52:46.759825 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 03:52:46.760321 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 03:52:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 25 03:52:46.762788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:46.763560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:46.908952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1201223270", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "81709051-a086-415e-9619-514c597f2c71"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:46.972080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] validate_networks() for [('81709051-a086-415e-9619-514c597f2c71', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:52:47.384746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:52:47.385181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:52:47.385660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:52:47.386207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:52:47.386625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:52:47.396254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:47.396736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:47.397203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:47.399425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:47.400168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:47.400769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:47.427268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Getting quotas for project 8cb1aa886fa841a88725f3ecfed8f543. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:52:47.433158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Getting quotas for user a05fcf81c8a34e21b87fa7c7d8571d50 and project 8cb1aa886fa841a88725f3ecfed8f543. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:52:47.446595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:52:47.448921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:52:47.497052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d18b4966-414f-465c-b9b7-ad2a755c5c57 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741857 Oct 25 03:52:47.498203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3606/7092] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:52:47.510119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-334390df-8dd1-413a-81f7-ae1bd0f8c81b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:47.510874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-334390df-8dd1-413a-81f7-ae1bd0f8c81b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:47.513985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:47.515085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:47.580359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-334390df-8dd1-413a-81f7-ae1bd0f8c81b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:47.589339 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-334390df-8dd1-413a-81f7-ae1bd0f8c81b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1215 microversion: 2.1 time: 0.083135 Oct 25 03:52:47.589956 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3487/7093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:47 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:48.614450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:48.615162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:48.633628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:48.634236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:48.634918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:48.635718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:48.636252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:48.636927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:48.721185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:48.730844 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7dbc7525-228a-4bb9-b504-dc053f7ece4a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1275 microversion: 2.1 time: 0.122154 Oct 25 03:52:48.731590 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3607/7094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:48 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:49.757002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:49.758384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:49.767256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:49.768972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:49.769703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:49.770775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:49.771260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:49.771771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:50.019689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:50.028275 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f8d2713-2e8b-4204-83f7-25348851a59f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1315 microversion: 2.1 time: 0.277179 Oct 25 03:52:50.029108 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3488/7095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:49 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:50.175252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-26b68ecc-159c-400a-abc2-bab502e928d3 req-2634881c-495c-463e-949c-5aa840faa3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8a9871-c581-4d2b-8526-e6c9505f7efb", "tag": "09b62c21-d198-4f2b-bd32-66ca923e9004"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:50.188077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26b68ecc-159c-400a-abc2-bab502e928d3 req-2634881c-495c-463e-949c-5aa840faa3b9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:50.188562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26b68ecc-159c-400a-abc2-bab502e928d3 req-2634881c-495c-463e-949c-5aa840faa3b9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:50.188992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-26b68ecc-159c-400a-abc2-bab502e928d3 req-2634881c-495c-463e-949c-5aa840faa3b9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:50.210243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-26b68ecc-159c-400a-abc2-bab502e928d3 req-2634881c-495c-463e-949c-5aa840faa3b9 service nova] Creating event network-changed:09b62c21-d198-4f2b-bd32-66ca923e9004 for instance dd8a9871-c581-4d2b-8526-e6c9505f7efb on n-h1-862355-1 Oct 25 03:52:50.215414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-26b68ecc-159c-400a-abc2-bab502e928d3 req-2634881c-495c-463e-949c-5aa840faa3b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043794 Oct 25 03:52:50.216272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3608/7096] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:51.053230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:51.053893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:51.061073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:51.062779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:51.063247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:51.064114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:51.064443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:51.065479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:51.199033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:51.208553 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0f3fe31e-1b4e-4155-870a-ac854dc87f5e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1315 microversion: 2.1 time: 0.159893 Oct 25 03:52:51.209180 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3489/7097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:51 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:52.235990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:52.237419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:52.243769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:52.244253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:52.244696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:52.245395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:52.245883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:52.246315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:52.384949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:52.392790 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d1f4542-7029-4a10-ae09-0e08b1b59071 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1315 microversion: 2.1 time: 0.161900 Oct 25 03:52:52.393894 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3609/7098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:52 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:53.417296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:53.417886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:53.425189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:53.425717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:53.426180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:53.426896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:53.427371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:53.427819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:53.565461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:53.573202 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35337cf5-b4b6-4878-be47-3d18aa6a7b7d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1315 microversion: 2.1 time: 0.160188 Oct 25 03:52:53.573819 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3490/7099] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:53 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:54.207378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d5db1ccf-1326-4bec-b75e-93e01bb24bc8 req-58502d76-9657-4392-ad6f-63770e22568b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8a9871-c581-4d2b-8526-e6c9505f7efb", "name": "network-vif-plugged", "status": "completed", "tag": "09b62c21-d198-4f2b-bd32-66ca923e9004"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:54.218525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d5db1ccf-1326-4bec-b75e-93e01bb24bc8 req-58502d76-9657-4392-ad6f-63770e22568b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:54.219011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d5db1ccf-1326-4bec-b75e-93e01bb24bc8 req-58502d76-9657-4392-ad6f-63770e22568b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:54.219444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d5db1ccf-1326-4bec-b75e-93e01bb24bc8 req-58502d76-9657-4392-ad6f-63770e22568b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:54.231258 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d5db1ccf-1326-4bec-b75e-93e01bb24bc8 req-58502d76-9657-4392-ad6f-63770e22568b service nova] Creating event network-vif-plugged:09b62c21-d198-4f2b-bd32-66ca923e9004 for instance dd8a9871-c581-4d2b-8526-e6c9505f7efb on n-h1-862355-1 Oct 25 03:52:54.236148 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d5db1ccf-1326-4bec-b75e-93e01bb24bc8 req-58502d76-9657-4392-ad6f-63770e22568b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033254 Oct 25 03:52:54.236787 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3610/7100] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:52:54.596615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:54.597174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:54.603842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:54.604336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:54.604793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:54.605502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:54.606003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:54.606449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:54.741320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:54.749172 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b1733e27-bf19-41cd-b6a3-9838ff9aec99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1315 microversion: 2.1 time: 0.156738 Oct 25 03:52:54.749983 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3491/7101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:54 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:55.775430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:55.776204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:55.778166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:55.784093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:55.784595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:55.785037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:55.785761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:55.786218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:55.786653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:55.789904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:55.922474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:55.930358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9870929-7818-493c-b638-8e0914d8d0ed tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1502 microversion: 2.1 time: 0.159995 Oct 25 03:52:55.930936 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3611/7102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:55 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:55.953473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:52:55.956419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:55.963258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:55.963756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:55.964209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:55.964918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:55.965425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:55.965899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:56.041351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:56.046804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Old instance type m1.heat2, new instance type m1.heat {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:52:56.053333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:52:56.053795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:52:56.054287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:52:56.054711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:52:56.055137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:52:56.123148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=82 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:56.170882 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-195dccc0-1ac6-4ad6-8680-51a0cb5d758b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "POST /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb/action" status: 202 len: 0 microversion: 2.1 time: 0.221147 Oct 25 03:52:56.171505 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3492/7103] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:52:55 2022] POST /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:52:56.179692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:56.180308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:56.186481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:56.186966 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:56.187402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:56.188092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:56.188550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:56.188975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:56.358417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:56.366817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f83117e4-5cfa-4305-8cc5-68c3180f37af tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1511 microversion: 2.1 time: 0.190930 Oct 25 03:52:56.367403 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3612/7104] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:56 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:57.405187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:57.405898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:57.409135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:57.414575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:57.415021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:57.415478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:57.416188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:57.416663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:57.417137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:57.548193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:57.556879 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fce65cb4-e390-4e28-b0e1-c0f611aa389f tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1511 microversion: 2.1 time: 0.155671 Oct 25 03:52:57.557463 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3493/7105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:57 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:58.580136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:58.581263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:58.584252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:58.584960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:58.591299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:58.591792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:58.592348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:58.593058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:58.593519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:58.593986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:58.730189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:58.739177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca472cda-48b8-4640-8ffb-7dc0a2b93d76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.162832 Oct 25 03:52:58.739701 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3613/7106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:58 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:52:59.763362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:52:59.764032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:52:59.766174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:52:59.772667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:59.773168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:59.773615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:59.774348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:52:59.774816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:52:59.775248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:52:59.989924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:52:59.997784 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d2893e8b-5a70-433e-8ac4-c7c68cf27788 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.238313 Oct 25 03:52:59.998590 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3494/7107] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:52:59 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:01.022768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:01.023389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:01.030300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:01.030791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:01.031226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:01.031920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:01.032381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:01.032808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:01.169241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:01.177556 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-816acd0e-f781-4e12-9242-856c6ef0e079 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.159268 Oct 25 03:53:01.178161 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3614/7108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:01 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:02.202148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:02.202777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:02.210084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:02.210573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:02.211017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:02.211712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:02.212174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:02.212614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:02.341045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:02.349304 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-70a35e44-959d-4f8f-954b-d45e109d7a3d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.151102 Oct 25 03:53:02.349908 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3495/7109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:02 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:03.372558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:03.373206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:03.381091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:03.381578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:03.382126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:03.382823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:03.383285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:03.383713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:03.516555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:03.524226 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e48d1ffa-3874-4299-9c6f-b80b13625a99 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.155821 Oct 25 03:53:03.524807 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3615/7110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:03 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:04.547985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:04.548614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:04.556280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:04.556778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:04.557229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:04.558218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:04.558691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:04.559129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:04.695853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:04.704772 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03bf581d-d42a-4cc4-84bd-3e9f36d4733e tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.160717 Oct 25 03:53:04.705371 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3496/7111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:04 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:05.728777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:05.729392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:05.736231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:05.736717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:05.737159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:05.738485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:05.738939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:05.739367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:05.866981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:05.874757 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b7ca01cc-1513-459f-8256-7b7516a6d549 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.149898 Oct 25 03:53:05.875338 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3616/7112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:05 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:06.898794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:06.899422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:06.906509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:06.907011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:06.907465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:06.908216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:06.908698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:06.909131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:07.043197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:07.051451 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5b6ca8f9-30ef-49b6-bee1-b61ca1fadcf7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.156500 Oct 25 03:53:07.052134 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3497/7113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:06 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:08.076011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:08.076636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:08.083536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:08.084027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:08.084471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:08.085171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:08.085663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:08.086125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:08.219666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:08.228654 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cc40e50-1f98-417f-b79e-1b92c9d8f0da tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.156542 Oct 25 03:53:08.229232 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3617/7114] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:08 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:09.252103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:09.252773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:09.260420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:09.260917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:09.261367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:09.262100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:09.262571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:09.263016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:09.404923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:09.413562 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1942bf07-d9a7-4aa6-9196-8d4be0cbd2c0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.165393 Oct 25 03:53:09.414177 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3498/7115] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:09 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:10.438709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:10.439246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:10.446526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:10.447008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:10.447446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:10.448140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:10.448600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:10.449029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:10.579742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:10.587599 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-29b66127-c387-4aba-b59b-3e3a31e80492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.153198 Oct 25 03:53:10.588193 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3618/7116] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:10 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:11.610158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:11.610705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:11.618379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:11.618876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:11.619327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:11.620038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:11.620500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:11.620944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:11.749306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:11.757094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8cf5e51-d49d-45f4-8d7d-ab9a1f96cd04 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.150984 Oct 25 03:53:11.757691 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3499/7117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:11 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:12.780499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:12.781115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:12.788651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:12.789136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:12.789603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:12.790390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:12.790847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:12.792041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:12.926389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:12.934276 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7229dc36-6613-4be5-ac2e-bb1c8b46a106 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.157701 Oct 25 03:53:12.934856 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3619/7118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:12 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:13.957936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:13.958474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:13.965340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:13.965865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:13.966316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:13.967016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:13.967506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:13.967940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:14.098759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:14.106498 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9dc93320-0c22-4418-b8bb-1615dba6f693 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.153158 Oct 25 03:53:14.107086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3500/7119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:13 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:15.131613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:15.132169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:15.139091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:15.139576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:15.140011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:15.140697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:15.141153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:15.141578 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:15.280433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:15.289026 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c9523a6-ef84-4946-b1c3-20f31678977c tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.162499 Oct 25 03:53:15.289609 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3620/7120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:15 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:16.312982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:16.313562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:16.320726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:16.321230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:16.321700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:16.322415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:16.322890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:16.323337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:16.458005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:16.465788 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d15daecb-14ae-42d9-8dd8-a3fc0aa68492 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.156751 Oct 25 03:53:16.466371 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3501/7121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:16 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:17.489542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:17.490237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:17.497140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:17.497618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:17.498083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:17.498770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:17.499223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:17.499645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:17.631589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:17.639237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-888ddfce-b056-401a-a2c5-132ba79bb24a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.154208 Oct 25 03:53:17.639811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3621/7122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:17 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:18.662513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:18.663135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:18.670198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:18.670701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:18.671154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:18.671861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:18.672331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:18.672771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:18.801825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:18.810024 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5339abe1-1f1d-4d9e-885b-fab33b528724 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.152341 Oct 25 03:53:18.810647 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3502/7123] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:18 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:19.833687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:19.834323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:19.841043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:19.841522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:19.841983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:19.842665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:19.843119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:19.843541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:19.975796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:19.985624 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9fd6e74-1920-4544-b7f0-bf0c264ae2d0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.155936 Oct 25 03:53:19.986262 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3622/7124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:19 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:21.010204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:21.010828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:21.017914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:21.018409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:21.018859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:21.019585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:21.020089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:21.020531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:21.153247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:21.161569 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c1b2c0a3-3f51-4bf0-af32-8ccd5efeed47 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.154724 Oct 25 03:53:21.162318 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3503/7125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:21 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:22.184499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:22.185157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:22.192252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:22.192737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:22.193179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:22.193907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:22.194365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:22.194794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:22.324745 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:22.332952 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8eae8a35-ded3-4917-8cc1-05968e925c0b tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.152160 Oct 25 03:53:22.333538 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3623/7126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:22 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:23.357193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:23.357859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:23.365059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:23.365551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:23.366025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:23.366730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:23.367197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:23.367634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:23.498882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:23.506948 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-11656e1d-9bb7-4c56-b046-b0909d04d4d5 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.153688 Oct 25 03:53:23.507534 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3504/7127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:23 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:24.530203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:24.530816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:24.538215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:24.538696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:24.539133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:24.539841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:24.540296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:24.540720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:24.673855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:24.682234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d26cb339-d2c8-4c3c-a81e-a3ec7539267d tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1516 microversion: 2.1 time: 0.155902 Oct 25 03:53:24.683352 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3624/7128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:24 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:25.708589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:25.709241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:25.716117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:25.716613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:25.717065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:25.717804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:25.718271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:25.718705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:25.859136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:25.867156 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-078cd195-43b5-488e-89b4-ac497b34f7a6 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1515 microversion: 2.1 time: 0.164306 Oct 25 03:53:25.867745 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3505/7129] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:25 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:25.903203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-7d510334-d6db-4499-bdd1-84b7c56ab07a req-8c955716-b9b5-4d04-8a9c-6dec5db2d4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8a9871-c581-4d2b-8526-e6c9505f7efb", "name": "network-vif-unplugged", "status": "completed", "tag": "09b62c21-d198-4f2b-bd32-66ca923e9004"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:25.909009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=28 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:25.915868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7d510334-d6db-4499-bdd1-84b7c56ab07a req-8c955716-b9b5-4d04-8a9c-6dec5db2d4fd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:25.916349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7d510334-d6db-4499-bdd1-84b7c56ab07a req-8c955716-b9b5-4d04-8a9c-6dec5db2d4fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:25.916776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-7d510334-d6db-4499-bdd1-84b7c56ab07a req-8c955716-b9b5-4d04-8a9c-6dec5db2d4fd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:25.921032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=84 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:25.931113 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-7d510334-d6db-4499-bdd1-84b7c56ab07a req-8c955716-b9b5-4d04-8a9c-6dec5db2d4fd service nova] Creating event network-vif-unplugged:09b62c21-d198-4f2b-bd32-66ca923e9004 for instance dd8a9871-c581-4d2b-8526-e6c9505f7efb on n-h2-862355-1 Oct 25 03:53:25.936984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-7d510334-d6db-4499-bdd1-84b7c56ab07a req-8c955716-b9b5-4d04-8a9c-6dec5db2d4fd service nova] Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:53:25.948246 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-7d510334-d6db-4499-bdd1-84b7c56ab07a req-8c955716-b9b5-4d04-8a9c-6dec5db2d4fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048699 Oct 25 03:53:25.948867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3625/7130] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:53:26.892737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:26.893390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:26.901092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:26.901589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:26.902079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:26.902778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:26.903242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:26.903679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:26.906196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:27.037266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:27.045048 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17bd12a5-3a15-4379-8743-766ddfeb5a76 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1513 microversion: 2.1 time: 0.156916 Oct 25 03:53:27.045635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3506/7131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:26 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:27.966013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-652f852b-6338-44b6-80a8-e782b8bb62ac req-68212d87-7b05-442c-a19f-c9d55a2ff3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8a9871-c581-4d2b-8526-e6c9505f7efb", "tag": "09b62c21-d198-4f2b-bd32-66ca923e9004"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:27.976046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-652f852b-6338-44b6-80a8-e782b8bb62ac req-68212d87-7b05-442c-a19f-c9d55a2ff3f7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:27.976525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-652f852b-6338-44b6-80a8-e782b8bb62ac req-68212d87-7b05-442c-a19f-c9d55a2ff3f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:27.976958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-652f852b-6338-44b6-80a8-e782b8bb62ac req-68212d87-7b05-442c-a19f-c9d55a2ff3f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:27.988137 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-652f852b-6338-44b6-80a8-e782b8bb62ac req-68212d87-7b05-442c-a19f-c9d55a2ff3f7 service nova] Creating event network-changed:09b62c21-d198-4f2b-bd32-66ca923e9004 for instance dd8a9871-c581-4d2b-8526-e6c9505f7efb on n-h2-862355-1 Oct 25 03:53:27.994058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-652f852b-6338-44b6-80a8-e782b8bb62ac req-68212d87-7b05-442c-a19f-c9d55a2ff3f7 service nova] Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:53:28.004832 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-652f852b-6338-44b6-80a8-e782b8bb62ac req-68212d87-7b05-442c-a19f-c9d55a2ff3f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043774 Oct 25 03:53:28.005434 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3626/7132] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:53:28.069077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:28.069764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:28.072224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=28 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:28.077624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:28.078146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:28.078598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:28.079309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:28.079809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:28.080249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:28.621760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:28.630526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17ac3982-56c4-4050-810d-b52012a75ae7 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1513 microversion: 2.1 time: 0.566000 Oct 25 03:53:28.631122 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3507/7133] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:28 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1513 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:29.656930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:29.657960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:29.665464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:29.666000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:29.666437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:29.667145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:29.667601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:29.668024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:29.884376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:29.892827 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b80f759d-0634-4dd5-87bc-b678014775a8 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1513 microversion: 2.1 time: 0.242445 Oct 25 03:53:29.905921 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3627/7134] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:29 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:30.917032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:30.917637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:30.924566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:30.925060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:30.925502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:30.926223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:30.926689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:30.927124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:31.063833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:31.072393 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c506a185-0f18-4ee1-be30-5cbba36b6470 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1510 microversion: 2.1 time: 0.159208 Oct 25 03:53:31.072985 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3508/7135] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:30 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:31.095449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:31.095983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:31.103753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:31.104228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:31.104659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:31.105343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:31.105819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:31.106240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:31.135986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:53:31.186184 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.compute.api [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Found an unconfirmed migration during delete, id: 16, status: finished Oct 25 03:53:32.423757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c7df01d0-ae77-40ba-ac9b-a5ae6d5cba60 req-cc9c3fed-85df-410b-ad70-0cf556e6cca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8a9871-c581-4d2b-8526-e6c9505f7efb", "name": "network-vif-plugged", "status": "completed", "tag": "09b62c21-d198-4f2b-bd32-66ca923e9004"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:32.438057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c7df01d0-ae77-40ba-ac9b-a5ae6d5cba60 req-cc9c3fed-85df-410b-ad70-0cf556e6cca2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:32.438457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c7df01d0-ae77-40ba-ac9b-a5ae6d5cba60 req-cc9c3fed-85df-410b-ad70-0cf556e6cca2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:32.438909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c7df01d0-ae77-40ba-ac9b-a5ae6d5cba60 req-cc9c3fed-85df-410b-ad70-0cf556e6cca2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:32.450900 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c7df01d0-ae77-40ba-ac9b-a5ae6d5cba60 req-cc9c3fed-85df-410b-ad70-0cf556e6cca2 service nova] Creating event network-vif-plugged:09b62c21-d198-4f2b-bd32-66ca923e9004 for instance dd8a9871-c581-4d2b-8526-e6c9505f7efb on n-h2-862355-1 Oct 25 03:53:32.456052 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c7df01d0-ae77-40ba-ac9b-a5ae6d5cba60 req-cc9c3fed-85df-410b-ad70-0cf556e6cca2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110023 Oct 25 03:53:32.456697 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3509/7136] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:53:32.726485 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-48e3eda8-9e61-45e9-8098-110e0a0cd609 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 204 len: 0 microversion: 2.1 time: 1.634511 Oct 25 03:53:32.727188 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3628/7137] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:53:31 2022] DELETE /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 0 bytes in 1636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:53:32.736155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:32.736877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:32.743901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:32.744406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:32.744858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:32.745565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:32.746071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:32.746514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:32.880381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:32.888806 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-112ec950-a598-4fa8-a089-2f63f60f90fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1502 microversion: 2.1 time: 0.156881 Oct 25 03:53:32.889428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3510/7138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:32 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:33.913510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:33.914271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:33.921204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:33.921716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:33.922166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:33.922869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:33.923325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:33.923754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:34.066081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fcf81c8a34e21b87fa7c7d8571d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb1aa886fa841a88725f3ecfed8f543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:34.075046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d34475ee-0ac3-4f5c-a3a4-3699e5f05354 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 200 len: 1502 microversion: 2.1 time: 0.166662 Oct 25 03:53:34.075642 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3629/7139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:33 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:34.540407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-29a0ac4c-6cc4-4a36-a712-12d1d287b74b req-4e6fae37-580f-428d-bfef-903431422dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8a9871-c581-4d2b-8526-e6c9505f7efb", "name": "network-vif-deleted", "tag": "09b62c21-d198-4f2b-bd32-66ca923e9004"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:34.552949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-29a0ac4c-6cc4-4a36-a712-12d1d287b74b req-4e6fae37-580f-428d-bfef-903431422dd8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:34.553597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-29a0ac4c-6cc4-4a36-a712-12d1d287b74b req-4e6fae37-580f-428d-bfef-903431422dd8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:34.554087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-29a0ac4c-6cc4-4a36-a712-12d1d287b74b req-4e6fae37-580f-428d-bfef-903431422dd8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:34.569466 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-29a0ac4c-6cc4-4a36-a712-12d1d287b74b req-4e6fae37-580f-428d-bfef-903431422dd8 service nova] Creating event network-vif-deleted:09b62c21-d198-4f2b-bd32-66ca923e9004 for instance dd8a9871-c581-4d2b-8526-e6c9505f7efb on n-h2-862355-1 Oct 25 03:53:34.574671 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-29a0ac4c-6cc4-4a36-a712-12d1d287b74b req-4e6fae37-580f-428d-bfef-903431422dd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039164 Oct 25 03:53:34.575484 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3511/7140] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:53:35.099548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:35.100176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:35.106969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:35.107459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:35.107907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:35.108597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:35.109059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:35.109496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:35.122783 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] HTTP exception thrown: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Request method failure captured: Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb HTTP/1.1 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV12OlHHs32kRfHb-Ck3nFtnN4XzDBf579pg3FRiU3lpxaIgDwenO0XbbImY2OB_dN5W2QtvHmnkx27gfeQ7vrD4qA-Qw2uQXY_HUdOU8mWvOL2WnWVEoWHv8aGxoF17VV2d6RrIzKGacnNV6UOXPv3htulO8WU_Vbj3hwQaWHDNfAJU Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8cb1aa886fa841a88725f3ecfed8f543 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cb1aa886fa841a88725f3ecfed8f543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cb1aa886fa841a88725f3ecfed8f543"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cb1aa886fa841a88725f3ecfed8f543", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cb1aa886fa841a88725f3ecfed8f543"}]}] Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8cb1aa886fa841a88725f3ecfed8f543 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1045877191-project Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: a05fcf81c8a34e21b87fa7c7d8571d50 Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1045877191-project Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'dd8a9871-c581-4d2b-8526-e6c9505f7efb'} Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:53:35.124418 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Returning 404 to user: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2a2fa75c-e37a-4ba5-8fd1-99c157fae2fa tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 404 len: 111 microversion: 2.1 time: 0.031021 Oct 25 03:53:35.129926 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3630/7141] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:35 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:53:35.141896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:35.142547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:35.149257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:35.149814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:35.150276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:35.150980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:35.151448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:35.151890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:35.165631 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] HTTP exception thrown: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Request method failure captured: Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb HTTP/1.1 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV12OlHHs32kRfHb-Ck3nFtnN4XzDBf579pg3FRiU3lpxaIgDwenO0XbbImY2OB_dN5W2QtvHmnkx27gfeQ7vrD4qA-Qw2uQXY_HUdOU8mWvOL2WnWVEoWHv8aGxoF17VV2d6RrIzKGacnNV6UOXPv3htulO8WU_Vbj3hwQaWHDNfAJU Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8cb1aa886fa841a88725f3ecfed8f543 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cb1aa886fa841a88725f3ecfed8f543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cb1aa886fa841a88725f3ecfed8f543"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cb1aa886fa841a88725f3ecfed8f543", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cb1aa886fa841a88725f3ecfed8f543"}]}] Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8cb1aa886fa841a88725f3ecfed8f543 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-DeleteServersTestJSON-1045877191-project Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: a05fcf81c8a34e21b87fa7c7d8571d50 Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-DeleteServersTestJSON-1045877191-project Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'dd8a9871-c581-4d2b-8526-e6c9505f7efb'} Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:53:35.167333 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Returning 404 to user: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4df2c9f1-237f-4441-bd27-f9d594c6fcc0 tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 404 len: 111 microversion: 2.1 time: 0.031228 Oct 25 03:53:35.171013 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3512/7142] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:53:35 2022] DELETE /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:53:35.178730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:35.179513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] [instance: dd8a9871-c581-4d2b-8526-e6c9505f7efb] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:35.186059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:35.186545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:35.186985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:35.187676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:35.188136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:35.188566 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:35.202309 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] HTTP exception thrown: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Request method failure captured: Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb HTTP/1.1 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV12OlHHs32kRfHb-Ck3nFtnN4XzDBf579pg3FRiU3lpxaIgDwenO0XbbImY2OB_dN5W2QtvHmnkx27gfeQ7vrD4qA-Qw2uQXY_HUdOU8mWvOL2WnWVEoWHv8aGxoF17VV2d6RrIzKGacnNV6UOXPv3htulO8WU_Vbj3hwQaWHDNfAJU Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8cb1aa886fa841a88725f3ecfed8f543 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cb1aa886fa841a88725f3ecfed8f543"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8cb1aa886fa841a88725f3ecfed8f543"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8cb1aa886fa841a88725f3ecfed8f543", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8cb1aa886fa841a88725f3ecfed8f543"}]}] Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8cb1aa886fa841a88725f3ecfed8f543 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1045877191 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-DeleteServersTestJSON-1045877191-project Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: a05fcf81c8a34e21b87fa7c7d8571d50 Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-DeleteServersTestJSON-1045877191-project Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'dd8a9871-c581-4d2b-8526-e6c9505f7efb'} Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:53:35.203817 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] Returning 404 to user: Instance dd8a9871-c581-4d2b-8526-e6c9505f7efb could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-38033d81-af45-4546-8034-b60b2fae421a tempest-DeleteServersTestJSON-1045877191 tempest-DeleteServersTestJSON-1045877191-project] 10.222.0.36 "GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb" status: 404 len: 111 microversion: 2.1 time: 0.031640 Oct 25 03:53:35.208904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3631/7143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:35 2022] GET /compute/v2.1/servers/dd8a9871-c581-4d2b-8526-e6c9505f7efb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:53:43.680640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-699171854", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "cbcde37f-ecb1-4328-97a6-883e1abe2657"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:43.743604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] validate_networks() for [('cbcde37f-ecb1-4328-97a6-883e1abe2657', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:53:44.127017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:53:44.127456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:53:44.127945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:53:44.128427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:53:44.128802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:53:44.138422 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:44.138920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:44.139373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:44.140114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:44.140584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:44.141024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:44.157869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Getting quotas for project fd5e1c2a2d6d435e9f742aa4c85c9fab. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:53:44.163480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Getting quotas for user d9454c9032694667a169c0f908887d85 and project fd5e1c2a2d6d435e9f742aa4c85c9fab. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:53:44.176356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:53:44.178951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:53:44.226966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-50ca3072-8053-4364-9c3f-ec8638c857fd tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674717 Oct 25 03:53:44.227790 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3513/7144] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:53:44.240957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6845cabe-abdc-4b61-aa84-b4189f803f5b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:44.241713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6845cabe-abdc-4b61-aa84-b4189f803f5b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:44.300046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6845cabe-abdc-4b61-aa84-b4189f803f5b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:44.308431 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6845cabe-abdc-4b61-aa84-b4189f803f5b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1217 microversion: 2.1 time: 0.072803 Oct 25 03:53:44.309045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3632/7145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:44 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:53:45.334702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:45.335930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:45.345836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:45.346407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:45.346930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:45.348362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:45.349016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:45.349468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:45.436294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:45.444840 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ff51ace2-0343-4c3b-a849-f803a1fe38ce tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1287 microversion: 2.1 time: 0.116152 Oct 25 03:53:45.445767 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3514/7146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:45 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:46.470368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:46.470991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:46.474561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:46.482256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:46.482760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:46.483202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:46.483917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:46.484406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:46.484843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:46.686896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:46.697611 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8052c7ec-d9ce-4fc4-9fc9-d0679997bfc2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1317 microversion: 2.1 time: 0.231393 Oct 25 03:53:46.698598 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3633/7147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:46 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:46.773914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7a43d3ed-b449-4f17-a5cc-3f0c95c0a3c8 req-bd23cda6-1e71-423f-b572-2eabba3298c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a14530-8157-4348-b41c-95d7fc627da7", "tag": "9f9e346c-1f4b-482e-9391-a46502e07f73"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:46.786320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a43d3ed-b449-4f17-a5cc-3f0c95c0a3c8 req-bd23cda6-1e71-423f-b572-2eabba3298c2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:46.787012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a43d3ed-b449-4f17-a5cc-3f0c95c0a3c8 req-bd23cda6-1e71-423f-b572-2eabba3298c2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:46.787602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7a43d3ed-b449-4f17-a5cc-3f0c95c0a3c8 req-bd23cda6-1e71-423f-b572-2eabba3298c2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:46.803221 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7a43d3ed-b449-4f17-a5cc-3f0c95c0a3c8 req-bd23cda6-1e71-423f-b572-2eabba3298c2 service nova] Creating event network-changed:9f9e346c-1f4b-482e-9391-a46502e07f73 for instance e9a14530-8157-4348-b41c-95d7fc627da7 on n-h2-862355-1 Oct 25 03:53:46.810563 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7a43d3ed-b449-4f17-a5cc-3f0c95c0a3c8 req-bd23cda6-1e71-423f-b572-2eabba3298c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040710 Oct 25 03:53:46.812348 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3515/7148] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:53:47.720561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:47.721183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:47.729100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:47.729589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:47.730059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:47.730751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:47.731210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:47.731639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:47.865226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:47.873161 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d0d095b-5308-4a86-b231-50cfb0dfbe1f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1317 microversion: 2.1 time: 0.156504 Oct 25 03:53:47.873759 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3634/7149] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:47 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:48.897967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:48.898566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:48.905211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:48.905741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:48.906192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:48.906906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:48.907443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:48.907798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:49.049060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:49.057859 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-912a57ea-2154-4add-8602-f5af0762592c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1317 microversion: 2.1 time: 0.164955 Oct 25 03:53:49.058734 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3516/7150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:48 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:50.080478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:50.081105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:50.088501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:50.088995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:50.089440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:50.090177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:50.090640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:50.091074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:50.226361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:50.235022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ff73d03b-cc76-4a11-a19c-6d4a8e41fc4c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1317 microversion: 2.1 time: 0.158552 Oct 25 03:53:50.235616 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3635/7151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:50 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:51.257927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:51.258553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:51.265602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:51.266127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:51.266572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:51.267269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:51.267733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:51.268164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:51.395457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:51.403170 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-faa54f1b-7198-4e28-b40d-7a9e78a4b0ec tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1317 microversion: 2.1 time: 0.149182 Oct 25 03:53:51.403756 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3517/7152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:51 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:52.427663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:52.428391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:52.435427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:52.435907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:52.436590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:52.437295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:52.437777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:52.438206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:52.476636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-40336e9a-feea-457f-a733-648bef49d6f9 req-db0f7eab-135b-428f-803a-e5f6ed006dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a14530-8157-4348-b41c-95d7fc627da7", "name": "network-vif-plugged", "status": "completed", "tag": "9f9e346c-1f4b-482e-9391-a46502e07f73"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:52.487076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-40336e9a-feea-457f-a733-648bef49d6f9 req-db0f7eab-135b-428f-803a-e5f6ed006dcc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:52.487692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-40336e9a-feea-457f-a733-648bef49d6f9 req-db0f7eab-135b-428f-803a-e5f6ed006dcc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:52.488786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-40336e9a-feea-457f-a733-648bef49d6f9 req-db0f7eab-135b-428f-803a-e5f6ed006dcc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:52.502011 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-40336e9a-feea-457f-a733-648bef49d6f9 req-db0f7eab-135b-428f-803a-e5f6ed006dcc service nova] Creating event network-vif-plugged:9f9e346c-1f4b-482e-9391-a46502e07f73 for instance e9a14530-8157-4348-b41c-95d7fc627da7 on n-h2-862355-1 Oct 25 03:53:52.508588 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-40336e9a-feea-457f-a733-648bef49d6f9 req-db0f7eab-135b-428f-803a-e5f6ed006dcc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036019 Oct 25 03:53:52.509255 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3518/7153] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:53:52.594136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:52.602818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d828cbc-8f1d-49ae-8a11-03960e999e8f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1317 microversion: 2.1 time: 0.179939 Oct 25 03:53:52.603412 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3636/7154] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:52 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:53.628037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:53.628894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:53.635840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:53.636336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:53.636790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:53.637499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:53.637992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:53.638432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:53.773764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:53.781429 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-92c97806-2734-401a-87e9-e413af9d4a04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1317 microversion: 2.1 time: 0.157900 Oct 25 03:53:53.782069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3519/7155] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:53 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:54.805863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:54.806481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:54.809470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:54.814871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:54.815359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:54.815801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:54.817105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:54.817570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:54.818024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:54.950609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:54.959627 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-83393a50-4d3a-49fb-9948-d86d4453660c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1507 microversion: 2.1 time: 0.158724 Oct 25 03:53:54.960217 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3637/7156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:54 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:54.983487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:54.984108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:54.986095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:54.986773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:54.994478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:54.994972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:54.995421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:54.996132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:54.996593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:54.997028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.126288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:55.134524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a8d66cef-8101-4962-bac6-2336aa44e8f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1507 microversion: 2.1 time: 0.155035 Oct 25 03:53:55.135109 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3520/7157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:54 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:55.156698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:55.159106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:55.165534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.166055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.166496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.167245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.167701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.168139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.231646 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1cd8d45d-3d8d-4ecb-838a-e4f637668e22 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "PUT /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1079 microversion: 2.1 time: 0.078877 Oct 25 03:53:55.238821 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3638/7158] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Oct 25 03:53:55 2022] PUT /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1079 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:55.251903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:55.252540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:55.258760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.259265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.259722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.260432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.260907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.261355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.393482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:55.401946 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa3df809-a4a3-48c8-9ef8-7e939845a640 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1505 microversion: 2.1 time: 0.153904 Oct 25 03:53:55.402565 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3521/7159] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:55 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:55.424337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:55.424892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:55.431124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.431619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.432068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.432774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.433235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.433964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.561891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:55.569867 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-971627b6-5240-4d14-b710-7c54a2c2c354 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1505 microversion: 2.1 time: 0.149457 Oct 25 03:53:55.570446 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3639/7160] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:55 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:55.592247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:53:55.594532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:55.601196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.601721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.602173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.602874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.603357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.603780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.632143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:55.637630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Old instance type m1.heat2, new instance type m1.heat {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:53:55.644127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:53:55.645107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:53:55.645595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:53:55.646045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:53:55.646470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:53:55.709436 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d353a1e-ab38-4212-8028-71463e7d1622 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "POST /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7/action" status: 202 len: 0 microversion: 2.1 time: 0.120937 Oct 25 03:53:55.710219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3522/7161] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:53:55 2022] POST /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:53:55.723529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:55.724650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:55.735895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.737215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.738403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.739636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:55.740471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:55.741353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:55.902045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:55.909898 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c1395596-243c-420e-90d7-18c8c61f81d0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1516 microversion: 2.1 time: 0.194798 Oct 25 03:53:55.910500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3640/7162] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:55 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:56.934510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:56.935170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:56.942842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:56.943334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:56.943786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:56.944489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:56.944956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:56.945395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:56.948320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:57.076826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:57.085358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-194555cb-6e93-471e-a16d-9f39e0218ed5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1516 microversion: 2.1 time: 0.155937 Oct 25 03:53:57.086061 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3523/7163] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:56 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:58.109453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:58.110134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:58.112796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:58.119124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:58.119617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:58.120061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:58.120767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:58.121229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:58.121666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:58.252167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:58.260640 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a218cc17-1b39-4104-82a9-5339637eab48 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.155877 Oct 25 03:53:58.261225 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3641/7164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:58 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:53:59.284559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:53:59.286401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:53:59.288527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:53:59.294607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:59.295112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:59.295574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:59.296359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:53:59.296836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:53:59.297285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:53:59.437832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:53:59.446542 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17aa079d-d4e3-47a3-b516-f93fb1d1cbd8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.165837 Oct 25 03:53:59.447261 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3524/7165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:53:59 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:00.471029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:00.471639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:00.479471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:00.479960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:00.480396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:00.481077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:00.481532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:00.481982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:00.626666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:00.634797 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cfa85b50-4a16-45fd-b082-ef4e61dc400b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.167734 Oct 25 03:54:00.635371 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3642/7166] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:00 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:01.660119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:01.660746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:01.667756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:01.668286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:01.668739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:01.669442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:01.669943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:01.670382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:01.802220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:01.810753 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-58f0ea76-b68b-42d4-bc91-41234c7e4c08 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.154889 Oct 25 03:54:01.811369 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3525/7167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:01 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:02.835206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:02.835763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:02.842445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:02.842925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:02.843361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:02.844046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:02.844498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:02.844922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:02.980083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:02.988749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33587ab0-4523-45d7-ada6-f3042f7d88c1 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.158032 Oct 25 03:54:02.989493 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3643/7168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:02 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:04.012880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:04.013257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:04.020948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:04.021509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:04.022294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:04.023388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:04.023757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:04.024251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:04.158741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:04.166790 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca5ba8f7-4fac-4ec3-aaff-5fbb83b0b403 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.158233 Oct 25 03:54:04.167362 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3526/7169] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:04 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:05.190733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:05.191451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:05.198418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:05.198905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:05.199344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:05.200035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:05.200492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:05.200921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:05.330361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:05.338727 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-48382cad-441a-4b37-a5ef-e067dc932a62 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.151953 Oct 25 03:54:05.339304 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3644/7170] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:05 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:06.363286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:06.364181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:06.371861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:06.372355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:06.372813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:06.373512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:06.373999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:06.374432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:06.829443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:06.837965 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-30c11e2d-2d94-4c31-a535-3c22e74173ee tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.479178 Oct 25 03:54:06.838562 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3527/7171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:06 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:07.861910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:07.862538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:07.870345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:07.870837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:07.871386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:07.871967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:07.872430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:07.872857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:08.014441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:08.023304 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8f757c18-236e-4604-a23c-aefd3ccee5b6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.165317 Oct 25 03:54:08.023876 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3645/7172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:07 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:09.047159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:09.047768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:09.055247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:09.055736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:09.056184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:09.056886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:09.057348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:09.057818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:09.185095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:09.193457 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46aa71fc-781d-46bd-94e5-ae937be38b75 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.150256 Oct 25 03:54:09.194073 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3528/7173] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:09 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:10.217263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:10.217911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:10.224600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:10.225080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:10.225517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:10.226241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:10.226696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:10.227128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:10.360964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:10.368985 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-00ce5be6-1349-4507-9a72-0c8dc66b75d6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.155803 Oct 25 03:54:10.369569 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3646/7174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:10 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:11.392648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:11.393371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:11.400914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:11.401425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:11.401909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:11.402625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:11.403176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:11.403576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:11.536999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:11.544856 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2c3a7d72-b1f9-4a22-9593-ed6eb13d7568 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.156157 Oct 25 03:54:11.545437 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3529/7175] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:11 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:12.570434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:12.571054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:12.577866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:12.578348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:12.578784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:12.579476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:12.579930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:12.580358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:12.712168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:12.719915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e42fdf16-7643-45c6-90fe-76a535d4e7db tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.154742 Oct 25 03:54:12.720491 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3647/7176] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:12 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:13.744761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:13.745431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:13.752335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:13.752839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:13.753295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:13.754033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:13.755449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:13.755911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:13.883998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:13.891715 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eee97991-e04c-47b0-b33c-f66b05e48814 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.151539 Oct 25 03:54:13.892299 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3530/7177] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:13 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:14.915553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:14.916207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:14.923010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:14.923496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:14.923934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:14.924630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:14.925089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:14.925519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:15.064291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:15.068288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:15.073516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a418b4c-034c-4b46-aeda-9aff3feed8a4 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.162149 Oct 25 03:54:15.074131 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3648/7178] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:14 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:16.097295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:16.097974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:16.105972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:16.106463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:16.106937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:16.107696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:16.108163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:16.108597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:16.243437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:16.251180 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-daa76a4c-9873-4ec6-8961-02927145daf8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.157765 Oct 25 03:54:16.251759 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3531/7179] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:16 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:17.274433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:17.275059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:17.283203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:17.283688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:17.284125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:17.284820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:17.285278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:17.285779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:17.416158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:17.423896 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-78ed2233-8bff-4fbe-978d-d966845677a3 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.154136 Oct 25 03:54:17.424471 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3649/7180] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:17 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:18.448378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:18.449001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:18.456045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:18.456536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:18.456984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:18.457786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:18.458316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:18.458805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:18.590221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:18.598856 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52b9cc91-fd34-44a4-95d5-91b99400afb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.153892 Oct 25 03:54:18.599635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3532/7181] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:18 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:19.622940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:19.623603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:19.631094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:19.631583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:19.632023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:19.632721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:19.633180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:19.633617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:19.766468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:19.774936 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1c218958-c594-468e-9ce1-a0851d9d8078 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.155966 Oct 25 03:54:19.775515 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3650/7182] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:19 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:20.798697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:20.799323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:20.806753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:20.807251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:20.807702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:20.808444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:20.809163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:20.809600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:20.945875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:20.953577 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5333d2ab-7f7b-4002-ac10-cbdd3b9571b5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.158853 Oct 25 03:54:20.954186 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3533/7183] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:20 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:21.977240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:21.977879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:21.984699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:21.985177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:21.985609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:21.986320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:21.986771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:21.987205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:22.118279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:22.125984 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a79eac4b-d4b2-4ca6-88dd-e7776b0e5cbc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.153485 Oct 25 03:54:22.126561 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3651/7184] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:21 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:23.149510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:23.150194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:23.156699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:23.157135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:23.157587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:23.158316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:23.158787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:23.159228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:23.287876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:23.295558 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3b0edcd9-e818-4e15-adda-23de9f85ccf7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.150325 Oct 25 03:54:23.296164 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3534/7185] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:23 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:24.320207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:24.320755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:24.327657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:24.328173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:24.328643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:24.329359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:24.329837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:24.330273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:24.460304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:24.468123 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-765379a6-8034-416a-ac71-8b790a2adf64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1521 microversion: 2.1 time: 0.152676 Oct 25 03:54:24.468708 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3652/7186] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:24 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:25.491695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:25.492462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:25.499775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:25.500286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:25.500795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:25.501605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:25.502186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:25.502640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:25.749810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:25.758733 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2d9a953-0a30-49cf-bb43-302bcdb4058a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1520 microversion: 2.1 time: 0.270897 Oct 25 03:54:25.759332 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3535/7187] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:25 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:25.996012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-acf6061a-b6f7-4a06-9cda-8156539400e8 req-dd535d76-6d46-47a9-bc7e-084a534d033a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a14530-8157-4348-b41c-95d7fc627da7", "name": "network-vif-unplugged", "status": "completed", "tag": "9f9e346c-1f4b-482e-9391-a46502e07f73"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:26.007411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-acf6061a-b6f7-4a06-9cda-8156539400e8 req-dd535d76-6d46-47a9-bc7e-084a534d033a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:26.007908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-acf6061a-b6f7-4a06-9cda-8156539400e8 req-dd535d76-6d46-47a9-bc7e-084a534d033a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:26.008344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-acf6061a-b6f7-4a06-9cda-8156539400e8 req-dd535d76-6d46-47a9-bc7e-084a534d033a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:26.024175 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-acf6061a-b6f7-4a06-9cda-8156539400e8 req-dd535d76-6d46-47a9-bc7e-084a534d033a service nova] Creating event network-vif-unplugged:9f9e346c-1f4b-482e-9391-a46502e07f73 for instance e9a14530-8157-4348-b41c-95d7fc627da7 on n-h1-862355-1 Oct 25 03:54:26.030625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-acf6061a-b6f7-4a06-9cda-8156539400e8 req-dd535d76-6d46-47a9-bc7e-084a534d033a service nova] Instance e9a14530-8157-4348-b41c-95d7fc627da7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:54:26.042106 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-acf6061a-b6f7-4a06-9cda-8156539400e8 req-dd535d76-6d46-47a9-bc7e-084a534d033a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121180 Oct 25 03:54:26.042742 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3653/7188] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:54:26.783231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:26.783851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:26.791530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:26.792427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:26.792988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:26.794056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:26.794794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:26.795243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:26.938313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:26.946687 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-150633a6-fcd9-4b74-95b9-d0b366e449cf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1520 microversion: 2.1 time: 0.167430 Oct 25 03:54:26.947276 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3536/7189] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:26 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:27.973176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:27.973927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:27.981453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:27.981982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:27.982430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:27.983128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:27.983587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:27.984016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:28.073806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-5c923832-5252-4a26-a4bb-9ae56eba34b4 req-eb8d39ce-33b4-48fd-acc5-67ad4ccfa3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a14530-8157-4348-b41c-95d7fc627da7", "tag": "9f9e346c-1f4b-482e-9391-a46502e07f73"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:28.083724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5c923832-5252-4a26-a4bb-9ae56eba34b4 req-eb8d39ce-33b4-48fd-acc5-67ad4ccfa3a5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:28.084890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5c923832-5252-4a26-a4bb-9ae56eba34b4 req-eb8d39ce-33b4-48fd-acc5-67ad4ccfa3a5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:28.085339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5c923832-5252-4a26-a4bb-9ae56eba34b4 req-eb8d39ce-33b4-48fd-acc5-67ad4ccfa3a5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:28.089462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=84 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:28.097971 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-5c923832-5252-4a26-a4bb-9ae56eba34b4 req-eb8d39ce-33b4-48fd-acc5-67ad4ccfa3a5 service nova] Creating event network-changed:9f9e346c-1f4b-482e-9391-a46502e07f73 for instance e9a14530-8157-4348-b41c-95d7fc627da7 on n-h1-862355-1 Oct 25 03:54:28.103991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-5c923832-5252-4a26-a4bb-9ae56eba34b4 req-eb8d39ce-33b4-48fd-acc5-67ad4ccfa3a5 service nova] Instance e9a14530-8157-4348-b41c-95d7fc627da7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:54:28.114817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-5c923832-5252-4a26-a4bb-9ae56eba34b4 req-eb8d39ce-33b4-48fd-acc5-67ad4ccfa3a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044891 Oct 25 03:54:28.115492 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3537/7190] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:54:28.121562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:28.129645 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c3bcf36e-ddea-4fac-81e3-7be99ff7e3ea tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1518 microversion: 2.1 time: 0.162467 Oct 25 03:54:28.130272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3654/7191] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:27 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:29.154686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:29.155395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:29.161476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:29.162496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:29.162987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:29.163683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:29.164142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:29.164593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:29.298010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:29.307058 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2519c81d-7de4-48b9-aaa5-6ce840714a1b tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1515 microversion: 2.1 time: 0.157681 Oct 25 03:54:29.307648 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3538/7192] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:29 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:29.329664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:29.330224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:29.332969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=28 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:29.338816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:29.339301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:29.339733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:29.340422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:29.340873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:29.341298 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:29.399831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dd34d06f-4946-499a-af50-45ea07361026 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "POST /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7/action" status: 204 len: 0 microversion: 2.1 time: 0.073995 Oct 25 03:54:29.400503 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3655/7193] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:54:29 2022] POST /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:54:29.408758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:29.409331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:29.411318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=30 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:29.417424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:29.417955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:29.418416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:29.419133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:29.419605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:29.420048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:29.556927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:29.565136 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f07a0350-ab13-40ec-a458-37ffd89c2660 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1515 microversion: 2.1 time: 0.160351 Oct 25 03:54:29.565740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3539/7194] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:29 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:30.591458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:30.592163 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:30.598981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:30.599867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:30.600640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:30.601725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:30.602155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:30.602596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:30.616219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-35ba4a6c-766c-46eb-a71e-662cea29ee08 req-f9bb0afa-acc6-4935-be7d-c4cb28a2ed69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a14530-8157-4348-b41c-95d7fc627da7", "name": "network-vif-plugged", "status": "completed", "tag": "9f9e346c-1f4b-482e-9391-a46502e07f73"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:30.631373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-35ba4a6c-766c-46eb-a71e-662cea29ee08 req-f9bb0afa-acc6-4935-be7d-c4cb28a2ed69 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:30.633272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-35ba4a6c-766c-46eb-a71e-662cea29ee08 req-f9bb0afa-acc6-4935-be7d-c4cb28a2ed69 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:30.634010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-35ba4a6c-766c-46eb-a71e-662cea29ee08 req-f9bb0afa-acc6-4935-be7d-c4cb28a2ed69 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:30.654191 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-35ba4a6c-766c-46eb-a71e-662cea29ee08 req-f9bb0afa-acc6-4935-be7d-c4cb28a2ed69 service nova] Creating event network-vif-plugged:9f9e346c-1f4b-482e-9391-a46502e07f73 for instance e9a14530-8157-4348-b41c-95d7fc627da7 on n-h1-862355-1 Oct 25 03:54:30.658414 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-35ba4a6c-766c-46eb-a71e-662cea29ee08 req-f9bb0afa-acc6-4935-be7d-c4cb28a2ed69 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049954 Oct 25 03:54:30.659704 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3540/7195] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:54:30.754763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:30.766741 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90d24f3f-5912-482c-8320-48e38ffe5b53 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1515 microversion: 2.1 time: 0.180425 Oct 25 03:54:30.767432 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3656/7196] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:30 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:31.792496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:31.793213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:31.799582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:31.800079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:31.800530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:31.801237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:31.801732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:31.802179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:31.932609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:31.942099 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce4e3a8a-5c71-4200-832c-34805f109c0c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1507 microversion: 2.1 time: 0.154937 Oct 25 03:54:31.942681 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3541/7197] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:31 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:54:31.964716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:31.965373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:31.972069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:31.972557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:31.973001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:31.973723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:31.974189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:31.974623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:32.107891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:32.115498 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f9f53ce-685b-4b5c-ad33-ff82a1d88752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1507 microversion: 2.1 time: 0.154657 Oct 25 03:54:32.116789 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3657/7198] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:31 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:32.141857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d11cba05-dab6-4593-83af-ed016f7b50f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'create', calling method: .version_select at 0x7efd33596c10>, body: {"keypair": {"name": "tempest-keypair-1048756566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDC4eGgBKAe9y0Kd1e61cxeLdnDad6LkbT4o9iGmpKO2fp/dln2CSlKcJLp6Q6PTqcEZFfNcvcTDklA9T2l1PCS+/7DloPmOLdfCpHKEJ5Ecol3L2hRj/sl7rS7lISGiQ=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:32.157392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d11cba05-dab6-4593-83af-ed016f7b50f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Getting quotas for project fd5e1c2a2d6d435e9f742aa4c85c9fab. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:54:32.163124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d11cba05-dab6-4593-83af-ed016f7b50f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Getting quotas for user d9454c9032694667a169c0f908887d85 and project fd5e1c2a2d6d435e9f742aa4c85c9fab. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:54:32.188817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d11cba05-dab6-4593-83af-ed016f7b50f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050841 Oct 25 03:54:32.189424 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3542/7199] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:54:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:54:33.375405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:33.376030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:33.383793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:33.384281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:33.384786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:33.385520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:33.386093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:33.386550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:33.519304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:33.527468 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0834b47e-d374-4c92-b69a-781bc80949e5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 200 len: 1507 microversion: 2.1 time: 0.156047 Oct 25 03:54:33.528043 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3658/7200] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:33 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:33.551287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:33.551806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:33.559283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:33.559792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:33.560248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:33.560958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:33.561462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:33.561935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:33.586703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:54:33.659843 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6071c8d0-8d17-4934-8d34-c95f5340a3be tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 204 len: 0 microversion: 2.1 time: 0.113204 Oct 25 03:54:33.660569 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3543/7201] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:54:33 2022] DELETE /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:54:33.715489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1671221558", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "cbcde37f-ecb1-4328-97a6-883e1abe2657"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:33.768484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] validate_networks() for [('cbcde37f-ecb1-4328-97a6-883e1abe2657', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:54:34.145253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:54:34.145737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:54:34.146223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:54:34.146639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:54:34.147570 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:54:34.156459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:34.156944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:34.157385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:34.158162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:34.158651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:34.159087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:34.175655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Getting quotas for project fd5e1c2a2d6d435e9f742aa4c85c9fab. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:54:34.181345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Getting quotas for user d9454c9032694667a169c0f908887d85 and project fd5e1c2a2d6d435e9f742aa4c85c9fab. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:54:34.194447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:54:34.196732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:54:34.239614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c1b36c9d-68bf-4a0d-9de9-34f7413b8a4e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528109 Oct 25 03:54:34.240271 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3659/7202] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:54:34.252598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8495b8d-6957-41b8-9f6f-ab202bbe55f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:34.253323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8495b8d-6957-41b8-9f6f-ab202bbe55f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:34.309769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8495b8d-6957-41b8-9f6f-ab202bbe55f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:34.316871 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8495b8d-6957-41b8-9f6f-ab202bbe55f9 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1218 microversion: 2.1 time: 0.068537 Oct 25 03:54:34.317465 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3544/7203] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:34 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:35.341347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:35.342073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:35.352777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:35.353270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:35.353734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:35.354439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:35.354893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:35.355318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:35.419536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:35.427731 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0753fc81-b7aa-4c3b-9c5c-4b242cd909a5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1270 microversion: 2.1 time: 0.091085 Oct 25 03:54:35.428330 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3660/7204] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:35 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:54:35.588753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-cd2c83ac-716c-4a0c-ab8b-2ecbc6362b65 req-3cf6ade3-1295-4517-8ac5-c7ac63544e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a14530-8157-4348-b41c-95d7fc627da7", "name": "network-vif-deleted", "tag": "9f9e346c-1f4b-482e-9391-a46502e07f73"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:35.602106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cd2c83ac-716c-4a0c-ab8b-2ecbc6362b65 req-3cf6ade3-1295-4517-8ac5-c7ac63544e3a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:35.603301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cd2c83ac-716c-4a0c-ab8b-2ecbc6362b65 req-3cf6ade3-1295-4517-8ac5-c7ac63544e3a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:35.603765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cd2c83ac-716c-4a0c-ab8b-2ecbc6362b65 req-3cf6ade3-1295-4517-8ac5-c7ac63544e3a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:35.622633 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-cd2c83ac-716c-4a0c-ab8b-2ecbc6362b65 req-3cf6ade3-1295-4517-8ac5-c7ac63544e3a service nova] Creating event network-vif-deleted:9f9e346c-1f4b-482e-9391-a46502e07f73 for instance e9a14530-8157-4348-b41c-95d7fc627da7 on n-h1-862355-1 Oct 25 03:54:35.628711 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-cd2c83ac-716c-4a0c-ab8b-2ecbc6362b65 req-3cf6ade3-1295-4517-8ac5-c7ac63544e3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044253 Oct 25 03:54:35.630004 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3545/7205] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:54:36.453273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:36.454655 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:36.462448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:36.463076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:36.463726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:36.464598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:36.465059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:36.465487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:36.602968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:36.610577 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7cba5721-f2cb-4566-b40d-8082e583a935 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1318 microversion: 2.1 time: 0.162301 Oct 25 03:54:36.611161 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3661/7206] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:36 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:54:37.635326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:37.635961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:37.642322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:37.642821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:37.643274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:37.644006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:37.644487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:37.644929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:37.647121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-db20f181-32ed-4232-b022-864f5c7881d9 req-147c4d55-56a2-498b-a5fc-95245f0ef79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8491264e-6618-4899-bcde-f0340202b4c9", "tag": "4bb5566b-ecda-48af-afd1-1b598de91738"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:37.658374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-db20f181-32ed-4232-b022-864f5c7881d9 req-147c4d55-56a2-498b-a5fc-95245f0ef79f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:37.658851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-db20f181-32ed-4232-b022-864f5c7881d9 req-147c4d55-56a2-498b-a5fc-95245f0ef79f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:37.659285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-db20f181-32ed-4232-b022-864f5c7881d9 req-147c4d55-56a2-498b-a5fc-95245f0ef79f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:37.671818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-db20f181-32ed-4232-b022-864f5c7881d9 req-147c4d55-56a2-498b-a5fc-95245f0ef79f service nova] Creating event network-changed:4bb5566b-ecda-48af-afd1-1b598de91738 for instance 8491264e-6618-4899-bcde-f0340202b4c9 on n-h1-862355-1 Oct 25 03:54:37.676948 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-db20f181-32ed-4232-b022-864f5c7881d9 req-147c4d55-56a2-498b-a5fc-95245f0ef79f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033498 Oct 25 03:54:37.677551 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3662/7207] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:54:37.780491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:37.788963 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0fa00c11-e53b-4860-a7b1-9ff9ef0ccc8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1318 microversion: 2.1 time: 0.158223 Oct 25 03:54:37.789549 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3546/7208] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:37 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:38.812929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:38.813639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:38.820957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:38.821442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:38.821907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:38.822653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:38.823109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:38.823554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:38.969758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:38.978794 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c96e8584-2c54-4f68-8c8a-f37f26947726 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1318 microversion: 2.1 time: 0.170400 Oct 25 03:54:38.979379 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3663/7209] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:38 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:40.001975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:40.002591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:40.009809 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:40.010309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:40.010758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:40.011474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:40.011938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:40.012411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:40.143029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:40.151398 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13841fb9-ebbf-489c-b70d-0a6b76f163dc tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1318 microversion: 2.1 time: 0.153360 Oct 25 03:54:40.151987 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3547/7210] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:39 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:40.605696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ca184922-9d5a-4e16-9f8f-bdf6831c1c50 req-1717e958-f0bd-486f-bd0b-2694b82f9b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8491264e-6618-4899-bcde-f0340202b4c9", "name": "network-vif-plugged", "status": "completed", "tag": "4bb5566b-ecda-48af-afd1-1b598de91738"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:40.617040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ca184922-9d5a-4e16-9f8f-bdf6831c1c50 req-1717e958-f0bd-486f-bd0b-2694b82f9b1e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:40.617534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ca184922-9d5a-4e16-9f8f-bdf6831c1c50 req-1717e958-f0bd-486f-bd0b-2694b82f9b1e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:40.617995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ca184922-9d5a-4e16-9f8f-bdf6831c1c50 req-1717e958-f0bd-486f-bd0b-2694b82f9b1e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:40.629189 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ca184922-9d5a-4e16-9f8f-bdf6831c1c50 req-1717e958-f0bd-486f-bd0b-2694b82f9b1e service nova] Creating event network-vif-plugged:4bb5566b-ecda-48af-afd1-1b598de91738 for instance 8491264e-6618-4899-bcde-f0340202b4c9 on n-h1-862355-1 Oct 25 03:54:40.635611 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ca184922-9d5a-4e16-9f8f-bdf6831c1c50 req-1717e958-f0bd-486f-bd0b-2694b82f9b1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033660 Oct 25 03:54:40.636223 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3664/7211] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:54:41.174970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:41.175515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:41.182446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:41.182939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:41.183385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:41.184334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:41.184795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:41.185228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:41.313209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:41.322063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96e3c0f9-1fde-4679-989d-1744de739d77 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1318 microversion: 2.1 time: 0.151054 Oct 25 03:54:41.322646 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3548/7212] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:41 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:42.347402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:42.348039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:42.354939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.355447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.355882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.356562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.357011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.357440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.488061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:42.495732 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8721ec3c-2620-49bd-8cf5-e251a1a39468 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1509 microversion: 2.1 time: 0.153634 Oct 25 03:54:42.496307 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3665/7213] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:42 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:42.518596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:42.519221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:42.526734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.527224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.527672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.528365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.528828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.529264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.661911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:42.669951 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a3c08a5a-8db8-4b48-8282-ab0f6cbe7441 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1509 microversion: 2.1 time: 0.155137 Oct 25 03:54:42.670544 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3549/7214] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:42 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:42.692166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:54:42.694977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:42.700855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.701339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.701800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.702493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.702956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.703385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.731515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:42.736812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:54:42.738582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:42.745093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:54:42.745512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:54:42.746024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:54:42.746439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:54:42.746848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:54:42.813512 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56b5fc65-d652-45e8-ade3-479450165c7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "POST /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9/action" status: 202 len: 0 microversion: 2.1 time: 0.125202 Oct 25 03:54:42.814180 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3666/7215] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:54:42 2022] POST /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:54:42.822283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:42.823030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:42.829004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.829498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.829977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.830683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:42.831143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:42.831578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:42.966175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:42.974225 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa8ff3cd-0546-4675-a2cf-daa061c44bb5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1516 microversion: 2.1 time: 0.155786 Oct 25 03:54:42.974801 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3550/7216] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:42 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:43.999459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:44.000079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:44.006380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:44.007772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:44.008220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:44.008929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:44.009389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:44.009850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:44.146501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:44.154929 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-84184ee2-aed6-405f-939f-f4106ce6b33a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1516 microversion: 2.1 time: 0.160368 Oct 25 03:54:44.155515 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3667/7217] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:43 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:45.177804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:45.179031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:45.181911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:45.188646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:45.189423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:45.190111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:45.191198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:45.191683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:45.192133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:45.325640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:45.333360 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7fcd1c36-bbd2-4d27-88fe-58c83a39a9ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.159592 Oct 25 03:54:45.333978 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3551/7218] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:45 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:46.357837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:46.358373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:46.360162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:46.360838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:46.368543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:46.369036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:46.369478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:46.370212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:46.370672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:46.371101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:46.503206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:46.511129 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c80d569d-27c7-480c-88a1-595636e16a64 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.157366 Oct 25 03:54:46.511721 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3668/7219] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:46 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:54:47.535388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:47.536115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:47.543205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:47.543704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:47.547906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:47.547906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:47.547906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:47.547906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:47.676337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:47.684952 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57b71d32-853e-4266-884d-ca778cede7d2 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.153530 Oct 25 03:54:47.685540 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3552/7220] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:47 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:48.708582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:48.709197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:48.716152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:48.716637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:48.717071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:48.717788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:48.718244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:48.718676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:48.853617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:48.861365 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ab55bab-41c8-4ed7-81d1-9c47f7e3e52f tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.156671 Oct 25 03:54:48.861976 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3669/7221] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:48 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:49.886463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:49.887093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:49.894097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:49.894599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:49.895052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:49.895758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:49.896228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:49.896671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:50.026256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:50.034037 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8b00a05e-a272-49aa-8707-6ad541928d3c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.152241 Oct 25 03:54:50.034617 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3553/7222] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:49 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:51.059523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:51.060161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:51.066939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:51.067420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:51.067853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:51.068553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:51.069001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:51.069425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:51.202317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:51.210094 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ac948d90-b490-4c34-a50d-3a61d57b5dd7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.155776 Oct 25 03:54:51.211198 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3670/7223] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:51 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:52.234078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:52.234710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:52.241563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:52.242714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:52.243169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:52.243908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:52.244381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:52.244821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:52.377907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:52.385771 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a37c7fcb-9d23-4396-94cc-5a7c4dee14e8 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.155671 Oct 25 03:54:52.386377 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3554/7224] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:52 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:53.409172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:53.409827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:53.417754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:53.418249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:53.418687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:53.419385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:53.419843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:53.420271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:53.548597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:53.556872 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1e8585f-e177-49cb-ae69-ea5fe269d752 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.151563 Oct 25 03:54:53.557439 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3671/7225] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:53 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:54.582304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:54.582937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:54.589521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:54.590053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:54.590507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:54.591209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:54.591703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:54.592146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:54.724976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:54.727786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:54:54.735290 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1bea2606-f75e-4568-88b9-c9f3bcaff00d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.157132 Oct 25 03:54:54.735889 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3555/7226] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:54 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:55.759703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:55.760296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:55.768060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:55.768548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:55.769008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:55.769703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:55.770171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:55.770604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:55.904115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:55.911798 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17b24357-625d-49e7-9f8d-4eb76d8aa39c tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.156036 Oct 25 03:54:55.912420 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3672/7227] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:55 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:56.936482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:56.937103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:56.945112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:56.945605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:56.946738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:56.947988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:56.948459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:56.948901 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:57.083168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:57.091748 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9e222062-4bb6-41b3-8046-450e39749fac tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.159874 Oct 25 03:54:57.092340 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3556/7228] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:56 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:58.114445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:58.115057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:58.122094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:58.122571 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:58.123008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:58.123696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:58.124151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:58.124577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:58.252963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:58.261267 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ae39d15-5d6c-4759-80db-f9625dbb6c01 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.150743 Oct 25 03:54:58.261996 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3673/7229] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:58 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:54:59.284743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:54:59.285376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:54:59.292545 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:59.293048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:59.293510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:59.294246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:54:59.294724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:54:59.295194 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:54:59.426141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:54:59.434393 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a05c189a-b4d9-4176-9cdb-f873932fa3b7 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.153573 Oct 25 03:54:59.434986 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3557/7230] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:54:59 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:00.457111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:00.457649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:00.460326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:00.465547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:00.466065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:00.466500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:00.467217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:00.467671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:00.468096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:00.603297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:00.611025 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-933ba9da-89dd-4d4e-9e9f-b16179c00bf0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.157943 Oct 25 03:55:00.611606 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3674/7231] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:00 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:01.634220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:01.634859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:01.637647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:01.643103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:01.643601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:01.644056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:01.644770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:01.645242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:01.645707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:01.777420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:01.785127 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c523def-9b3b-45be-af40-c13a514de6d5 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.154917 Oct 25 03:55:01.785737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3558/7232] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:01 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:02.808563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:02.809496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:02.815928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:02.816419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:02.816864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:02.817563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:02.818063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:02.818495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:02.947946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:02.955989 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3ae0516-a871-470f-ad93-6036b17f7a8e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.151547 Oct 25 03:55:02.956571 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3675/7233] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:02 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:03.978704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:03.979338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:03.986314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:03.986822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:03.987282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:03.987993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:03.988469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:03.988917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:04.123129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:04.130948 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42a299bd-d78c-4157-b99c-732d962cab9d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.156197 Oct 25 03:55:04.131532 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3559/7234] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:03 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:05.154541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:05.155169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:05.162087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:05.162584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:05.163024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:05.163726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:05.164188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:05.164621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:05.307257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:05.315186 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f672f5ab-7900-4f57-abfd-53f397cc7c58 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.164756 Oct 25 03:55:05.315772 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3676/7235] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:05 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:06.340073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:06.340619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:06.347489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:06.347984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:06.348433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:06.349139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:06.349610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:06.350078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:06.482985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:06.490838 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51b6d3ea-fc05-4c9d-822a-b9012d97a890 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.154784 Oct 25 03:55:06.491428 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3560/7236] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:06 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:07.514804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:07.515332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:07.522311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:07.522794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:07.523229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:07.523982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:07.525097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:07.525530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:07.669855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:07.677643 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9f4b6c6-7666-4a40-b851-cd4f5edf0131 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.166836 Oct 25 03:55:07.678257 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3677/7237] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:07 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:08.701774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:08.702438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:08.709656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:08.710122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:08.710566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:08.711280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:08.712396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:08.712840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:08.843031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:08.850754 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-28a875de-4fa2-4978-b389-7237c408b5bf tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.152925 Oct 25 03:55:08.851328 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3561/7238] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:08 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:09.875927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:09.876549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:09.883891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:09.884375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:09.884809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:09.885509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:09.885992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:09.888361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:10.053299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:10.061386 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-13603372-c051-429b-9e6c-57e0f4564145 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.190371 Oct 25 03:55:10.062276 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3678/7239] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:09 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:11.084874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:11.085500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:11.093406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:11.094010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:11.094469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:11.095186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:11.095663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:11.096108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:11.230094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:11.237879 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-135cc0ec-43ad-4dbd-9457-0d42671bdb04 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1521 microversion: 2.1 time: 0.156922 Oct 25 03:55:11.238474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3562/7240] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:11 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:12.262318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:12.264067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:12.270961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:12.271448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:12.271884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:12.272573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:12.273032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:12.273454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:12.488488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:12.497535 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c18453c4-28c8-42a9-8c36-cf5d11727790 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1520 microversion: 2.1 time: 0.239322 Oct 25 03:55:12.498134 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3679/7241] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:12 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:12.554677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e961daed-a6fa-460f-9196-8c9978785e8d req-f84484bf-c164-41a0-b201-cc9ac0c1e7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8491264e-6618-4899-bcde-f0340202b4c9", "name": "network-vif-unplugged", "status": "completed", "tag": "4bb5566b-ecda-48af-afd1-1b598de91738"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:12.566789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e961daed-a6fa-460f-9196-8c9978785e8d req-f84484bf-c164-41a0-b201-cc9ac0c1e7f0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:12.567137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e961daed-a6fa-460f-9196-8c9978785e8d req-f84484bf-c164-41a0-b201-cc9ac0c1e7f0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:12.567660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e961daed-a6fa-460f-9196-8c9978785e8d req-f84484bf-c164-41a0-b201-cc9ac0c1e7f0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:12.580997 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e961daed-a6fa-460f-9196-8c9978785e8d req-f84484bf-c164-41a0-b201-cc9ac0c1e7f0 service nova] Creating event network-vif-unplugged:4bb5566b-ecda-48af-afd1-1b598de91738 for instance 8491264e-6618-4899-bcde-f0340202b4c9 on n-h2-862355-1 Oct 25 03:55:12.586481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-e961daed-a6fa-460f-9196-8c9978785e8d req-f84484bf-c164-41a0-b201-cc9ac0c1e7f0 service nova] Instance 8491264e-6618-4899-bcde-f0340202b4c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:55:12.597551 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e961daed-a6fa-460f-9196-8c9978785e8d req-f84484bf-c164-41a0-b201-cc9ac0c1e7f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046585 Oct 25 03:55:12.598667 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3563/7242] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:13.522368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:13.522912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:13.530855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:13.531339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:13.531773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:13.532460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:13.532916 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:13.533340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:13.535890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:13.669733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:13.677539 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37d1e8d7-9ef6-4984-9296-56773b774e9e tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1518 microversion: 2.1 time: 0.159528 Oct 25 03:55:13.678159 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3680/7243] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:13 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:14.615138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-642e104a-7af5-4080-8a7c-0497f10e2a9e req-4f8d76d3-4f34-4a29-88d0-f4ea414972f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8491264e-6618-4899-bcde-f0340202b4c9", "tag": "4bb5566b-ecda-48af-afd1-1b598de91738"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:14.625467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-642e104a-7af5-4080-8a7c-0497f10e2a9e req-4f8d76d3-4f34-4a29-88d0-f4ea414972f9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:14.625997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-642e104a-7af5-4080-8a7c-0497f10e2a9e req-4f8d76d3-4f34-4a29-88d0-f4ea414972f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:14.626479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-642e104a-7af5-4080-8a7c-0497f10e2a9e req-4f8d76d3-4f34-4a29-88d0-f4ea414972f9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:14.638742 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-642e104a-7af5-4080-8a7c-0497f10e2a9e req-4f8d76d3-4f34-4a29-88d0-f4ea414972f9 service nova] Creating event network-changed:4bb5566b-ecda-48af-afd1-1b598de91738 for instance 8491264e-6618-4899-bcde-f0340202b4c9 on n-h2-862355-1 Oct 25 03:55:14.644335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-642e104a-7af5-4080-8a7c-0497f10e2a9e req-4f8d76d3-4f34-4a29-88d0-f4ea414972f9 service nova] Instance 8491264e-6618-4899-bcde-f0340202b4c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:55:14.655085 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-642e104a-7af5-4080-8a7c-0497f10e2a9e req-4f8d76d3-4f34-4a29-88d0-f4ea414972f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045176 Oct 25 03:55:14.655691 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3564/7244] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:14.702472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:14.703068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:14.710664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:14.711134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:14.711697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:14.712343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:14.712822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:14.713228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:14.853087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:14.860993 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-282b1a0e-76ab-44e1-b7a4-7e9067b5ba87 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1518 microversion: 2.1 time: 0.162306 Oct 25 03:55:14.861506 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3681/7245] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:14 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:15.886950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:15.887751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:15.894699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:15.895324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:15.895848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:15.896646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:15.897298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:15.897774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:16.035231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:16.043128 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa74e87d-9db3-4ca2-9cc9-8ce30d5b4369 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1518 microversion: 2.1 time: 0.162339 Oct 25 03:55:16.043708 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3565/7246] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:15 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:17.066960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:17.067643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:17.075256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:17.075744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:17.076184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:17.076884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:17.077340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:17.077873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:17.212963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:17.220825 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-72a6c522-57be-417a-a59b-b9f8bcfa7dda tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1515 microversion: 2.1 time: 0.157805 Oct 25 03:55:17.221405 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3682/7247] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:17 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:17.244602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:17.245239 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:17.252019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:17.252516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:17.252965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:17.253670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:17.254155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:17.254592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:17.317407 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-20f636f6-9c24-4ab3-b507-832bad71fe0d tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "POST /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9/action" status: 204 len: 0 microversion: 2.1 time: 0.076985 Oct 25 03:55:17.318110 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3566/7248] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:55:17 2022] POST /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:55:17.326382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:17.327009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:17.333146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:17.333630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:17.334106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:17.334805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:17.335258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:17.335687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:17.468510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:17.476500 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-32aaeb2e-d406-430a-8519-326569f67d09 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1515 microversion: 2.1 time: 0.154006 Oct 25 03:55:17.477668 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3683/7249] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:17 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:18.503536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:18.504369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:18.511683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:18.512489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:18.513238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:18.514594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:18.515282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:18.515881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:18.658387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:18.667912 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fe4fd964-6551-48c9-9d4f-b036b465c929 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1515 microversion: 2.1 time: 0.169575 Oct 25 03:55:18.669060 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3567/7250] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:18 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:18.820624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f1272770-c7ac-4174-a082-f10f854c8e60 req-4383dce7-d1f8-4584-85a8-6af98324b707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8491264e-6618-4899-bcde-f0340202b4c9", "name": "network-vif-plugged", "status": "completed", "tag": "4bb5566b-ecda-48af-afd1-1b598de91738"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:18.832733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f1272770-c7ac-4174-a082-f10f854c8e60 req-4383dce7-d1f8-4584-85a8-6af98324b707 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:18.833410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f1272770-c7ac-4174-a082-f10f854c8e60 req-4383dce7-d1f8-4584-85a8-6af98324b707 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:18.834058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f1272770-c7ac-4174-a082-f10f854c8e60 req-4383dce7-d1f8-4584-85a8-6af98324b707 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:18.846633 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f1272770-c7ac-4174-a082-f10f854c8e60 req-4383dce7-d1f8-4584-85a8-6af98324b707 service nova] Creating event network-vif-plugged:4bb5566b-ecda-48af-afd1-1b598de91738 for instance 8491264e-6618-4899-bcde-f0340202b4c9 on n-h2-862355-1 Oct 25 03:55:18.851757 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f1272770-c7ac-4174-a082-f10f854c8e60 req-4383dce7-d1f8-4584-85a8-6af98324b707 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Oct 25 03:55:18.852376 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3684/7251] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:19.693288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:19.693951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:19.700974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:19.701477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:19.701961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:19.702681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:19.703156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:19.703602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:19.835385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:19.843907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9a86a9ec-77b1-4c3b-a845-190970ad1c38 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1507 microversion: 2.1 time: 0.154594 Oct 25 03:55:19.844494 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3568/7252] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:19 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:19.867212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:19.867917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:19.875702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:19.876190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:19.876631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:19.877330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:19.877816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:19.878251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.013956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:20.021854 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c91b1e9-5af5-445c-805f-15d6c73f1326 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1507 microversion: 2.1 time: 0.158800 Oct 25 03:55:20.022479 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3685/7253] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:19 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:20.045080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:20.045732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:20.051962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.052466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.052931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.053644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.054153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.054595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.188420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:20.196163 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eeca6204-bbdf-40dc-b3d6-8df715ba9069 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1507 microversion: 2.1 time: 0.155751 Oct 25 03:55:20.196807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3569/7254] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:20 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:20.218252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:20.218751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:20.224568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.225048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.225478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.226329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.226785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.227207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.253548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:55:20.332580 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa41ca9c-c328-491b-a1a4-8431b7f4cc81 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 204 len: 0 microversion: 2.1 time: 0.117621 Oct 25 03:55:20.333332 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3686/7255] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:55:20 2022] DELETE /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:55:20.350560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:20.351079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:20.357854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.358361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.358820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.359533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.360008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.360453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.385233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:55:20.420305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:20.434865 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.compute.api [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Instance is already in deleting state, ignoring this request Oct 25 03:55:20.435718 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7854c9ce-72d6-4f82-9149-96fdbf19cc7a tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 204 len: 0 microversion: 2.1 time: 0.089159 Oct 25 03:55:20.436292 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3570/7256] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:55:20 2022] DELETE /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:55:20.444950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:20.445700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:20.451673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.452153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.452595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.453282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:20.453766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:20.454195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:20.584598 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:20.593249 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7a04bc9-674e-4012-8fd9-aa8374616ce0 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1513 microversion: 2.1 time: 0.152613 Oct 25 03:55:20.593860 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3687/7257] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:20 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:21.616752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:21.617384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:21.624902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:21.625399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:21.625891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:21.626600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:21.627069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:21.627516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:21.761331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9454c9032694667a169c0f908887d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5e1c2a2d6d435e9f742aa4c85c9fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:21.769235 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1c33e144-360b-449d-8192-e0f1875721ab tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 200 len: 1513 microversion: 2.1 time: 0.156781 Oct 25 03:55:21.769931 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3571/7258] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:21 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:22.532752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4af3839f-5a4d-425c-90f3-2075100ad41d req-b0fb3e4b-60da-427e-82b2-e87329f12e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8491264e-6618-4899-bcde-f0340202b4c9", "name": "network-vif-deleted", "tag": "4bb5566b-ecda-48af-afd1-1b598de91738"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:22.543636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4af3839f-5a4d-425c-90f3-2075100ad41d req-b0fb3e4b-60da-427e-82b2-e87329f12e06 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:22.544124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4af3839f-5a4d-425c-90f3-2075100ad41d req-b0fb3e4b-60da-427e-82b2-e87329f12e06 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:22.544589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4af3839f-5a4d-425c-90f3-2075100ad41d req-b0fb3e4b-60da-427e-82b2-e87329f12e06 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:22.558046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4af3839f-5a4d-425c-90f3-2075100ad41d req-b0fb3e4b-60da-427e-82b2-e87329f12e06 service nova] Creating event network-vif-deleted:4bb5566b-ecda-48af-afd1-1b598de91738 for instance 8491264e-6618-4899-bcde-f0340202b4c9 on n-h2-862355-1 Oct 25 03:55:22.563499 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4af3839f-5a4d-425c-90f3-2075100ad41d req-b0fb3e4b-60da-427e-82b2-e87329f12e06 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103361 Oct 25 03:55:22.564108 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3688/7259] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:22.793138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:22.793803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: 8491264e-6618-4899-bcde-f0340202b4c9] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:22.800647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:22.801144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:22.801597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:22.802328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:22.802797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:22.803237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:22.816923 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] HTTP exception thrown: Instance 8491264e-6618-4899-bcde-f0340202b4c9 could not be found. Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Request method failure captured: Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 HTTP/1.1 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV13HyDVvv5ieIrF61FXA4FsIYfEOWyEQq7J__gZl1hgGfsVNJy7_tNPMALmiVjjsG6dEJDUDIUE37VWNhDtpn4S4i-dQTKY830RlY_y6G2TRO_ROdpz55nKgr-4wUVbBLaBHedzwSP0CacK9SG-ViCz8E_cWpoIz7NxzYkfPKGvmoZk Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: fd5e1c2a2d6d435e9f742aa4c85c9fab Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5e1c2a2d6d435e9f742aa4c85c9fab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}] Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: fd5e1c2a2d6d435e9f742aa4c85c9fab Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerDiskConfigTestJSON-593965230-project Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d9454c9032694667a169c0f908887d85 Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerDiskConfigTestJSON-593965230-project Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 8491264e-6618-4899-bcde-f0340202b4c9 could not be found. Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '8491264e-6618-4899-bcde-f0340202b4c9'} Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8491264e-6618-4899-bcde-f0340202b4c9 could not be found. Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8491264e-6618-4899-bcde-f0340202b4c9 could not be found. Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:55:22.818598 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8491264e-6618-4899-bcde-f0340202b4c9 could not be found. Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Returning 404 to user: Instance 8491264e-6618-4899-bcde-f0340202b4c9 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2573f9ea-bc48-49ec-8032-ddbab5d3b1a6 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9" status: 404 len: 111 microversion: 2.1 time: 0.031520 Oct 25 03:55:22.823566 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3572/7260] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:22 2022] GET /compute/v2.1/servers/8491264e-6618-4899-bcde-f0340202b4c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:55:22.829409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6938fdbc-ce0b-41d2-94b1-21da0ee14b76 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '.version_select at 0x7efd31ee9670>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:22.853925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6938fdbc-ce0b-41d2-94b1-21da0ee14b76 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048756566" status: 202 len: 0 microversion: 2.1 time: 0.028004 Oct 25 03:55:22.854522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3689/7261] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 03:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048756566 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:55:23.453129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:23.453648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:23.459842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:23.460337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:23.460789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:23.461488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:23.461997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:23.462441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:23.475694 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] HTTP exception thrown: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Request method failure captured: Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 HTTP/1.1 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV13HyDVvv5ieIrF61FXA4FsIYfEOWyEQq7J__gZl1hgGfsVNJy7_tNPMALmiVjjsG6dEJDUDIUE37VWNhDtpn4S4i-dQTKY830RlY_y6G2TRO_ROdpz55nKgr-4wUVbBLaBHedzwSP0CacK9SG-ViCz8E_cWpoIz7NxzYkfPKGvmoZk Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: fd5e1c2a2d6d435e9f742aa4c85c9fab Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5e1c2a2d6d435e9f742aa4c85c9fab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}] Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: fd5e1c2a2d6d435e9f742aa4c85c9fab Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerDiskConfigTestJSON-593965230-project Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d9454c9032694667a169c0f908887d85 Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerDiskConfigTestJSON-593965230-project Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'e9a14530-8157-4348-b41c-95d7fc627da7'} Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:55:23.477221 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Returning 404 to user: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9cccd1f7-96d1-4a5c-baf6-8ef6b6a57a35 tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 404 len: 111 microversion: 2.1 time: 0.029605 Oct 25 03:55:23.481587 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3573/7262] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:55:23 2022] DELETE /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 25 03:55:23.488187 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:23.488958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] [instance: e9a14530-8157-4348-b41c-95d7fc627da7] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:23.496350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:23.496815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:23.497253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:23.497973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:23.498433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:23.498862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:23.512424 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] HTTP exception thrown: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Request method failure captured: Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 HTTP/1.1 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV13HyDVvv5ieIrF61FXA4FsIYfEOWyEQq7J__gZl1hgGfsVNJy7_tNPMALmiVjjsG6dEJDUDIUE37VWNhDtpn4S4i-dQTKY830RlY_y6G2TRO_ROdpz55nKgr-4wUVbBLaBHedzwSP0CacK9SG-ViCz8E_cWpoIz7NxzYkfPKGvmoZk Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: fd5e1c2a2d6d435e9f742aa4c85c9fab Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5e1c2a2d6d435e9f742aa4c85c9fab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5e1c2a2d6d435e9f742aa4c85c9fab"}]}] Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: fd5e1c2a2d6d435e9f742aa4c85c9fab Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-593965230 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerDiskConfigTestJSON-593965230-project Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d9454c9032694667a169c0f908887d85 Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerDiskConfigTestJSON-593965230-project Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'e9a14530-8157-4348-b41c-95d7fc627da7'} Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:55:23.514058 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] Returning 404 to user: Instance e9a14530-8157-4348-b41c-95d7fc627da7 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-92fa24bd-c9a9-48c1-bb12-2cfbd5b41afb tempest-ServerDiskConfigTestJSON-593965230 tempest-ServerDiskConfigTestJSON-593965230-project] 10.222.0.36 "GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7" status: 404 len: 111 microversion: 2.1 time: 0.032064 Oct 25 03:55:23.518633 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3690/7263] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:23 2022] GET /compute/v2.1/servers/e9a14530-8157-4348-b41c-95d7fc627da7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:55:31.839259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-edb97399-7ff9-4862-977a-aa7da05eddbc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'create', calling method: .version_select at 0x7efd32285040>, body: {"keypair": {"name": "tempest-keypair-1080434280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkv+D5T/1MwOEEF8VxygSblyuZQ3AOuxLuJucUBWHOlTyQOYRZVHleRmI5k156D2YOQHUiVo85EnSuANVMxuK3WQudbGjN3YaY6UWnClXRGOQ26FQG1MHM2VH8pidAEFw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:31.844754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=32 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:31.857255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-edb97399-7ff9-4862-977a-aa7da05eddbc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for project 3658252363f948bd83e3f172fd493212. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:55:31.862716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-edb97399-7ff9-4862-977a-aa7da05eddbc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for user 93ac3b8248b342079ead4a7aedce89ea and project 3658252363f948bd83e3f172fd493212. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:55:31.889750 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-edb97399-7ff9-4862-977a-aa7da05eddbc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203346 Oct 25 03:55:31.890363 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3574/7264] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 03:55:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:33.560477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1407743186", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69c785b0-6a4b-4eeb-b425-f9fa4134c01b"}], "security_groups": [{"name": "tempest-securitygroup--1576704750"}], "key_name": "tempest-keypair-1080434280", "user_data": "}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:33.569965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:33.570834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:33.671535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] validate_networks() for [('69c785b0-6a4b-4eeb-b425-f9fa4134c01b', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:55:34.058150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:55:34.058582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:55:34.059059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:55:34.059476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:55:34.060144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:55:34.069174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:34.069663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:34.070135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:34.070872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:34.071333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:34.072533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:34.089912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:55:34.095643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for user 93ac3b8248b342079ead4a7aedce89ea and project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:55:34.108706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:55:34.111052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:55:34.159901 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b4923ff-bb52-475b-8330-2f87c460961c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.604797 Oct 25 03:55:34.160785 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3691/7265] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:55:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:55:34.171753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:34.177160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-561a3b13-66e0-4ed0-bfd7-b831a1bf66e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:34.177997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-561a3b13-66e0-4ed0-bfd7-b831a1bf66e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:34.238568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-561a3b13-66e0-4ed0-bfd7-b831a1bf66e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:34.254323 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-561a3b13-66e0-4ed0-bfd7-b831a1bf66e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1239 microversion: 2.1 time: 0.077174 Oct 25 03:55:34.258221 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3575/7266] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:34 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:35.271928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:35.272744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:35.281979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:35.283514 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:35.284152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:35.285035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:35.286279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:35.286721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:35.395650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:35.405793 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eacb4bb9-1a92-4eb7-b209-31fc3b29b73b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1309 microversion: 2.1 time: 0.139834 Oct 25 03:55:35.406815 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3692/7267] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:35 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1309 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:36.431937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:36.432567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:36.440119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:36.440620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:36.441067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:36.441803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:36.442273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:36.442712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:36.580926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:36.590109 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3a411261-59f4-469a-b202-2a5adfb234f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1365 microversion: 2.1 time: 0.162763 Oct 25 03:55:36.590863 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3576/7268] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:36 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:36.688037 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-cc5b0290-434f-44db-8838-5d142cc3559e req-f92cbea3-ee6d-4276-a3bf-7b01637cb9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9437afdd-eedf-484e-9f1c-fc6499a85f70", "tag": "668f7b1f-c4c7-45a8-b101-bb074b48fd9d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:36.699889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cc5b0290-434f-44db-8838-5d142cc3559e req-f92cbea3-ee6d-4276-a3bf-7b01637cb9f7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:36.700502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cc5b0290-434f-44db-8838-5d142cc3559e req-f92cbea3-ee6d-4276-a3bf-7b01637cb9f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:36.701125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-cc5b0290-434f-44db-8838-5d142cc3559e req-f92cbea3-ee6d-4276-a3bf-7b01637cb9f7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:36.713880 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-cc5b0290-434f-44db-8838-5d142cc3559e req-f92cbea3-ee6d-4276-a3bf-7b01637cb9f7 service nova] Creating event network-changed:668f7b1f-c4c7-45a8-b101-bb074b48fd9d for instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 on n-h2-862355-1 Oct 25 03:55:36.718687 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-cc5b0290-434f-44db-8838-5d142cc3559e req-f92cbea3-ee6d-4276-a3bf-7b01637cb9f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035008 Oct 25 03:55:36.719517 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3693/7269] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:37.613964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:37.614517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:37.621568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:37.622098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:37.622551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:37.623259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:37.623729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:37.624171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:37.759834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:37.767515 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2357d7e0-44b5-4e20-89df-259f4bc86132 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1365 microversion: 2.1 time: 0.157742 Oct 25 03:55:37.768086 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3577/7270] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:37 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:38.793060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:38.793789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:38.800183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:38.800666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:38.801213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:38.801940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:38.802404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:38.802833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:38.941282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:38.949215 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d0836549-4ad3-4469-8054-94cd95110f1e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1365 microversion: 2.1 time: 0.161870 Oct 25 03:55:38.949864 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3694/7271] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:38 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:39.972538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:39.973198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:39.980293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:39.980787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:39.981270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:39.981993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:39.982462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:39.982899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:40.112939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:40.121737 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b2172d99-3382-4314-94e2-c405ae20e291 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1365 microversion: 2.1 time: 0.153130 Oct 25 03:55:40.122313 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3578/7272] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:39 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:41.144741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:41.145352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:41.152568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:41.153042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:41.153473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:41.154189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:41.154644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:41.155064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:41.289350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:41.297394 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-18c95808-b82d-459f-9ed4-b437e136067c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1365 microversion: 2.1 time: 0.156659 Oct 25 03:55:41.298012 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3695/7273] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:41 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:42.320535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:42.321073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:42.328555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:42.329057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:42.329515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:42.330289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:42.330765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:42.331210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:42.463142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:42.470863 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-71f3495b-2690-4f9e-82cb-68ea63918663 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1365 microversion: 2.1 time: 0.154329 Oct 25 03:55:42.471443 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3579/7274] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:42 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:42.922367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-228d53a6-da6a-4035-9e08-317523b2c540 req-f8f87c5a-db83-48ba-ad5c-3f2930ee82b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9437afdd-eedf-484e-9f1c-fc6499a85f70", "name": "network-vif-plugged", "status": "completed", "tag": "668f7b1f-c4c7-45a8-b101-bb074b48fd9d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:42.933385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-228d53a6-da6a-4035-9e08-317523b2c540 req-f8f87c5a-db83-48ba-ad5c-3f2930ee82b5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:42.933899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-228d53a6-da6a-4035-9e08-317523b2c540 req-f8f87c5a-db83-48ba-ad5c-3f2930ee82b5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:42.934336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-228d53a6-da6a-4035-9e08-317523b2c540 req-f8f87c5a-db83-48ba-ad5c-3f2930ee82b5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:42.946284 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-228d53a6-da6a-4035-9e08-317523b2c540 req-f8f87c5a-db83-48ba-ad5c-3f2930ee82b5 service nova] Creating event network-vif-plugged:668f7b1f-c4c7-45a8-b101-bb074b48fd9d for instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 on n-h2-862355-1 Oct 25 03:55:42.952325 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-228d53a6-da6a-4035-9e08-317523b2c540 req-f8f87c5a-db83-48ba-ad5c-3f2930ee82b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Oct 25 03:55:42.952951 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3696/7275] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:43.494424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:43.495066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:43.502052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:43.502553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:43.503006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:43.503723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:43.504196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:43.504639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:43.638858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:43.646628 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6428f205-36f0-4eab-a970-601f1189bae1 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1365 microversion: 2.1 time: 0.156845 Oct 25 03:55:43.647211 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3580/7276] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:43 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:44.671714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:44.672441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:44.675179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:44.675856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:44.683206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:44.683695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:44.684140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:44.685101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:44.685563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:44.686026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:44.820121 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:55:44.827957 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-835f4dbe-0e5a-4090-9905-7e816d0e6c24 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1553 microversion: 2.1 time: 0.160495 Oct 25 03:55:44.828472 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3697/7277] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:55:44 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:55:44.850250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:55:44.850763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:55:44.852685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:55:44.859241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:44.859741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:44.860198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:44.860902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:44.861372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:44.861843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:44.940980 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57ccf297-2761-417b-80b5-fe0832f3a686 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094576 Oct 25 03:55:44.941593 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3581/7278] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:55:44 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:55:45.898208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b7661490-40db-41e8-a518-b3cc889d0bc6 req-405ac72e-ca9e-4d79-a5ef-1828a4af0068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9437afdd-eedf-484e-9f1c-fc6499a85f70", "tag": "668f7b1f-c4c7-45a8-b101-bb074b48fd9d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:55:45.908628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b7661490-40db-41e8-a518-b3cc889d0bc6 req-405ac72e-ca9e-4d79-a5ef-1828a4af0068 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:55:45.909109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b7661490-40db-41e8-a518-b3cc889d0bc6 req-405ac72e-ca9e-4d79-a5ef-1828a4af0068 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:55:45.909542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b7661490-40db-41e8-a518-b3cc889d0bc6 req-405ac72e-ca9e-4d79-a5ef-1828a4af0068 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:55:45.920584 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b7661490-40db-41e8-a518-b3cc889d0bc6 req-405ac72e-ca9e-4d79-a5ef-1828a4af0068 service nova] Creating event network-changed:668f7b1f-c4c7-45a8-b101-bb074b48fd9d for instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 on n-h2-862355-1 Oct 25 03:55:45.925415 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b7661490-40db-41e8-a518-b3cc889d0bc6 req-405ac72e-ca9e-4d79-a5ef-1828a4af0068 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030852 Oct 25 03:55:45.926043 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3698/7279] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:56:50.282223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:56:50.282964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=34 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:56:50.283959 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 03:56:50.284082 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 03:56:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 (ip 10.222.0.36) !!! Oct 25 03:56:50.289457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:50.290110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:50.298338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.298832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.299276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.299974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.300438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.300874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.494736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:50.503016 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5917226e-27c9-4285-88f7-83d54b73fc0a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1672 microversion: 2.1 time: 0.223426 Oct 25 03:56:50.503589 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3582/7280] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:50 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:50.524855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:56:50.525601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=32 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:56:50.531334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:50.532043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:50.539817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.540240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.540676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.541363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.541856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.542289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.733113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:50.740896 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5dd3edea-c1f5-4b85-a27c-4aa25aa61c57 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1672 microversion: 2.1 time: 0.218723 Oct 25 03:56:50.741474 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3699/7281] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:50 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:50.762826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:50.763449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:50.770128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.770621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.771069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.771774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.772240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.772679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.903361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:50.911827 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c389cbbe-0085-4c34-b748-46119b7d24d3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1672 microversion: 2.1 time: 0.152782 Oct 25 03:56:50.912412 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3583/7282] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:50 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:50.935069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:56:50.937669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:50.943720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.944209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.944649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.945346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:50.945847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:50.946282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:50.974344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:50.979703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Old instance type m1.heat2, new instance type m1.heat {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:56:50.986960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:56:50.987386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:56:50.987863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:56:50.988278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:56:50.988692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:56:51.055045 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5181141d-e645-4647-830f-d4699f2c074d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70/action" status: 202 len: 0 microversion: 2.1 time: 0.124199 Oct 25 03:56:51.055673 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3700/7283] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:56:50 2022] POST /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:56:51.064543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:51.065173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:51.071107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:51.071635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:51.072083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:51.073263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:51.073263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:51.073671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:51.210085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:51.218817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eeb73a38-7f0f-4594-891f-5b41d397c0f2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1681 microversion: 2.1 time: 0.158827 Oct 25 03:56:51.219381 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3584/7284] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:51 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:52.243406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:52.244191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:52.250786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:52.251270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:52.251707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:52.252397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:52.252860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:52.253287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:52.381653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:52.389386 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe9ccf08-00b8-4a12-a002-27103fe5d9aa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1681 microversion: 2.1 time: 0.150687 Oct 25 03:56:52.390154 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3701/7285] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:52 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:53.414724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:53.415278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:53.422610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:53.423107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:53.423579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:53.424266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:53.424732 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:53.425170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:53.554531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:53.562712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db992ac9-4efa-41b9-9db4-b93d42b946cf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.152180 Oct 25 03:56:53.563287 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3585/7286] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:53 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:54.586841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:54.587464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:54.594840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:54.595326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:54.595761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:54.596442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:54.596897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:54.597318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:54.731469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:54.740015 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b44593c-799c-4ff3-9df1-185ccfefedaa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.157070 Oct 25 03:56:54.740596 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3702/7287] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:54 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:56:55.764050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:55.765226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:55.772581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:55.773081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:55.773530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:55.774303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:55.774772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:55.775210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:55.906637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:55.914362 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0c10c9b0-dd2c-492d-a2cb-aa6d29b59773 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.154296 Oct 25 03:56:55.914934 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3586/7288] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:55 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:56.938626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:56.939184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:56.946219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:56.946713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:56.947155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:56.947863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:56.948657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:56.949292 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:57.080177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:57.087898 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7856e17f-82d1-454c-aa47-97fc0eefef92 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.153564 Oct 25 03:56:57.088477 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3703/7289] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:56 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:58.112495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:58.113128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:58.119826 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:58.120320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:58.120770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:58.121493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:58.121987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:58.122430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:58.255003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:58.262800 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-03392e26-9df5-4da3-996f-5288723e73c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.154769 Oct 25 03:56:58.263337 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3587/7290] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:58 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:56:59.287059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:56:59.287601 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:56:59.294397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:59.294883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:59.295321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:59.296625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:56:59.297082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:56:59.297513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:56:59.426176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:56:59.433937 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9afafd3b-50c3-40cf-b311-cb423684ac04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.150793 Oct 25 03:56:59.434516 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3704/7291] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:56:59 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:00.457667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:00.458243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:00.465142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:00.465630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:00.466106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:00.466805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:00.467271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:00.468220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:00.599130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:00.606803 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-73e884a5-deec-4c47-9966-1d691cdce08e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.153189 Oct 25 03:57:00.607377 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3588/7292] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:00 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:01.631032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:01.631656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:01.638680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:01.639767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:01.640218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:01.640915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:01.641377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:01.641838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:01.785961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:01.793738 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-636d791c-b18e-400d-a9e0-e17ed0019ebe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.166588 Oct 25 03:57:01.794327 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3705/7293] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:01 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:02.817555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:02.818209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:02.825041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:02.825564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:02.826045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:02.827336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:02.827740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:02.828137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:02.962910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:02.970661 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba8f7d61-738f-41d2-a80b-8b114e344433 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.156988 Oct 25 03:57:02.971240 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3589/7294] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:02 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:03.994342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:03.994965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:04.001898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:04.002393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:04.002833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:04.003528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:04.003984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:04.004613 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:04.138185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:04.146434 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eb8de0d0-9b6d-430a-9e57-61939fe29f12 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1686 microversion: 2.1 time: 0.156325 Oct 25 03:57:04.147017 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3706/7295] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:03 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:05.172715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:05.173348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:05.180644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:05.181152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:05.181824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:05.182552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:05.183190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:05.183636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:05.459828 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:05.468590 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c45cafd-c2c7-4b66-b3ea-09dd95c0dd6b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1685 microversion: 2.1 time: 0.300481 Oct 25 03:57:05.469181 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3590/7296] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:05 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1685 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:05.568361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d0b6e036-8b2f-40c0-aae0-99b00d92fc6d req-b737cc0f-058b-43bd-a6f1-6e49b2c879d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9437afdd-eedf-484e-9f1c-fc6499a85f70", "name": "network-vif-unplugged", "status": "completed", "tag": "668f7b1f-c4c7-45a8-b101-bb074b48fd9d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:05.580774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d0b6e036-8b2f-40c0-aae0-99b00d92fc6d req-b737cc0f-058b-43bd-a6f1-6e49b2c879d6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:05.581264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d0b6e036-8b2f-40c0-aae0-99b00d92fc6d req-b737cc0f-058b-43bd-a6f1-6e49b2c879d6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:05.581765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d0b6e036-8b2f-40c0-aae0-99b00d92fc6d req-b737cc0f-058b-43bd-a6f1-6e49b2c879d6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:05.594436 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d0b6e036-8b2f-40c0-aae0-99b00d92fc6d req-b737cc0f-058b-43bd-a6f1-6e49b2c879d6 service nova] Creating event network-vif-unplugged:668f7b1f-c4c7-45a8-b101-bb074b48fd9d for instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 on n-h1-862355-1 Oct 25 03:57:05.599837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-d0b6e036-8b2f-40c0-aae0-99b00d92fc6d req-b737cc0f-058b-43bd-a6f1-6e49b2c879d6 service nova] Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:57:05.611163 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d0b6e036-8b2f-40c0-aae0-99b00d92fc6d req-b737cc0f-058b-43bd-a6f1-6e49b2c879d6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046399 Oct 25 03:57:05.611736 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3707/7297] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:57:06.492485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:06.493228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:06.501136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:06.501639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:06.502122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:06.502875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:06.503345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:06.503789 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:06.669322 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:06.678580 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b6538da1-18df-41f5-81a1-ee0848c522fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1685 microversion: 2.1 time: 0.190046 Oct 25 03:57:06.679466 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3591/7298] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:06 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:07.629248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-bb494fa5-a80a-4725-83a2-ca46ecdb9535 req-ed7ca06b-fdcc-4d74-ac0f-bba15afaa5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9437afdd-eedf-484e-9f1c-fc6499a85f70", "tag": "668f7b1f-c4c7-45a8-b101-bb074b48fd9d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:07.638693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb494fa5-a80a-4725-83a2-ca46ecdb9535 req-ed7ca06b-fdcc-4d74-ac0f-bba15afaa5a6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:07.640315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb494fa5-a80a-4725-83a2-ca46ecdb9535 req-ed7ca06b-fdcc-4d74-ac0f-bba15afaa5a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:07.640762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-bb494fa5-a80a-4725-83a2-ca46ecdb9535 req-ed7ca06b-fdcc-4d74-ac0f-bba15afaa5a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:07.652125 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-bb494fa5-a80a-4725-83a2-ca46ecdb9535 req-ed7ca06b-fdcc-4d74-ac0f-bba15afaa5a6 service nova] Creating event network-changed:668f7b1f-c4c7-45a8-b101-bb074b48fd9d for instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 on n-h1-862355-1 Oct 25 03:57:07.657933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-bb494fa5-a80a-4725-83a2-ca46ecdb9535 req-ed7ca06b-fdcc-4d74-ac0f-bba15afaa5a6 service nova] Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:57:07.668508 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-bb494fa5-a80a-4725-83a2-ca46ecdb9535 req-ed7ca06b-fdcc-4d74-ac0f-bba15afaa5a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045353 Oct 25 03:57:07.669116 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3708/7299] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:57:07.703163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:07.703793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:07.711056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:07.711566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:07.712016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:07.712744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:07.713215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:07.713893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:07.855342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:07.864595 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad568432-5266-4087-9ce8-3212d0b88ac6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1683 microversion: 2.1 time: 0.166008 Oct 25 03:57:07.865210 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3592/7300] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:07 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:08.891146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:08.891849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:08.898001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:08.898495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:08.898934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:08.899634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:08.900099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:08.900530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:09.037019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:09.044874 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b47b1276-c3ce-4819-b7cb-f9c10e0eda64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1680 microversion: 2.1 time: 0.159418 Oct 25 03:57:09.045927 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3709/7301] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:08 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:09.068603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:09.069152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:09.075976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:09.076496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:09.077997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:09.078699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:09.079168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:09.079602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:09.136995 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3255668d-92fc-43f4-b174-9454c09dd241 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70/action" status: 204 len: 0 microversion: 2.1 time: 0.072167 Oct 25 03:57:09.137644 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3593/7302] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:57:09 2022] POST /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:57:09.146522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:09.147151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:09.153055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:09.153732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:09.154270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:09.155237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:09.155714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:09.156197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:09.337999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:09.347815 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c18b24a5-6b1a-459b-b0c8-4c680c435a56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1680 microversion: 2.1 time: 0.205208 Oct 25 03:57:09.348439 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3710/7303] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:09 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:10.372993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:10.373635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:10.381515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:10.382041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:10.382495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:10.383211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:10.383683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:10.384123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:10.520314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:10.528791 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5fb8701e-883e-49db-ba16-3b47dbb49a39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1680 microversion: 2.1 time: 0.160160 Oct 25 03:57:10.529372 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3594/7304] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:10 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:11.552600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:11.553218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:11.560396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:11.561475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:11.562087 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:11.562822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:11.563556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:11.563987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:11.725503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:11.733575 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bd8632f3-8344-4ce1-aaca-aee00105dfe0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1672 microversion: 2.1 time: 0.185057 Oct 25 03:57:11.734184 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3711/7305] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:11 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:11.764594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:11.765264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:11.772960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:11.773471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:11.773980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:11.774705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:11.775178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:11.775620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:11.926618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:11.938847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6e4bdd7-e396-43a5-bfb7-e7e4a34eb0cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1672 microversion: 2.1 time: 0.177317 Oct 25 03:57:11.939622 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3595/7306] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:11 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:11.967534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:11.968145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:11.975200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:11.975614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:11.976111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:11.976844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:11.977297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:11.977750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:12.116361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:12.124349 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1c85846-014b-45df-9f1c-ebe3f14875ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1672 microversion: 2.1 time: 0.160809 Oct 25 03:57:12.125727 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3712/7307] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:11 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:12.149991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:12.150498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:12.156532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:12.157154 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:12.157605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:12.158349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:12.158795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:12.159230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:12.184120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:57:12.208973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:57:12.259575 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-41ffa31a-cc67-4ca8-b9af-e2a70d332f5b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 204 len: 0 microversion: 2.1 time: 0.113197 Oct 25 03:57:12.260082 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3596/7308] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:57:12 2022] DELETE /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:57:12.269167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:12.269823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:12.275798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:12.276285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:12.276727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:12.277422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:12.277931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:12.278366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:12.415512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:12.423883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-02263e1a-882d-4dbe-8c9f-db9aa6d92d68 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1678 microversion: 2.1 time: 0.159269 Oct 25 03:57:12.424467 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3713/7309] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:12 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:13.050633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1ff456db-61fb-4553-ad32-4becb88732b0 req-1be74bd0-e383-45a1-8ef1-08cb0de85ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9437afdd-eedf-484e-9f1c-fc6499a85f70", "name": "network-vif-plugged", "status": "completed", "tag": "668f7b1f-c4c7-45a8-b101-bb074b48fd9d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:13.066706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1ff456db-61fb-4553-ad32-4becb88732b0 req-1be74bd0-e383-45a1-8ef1-08cb0de85ed0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:13.066808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1ff456db-61fb-4553-ad32-4becb88732b0 req-1be74bd0-e383-45a1-8ef1-08cb0de85ed0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:13.067230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1ff456db-61fb-4553-ad32-4becb88732b0 req-1be74bd0-e383-45a1-8ef1-08cb0de85ed0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:13.079530 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1ff456db-61fb-4553-ad32-4becb88732b0 req-1be74bd0-e383-45a1-8ef1-08cb0de85ed0 service nova] Creating event network-vif-plugged:668f7b1f-c4c7-45a8-b101-bb074b48fd9d for instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 on n-h1-862355-1 Oct 25 03:57:13.084772 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1ff456db-61fb-4553-ad32-4becb88732b0 req-1be74bd0-e383-45a1-8ef1-08cb0de85ed0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038885 Oct 25 03:57:13.085384 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3597/7310] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:57:13.448206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:13.448739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:13.456223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:13.456706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:13.457142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:13.457868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:13.458330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:13.458754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:13.585799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:13.589371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:57:13.594927 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-de41b986-cf05-40bc-8893-020b34ddb411 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1678 microversion: 2.1 time: 0.150689 Oct 25 03:57:13.595501 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3714/7311] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:13 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:14.621000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:14.621615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:14.628011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:14.628524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:14.628964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:14.629689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:14.630169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:14.630599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:14.751747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:14.759600 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6f52c678-1c88-4dc2-9932-441eb45be614 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 200 len: 1610 microversion: 2.1 time: 0.143923 Oct 25 03:57:14.760189 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3598/7312] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:14 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 1610 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:14.870041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-fa7175ab-0082-4791-808b-c787affc0321 req-991febd0-a461-4e0e-a172-bc0f512b8450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9437afdd-eedf-484e-9f1c-fc6499a85f70", "name": "network-vif-deleted", "tag": "668f7b1f-c4c7-45a8-b101-bb074b48fd9d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:14.881619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fa7175ab-0082-4791-808b-c787affc0321 req-991febd0-a461-4e0e-a172-bc0f512b8450 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:14.882106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fa7175ab-0082-4791-808b-c787affc0321 req-991febd0-a461-4e0e-a172-bc0f512b8450 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:14.882502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-fa7175ab-0082-4791-808b-c787affc0321 req-991febd0-a461-4e0e-a172-bc0f512b8450 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:14.896582 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-fa7175ab-0082-4791-808b-c787affc0321 req-991febd0-a461-4e0e-a172-bc0f512b8450 service nova] Creating event network-vif-deleted:668f7b1f-c4c7-45a8-b101-bb074b48fd9d for instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 on n-h1-862355-1 Oct 25 03:57:14.901921 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-fa7175ab-0082-4791-808b-c787affc0321 req-991febd0-a461-4e0e-a172-bc0f512b8450 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035960 Oct 25 03:57:14.902438 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3715/7313] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:57:15.784621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:15.785172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:15.792054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:15.792560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:15.793019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:15.793787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:15.794269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:15.794716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:15.808615 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 HTTP/1.1 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9437afdd-eedf-484e-9f1c-fc6499a85f70'} Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:57:15.810360 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8947c854-cb9b-4a7a-8306-00f138d52e39 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 404 len: 111 microversion: 2.1 time: 0.031679 Oct 25 03:57:15.816172 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3599/7314] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:15 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:57:15.829729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:15.830658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:15.837403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:15.837918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:15.838383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:15.839081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:15.839533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:15.839956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:15.858494 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 HTTP/1.1 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9437afdd-eedf-484e-9f1c-fc6499a85f70'} Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:57:15.860333 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-319d6fdf-7d8d-4d8d-8839-88bf3f274573 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 404 len: 111 microversion: 2.1 time: 0.038069 Oct 25 03:57:15.870136 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3716/7315] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:15 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:57:15.912739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-501935562", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "69c785b0-6a4b-4eeb-b425-f9fa4134c01b"}], "security_groups": [{"name": "tempest-securitygroup--1576704750"}], "key_name": "tempest-keypair-1080434280", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:16.018790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] validate_networks() for [('69c785b0-6a4b-4eeb-b425-f9fa4134c01b', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:57:16.396743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:57:16.397358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:57:16.397978 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:57:16.398447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:57:16.398976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:57:16.408498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:16.408988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:16.409431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:16.410204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:16.410669 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:16.411287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:16.427817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:57:16.433061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for user 93ac3b8248b342079ead4a7aedce89ea and project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:57:16.446188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:57:16.448486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:57:16.496122 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a1fff16-4dbd-46b1-aa41-c97e26e08c34 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.587323 Oct 25 03:57:16.496993 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3600/7316] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:57:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:57:16.510052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4b62536-d0e7-423b-95d0-196f69975348 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:16.510672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b4b62536-d0e7-423b-95d0-196f69975348 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:16.583723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4b62536-d0e7-423b-95d0-196f69975348 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:16.591822 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b4b62536-d0e7-423b-95d0-196f69975348 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1238 microversion: 2.1 time: 0.086201 Oct 25 03:57:16.592392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3717/7317] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:16 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:17.616236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:17.617021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:17.625390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:17.627001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:17.627237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:17.628041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:17.628604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:17.629113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:17.694680 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:17.702588 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d385cc27-618d-4eeb-a21c-af5b331e97a4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1308 microversion: 2.1 time: 0.090384 Oct 25 03:57:17.703160 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3601/7318] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:17 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:18.728048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:18.728671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:18.736282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:18.736776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:18.737218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:18.737952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:18.738415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:18.738844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:18.932680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:18.941316 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33fc5cbc-9dc6-4376-8d2c-72d606af8e6e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1364 microversion: 2.1 time: 0.217422 Oct 25 03:57:18.941920 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3718/7319] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:18 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:19.017264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-92f3ad65-c156-470f-91aa-919c80d42bf1 req-7e0fa8ee-c4d9-4fab-89d6-2ce000e61b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a9fc46-8869-4dc9-861c-a76e3803bd08", "tag": "d72c6014-cf0c-4c5a-ad73-01ca09fd867d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:19.028623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-92f3ad65-c156-470f-91aa-919c80d42bf1 req-7e0fa8ee-c4d9-4fab-89d6-2ce000e61b36 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:19.029222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-92f3ad65-c156-470f-91aa-919c80d42bf1 req-7e0fa8ee-c4d9-4fab-89d6-2ce000e61b36 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:19.029759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-92f3ad65-c156-470f-91aa-919c80d42bf1 req-7e0fa8ee-c4d9-4fab-89d6-2ce000e61b36 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:19.042290 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-92f3ad65-c156-470f-91aa-919c80d42bf1 req-7e0fa8ee-c4d9-4fab-89d6-2ce000e61b36 service nova] Creating event network-changed:d72c6014-cf0c-4c5a-ad73-01ca09fd867d for instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 on n-h2-862355-1 Oct 25 03:57:19.047231 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-92f3ad65-c156-470f-91aa-919c80d42bf1 req-7e0fa8ee-c4d9-4fab-89d6-2ce000e61b36 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034942 Oct 25 03:57:19.048440 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3602/7320] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:57:19.965812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:19.966467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:19.973476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:19.973999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:19.974452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:19.975143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:19.975604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:19.976035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:20.104946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:20.112895 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6298e087-ffa2-4c35-9a66-73faa9995e87 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1364 microversion: 2.1 time: 0.151019 Oct 25 03:57:20.113478 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3719/7321] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:19 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:21.137983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:21.138702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:21.140640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:57:21.148109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:21.148599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:21.149048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:21.149781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:21.150248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:21.150682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:21.289169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:21.296957 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-74ee2350-6b0e-46f5-988f-0f041d7d8f00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1364 microversion: 2.1 time: 0.164237 Oct 25 03:57:21.298124 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3603/7322] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:21 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:22.320446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:22.321091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:22.323945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=49 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:57:22.329483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:22.330270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:22.330778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:22.331467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:22.331918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:22.332338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:22.465468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:22.474180 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-35e418f3-4484-4819-8def-21b112e24ab2 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1364 microversion: 2.1 time: 0.157683 Oct 25 03:57:22.474743 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3720/7323] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:22 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:23.498310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:23.498942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:23.506009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:23.506716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:23.506956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:23.507667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:23.508144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:23.508587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:23.637967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:23.646327 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-44e6da83-5dbd-4744-bba2-40f121516ac3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1364 microversion: 2.1 time: 0.151869 Oct 25 03:57:23.646943 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3604/7324] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:23 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:57:24.670336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:24.670945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:24.678254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:24.678732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:24.679161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:24.679840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:24.680291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:24.680711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:24.812132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:24.820755 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ae1dee23-f327-453a-b1a7-47f58db7cc05 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1364 microversion: 2.1 time: 0.154326 Oct 25 03:57:24.821335 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3721/7325] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:24 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:25.515671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-6243d08c-f5df-4f27-b9d5-3e02fb942010 req-e8f82f24-23bd-4a65-85b5-cd2cb25570c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a9fc46-8869-4dc9-861c-a76e3803bd08", "name": "network-vif-plugged", "status": "completed", "tag": "d72c6014-cf0c-4c5a-ad73-01ca09fd867d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:25.527049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6243d08c-f5df-4f27-b9d5-3e02fb942010 req-e8f82f24-23bd-4a65-85b5-cd2cb25570c6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:25.527558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6243d08c-f5df-4f27-b9d5-3e02fb942010 req-e8f82f24-23bd-4a65-85b5-cd2cb25570c6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:25.528038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6243d08c-f5df-4f27-b9d5-3e02fb942010 req-e8f82f24-23bd-4a65-85b5-cd2cb25570c6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:25.540592 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-6243d08c-f5df-4f27-b9d5-3e02fb942010 req-e8f82f24-23bd-4a65-85b5-cd2cb25570c6 service nova] Creating event network-vif-plugged:d72c6014-cf0c-4c5a-ad73-01ca09fd867d for instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 on n-h2-862355-1 Oct 25 03:57:25.545589 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-6243d08c-f5df-4f27-b9d5-3e02fb942010 req-e8f82f24-23bd-4a65-85b5-cd2cb25570c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Oct 25 03:57:25.546254 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3605/7326] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:57:25.845961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:25.846584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:25.853444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:25.853955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:25.854394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:25.855081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:25.855536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:25.855968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:25.995444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:26.003516 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4cf34591-c9a5-4235-a9be-2484f39c6044 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1364 microversion: 2.1 time: 0.162163 Oct 25 03:57:26.004111 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3722/7327] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:25 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:27.024937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:57:27.025775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:57:27.032902 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:27.033633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:27.040568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:27.041063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:27.041517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:27.042261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:27.042724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:27.043162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:27.179606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:57:27.187667 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6dcef31-ef5f-46f1-9ee8-9f99e882c21b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1551 microversion: 2.1 time: 0.163715 Oct 25 03:57:27.188926 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3606/7328] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:57:27 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:57:27.211208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:57:27.211680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:57:27.213482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:57:27.220581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:27.221080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:27.221542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:27.222220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:27.222701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:27.223128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:27.301713 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65155a8d-cd8b-4ccd-a813-0939f9f917ad tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093837 Oct 25 03:57:27.302497 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3723/7329] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:57:27 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:57:28.250055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-682500b2-d66f-43ba-bb9b-5791af59d944 req-9c4c2442-9520-4185-86a8-90758bec135e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a9fc46-8869-4dc9-861c-a76e3803bd08", "tag": "d72c6014-cf0c-4c5a-ad73-01ca09fd867d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:57:28.259847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-682500b2-d66f-43ba-bb9b-5791af59d944 req-9c4c2442-9520-4185-86a8-90758bec135e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:57:28.260345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-682500b2-d66f-43ba-bb9b-5791af59d944 req-9c4c2442-9520-4185-86a8-90758bec135e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:57:28.260785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-682500b2-d66f-43ba-bb9b-5791af59d944 req-9c4c2442-9520-4185-86a8-90758bec135e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:57:28.272456 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-682500b2-d66f-43ba-bb9b-5791af59d944 req-9c4c2442-9520-4185-86a8-90758bec135e service nova] Creating event network-changed:d72c6014-cf0c-4c5a-ad73-01ca09fd867d for instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 on n-h2-862355-1 Oct 25 03:57:28.277369 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-682500b2-d66f-43ba-bb9b-5791af59d944 req-9c4c2442-9520-4185-86a8-90758bec135e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031122 Oct 25 03:57:28.278021 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3607/7330] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:58:32.003681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=7 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:58:32.004639 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=38 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:58:32.005897 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 03:58:32.006051 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 03:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action (ip 10.222.0.36) !!! Oct 25 03:58:32.013057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-be353629-bfe1-44fe-858d-f718b23b90cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:32.020058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be353629-bfe1-44fe-858d-f718b23b90cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:32.020542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be353629-bfe1-44fe-858d-f718b23b90cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:32.020981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-be353629-bfe1-44fe-858d-f718b23b90cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:32.043944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-be353629-bfe1-44fe-858d-f718b23b90cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Going to try to stop instance {{(pid=120562) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 03:58:32.084976 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-be353629-bfe1-44fe-858d-f718b23b90cc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action" status: 202 len: 0 microversion: 2.1 time: 0.083653 Oct 25 03:58:32.085587 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3724/7331] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:58:31 2022] POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:58:32.092973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=9 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:58:32.093891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:58:32.094958 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 03:58:32.095226 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 03:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 (ip 10.222.0.36) !!! Oct 25 03:58:32.102968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:32.103740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:32.112171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:32.112673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:32.113132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:32.114728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:32.115216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:32.115670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:32.325026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:32.333050 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9d961d08-5c11-4dc6-9823-b9871df02f7a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.242832 Oct 25 03:58:32.333635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3608/7332] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:32 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:33.358007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:33.358632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:33.365058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:33.365547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:33.366014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:33.366715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:33.367170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:33.367602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:33.536746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:33.544540 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6c12cbc3-0189-4a3e-9b4f-e30666a8f0ef tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.191803 Oct 25 03:58:33.545113 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3725/7333] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:33 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:34.569890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:34.570521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:34.577349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:34.577879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:34.578360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:34.579068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:34.579541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:34.579981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:34.709270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:34.717140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d3d67a04-99a8-4ee4-88b0-147f94abf828 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.151181 Oct 25 03:58:34.717750 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3609/7334] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:34 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:35.741492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:35.742138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:35.748912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:35.749387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:35.749848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:35.750531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:35.750983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:35.751405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:35.966114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:35.974048 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fe656c5c-e08f-4d1a-91a4-daebef59b317 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.236962 Oct 25 03:58:35.974627 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3726/7335] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:35 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:36.997658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:36.998323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:37.005583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:37.006135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:37.006597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:37.007320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:37.007796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:37.008248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:37.221140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:37.229750 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce6ba6c4-271c-4b1d-a67e-51834c9a682b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.236037 Oct 25 03:58:37.230327 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3610/7336] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:36 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:58:38.253606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:38.254256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:38.261116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:38.261600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:38.262136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:38.262871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:38.263285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:38.263712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:38.393023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:38.401547 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab88c3cc-de8f-4e25-87e3-bde72c6358ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.151807 Oct 25 03:58:38.402176 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3727/7337] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:38 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:39.425700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:39.426293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:39.433864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:39.434357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:39.434806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:39.435507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:39.435977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:39.436419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:39.568751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:39.576883 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0b7185e-e6e7-4391-bcf9-1b73540f8183 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.155152 Oct 25 03:58:39.577481 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3611/7338] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:39 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:40.601564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:40.602177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:40.608706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:40.609193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:40.609632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:40.610351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:40.610810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:40.611244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:40.743675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:40.751354 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e31c4e1-970f-479c-8914-ea168409fec6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.154449 Oct 25 03:58:40.751934 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3728/7339] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:40 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:41.775190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:41.775813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:41.782693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:41.783182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:41.783630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:41.784327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:41.784793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:41.785229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:41.919494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:41.927258 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-91490676-ba4c-4149-93c5-2079b2488895 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.156124 Oct 25 03:58:41.927843 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3612/7340] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:41 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:42.950621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:42.951246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:42.958250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:42.958731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:42.959167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:42.959922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:42.960375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:42.960802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:43.358792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:43.366457 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7eafcf4-a4c5-4bcf-8687-1eb33bfe8a71 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1657 microversion: 2.1 time: 0.419743 Oct 25 03:58:43.367035 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3729/7341] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:42 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1657 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:43.390390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:43.392627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:43.400767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:43.401260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:43.401741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:43.402442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:43.402910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:43.403379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:43.433514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:43.439243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Old instance type m1.heat2, new instance type m1.heat {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 03:58:43.446202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:58:43.446666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:58:43.447151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:58:43.447569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:58:43.447991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:58:43.512164 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-59001c58-9085-49c7-b051-05425d8aa2e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action" status: 202 len: 0 microversion: 2.1 time: 0.125637 Oct 25 03:58:43.512794 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3613/7342] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:58:43 2022] POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:58:43.520896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:43.521504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:43.528774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:43.529261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:43.529722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:43.530419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:43.530872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:43.531301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:43.699490 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:43.707230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-444da146-e17e-4d46-802b-266c2377195f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.190170 Oct 25 03:58:43.708092 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3730/7343] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:43 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:58:44.732892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:44.733563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:44.741961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:44.742555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:44.743087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:44.743885 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:44.744582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:44.745217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:44.876363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:44.884177 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ee045e3-6708-4ae6-b3c1-e7426a682732 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1680 microversion: 2.1 time: 0.156444 Oct 25 03:58:44.884753 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3614/7344] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:44 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:45.908439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:45.909054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:45.915978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:45.916463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:45.916900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:45.917587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:45.918073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:45.918555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:46.056893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:46.064857 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fed71b01-7c68-4fe8-904b-62f4bdc7c63c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1685 microversion: 2.1 time: 0.160394 Oct 25 03:58:46.065424 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3731/7345] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:45 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:47.089108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:47.089761 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:47.096610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:47.097105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:47.097561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:47.098311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:47.098781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:47.099219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:47.230414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:47.238142 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dd5e924e-cb79-4376-8957-2fb2c122c802 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1685 microversion: 2.1 time: 0.152920 Oct 25 03:58:47.238708 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3615/7346] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:47 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:47.849877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-b93e9199-31d5-4cff-91a1-10413715fb4f req-b55a573d-d2ab-4478-a216-f1f54c0f8e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a9fc46-8869-4dc9-861c-a76e3803bd08", "name": "network-vif-unplugged", "status": "completed", "tag": "d72c6014-cf0c-4c5a-ad73-01ca09fd867d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:47.861013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b93e9199-31d5-4cff-91a1-10413715fb4f req-b55a573d-d2ab-4478-a216-f1f54c0f8e58 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:47.861502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b93e9199-31d5-4cff-91a1-10413715fb4f req-b55a573d-d2ab-4478-a216-f1f54c0f8e58 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:47.861968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-b93e9199-31d5-4cff-91a1-10413715fb4f req-b55a573d-d2ab-4478-a216-f1f54c0f8e58 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:47.873882 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-b93e9199-31d5-4cff-91a1-10413715fb4f req-b55a573d-d2ab-4478-a216-f1f54c0f8e58 service nova] Creating event network-vif-unplugged:d72c6014-cf0c-4c5a-ad73-01ca09fd867d for instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 on n-h1-862355-1 Oct 25 03:58:47.879271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-b93e9199-31d5-4cff-91a1-10413715fb4f req-b55a573d-d2ab-4478-a216-f1f54c0f8e58 service nova] Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:58:47.891231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-b93e9199-31d5-4cff-91a1-10413715fb4f req-b55a573d-d2ab-4478-a216-f1f54c0f8e58 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044993 Oct 25 03:58:47.891877 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3732/7347] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:58:48.262814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:48.263353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:48.270337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:48.270843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:48.271296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:48.272012 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:48.273316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:48.273936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:48.433188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:48.441270 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3f6baf8f-54da-4edf-bbdf-9070ace89259 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1684 microversion: 2.1 time: 0.182573 Oct 25 03:58:48.442037 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3616/7348] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:48 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:49.467448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:49.468159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:49.474423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:49.474908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:49.475435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:49.476083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:49.476532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:49.476959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:49.612290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:49.621810 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b59840db-578c-419b-9884-778908157cd0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1682 microversion: 2.1 time: 0.159250 Oct 25 03:58:49.622387 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3733/7349] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:49 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:58:49.929120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-cafa18ca-a776-4787-9c22-e3f27c7892db req-a6bb6769-0c81-4991-ad9e-c56bb7fa34d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a9fc46-8869-4dc9-861c-a76e3803bd08", "tag": "d72c6014-cf0c-4c5a-ad73-01ca09fd867d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:49.939697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cafa18ca-a776-4787-9c22-e3f27c7892db req-a6bb6769-0c81-4991-ad9e-c56bb7fa34d7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:49.940191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cafa18ca-a776-4787-9c22-e3f27c7892db req-a6bb6769-0c81-4991-ad9e-c56bb7fa34d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:49.940642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cafa18ca-a776-4787-9c22-e3f27c7892db req-a6bb6769-0c81-4991-ad9e-c56bb7fa34d7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:49.952777 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-cafa18ca-a776-4787-9c22-e3f27c7892db req-a6bb6769-0c81-4991-ad9e-c56bb7fa34d7 service nova] Creating event network-changed:d72c6014-cf0c-4c5a-ad73-01ca09fd867d for instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 on n-h1-862355-1 Oct 25 03:58:49.958102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-cafa18ca-a776-4787-9c22-e3f27c7892db req-a6bb6769-0c81-4991-ad9e-c56bb7fa34d7 service nova] Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 03:58:49.969381 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-cafa18ca-a776-4787-9c22-e3f27c7892db req-a6bb6769-0c81-4991-ad9e-c56bb7fa34d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044584 Oct 25 03:58:49.970017 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3617/7350] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:58:50.645609 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:50.646289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:50.653108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:50.653596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:50.654076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:50.654782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:50.655242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:50.655670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:50.792365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:50.800298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6d5a648c-983e-4591-a715-080897e055e0 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1678 microversion: 2.1 time: 0.158694 Oct 25 03:58:50.800893 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3734/7351] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:50 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:58:50.825328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:50.826127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:50.832600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:50.833226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:50.833794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:50.834673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:50.835337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:50.835855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:50.897311 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c68b077f-1b78-45b3-9333-25e00cd22fc7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action" status: 204 len: 0 microversion: 2.1 time: 0.076104 Oct 25 03:58:50.898090 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3618/7352] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:58:50 2022] POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:58:50.913976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:50.914968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:50.923082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:50.924101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:50.924558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:50.925275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:50.925756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:50.926182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:51.153647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:51.162838 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e22c3fb1-234e-497c-b51a-429aaebf310f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1678 microversion: 2.1 time: 0.260249 Oct 25 03:58:51.163444 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3735/7353] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:50 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:58:52.188372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:52.189082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:52.195333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:52.195862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:52.196305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:52.197007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:52.197475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:52.197937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:52.333586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:52.342426 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7b12cf18-e1b0-4f2b-ba1d-cdb1ac8f935c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1657 microversion: 2.1 time: 0.159325 Oct 25 03:58:52.343001 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3619/7354] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:52 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:52.365572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:52.366717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:52.373466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:52.373987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:52.374421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:52.375107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:52.375563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:52.375983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:52.510010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:52.517767 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0fb1ae7f-a416-4965-b7f0-d0ac542b4121 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1657 microversion: 2.1 time: 0.156089 Oct 25 03:58:52.518343 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3736/7355] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:52 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:52.541570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5e632e1f-e669-4c8e-9b38-7215f26fa2c3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:52.547587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e632e1f-e669-4c8e-9b38-7215f26fa2c3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:52.548083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e632e1f-e669-4c8e-9b38-7215f26fa2c3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:52.548532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5e632e1f-e669-4c8e-9b38-7215f26fa2c3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:52.571190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5e632e1f-e669-4c8e-9b38-7215f26fa2c3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Going to try to start instance {{(pid=120563) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 25 03:58:52.612536 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5e632e1f-e669-4c8e-9b38-7215f26fa2c3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action" status: 202 len: 0 microversion: 2.1 time: 0.075284 Oct 25 03:58:52.613141 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3620/7356] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 03:58:52 2022] POST /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 03:58:52.621992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:52.622540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:52.628705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:52.629201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:52.629642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:52.632125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:52.632783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:52.633126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:52.768320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:52.777561 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f23ef29-43ae-4028-8388-5bb6e149a837 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1666 microversion: 2.1 time: 0.159543 Oct 25 03:58:52.778191 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3737/7357] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:52 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:53.591745 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-92bc9a50-5dfe-4b7e-ae05-c0db819fa71c req-f9a0e75a-55e8-48a6-9e1d-cf89e183f018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a9fc46-8869-4dc9-861c-a76e3803bd08", "name": "network-vif-plugged", "status": "completed", "tag": "d72c6014-cf0c-4c5a-ad73-01ca09fd867d"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:53.602146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-92bc9a50-5dfe-4b7e-ae05-c0db819fa71c req-f9a0e75a-55e8-48a6-9e1d-cf89e183f018 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:53.602644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-92bc9a50-5dfe-4b7e-ae05-c0db819fa71c req-f9a0e75a-55e8-48a6-9e1d-cf89e183f018 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:53.603099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-92bc9a50-5dfe-4b7e-ae05-c0db819fa71c req-f9a0e75a-55e8-48a6-9e1d-cf89e183f018 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:53.614888 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-92bc9a50-5dfe-4b7e-ae05-c0db819fa71c req-f9a0e75a-55e8-48a6-9e1d-cf89e183f018 service nova] Creating event network-vif-plugged:d72c6014-cf0c-4c5a-ad73-01ca09fd867d for instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 on n-h1-862355-1 Oct 25 03:58:53.621474 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-92bc9a50-5dfe-4b7e-ae05-c0db819fa71c req-f9a0e75a-55e8-48a6-9e1d-cf89e183f018 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137670 Oct 25 03:58:53.622287 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3621/7358] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:58:53.801903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:53.802435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:53.809339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:53.809862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:53.810303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:53.810993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:53.811447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:53.811873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:53.940843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:53.948888 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9e551bae-4592-4537-9065-33b4672adfd8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1670 microversion: 2.1 time: 0.151114 Oct 25 03:58:53.949462 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3738/7359] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:53 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:53.972688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:53.973328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:53.980169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:53.980670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:53.981120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:53.981861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:53.982358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:53.982801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:53.985401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:58:54.009643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 03:58:54.089890 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fa648048-7a2a-4b77-9400-faf376552457 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 204 len: 0 microversion: 2.1 time: 0.121168 Oct 25 03:58:54.090975 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3622/7360] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 03:58:53 2022] DELETE /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 03:58:54.100496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:54.101279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:54.107913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:54.108484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:54.109190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:54.110212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:54.110906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:54.111528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:54.241563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:54.245165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:58:54.250200 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e39d7b67-4aee-47bf-adc9-16990b03ee8d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1676 microversion: 2.1 time: 0.154411 Oct 25 03:58:54.250778 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3739/7361] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:54 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:55.274495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:55.275218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:55.282032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:55.282537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:55.282995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:55.283702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:55.284176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:55.284620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:55.422811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:55.431126 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-17779444-4e54-45cd-9b16-d3ef03fc2625 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1676 microversion: 2.1 time: 0.161116 Oct 25 03:58:55.431697 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3623/7362] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:55 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:56.448198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d7917e83-ed00-40e0-8c98-298290b5de0a req-5802cb8b-72c2-44dc-bfbb-f869e26e1d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a9fc46-8869-4dc9-861c-a76e3803bd08", "name": "network-vif-deleted", "tag": "d72c6014-cf0c-4c5a-ad73-01ca09fd867d"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:56.455544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:56.458391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d7917e83-ed00-40e0-8c98-298290b5de0a req-5802cb8b-72c2-44dc-bfbb-f869e26e1d19 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:56.458888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d7917e83-ed00-40e0-8c98-298290b5de0a req-5802cb8b-72c2-44dc-bfbb-f869e26e1d19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:56.459327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d7917e83-ed00-40e0-8c98-298290b5de0a req-5802cb8b-72c2-44dc-bfbb-f869e26e1d19 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:56.465774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:56.472227 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d7917e83-ed00-40e0-8c98-298290b5de0a req-5802cb8b-72c2-44dc-bfbb-f869e26e1d19 service nova] Creating event network-vif-deleted:d72c6014-cf0c-4c5a-ad73-01ca09fd867d for instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 on n-h1-862355-1 Oct 25 03:58:56.477155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:56.478084 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d7917e83-ed00-40e0-8c98-298290b5de0a req-5802cb8b-72c2-44dc-bfbb-f869e26e1d19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090435 Oct 25 03:58:56.478696 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3740/7363] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:58:56.479175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:56.482089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:56.483754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:56.484326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:56.484824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:56.527640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:56.528059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:56.528516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:56.528982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lazy-loading 'fault' on Instance uuid 37a9fc46-8869-4dc9-861c-a76e3803bd08 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 03:58:56.580227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:56.589124 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee31f884-17ab-4d6a-b8e5-5029799f7199 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 200 len: 1328 microversion: 2.1 time: 0.137572 Oct 25 03:58:56.589806 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3624/7364] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:56 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 1328 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 03:58:57.614549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:57.615181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:57.621982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:57.622472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:57.622914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:57.623605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:57.624063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:57.624500 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:57.638294 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 HTTP/1.1 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '37a9fc46-8869-4dc9-861c-a76e3803bd08'} Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:58:57.639961 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-679032c0-48c4-4ae2-bc0b-fd4ffb6ecbcf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 404 len: 111 microversion: 2.1 time: 0.032055 Oct 25 03:58:57.644650 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3741/7365] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:57 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:58:57.655249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:57.655873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:57.662757 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:57.663802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:57.664284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:57.664980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:57.665485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:57.665952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:57.680081 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 HTTP/1.1 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '37a9fc46-8869-4dc9-861c-a76e3803bd08'} Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 03:58:57.681768 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-697525bd-5f0b-45a2-bbd7-100a974c6e08 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 404 len: 111 microversion: 2.1 time: 0.031898 Oct 25 03:58:57.686271 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3625/7366] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:57 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 03:58:57.733159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1695754527", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "69c785b0-6a4b-4eeb-b425-f9fa4134c01b"}], "security_groups": [{"name": "tempest-securitygroup--1576704750"}], "key_name": "tempest-keypair-1080434280", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:58:57.841061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] validate_networks() for [('69c785b0-6a4b-4eeb-b425-f9fa4134c01b', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 03:58:58.310050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 03:58:58.310480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 03:58:58.310959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 03:58:58.311373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 03:58:58.311786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 03:58:58.321547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:58.322067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:58.322509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:58.323235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:58.323691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:58.324120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:58.340864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 03:58:58.346186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for user 93ac3b8248b342079ead4a7aedce89ea and project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 03:58:58.359079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 03:58:58.361356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 03:58:58.408990 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-71685942-a7d5-4405-aaed-0c49a8482833 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.679655 Oct 25 03:58:58.409648 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3742/7367] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 03:58:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 03:58:58.421717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4cb2701-460a-4790-9b4e-c649b378b2af tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:58.422345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4cb2701-460a-4790-9b4e-c649b378b2af tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:58.482655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4cb2701-460a-4790-9b4e-c649b378b2af tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:58.490175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4cb2701-460a-4790-9b4e-c649b378b2af tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1239 microversion: 2.1 time: 0.072521 Oct 25 03:58:58.491275 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3626/7368] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:58 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:58:59.518071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:58:59.518785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:58:59.526733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:59.527803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:59.528321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:59.529431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:58:59.530108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:58:59.530756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:58:59.611264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:58:59.620279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7dbd1b94-3216-4982-bf8e-e122c3ada752 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1297 microversion: 2.1 time: 0.107477 Oct 25 03:58:59.620860 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3743/7369] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:58:59 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:00.644693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:00.645324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:00.653797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:00.654310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:00.654770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:00.655488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:00.655966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:00.656413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:00.791406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:59:00.799734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cfb2b93d-ad5b-414e-b19b-8a276685ce7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1365 microversion: 2.1 time: 0.158952 Oct 25 03:59:00.811844 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3627/7370] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:59:00 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:00.835341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-6483e641-0a0c-411b-b93b-e543bd6e6bbc req-0cef7063-a31e-410f-ae85-5a296de881e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:59:00.848351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6483e641-0a0c-411b-b93b-e543bd6e6bbc req-0cef7063-a31e-410f-ae85-5a296de881e6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:00.848948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6483e641-0a0c-411b-b93b-e543bd6e6bbc req-0cef7063-a31e-410f-ae85-5a296de881e6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:00.849481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-6483e641-0a0c-411b-b93b-e543bd6e6bbc req-0cef7063-a31e-410f-ae85-5a296de881e6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:00.864831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-6483e641-0a0c-411b-b93b-e543bd6e6bbc req-0cef7063-a31e-410f-ae85-5a296de881e6 service nova] Creating event network-changed:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h2-862355-1 Oct 25 03:59:00.870208 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-6483e641-0a0c-411b-b93b-e543bd6e6bbc req-0cef7063-a31e-410f-ae85-5a296de881e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039429 Oct 25 03:59:00.871262 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3744/7371] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:59:01.825808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:01.826556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:01.833479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:01.834020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:01.834485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:01.835200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:01.835674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:01.836121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:01.969410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:59:01.978173 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-92f82020-3207-4683-9cd8-6458260f4dd9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1365 microversion: 2.1 time: 0.156337 Oct 25 03:59:01.978752 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3628/7372] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:59:01 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:03.002369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:03.003069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:03.005523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:59:03.012466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:03.012959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:03.013783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:03.014118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:03.014607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:03.015077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:03.145095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:59:03.153488 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-03bcb9dc-2102-4ea8-9c5b-8a5cb9ec236e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1365 microversion: 2.1 time: 0.155581 Oct 25 03:59:03.154108 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3745/7373] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:59:02 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:04.177258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:04.177911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:04.181421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:59:04.186706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:04.187459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:04.187912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:04.188659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:04.189132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:04.189569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:04.320196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:59:04.328249 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bbeb8fc8-3c52-4802-83bc-fea8203c20fa tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1365 microversion: 2.1 time: 0.154956 Oct 25 03:59:04.328827 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3629/7374] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:59:04 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:05.351378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:05.351996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:05.358905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:05.359390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:05.359830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:05.360529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:05.360988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:05.361416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:05.496778 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:59:05.504502 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b4f76fc9-8bc1-4b66-add1-08b84e38bfbd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1365 microversion: 2.1 time: 0.157629 Oct 25 03:59:05.505098 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3746/7375] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:59:05 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:06.157228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-3ffba9a1-34cc-4299-b383-bf9a0c01b299 req-0a126348-ebe2-461f-a9da-21d33fea0eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "name": "network-vif-plugged", "status": "completed", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:59:06.167031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3ffba9a1-34cc-4299-b383-bf9a0c01b299 req-0a126348-ebe2-461f-a9da-21d33fea0eaa service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:06.167531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3ffba9a1-34cc-4299-b383-bf9a0c01b299 req-0a126348-ebe2-461f-a9da-21d33fea0eaa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:06.167984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-3ffba9a1-34cc-4299-b383-bf9a0c01b299 req-0a126348-ebe2-461f-a9da-21d33fea0eaa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:06.178977 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-3ffba9a1-34cc-4299-b383-bf9a0c01b299 req-0a126348-ebe2-461f-a9da-21d33fea0eaa service nova] Creating event network-vif-plugged:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h2-862355-1 Oct 25 03:59:06.183983 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-3ffba9a1-34cc-4299-b383-bf9a0c01b299 req-0a126348-ebe2-461f-a9da-21d33fea0eaa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082299 Oct 25 03:59:06.184580 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3630/7376] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 03:59:06.529149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:06.529818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:06.536624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:06.537106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:06.538441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:06.539318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:06.539964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:06.540447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:06.672309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:59:06.680769 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad73bf1b-0166-4633-a4a6-7d6ace53d6c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1365 microversion: 2.1 time: 0.155503 Oct 25 03:59:06.681348 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3747/7377] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:59:06 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:07.706487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:07.707216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:07.714094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:07.714603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:07.715092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:07.716263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:07.717045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:07.717570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:07.861182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 03:59:07.869097 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c9fa307-bfe6-4977-8070-6d789f1def94 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1552 microversion: 2.1 time: 0.168419 Oct 25 03:59:07.869709 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3631/7378] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 03:59:07 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 03:59:07.893019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 03:59:07.893530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 03:59:07.901360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:07.901885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:07.902327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:07.903024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:07.903484 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:07.903915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:07.984616 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0527eea2-679d-43be-a6dc-b2af1696f345 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095473 Oct 25 03:59:07.985301 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3748/7379] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 03:59:07 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 03:59:09.202376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a1c21969-4675-456b-b700-e4067e3a0bb4 req-62adcbf1-5e32-4993-941f-5e1cc01befaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 03:59:09.207250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 03:59:09.214105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a1c21969-4675-456b-b700-e4067e3a0bb4 req-62adcbf1-5e32-4993-941f-5e1cc01befaa service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 03:59:09.214601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a1c21969-4675-456b-b700-e4067e3a0bb4 req-62adcbf1-5e32-4993-941f-5e1cc01befaa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 03:59:09.215060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a1c21969-4675-456b-b700-e4067e3a0bb4 req-62adcbf1-5e32-4993-941f-5e1cc01befaa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 03:59:09.226644 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a1c21969-4675-456b-b700-e4067e3a0bb4 req-62adcbf1-5e32-4993-941f-5e1cc01befaa service nova] Creating event network-changed:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h2-862355-1 Oct 25 03:59:09.231815 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a1c21969-4675-456b-b700-e4067e3a0bb4 req-62adcbf1-5e32-4993-941f-5e1cc01befaa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033097 Oct 25 03:59:09.232469 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3632/7380] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 03:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:00:21.551061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:21.551850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:21.555775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=7 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:21.556480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=36 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:21.564689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:21.566918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:21.574990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:21.575477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:21.575909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:21.576593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:21.577044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:21.577498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:21.607046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:21.612488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Old instance type m1.heat2, new instance type m1.heat {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 04:00:21.619582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:00:21.620014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:00:21.620469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:00:21.620873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:00:21.621276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:00:21.685731 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b57da6d2-0cc8-4490-b782-13b5ab94ce4a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa/action" status: 202 len: 0 microversion: 2.1 time: 0.135284 Oct 25 04:00:21.686346 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3749/7381] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:00:21 2022] POST /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:00:21.694429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=7 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:21.695330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:21.701643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:21.702402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:21.710300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:21.710804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:21.711274 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:21.711983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:21.712457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:21.712900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:21.861551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:21.870269 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa6421db-5aff-4491-afa7-c644c9642400 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1680 microversion: 2.1 time: 0.179154 Oct 25 04:00:21.870944 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3633/7382] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:21 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:22.893139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:22.893779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:22.904676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:22.905165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:22.905597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:22.906311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:22.906764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:22.907192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:23.046097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:23.055023 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46601b73-0839-48c6-9892-9b4cd46f002f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1680 microversion: 2.1 time: 0.165767 Oct 25 04:00:23.055744 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3750/7383] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:22 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:24.080723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:24.081362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:24.088569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:24.089073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:24.089530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:24.090279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:24.090758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:24.091201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:24.227265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:24.235144 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-79485358-fc49-429b-92ed-33a8c5973f86 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.158589 Oct 25 04:00:24.235726 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3634/7384] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:24 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:25.259673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:25.260324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:25.267124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:25.267564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:25.267977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:25.268662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:25.269114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:25.269536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:25.400596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:25.408339 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-847dfc00-3d53-41d5-aeab-b8cc158d07ff tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.154145 Oct 25 04:00:25.408903 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3751/7385] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:25 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:26.434212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:26.434811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:26.441938 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:26.442437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:26.442918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:26.443779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:26.444251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:26.444693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:26.575169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:26.582897 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8c0ddeac-702a-4d16-a17c-ad69b2d3e8dd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.152801 Oct 25 04:00:26.583501 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3635/7386] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:26 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:27.607138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:27.607993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:27.617822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:27.618306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:27.618741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:27.619434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:27.619896 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:27.620322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:27.748673 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:27.757063 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8e2a045d-1d3b-484c-b3ec-bf21598ab803 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.153811 Oct 25 04:00:27.757648 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3752/7387] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:27 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:28.780566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:28.781190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:28.790403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:28.790900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:28.791351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:28.792063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:28.792530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:28.792969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:28.929016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:28.936697 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84800f3b-b2ec-4bc2-b4f8-d1ad3181d9d6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.160304 Oct 25 04:00:28.937585 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3636/7388] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:28 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:29.961594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:29.962239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:29.969029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:29.969510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:29.969976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:29.970666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:29.971122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:29.971547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:30.105390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:30.113233 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7be4bdea-cbc5-47f6-9db6-347c7b044d13 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.156156 Oct 25 04:00:30.113840 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3753/7389] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:29 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:31.136316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:31.136944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:31.146985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:31.147478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:31.147932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:31.148625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:31.149090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:31.149522 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:31.291881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:31.299620 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e07b76e7-f313-4230-9235-ec83c314b81e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.167189 Oct 25 04:00:31.300228 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3637/7390] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:31 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:32.377151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:32.377816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:32.384377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:32.384882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:32.385332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:32.386206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:32.386690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:32.387132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:32.519059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:32.527076 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c890f2df-6268-4e6f-976f-e4231fabc69e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.207376 Oct 25 04:00:32.527655 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3754/7391] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:32 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:33.553759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:33.554381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:33.561421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:33.562208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:33.562661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:33.563363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:33.563832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:33.564273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:33.695633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:33.703358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3773b058-462e-40fb-a67e-dc86e7ef5424 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.153658 Oct 25 04:00:33.703936 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3638/7392] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:33 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:34.727257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:34.727877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:34.736902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:34.737390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:34.737880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:34.738590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:34.739052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:34.740134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:34.878473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:34.886421 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d3990344-8db4-4165-b342-9e79d094448d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1685 microversion: 2.1 time: 0.163708 Oct 25 04:00:34.887000 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3755/7393] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:34 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:35.910631 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:35.911434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:35.918354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:35.918852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:35.919300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:35.920008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:35.920476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:35.920914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:36.132550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-231e1694-87b9-4cd5-b303-0782bacb2ab0 req-f0d59934-dd9a-43da-aaee-4b2232071c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "name": "network-vif-unplugged", "status": "completed", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:36.137849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:36.143880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-231e1694-87b9-4cd5-b303-0782bacb2ab0 req-f0d59934-dd9a-43da-aaee-4b2232071c64 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:36.144360 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-231e1694-87b9-4cd5-b303-0782bacb2ab0 req-f0d59934-dd9a-43da-aaee-4b2232071c64 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:36.144981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-231e1694-87b9-4cd5-b303-0782bacb2ab0 req-f0d59934-dd9a-43da-aaee-4b2232071c64 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:36.147032 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8310e0fc-6a14-4c71-8bdd-19ee4fec7d4c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1684 microversion: 2.1 time: 0.240332 Oct 25 04:00:36.147728 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3639/7394] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:35 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1684 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:36.163978 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-231e1694-87b9-4cd5-b303-0782bacb2ab0 req-f0d59934-dd9a-43da-aaee-4b2232071c64 service nova] Creating event network-vif-unplugged:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h1-862355-1 Oct 25 04:00:36.165560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-231e1694-87b9-4cd5-b303-0782bacb2ab0 req-f0d59934-dd9a-43da-aaee-4b2232071c64 service nova] Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:00:36.176531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-231e1694-87b9-4cd5-b303-0782bacb2ab0 req-f0d59934-dd9a-43da-aaee-4b2232071c64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048290 Oct 25 04:00:36.178518 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3756/7395] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:00:37.173187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:37.173872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:37.182366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:37.182876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:37.183328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:37.184040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:37.184512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:37.184955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:37.321903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:37.329736 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89fb52d6-48c5-4c44-a43c-ac7d7776e821 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1684 microversion: 2.1 time: 0.160801 Oct 25 04:00:37.330316 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3640/7396] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:37 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:38.201385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f8e7e918-16bc-4b0f-8b71-2259f9439a64 req-d769d791-464d-493e-9124-a8d3fdf3aac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:38.211545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f8e7e918-16bc-4b0f-8b71-2259f9439a64 req-d769d791-464d-493e-9124-a8d3fdf3aac4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:38.212028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f8e7e918-16bc-4b0f-8b71-2259f9439a64 req-d769d791-464d-493e-9124-a8d3fdf3aac4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:38.212475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f8e7e918-16bc-4b0f-8b71-2259f9439a64 req-d769d791-464d-493e-9124-a8d3fdf3aac4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:38.227546 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f8e7e918-16bc-4b0f-8b71-2259f9439a64 req-d769d791-464d-493e-9124-a8d3fdf3aac4 service nova] Creating event network-changed:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h1-862355-1 Oct 25 04:00:38.232782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-f8e7e918-16bc-4b0f-8b71-2259f9439a64 req-d769d791-464d-493e-9124-a8d3fdf3aac4 service nova] Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:00:38.243610 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f8e7e918-16bc-4b0f-8b71-2259f9439a64 req-d769d791-464d-493e-9124-a8d3fdf3aac4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047201 Oct 25 04:00:38.244236 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3757/7397] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:00:38.353414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:38.354064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:38.360846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:38.361346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:38.361825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:38.362529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:38.362992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:38.363424 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:38.501517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:38.510881 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-78c2e7bc-4952-4905-a22f-b710e9604a8c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1682 microversion: 2.1 time: 0.162135 Oct 25 04:00:38.511949 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3641/7398] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:38 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:39.537180 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:39.537903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:39.543991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.544468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.544900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:39.545584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.546530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.546961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:39.679230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:39.687245 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-477e7538-a795-4ccf-a4d2-1007abff71e9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1679 microversion: 2.1 time: 0.155250 Oct 25 04:00:39.687821 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3758/7399] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:39 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:39.711395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:39.711952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:39.718714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.719217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.719672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:39.720385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.720856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.721301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:39.760511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.761004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.761450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:39.762215 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.762685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.763120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:39.787754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:00:39.793007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for user 93ac3b8248b342079ead4a7aedce89ea and project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:00:39.900846 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aa2eea16-d735-4e18-b609-35d2aea1ed80 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa/action" status: 202 len: 0 microversion: 2.1 time: 0.193849 Oct 25 04:00:39.901474 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3642/7400] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:00:39 2022] POST /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:00:39.909874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:39.910653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:39.918611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.919230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.919687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:39.920550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:39.921114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:39.921608 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:40.071066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:40.079028 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-99a5393c-3c40-4867-94fa-f61c48674c28 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1678 microversion: 2.1 time: 0.173328 Oct 25 04:00:40.079651 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3759/7401] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:39 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:41.103542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:41.104289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:41.114686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:41.115204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:41.115652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:41.116362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:41.116829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:41.117297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:41.249506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:41.257774 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fd3f7d76-0241-459d-b77f-c5ee849ae788 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1678 microversion: 2.1 time: 0.159506 Oct 25 04:00:41.258365 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3643/7402] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:41 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:41.854699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e037a7fc-c41f-4fe5-a527-5c813f505658 req-215ea2d5-965a-4d5a-9ddb-0a88d085588c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "name": "network-vif-plugged", "status": "completed", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:41.864853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e037a7fc-c41f-4fe5-a527-5c813f505658 req-215ea2d5-965a-4d5a-9ddb-0a88d085588c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:41.865341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e037a7fc-c41f-4fe5-a527-5c813f505658 req-215ea2d5-965a-4d5a-9ddb-0a88d085588c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:41.865806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e037a7fc-c41f-4fe5-a527-5c813f505658 req-215ea2d5-965a-4d5a-9ddb-0a88d085588c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:41.877904 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e037a7fc-c41f-4fe5-a527-5c813f505658 req-215ea2d5-965a-4d5a-9ddb-0a88d085588c service nova] Creating event network-vif-plugged:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h1-862355-1 Oct 25 04:00:41.883318 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-e037a7fc-c41f-4fe5-a527-5c813f505658 req-215ea2d5-965a-4d5a-9ddb-0a88d085588c service nova] Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:00:41.893996 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e037a7fc-c41f-4fe5-a527-5c813f505658 req-215ea2d5-965a-4d5a-9ddb-0a88d085588c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043054 Oct 25 04:00:41.894620 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3760/7403] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:00:42.281644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:42.282231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:42.289236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:42.289774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:42.290236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:42.290948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:42.291425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:42.291875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:42.425834 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:42.434433 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7818fb91-7f59-40ea-bcd0-e5b0d4db5d8a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1678 microversion: 2.1 time: 0.156753 Oct 25 04:00:42.435020 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3644/7404] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:42 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:43.281754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-502486c8-7068-4e47-adb3-f7a935765f74 req-bd4bf309-a6ae-46c3-bfc4-9915b05cdfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "name": "network-vif-unplugged", "status": "completed", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:43.291783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-502486c8-7068-4e47-adb3-f7a935765f74 req-bd4bf309-a6ae-46c3-bfc4-9915b05cdfc5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:43.292850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-502486c8-7068-4e47-adb3-f7a935765f74 req-bd4bf309-a6ae-46c3-bfc4-9915b05cdfc5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:43.293288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-502486c8-7068-4e47-adb3-f7a935765f74 req-bd4bf309-a6ae-46c3-bfc4-9915b05cdfc5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:43.305550 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-502486c8-7068-4e47-adb3-f7a935765f74 req-bd4bf309-a6ae-46c3-bfc4-9915b05cdfc5 service nova] Creating event network-vif-unplugged:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h2-862355-1 Oct 25 04:00:43.310930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-502486c8-7068-4e47-adb3-f7a935765f74 req-bd4bf309-a6ae-46c3-bfc4-9915b05cdfc5 service nova] Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:00:43.322578 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-502486c8-7068-4e47-adb3-f7a935765f74 req-bd4bf309-a6ae-46c3-bfc4-9915b05cdfc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103399 Oct 25 04:00:43.323561 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3761/7405] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:00:43.459723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:43.460277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:43.467872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:43.468413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:43.468871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:43.469639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:43.470152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:43.470600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:43.624102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:43.632258 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a21652e6-ac59-4d60-85cf-95cbecc549bc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1678 microversion: 2.1 time: 0.176641 Oct 25 04:00:43.632844 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3645/7406] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:43 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:44.657277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:44.657960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:44.664666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:44.665155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:44.665594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:44.666316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:44.666775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:44.667207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:44.800557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:44.808596 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-66d33c48-b6d9-4bae-bb57-4a67886efc5a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1678 microversion: 2.1 time: 0.156523 Oct 25 04:00:44.809189 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3762/7407] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:44 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:45.337157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e6badb5a-15e6-4a70-b74f-aed06d752fd8 req-b15d987d-0c7a-4d8f-995d-c9b432d7614f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:45.347218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e6badb5a-15e6-4a70-b74f-aed06d752fd8 req-b15d987d-0c7a-4d8f-995d-c9b432d7614f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:45.347702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e6badb5a-15e6-4a70-b74f-aed06d752fd8 req-b15d987d-0c7a-4d8f-995d-c9b432d7614f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:45.348276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e6badb5a-15e6-4a70-b74f-aed06d752fd8 req-b15d987d-0c7a-4d8f-995d-c9b432d7614f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:45.359574 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e6badb5a-15e6-4a70-b74f-aed06d752fd8 req-b15d987d-0c7a-4d8f-995d-c9b432d7614f service nova] Creating event network-changed:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h2-862355-1 Oct 25 04:00:45.361989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:45.366218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-e6badb5a-15e6-4a70-b74f-aed06d752fd8 req-b15d987d-0c7a-4d8f-995d-c9b432d7614f service nova] Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:00:45.377238 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e6badb5a-15e6-4a70-b74f-aed06d752fd8 req-b15d987d-0c7a-4d8f-995d-c9b432d7614f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044527 Oct 25 04:00:45.377848 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3646/7408] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:00:45.833008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:45.833559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:45.840226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:45.840721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:45.841161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:45.841889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:45.842355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:45.842776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:45.979820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:45.987777 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-58dd959c-d01c-4718-9323-cd5d606c9eb9 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1678 microversion: 2.1 time: 0.159359 Oct 25 04:00:45.988356 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3763/7409] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:45 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:47.013877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:47.014700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:47.023846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:47.024339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:47.024792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:47.025523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:47.026023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:47.026469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:47.162093 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:47.169898 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e8476e8e-2e76-4abd-a6cf-05b58a1789e8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1678 microversion: 2.1 time: 0.161627 Oct 25 04:00:47.170687 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3647/7410] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:47 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:48.193984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:48.194635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:48.201325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.201840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.202384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.203157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.203619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.204045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.338466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:48.346145 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6a9faf5-2313-4846-9fd5-28e7a5c07065 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1671 microversion: 2.1 time: 0.156647 Oct 25 04:00:48.346719 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3764/7411] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:48 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:48.369427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:48.370090 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:48.376912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.377404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.377911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.378598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.379074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.379718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.518935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:48.528188 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0e0bc657-6e03-42bb-a293-7dc62f401173 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1671 microversion: 2.1 time: 0.162309 Oct 25 04:00:48.529013 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3648/7412] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:48 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:48.550705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:48.551533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:48.557399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.557941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.558385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.559077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.559533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.559954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.581080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:48.696382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:48.704264 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5007a2b3-5522-43ef-9baa-cee9c3cfc932 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1671 microversion: 2.1 time: 0.157483 Oct 25 04:00:48.708937 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3765/7413] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:48 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:48.727888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:48.728416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:48.734299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.734784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.735237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.735953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.736413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.736855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.765992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:00:48.841586 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-790eb567-08ea-4413-aec8-73af4384a057 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 204 len: 0 microversion: 2.1 time: 0.117559 Oct 25 04:00:48.842333 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3649/7414] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:00:48 2022] DELETE /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:00:48.851172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:48.851787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:48.857643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.858160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.858599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.859294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:48.859750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:48.860179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:48.995700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:49.003574 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ee417e71-e821-463d-a8d7-84f74dfcbe3b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1677 microversion: 2.1 time: 0.156947 Oct 25 04:00:49.004617 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3766/7415] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:48 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:50.027986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:50.028705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:50.031501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:50.038379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:50.038886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:50.039336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:50.040051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:50.040523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:50.040961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:50.173444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:50.182057 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-262f5139-0e0b-4721-86c0-88e87fc8a8ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1677 microversion: 2.1 time: 0.158365 Oct 25 04:00:50.182642 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3650/7416] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:50 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:51.141079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d89cdcc6-1244-4fe2-b4ea-f3e370fcb095 req-71719c2e-e50a-4858-89fc-4b3bb301467f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a54dffa-b492-4944-8b2e-3183a6e19dfa", "name": "network-vif-deleted", "tag": "5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:51.156108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d89cdcc6-1244-4fe2-b4ea-f3e370fcb095 req-71719c2e-e50a-4858-89fc-4b3bb301467f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:51.156589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d89cdcc6-1244-4fe2-b4ea-f3e370fcb095 req-71719c2e-e50a-4858-89fc-4b3bb301467f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:51.157023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d89cdcc6-1244-4fe2-b4ea-f3e370fcb095 req-71719c2e-e50a-4858-89fc-4b3bb301467f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:51.171027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d89cdcc6-1244-4fe2-b4ea-f3e370fcb095 req-71719c2e-e50a-4858-89fc-4b3bb301467f service nova] Creating event network-vif-deleted:5c2b71c6-fc43-4553-b2fa-1cd6c2170bd0 for instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa on n-h2-862355-1 Oct 25 04:00:51.177027 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d89cdcc6-1244-4fe2-b4ea-f3e370fcb095 req-71719c2e-e50a-4858-89fc-4b3bb301467f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039774 Oct 25 04:00:51.178013 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3767/7417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:00:51.206155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:51.206829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:51.214795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:51.215575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:51.216023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:51.216730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:51.217401 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:51.218054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:51.288795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:51.297211 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-af6f721a-615f-4ec1-bbef-f06827fb7b93 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 200 len: 1324 microversion: 2.1 time: 0.095215 Oct 25 04:00:51.297844 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3651/7418] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:51 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 1324 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:52.322434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:52.323056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:52.325827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=43 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:52.331191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:52.331675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:52.332145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:52.332924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:52.333389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:52.333844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:52.347348 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa HTTP/1.1 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0a54dffa-b492-4944-8b2e-3183a6e19dfa'} Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:00:52.349095 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ed851d7-bc5b-439c-82ed-1553fc11c17e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 404 len: 111 microversion: 2.1 time: 0.032495 Oct 25 04:00:52.354260 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3768/7419] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:52 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:00:52.366556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:52.367186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:52.369892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:00:52.375730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:52.376224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:52.376673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:52.377373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:52.377873 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:52.378314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:52.392587 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa HTTP/1.1 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0a54dffa-b492-4944-8b2e-3183a6e19dfa'} Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:00:52.394262 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0dc768e8-309c-4216-9e64-ecbe6c1391a6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 404 len: 111 microversion: 2.1 time: 0.033948 Oct 25 04:00:52.398909 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3652/7420] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:52 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:00:52.446811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-468038422", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "69c785b0-6a4b-4eeb-b425-f9fa4134c01b"}], "security_groups": [{"name": "tempest-securitygroup--1576704750"}], "key_name": "tempest-keypair-1080434280", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:52.556645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] validate_networks() for [('69c785b0-6a4b-4eeb-b425-f9fa4134c01b', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:00:52.921005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:00:52.921434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:00:52.921950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:00:52.922369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:00:52.922784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:00:52.934349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:52.934840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:52.935281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:52.936016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:52.936727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:52.937162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:52.956314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:00:52.962434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for user 93ac3b8248b342079ead4a7aedce89ea and project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:00:52.975557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:00:52.977908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:00:53.024910 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0f63ea03-9240-4c2f-a27f-b734027c8557 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.582012 Oct 25 04:00:53.032021 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3769/7421] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:00:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:00:53.040704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-735fab4f-12c1-42f4-950b-8d96c0943b98 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:53.041728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-735fab4f-12c1-42f4-950b-8d96c0943b98 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:53.102599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-735fab4f-12c1-42f4-950b-8d96c0943b98 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:53.112794 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-735fab4f-12c1-42f4-950b-8d96c0943b98 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1238 microversion: 2.1 time: 0.077542 Oct 25 04:00:53.113419 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3653/7422] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:53 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:54.137652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:54.138630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:54.159206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:54.160052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:54.161194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:54.162229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:54.162804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:54.163336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:54.234383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:54.243054 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4934eb50-511b-4d24-8434-f503c18776fc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1308 microversion: 2.1 time: 0.110769 Oct 25 04:00:54.243765 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3770/7423] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:54 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:55.267655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:55.268396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:55.277266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:55.277907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:55.278457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:55.279253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:55.279806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:55.280258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:55.657661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:55.666235 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-27bb4828-9a38-4733-aa95-1f4f16b0d637 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1364 microversion: 2.1 time: 0.402659 Oct 25 04:00:55.666825 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3654/7424] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:55 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:55.929019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-8e32e0d9-bb9d-4e2c-b52d-aef8450f4ee0 req-b3387571-d6c7-471e-922c-8542810b555c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:55.940193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e32e0d9-bb9d-4e2c-b52d-aef8450f4ee0 req-b3387571-d6c7-471e-922c-8542810b555c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:55.940695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e32e0d9-bb9d-4e2c-b52d-aef8450f4ee0 req-b3387571-d6c7-471e-922c-8542810b555c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:55.941109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-8e32e0d9-bb9d-4e2c-b52d-aef8450f4ee0 req-b3387571-d6c7-471e-922c-8542810b555c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:55.954059 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-8e32e0d9-bb9d-4e2c-b52d-aef8450f4ee0 req-b3387571-d6c7-471e-922c-8542810b555c service nova] Creating event network-changed:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h1-862355-1 Oct 25 04:00:55.959250 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-8e32e0d9-bb9d-4e2c-b52d-aef8450f4ee0 req-b3387571-d6c7-471e-922c-8542810b555c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035383 Oct 25 04:00:55.959855 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3771/7425] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:00:56.690989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:56.691775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:56.698543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:56.699042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:56.699495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:56.700196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:56.700666 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:56.701106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:56.832991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:56.840738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-53af5a5c-8286-4246-8666-88d42cff3c22 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1364 microversion: 2.1 time: 0.153684 Oct 25 04:00:56.841311 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3655/7426] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:56 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:57.866742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:57.867483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:57.873660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:57.874215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:57.874667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:57.875363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:57.875816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:57.876246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:58.010273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:58.018254 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5115db04-e955-4536-beb0-6fb4071b5eb8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1364 microversion: 2.1 time: 0.157475 Oct 25 04:00:58.018839 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3772/7427] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:57 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:00:59.041993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:00:59.042618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:00:59.049246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:59.049770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:59.050220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:59.051787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:59.052301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:59.052741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:59.184781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:00:59.193968 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d6b4ae4d-4460-449d-808f-0201bd401c7f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1364 microversion: 2.1 time: 0.156061 Oct 25 04:00:59.194544 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3656/7428] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:00:59 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:00:59.925768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3457a200-5571-496c-92f9-34b66e111d7c req-e1c80d77-592c-4917-a2d0-f61eb7b57e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "name": "network-vif-plugged", "status": "completed", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:00:59.937631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3457a200-5571-496c-92f9-34b66e111d7c req-e1c80d77-592c-4917-a2d0-f61eb7b57e47 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:00:59.938130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3457a200-5571-496c-92f9-34b66e111d7c req-e1c80d77-592c-4917-a2d0-f61eb7b57e47 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:00:59.938558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3457a200-5571-496c-92f9-34b66e111d7c req-e1c80d77-592c-4917-a2d0-f61eb7b57e47 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:00:59.950487 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3457a200-5571-496c-92f9-34b66e111d7c req-e1c80d77-592c-4917-a2d0-f61eb7b57e47 service nova] Creating event network-vif-plugged:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h1-862355-1 Oct 25 04:00:59.955281 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3457a200-5571-496c-92f9-34b66e111d7c req-e1c80d77-592c-4917-a2d0-f61eb7b57e47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033502 Oct 25 04:00:59.955915 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3773/7429] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:01:00.217734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:00.218362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:00.225996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:00.226486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:00.226930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:00.227627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:00.228089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:00.228521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:00.358824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:00.367691 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5084508f-1a69-4332-9aee-eb1924b4649f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1364 microversion: 2.1 time: 0.153882 Oct 25 04:01:00.368274 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3657/7430] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:00 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:01.392432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:01.393093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:01.399467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:01.399956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:01.400402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:01.401113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:01.401572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:01.402030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:01.536764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:01.544756 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3c67d364-2642-4911-a0ea-95ff759f3160 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1551 microversion: 2.1 time: 0.157604 Oct 25 04:01:01.545386 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3774/7431] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:01 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:01.568881 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:01.569437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:01.576210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:01.576704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:01.577149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:01.577884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:01.578352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:01.578786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:01.655434 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-115f13b6-2c25-4fdd-9a07-52df54746df8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090884 Oct 25 04:01:01.656043 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3658/7432] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 04:01:01 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:01:02.605506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e048ee75-19a3-4ff1-a14b-1711e2171e54 req-94537b8c-daac-4afe-bece-f8dec23e6b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:01:02.616167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e048ee75-19a3-4ff1-a14b-1711e2171e54 req-94537b8c-daac-4afe-bece-f8dec23e6b98 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:02.616650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e048ee75-19a3-4ff1-a14b-1711e2171e54 req-94537b8c-daac-4afe-bece-f8dec23e6b98 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:02.617078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e048ee75-19a3-4ff1-a14b-1711e2171e54 req-94537b8c-daac-4afe-bece-f8dec23e6b98 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:02.628134 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e048ee75-19a3-4ff1-a14b-1711e2171e54 req-94537b8c-daac-4afe-bece-f8dec23e6b98 service nova] Creating event network-changed:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h1-862355-1 Oct 25 04:01:02.633088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e048ee75-19a3-4ff1-a14b-1711e2171e54 req-94537b8c-daac-4afe-bece-f8dec23e6b98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031416 Oct 25 04:01:02.633704 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3775/7433] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:01:39.594899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:39.597049 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=15 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:39.597790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:39.602117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:39.602700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:39.610590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:39.611229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:39.611690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:39.612404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:39.612878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:39.613323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:39.742990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:39.750734 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60203b1d-41fb-4197-abc8-5983ecf6ca36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1670 microversion: 2.1 time: 0.157734 Oct 25 04:01:39.751314 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3659/7434] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:39 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:39.771862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:39.772634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:39.774661 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:39.775478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=38 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:39.780188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4de474ed-9909-40a0-9197-0fd2b2a68383"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:01:39.782607 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:39.791118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:39.791599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:39.792034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:39.792718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:39.793176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:39.793619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:40.038548 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d8495481-bd26-4da5-9c8d-69c912123b16 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266719 Oct 25 04:01:40.039323 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3776/7435] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 04:01:39 2022] POST /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:01:50.758454 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:01:50.760699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:50.763740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:50.764411 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:50.770961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:50.771495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:50.771946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:50.772851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:50.773470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:50.774084 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:50.803731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:50.809101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Old instance type m1.heat2, new instance type m1.heat {{(pid=120563) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 04:01:50.816446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:01:50.816878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:01:50.817360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:01:50.817839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:01:50.818269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:01:50.880467 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [5e384832-316c-4719-9ce3-ffddafbb8b15] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:01:51.887427 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [5e384832-316c-4719-9ce3-ffddafbb8b15] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 42660. Oct 25 04:01:51.890646 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f4efa3b-4d82-4f21-bcd5-2a5e7748d727 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/action" status: 202 len: 0 microversion: 2.1 time: 1.136282 Oct 25 04:01:51.891272 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3660/7436] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:01:50 2022] POST /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/action => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:01:51.898415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:51.899186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:01:51.903955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:51.904664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:51.912130 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:51.912657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:51.913136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:51.913860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:51.914314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:51.914733 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:52.082081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:52.090711 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-633c95a8-756a-4532-b411-b54fbeb07f79 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1725 microversion: 2.1 time: 0.194196 Oct 25 04:01:52.091302 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3777/7437] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:51 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:01:53.115498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:53.116071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:53.122026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:53.122521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:53.122970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:53.123675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:53.124138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:53.124574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:53.357388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:53.365893 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-66701a65-5a99-42d5-a3ec-bdd16e69eec4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1725 microversion: 2.1 time: 0.256294 Oct 25 04:01:53.366411 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3661/7438] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:53 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:54.390612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:54.391197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:54.398600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:54.399092 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:54.399541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:54.400238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:54.400704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:54.401134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:54.535968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:54.544766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d292fd89-b74a-4ded-9626-a21ec813bd36 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.158199 Oct 25 04:01:54.545339 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3778/7439] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:54 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:55.568241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:55.568882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:55.575883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:55.576384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:55.576841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:55.577572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:55.578055 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:55.578504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:55.707230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:55.715466 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ac6c178-5277-46a2-8dfa-a009b3a0999e tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.151232 Oct 25 04:01:55.716058 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3662/7440] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:55 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:56.739803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:56.742809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:56.747682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:56.748162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:56.748599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:56.749287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:56.749763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:56.750198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:56.882816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:56.891429 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b54651c-c39a-40e6-b709-52b3d13b6006 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.156324 Oct 25 04:01:56.892001 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3779/7441] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:56 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:57.915282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:57.915903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:57.922854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:57.923409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:57.923924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:57.924657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:57.925123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:57.925557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:58.061420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:58.070540 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ab21c236-de0f-4d0f-8561-cdbdbd2fd782 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.159214 Oct 25 04:01:58.071145 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3663/7442] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:57 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:01:59.094684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:01:59.095393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:01:59.104441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:59.104994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:59.105482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:59.106265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:01:59.106772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:01:59.107261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:01:59.237621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:01:59.246040 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34fe8f45-829c-4411-ad9d-fda52a86f013 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.155228 Oct 25 04:01:59.246641 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3780/7443] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:01:59 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:00.270294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:00.270926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:00.277864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:00.278359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:00.278805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:00.279513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:00.279972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:00.280410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:00.414544 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:00.423606 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3dd1be0a-72f8-46f5-a1e9-b6ebe0aed93f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.157506 Oct 25 04:02:00.424192 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3664/7444] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:00 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:01.448262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:01.448809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:01.456046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:01.456534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:01.456974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:01.457685 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:01.458150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:01.458581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:01.561388 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:02:01.561582 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 (ip 10.222.0.36) !!! Oct 25 04:02:01.593251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:01.602179 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65ba0e52-5c8b-4136-b9da-a4e1f11b34c4 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.157988 Oct 25 04:02:01.602775 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3781/7445] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:01 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:02.626415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:02.627720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:02.630803 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:02:02.630939 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 (ip 10.222.0.36) !!! Oct 25 04:02:02.637489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:02.638017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:02.638472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:02.639184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:02.639655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:02.640100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:02.776286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:02.785154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-354fac79-9dda-44ef-b681-7ce4c4e992d7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.162739 Oct 25 04:02:02.785751 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3665/7446] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:02 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:03.815847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:03.816460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:03.823251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:03.823736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:03.824177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:03.824891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:03.825337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:03.825794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:03.954719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:03.964126 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-11772c11-6ccd-4917-9253-bda3e573e402 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.152759 Oct 25 04:02:03.964712 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3782/7447] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:03 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:04.988719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:04.989344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:04.996198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:04.996692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:04.997140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:04.997879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:04.998349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:04.998785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:05.134161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:05.142978 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-af7be8ef-8b1a-425d-adcd-fd928eb52aed tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.158161 Oct 25 04:02:05.143575 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3666/7448] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:04 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:06.168040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:06.168664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:06.176068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:06.176548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:06.176983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:06.177693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:06.178142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:06.178569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:06.312105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:06.320395 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ef5c76c6-1288-46c6-8c00-37546b6c2e9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.157479 Oct 25 04:02:06.320972 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3783/7449] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:06 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:07.344014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:07.344537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:07.351578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:07.352087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:07.352543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:07.353262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:07.353759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:07.354214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:07.485979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:07.494815 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ca34b1b3-6e8f-4ab4-a8a1-4799523feea8 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.154847 Oct 25 04:02:07.495409 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3667/7450] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:07 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:08.519738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:08.520378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:08.527192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:08.527681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:08.528132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:08.528834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:08.529299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:08.529757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:08.660938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:08.669301 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f6992b96-8065-44d3-b387-fb0e6b2c5f04 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.154206 Oct 25 04:02:08.669926 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3784/7451] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:08 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:09.693836 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:09.694464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:09.701696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:09.702206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:09.702664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:09.703385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:09.703861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:09.704309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:09.838664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:09.847395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0adbac1-6406-4c58-b926-e7b1d7bed6a3 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.157544 Oct 25 04:02:09.848015 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3668/7452] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:09 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:10.870447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:10.871065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:10.878632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:10.879167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:10.879619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:10.880307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:10.880761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:10.881186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:11.016278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:11.025382 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-56a652c2-4f8c-433c-9667-d46f15a97012 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.158814 Oct 25 04:02:11.026247 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3785/7453] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:10 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:12.048602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:12.049238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:12.056673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:12.057180 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:12.057639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:12.058389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:12.058867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:12.059311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:12.201288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:12.210765 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-aafc1a6e-e9fe-4ad1-bed0-b35f7dfa6ba7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.166102 Oct 25 04:02:12.211357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3669/7454] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:12 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:13.236125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:13.236747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:13.243615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:13.244244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:13.244687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:13.245375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:13.245871 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:13.246299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:13.391906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:13.408483 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3453036e-85c8-41c5-8e55-4bd16a86ea35 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1730 microversion: 2.1 time: 0.176227 Oct 25 04:02:13.414189 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3786/7455] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:13 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:13.809615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-810a213f-5a07-4cb5-8b9f-338207224e2a req-317dc53f-3287-4ca2-87bf-42d1e3b9b460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "name": "network-vif-unplugged", "status": "completed", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:13.820889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-810a213f-5a07-4cb5-8b9f-338207224e2a req-317dc53f-3287-4ca2-87bf-42d1e3b9b460 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:13.821376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-810a213f-5a07-4cb5-8b9f-338207224e2a req-317dc53f-3287-4ca2-87bf-42d1e3b9b460 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:13.821862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-810a213f-5a07-4cb5-8b9f-338207224e2a req-317dc53f-3287-4ca2-87bf-42d1e3b9b460 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:13.834036 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-810a213f-5a07-4cb5-8b9f-338207224e2a req-317dc53f-3287-4ca2-87bf-42d1e3b9b460 service nova] Creating event network-vif-unplugged:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h2-862355-1 Oct 25 04:02:13.839559 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-810a213f-5a07-4cb5-8b9f-338207224e2a req-317dc53f-3287-4ca2-87bf-42d1e3b9b460 service nova] Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:02:13.850768 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-810a213f-5a07-4cb5-8b9f-338207224e2a req-317dc53f-3287-4ca2-87bf-42d1e3b9b460 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045010 Oct 25 04:02:13.851444 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3670/7456] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:02:14.432529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:14.433268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:14.441028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:14.441706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:14.442226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:14.442941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:14.443402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:14.443831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:14.645374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:14.653842 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b1fdc777-92ad-42c7-82e2-bbb708f242a5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1729 microversion: 2.1 time: 0.225340 Oct 25 04:02:14.654440 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3787/7457] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:14 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:15.680907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:15.681629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:15.688176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:15.688677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:15.689126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:15.690051 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:15.691453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:15.691585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:15.889534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-34003bd5-e9e6-45d2-a16c-d6dc704c4ade req-c91fca23-3632-49a8-bdfd-88428a0b42a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:15.901824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-34003bd5-e9e6-45d2-a16c-d6dc704c4ade req-c91fca23-3632-49a8-bdfd-88428a0b42a7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:15.902322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-34003bd5-e9e6-45d2-a16c-d6dc704c4ade req-c91fca23-3632-49a8-bdfd-88428a0b42a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:15.902762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-34003bd5-e9e6-45d2-a16c-d6dc704c4ade req-c91fca23-3632-49a8-bdfd-88428a0b42a7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:15.915808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-34003bd5-e9e6-45d2-a16c-d6dc704c4ade req-c91fca23-3632-49a8-bdfd-88428a0b42a7 service nova] Creating event network-changed:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h2-862355-1 Oct 25 04:02:15.922394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-34003bd5-e9e6-45d2-a16c-d6dc704c4ade req-c91fca23-3632-49a8-bdfd-88428a0b42a7 service nova] Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:02:15.935064 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-34003bd5-e9e6-45d2-a16c-d6dc704c4ade req-c91fca23-3632-49a8-bdfd-88428a0b42a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048838 Oct 25 04:02:15.935880 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3788/7458] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:02:16.201473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:16.211933 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5447257-ee92-4bca-adee-76c0ff300b56 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.536087 Oct 25 04:02:16.226722 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3671/7459] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:15 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:17.239290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:17.240003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:17.246358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:17.246847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:17.247284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:17.247989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:17.248441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:17.248867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:17.387493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:17.396529 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89df30d4-f7c3-44a8-9fda-5a1161ce8ccc tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.163733 Oct 25 04:02:17.397122 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3789/7460] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:17 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:18.420818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:18.421991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:18.429190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:18.429715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:18.430168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:18.430879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:18.431347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:18.431815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:18.578241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:18.588708 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9096695d-2413-4415-a767-7888aa9f474d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.171892 Oct 25 04:02:18.589309 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3672/7461] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:18 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:19.614845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:19.615492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:19.622663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:19.623149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:19.623586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:19.624286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:19.624739 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:19.625165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:19.761189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:19.770446 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8d312f2-746d-4d83-8e82-40bdea593dde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.160169 Oct 25 04:02:19.771033 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3790/7462] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:19 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:20.793661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:20.794318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:20.797149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=31 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:20.803413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:20.803910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:20.804365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:20.805075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:20.805542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:20.806007 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:20.808573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:20.944008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:20.952458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cbb6a765-acee-4a20-ad95-d90fa38c72da tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.162711 Oct 25 04:02:20.953033 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3673/7463] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:20 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:21.975999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:21.976628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:21.979423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=29 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:21.984731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:21.985218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:21.985663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:21.986375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:21.986841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:21.987275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:21.990033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=83 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:22.118396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:22.126678 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e332ba0f-1efe-4fca-a0c5-2dda61527d64 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.154702 Oct 25 04:02:22.127260 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3791/7464] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:21 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:02:23.151582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:23.152213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:23.158866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:23.159360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:23.159810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:23.160517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:23.160988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:23.161430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:23.291989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:23.301018 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0bb04ba-99b7-4bd3-a809-59e9dea77b1b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.153537 Oct 25 04:02:23.301604 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3674/7465] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:23 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:24.325306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:24.325898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:24.333364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:24.333882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:24.334326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:24.335056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:24.335524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:24.335957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:24.468190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:24.477430 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b0d3f89-97f1-4907-90f8-4f409a56f21c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.156165 Oct 25 04:02:24.478045 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3792/7466] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:24 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:25.500742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:25.501423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:25.509207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:25.509706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:25.510158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:25.510847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:25.511315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:25.511749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:25.644637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:25.652849 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-14da265d-a7af-43fe-90fa-4f9449fe0635 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.156008 Oct 25 04:02:25.653430 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3675/7467] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:25 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:26.677099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:26.677738 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:26.684762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:26.685243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:26.685707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:26.686389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:26.686846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:26.687271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:26.821389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:26.829883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80089b2c-6ad6-49f1-9a47-567e69256d20 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.157318 Oct 25 04:02:26.830538 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3793/7468] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:26 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:27.853742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:27.854370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:27.861179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:27.861858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:27.862321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:27.863018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:27.863491 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:27.863931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:28.001369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:28.009876 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-651bb202-3ff3-4491-b8c8-f94d0d69453d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1727 microversion: 2.1 time: 0.160163 Oct 25 04:02:28.010462 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3676/7469] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:27 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:29.032467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:29.033077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:29.040202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.040684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.041119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.041846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.042303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.042728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.180616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:29.190234 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0033db2d-0ee6-44d7-98e8-30bfac273fbe tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1724 microversion: 2.1 time: 0.161021 Oct 25 04:02:29.190852 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3794/7470] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:29 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:29.213810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:29.214517 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:29.222304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.222661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.223299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.224034 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.224657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.225108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.265351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.265790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.266243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.266989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.267459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.267955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.289878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:02:29.295364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Getting quotas for user 93ac3b8248b342079ead4a7aedce89ea and project 3658252363f948bd83e3f172fd493212. Resources: {'ram', 'cores'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:02:29.404053 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-15526eb4-82fa-4f86-b74e-99f5d1ad06db tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "POST /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/action" status: 202 len: 0 microversion: 2.1 time: 0.194232 Oct 25 04:02:29.404677 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3677/7471] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:02:29 2022] POST /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:02:29.414996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:29.415970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:29.423434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.424804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.425710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.426540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:29.427137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:29.428445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:29.624780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:29.634168 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e800ae57-13bc-4249-b402-6be97dc8d00d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.224430 Oct 25 04:02:29.634766 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3795/7472] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:29 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:30.657940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:30.658625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:30.666463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:30.666964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:30.667416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:30.668123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:30.668594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:30.669036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:30.800076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:30.808320 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f2cd87b5-d71b-4d6d-ada0-3cbdad47afde tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.154839 Oct 25 04:02:30.808891 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3678/7473] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:30 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:31.271683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0bfb76d4-aeda-4d8d-8de7-cb532565a978 req-7ed9ace8-5968-4281-8637-306a1821d0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "name": "network-vif-plugged", "status": "completed", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:31.281747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0bfb76d4-aeda-4d8d-8de7-cb532565a978 req-7ed9ace8-5968-4281-8637-306a1821d0a9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:31.282235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0bfb76d4-aeda-4d8d-8de7-cb532565a978 req-7ed9ace8-5968-4281-8637-306a1821d0a9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:31.282668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0bfb76d4-aeda-4d8d-8de7-cb532565a978 req-7ed9ace8-5968-4281-8637-306a1821d0a9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:31.295669 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0bfb76d4-aeda-4d8d-8de7-cb532565a978 req-7ed9ace8-5968-4281-8637-306a1821d0a9 service nova] Creating event network-vif-plugged:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h2-862355-1 Oct 25 04:02:31.301193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-0bfb76d4-aeda-4d8d-8de7-cb532565a978 req-7ed9ace8-5968-4281-8637-306a1821d0a9 service nova] Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:02:31.312343 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0bfb76d4-aeda-4d8d-8de7-cb532565a978 req-7ed9ace8-5968-4281-8637-306a1821d0a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045830 Oct 25 04:02:31.312956 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3796/7474] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:02:31.832597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:31.833263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:31.840392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:31.840890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:31.841344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:31.842078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:31.842551 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:31.842992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:31.988130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:31.999136 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-738e225b-6e5b-4586-87bc-edff1181af8f tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.170398 Oct 25 04:02:31.999679 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3679/7475] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:31 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:33.024706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:33.025402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:33.031668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:33.032150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:33.032586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:33.034383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:33.034851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:33.035280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:33.176499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:33.185361 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-adeb267c-ec32-41cd-908c-cd91eb8fb728 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.165888 Oct 25 04:02:33.186062 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3797/7476] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:33 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:34.209760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:34.210394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:34.217259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:34.217797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:34.218250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:34.218956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:34.219428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:34.219870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:34.356179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:34.365805 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1400a44d-8f7a-4500-a5c9-6a568f9900be tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.159950 Oct 25 04:02:34.366395 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3680/7477] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:34 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:34.842988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-56d8668b-de72-47a0-9855-a8df669ef87e req-41eff7aa-facf-4316-ba34-b41e8679bf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "name": "network-vif-unplugged", "status": "completed", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:34.854213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-56d8668b-de72-47a0-9855-a8df669ef87e req-41eff7aa-facf-4316-ba34-b41e8679bf56 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:34.854706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-56d8668b-de72-47a0-9855-a8df669ef87e req-41eff7aa-facf-4316-ba34-b41e8679bf56 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:34.855141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-56d8668b-de72-47a0-9855-a8df669ef87e req-41eff7aa-facf-4316-ba34-b41e8679bf56 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:34.868444 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-56d8668b-de72-47a0-9855-a8df669ef87e req-41eff7aa-facf-4316-ba34-b41e8679bf56 service nova] Creating event network-vif-unplugged:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h1-862355-1 Oct 25 04:02:34.873906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-56d8668b-de72-47a0-9855-a8df669ef87e req-41eff7aa-facf-4316-ba34-b41e8679bf56 service nova] Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:02:34.885204 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-56d8668b-de72-47a0-9855-a8df669ef87e req-41eff7aa-facf-4316-ba34-b41e8679bf56 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046409 Oct 25 04:02:34.886000 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3798/7478] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:02:35.390373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:35.391030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:35.398671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:35.399175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:35.399626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:35.400404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:35.401052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:35.401503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:35.629839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:35.641175 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8f25eb2c-7a96-4028-8d44-3383fd6a1081 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.255805 Oct 25 04:02:35.641804 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3681/7479] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:35 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:36.667267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:36.667982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:36.674833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:36.675321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:36.675765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:36.676462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:36.676921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:36.677351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:36.811067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:36.819665 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1559e05e-ba33-40a5-bcf9-ea70fdfb72ec tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.157681 Oct 25 04:02:36.833841 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3799/7480] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:36 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:36.930996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a4d6637e-01b2-406a-bf2c-daf55e7dbb21 req-b71eec5a-09b1-4275-8617-f5b6ec161e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:36.942569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4d6637e-01b2-406a-bf2c-daf55e7dbb21 req-b71eec5a-09b1-4275-8617-f5b6ec161e92 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:36.943060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4d6637e-01b2-406a-bf2c-daf55e7dbb21 req-b71eec5a-09b1-4275-8617-f5b6ec161e92 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:36.943497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a4d6637e-01b2-406a-bf2c-daf55e7dbb21 req-b71eec5a-09b1-4275-8617-f5b6ec161e92 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:36.956257 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a4d6637e-01b2-406a-bf2c-daf55e7dbb21 req-b71eec5a-09b1-4275-8617-f5b6ec161e92 service nova] Creating event network-changed:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h1-862355-1 Oct 25 04:02:36.961664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-a4d6637e-01b2-406a-bf2c-daf55e7dbb21 req-b71eec5a-09b1-4275-8617-f5b6ec161e92 service nova] Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:02:36.972396 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a4d6637e-01b2-406a-bf2c-daf55e7dbb21 req-b71eec5a-09b1-4275-8617-f5b6ec161e92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045059 Oct 25 04:02:36.972999 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3682/7481] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:02:37.843244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:37.843859 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:37.851559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:37.852044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:37.852479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:37.853167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:37.853622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:37.854071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:37.988756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:37.997298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d19525c-756d-43a3-b297-e4a442f9dbe7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.158010 Oct 25 04:02:37.997908 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3800/7482] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:37 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:39.022622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:39.023608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:39.029999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:39.030500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:39.030954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:39.031667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:39.032140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:39.032612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:39.171113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:39.180427 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c00b2fea-d076-4011-82a8-36e8036c3d46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.163573 Oct 25 04:02:39.181009 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3683/7483] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:39 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:40.205976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:40.206597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:40.213186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:40.213669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:40.214167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:40.214863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:40.215317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:40.215742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:40.362237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:40.370864 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55cda5eb-6ce0-41dc-bb6c-9dec17e33c63 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.169505 Oct 25 04:02:40.371448 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3801/7484] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:40 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:41.395611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:41.396145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:41.398152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:41.404354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:41.404853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:41.405303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:41.406043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:41.406530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:41.406957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:41.540334 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:41.549205 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8c99ded-2191-45b3-a301-d66c2fa63aae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.156960 Oct 25 04:02:41.550003 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3684/7485] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:41 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:42.573303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:42.573958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:42.581741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:42.582233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:42.582680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:42.583375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:42.583838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:42.584276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:42.715929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:42.724280 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34f53a54-1067-4a1c-903b-5f53faf95a90 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.154966 Oct 25 04:02:42.724859 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3802/7486] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:42 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:43.748832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:43.749441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:43.756520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:43.757023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:43.757479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:43.758223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:43.758689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:43.759311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:43.894504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:43.902750 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-77d1593a-50e2-48ef-b7e4-626d1c7f5544 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.158847 Oct 25 04:02:43.903332 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3685/7487] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:43 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:44.927205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:44.927813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:44.934927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:44.935409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:44.935848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:44.936534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:44.936989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:44.937416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:45.083535 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:45.091935 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b38b3d54-b398-4add-a2ab-61fc11198d82 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.169338 Oct 25 04:02:45.092532 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3803/7488] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:44 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:46.116231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:46.116912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:46.123816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:46.124363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:46.124808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:46.125503 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:46.125995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:46.127050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:46.255282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:46.263530 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4227fa7-3d2f-4c69-9d69-5674944c034c tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.151188 Oct 25 04:02:46.264069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3686/7489] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:46 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:47.288114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:47.288769 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:47.295627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:47.296110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:47.296549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:47.297246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:47.297728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:47.298765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:47.429885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:47.438555 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-83bfe3ae-1480-4f30-b6a3-1af44d6b9a46 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1723 microversion: 2.1 time: 0.154438 Oct 25 04:02:47.439186 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3804/7490] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:47 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:48.461670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:48.462381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:48.469132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:48.469630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:48.470176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:48.471126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:48.471596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:48.472064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:48.474712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:48.612344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:48.620662 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e5510e31-4b3a-49c9-967a-9fdf26795150 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1716 microversion: 2.1 time: 0.162959 Oct 25 04:02:48.621262 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3687/7491] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:48 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:48.644434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:48.645202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:48.652129 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:48.652695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:48.653213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:48.654017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:48.654483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:48.654918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:48.790890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:48.799462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8f8acf08-76eb-47a9-bd1c-69b7a75acd3d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1716 microversion: 2.1 time: 0.159036 Oct 25 04:02:48.800119 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3805/7492] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:48 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:48.823689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:48.824328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:48.830872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:48.831377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:48.831832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:48.832552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:48.833026 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:48.833473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:48.967475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:48.976273 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52aa839d-3166-473c-9ef2-390fe6de8da7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1716 microversion: 2.1 time: 0.156475 Oct 25 04:02:48.976942 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3688/7493] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:48 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:48.999354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:48.999858 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:49.005941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:49.006436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:49.006875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:49.007573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:49.008028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:49.008456 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:49.034998 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:02:49.085935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:49.114462 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5658d41c-ebc9-4852-bc9a-ddae283d21e5 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 204 len: 0 microversion: 2.1 time: 0.118396 Oct 25 04:02:49.115252 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3806/7494] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:02:48 2022] DELETE /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:02:49.123683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:49.124316 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:49.130439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:49.130939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:49.131392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:49.132201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:49.132746 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:49.133200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:49.262141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:49.270975 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d0c09e2-bccf-4dc6-b865-fe9c62e4c82d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1722 microversion: 2.1 time: 0.151245 Oct 25 04:02:49.271563 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3689/7495] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:49 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:50.295442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:50.296108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:50.302925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:50.303419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:50.303864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:50.304564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:50.305027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:50.305462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:50.445588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:50.454905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ba40470-7b65-40a0-9cc5-a827293c71bf tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1722 microversion: 2.1 time: 0.163303 Oct 25 04:02:50.455517 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3807/7496] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:50 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:50.513216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-cef27a65-19bb-4a6b-ad4b-d788e92d0c3b req-b587fac8-8867-464f-b74c-177e5707fd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "name": "network-vif-plugged", "status": "completed", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:50.526094 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cef27a65-19bb-4a6b-ad4b-d788e92d0c3b req-b587fac8-8867-464f-b74c-177e5707fd88 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:50.526652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cef27a65-19bb-4a6b-ad4b-d788e92d0c3b req-b587fac8-8867-464f-b74c-177e5707fd88 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:50.527253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-cef27a65-19bb-4a6b-ad4b-d788e92d0c3b req-b587fac8-8867-464f-b74c-177e5707fd88 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:50.540506 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-cef27a65-19bb-4a6b-ad4b-d788e92d0c3b req-b587fac8-8867-464f-b74c-177e5707fd88 service nova] Creating event network-vif-plugged:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h1-862355-1 Oct 25 04:02:50.545661 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-cef27a65-19bb-4a6b-ad4b-d788e92d0c3b req-b587fac8-8867-464f-b74c-177e5707fd88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036262 Oct 25 04:02:50.546257 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3690/7497] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:02:51.478796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:51.480145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:51.488169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:51.488667 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:51.489369 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:51.490114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:51.490573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:51.491251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:51.558051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:51.567047 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0cd4ab63-1290-4f4a-b716-62726c60ea18 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1654 microversion: 2.1 time: 0.092296 Oct 25 04:02:51.567637 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3808/7498] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:51 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1654 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:51.665148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f7409b3a-308c-4315-9169-5a6711d43171 req-1d8d0380-03cb-4d68-9d51-59b321872cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac846dd-87a5-4907-ad7d-df347bdbe9f6", "name": "network-vif-deleted", "tag": "96b31924-fef1-4ed6-b64c-85f08670a78f"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:02:51.677286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:51.681214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f7409b3a-308c-4315-9169-5a6711d43171 req-1d8d0380-03cb-4d68-9d51-59b321872cc4 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:51.681580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f7409b3a-308c-4315-9169-5a6711d43171 req-1d8d0380-03cb-4d68-9d51-59b321872cc4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:51.682214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f7409b3a-308c-4315-9169-5a6711d43171 req-1d8d0380-03cb-4d68-9d51-59b321872cc4 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:51.699498 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f7409b3a-308c-4315-9169-5a6711d43171 req-1d8d0380-03cb-4d68-9d51-59b321872cc4 service nova] Creating event network-vif-deleted:96b31924-fef1-4ed6-b64c-85f08670a78f for instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 on n-h1-862355-1 Oct 25 04:02:51.705914 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f7409b3a-308c-4315-9169-5a6711d43171 req-1d8d0380-03cb-4d68-9d51-59b321872cc4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045104 Oct 25 04:02:51.706759 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3691/7499] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:02:52.591646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:52.592262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:52.595843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:02:52.601953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:52.602189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:52.602909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:52.603327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:52.603777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:52.604208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:52.672325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:52.684370 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a637ea95-2116-4cb6-af8c-e62a80f6b198 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1369 microversion: 2.1 time: 0.096250 Oct 25 04:02:52.689828 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3809/7500] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:52 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:53.710041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:53.710664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:53.717420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:53.717961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:53.718415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:53.719136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:53.719610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:53.720607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:53.784432 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:53.793063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a25e7ce6-1268-4284-89a6-c93f974f9a0b tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1369 microversion: 2.1 time: 0.087650 Oct 25 04:02:53.793654 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3692/7501] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:53 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:54.816762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:54.817390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:54.824273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:54.824763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:54.825209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:54.825953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:54.826420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:54.826855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:54.894585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:54.903084 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-840cc3e6-e900-4907-8234-04a79ae967c6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1369 microversion: 2.1 time: 0.091007 Oct 25 04:02:54.903696 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3810/7502] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:54 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:55.926979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:55.927608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:55.935326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:55.935818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:55.936292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:55.936998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:55.937512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:55.938078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:55.970307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:55.970779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:55.971191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:55.971653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lazy-loading 'fault' on Instance uuid 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:02:56.012912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ac3b8248b342079ead4a7aedce89ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3658252363f948bd83e3f172fd493212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:02:56.021418 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2cdbf01d-df64-4d8a-9a7a-db84a9c69f4d tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 200 len: 1374 microversion: 2.1 time: 0.099170 Oct 25 04:02:56.022036 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3693/7503] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:55 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 1374 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:02:57.044792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:57.045411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:57.053815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:57.053815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:57.054247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:57.054952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:57.055405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:57.055833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:57.070534 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 HTTP/1.1 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5ac846dd-87a5-4907-ad7d-df347bdbe9f6'} Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:02:57.072234 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2d819fa9-ffaa-41a2-8602-675e1e071683 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 404 len: 111 microversion: 2.1 time: 0.032913 Oct 25 04:02:57.077428 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3811/7504] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:02:57 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:02:57.191127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:02:57.193307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:02:57.200190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:57.200684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:57.201130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:57.201875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:02:57.202330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:02:57.202760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:02:57.215705 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/os-volume_attachments HTTP/1.1 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'server_id': '5ac846dd-87a5-4907-ad7d-df347bdbe9f6'} Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:02:57.217356 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d58faaea-2e5b-43e1-b13e-eacc51cb2d81 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032385 Oct 25 04:02:57.222658 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3694/7505] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:02:57 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.543538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.544053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.551562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.552050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.552495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.553193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.553653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.554113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.568726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 HTTP/1.1 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5ac846dd-87a5-4907-ad7d-df347bdbe9f6'} Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.570331 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d36dff46-e411-43ae-9b59-772172837b00 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 404 len: 111 microversion: 2.1 time: 0.032083 Oct 25 04:03:00.574760 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3812/7506] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:03:00 2022] DELETE /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.580451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.581113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 5ac846dd-87a5-4907-ad7d-df347bdbe9f6] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.589947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.590445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.590891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.591589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.592056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.592497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.607130 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 HTTP/1.1 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '5ac846dd-87a5-4907-ad7d-df347bdbe9f6'} Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.608585 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 5ac846dd-87a5-4907-ad7d-df347bdbe9f6 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5c85f65-4a35-4008-9bd6-6e7c434295cd tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6" status: 404 len: 111 microversion: 2.1 time: 0.033568 Oct 25 04:03:00.613621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3695/7507] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:00 2022] GET /compute/v2.1/servers/5ac846dd-87a5-4907-ad7d-df347bdbe9f6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.619483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.620186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.626663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.627169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.627627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.628362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.628829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.629267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.644889 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa HTTP/1.1 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '0a54dffa-b492-4944-8b2e-3183a6e19dfa'} Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.646787 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-07ba0236-2e9a-4980-9c3c-a009696e8560 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 404 len: 111 microversion: 2.1 time: 0.032720 Oct 25 04:03:00.650915 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3813/7508] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:03:00 2022] DELETE /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.657696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.658377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 0a54dffa-b492-4944-8b2e-3183a6e19dfa] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.664618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.665121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.665570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.666323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.666793 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.667243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.682068 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa HTTP/1.1 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '0a54dffa-b492-4944-8b2e-3183a6e19dfa'} Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.683918 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 0a54dffa-b492-4944-8b2e-3183a6e19dfa could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0c57919-e949-46fe-b494-429e1bbb6dd6 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa" status: 404 len: 111 microversion: 2.1 time: 0.032190 Oct 25 04:03:00.687981 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3696/7509] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:00 2022] GET /compute/v2.1/servers/0a54dffa-b492-4944-8b2e-3183a6e19dfa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.695562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.696079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.702354 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.702853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.703302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.704626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.705093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.705713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.719799 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 HTTP/1.1 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '37a9fc46-8869-4dc9-861c-a76e3803bd08'} Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.721386 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5f06c4e7-d018-4220-8bc8-77eed747fee7 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 404 len: 111 microversion: 2.1 time: 0.031300 Oct 25 04:03:00.725269 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3814/7510] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:03:00 2022] DELETE /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.731721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.732346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 37a9fc46-8869-4dc9-861c-a76e3803bd08] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.738364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.738860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.739308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.740009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.740475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.740911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.756629 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 HTTP/1.1 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '37a9fc46-8869-4dc9-861c-a76e3803bd08'} Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.758197 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 37a9fc46-8869-4dc9-861c-a76e3803bd08 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-61d77d23-8e7e-40d6-808a-12fd2f9d5761 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08" status: 404 len: 111 microversion: 2.1 time: 0.031782 Oct 25 04:03:00.762616 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3697/7511] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:00 2022] GET /compute/v2.1/servers/37a9fc46-8869-4dc9-861c-a76e3803bd08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.768384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.768932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.774948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.775442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.775886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.776590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.777053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.777489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.791969 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 HTTP/1.1 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9437afdd-eedf-484e-9f1c-fc6499a85f70'} Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.793545 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b8f05819-2da5-42f4-a38a-eb7948561c9a tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 404 len: 111 microversion: 2.1 time: 0.030641 Oct 25 04:03:00.797414 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3815/7512] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:03:00 2022] DELETE /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.804300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.804932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] [instance: 9437afdd-eedf-484e-9f1c-fc6499a85f70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:00.811241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.811744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.812201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.812907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:00.813588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:00.814064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:00.827534 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] HTTP exception thrown: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Request method failure captured: Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 HTTP/1.1 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV14zih0CbvS8R5UPzBatNXyHCY4e3oqDs-2UJpdX1B53m4TZ6qODUQxNyp-GtpIVuH8vD67hVmHMf8sUL-1HI9VMe4upC9Siyj64ssa-JF_lFwmLIAFAbr1xajN3_G3ABPWvp_dm-fc4DCo_RRGmdwmm0OK18U8yU4-X7ievJdTvbys Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3658252363f948bd83e3f172fd493212"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3658252363f948bd83e3f172fd493212", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3658252363f948bd83e3f172fd493212"}]}] Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 3658252363f948bd83e3f172fd493212 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServerActionsTestJSON-1641795439 Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 93ac3b8248b342079ead4a7aedce89ea Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServerActionsTestJSON-1641795439-project Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '9437afdd-eedf-484e-9f1c-fc6499a85f70'} Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:00.829530 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Returning 404 to user: Instance 9437afdd-eedf-484e-9f1c-fc6499a85f70 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-60101bd3-02ec-4c0b-9665-a8a3b0a5deae tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70" status: 404 len: 111 microversion: 2.1 time: 0.030542 Oct 25 04:03:00.833606 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3698/7513] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:00 2022] GET /compute/v2.1/servers/9437afdd-eedf-484e-9f1c-fc6499a85f70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:00.839710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3127f950-8e3f-4598-ae3a-517a7672a093 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] Calling method '.version_select at 0x7efd327d9310>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:00.863874 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3127f950-8e3f-4598-ae3a-517a7672a093 tempest-ServerActionsTestJSON-1641795439 tempest-ServerActionsTestJSON-1641795439-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080434280" status: 202 len: 0 microversion: 2.1 time: 0.027797 Oct 25 04:03:00.864580 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3816/7514] 10.222.0.36 () {58 vars in 1221 bytes} [Tue Oct 25 04:03:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080434280 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:03:10.491852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1968265613", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "a2819aec-6042-4c69-a384-343f710bd48b"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:10.548607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] validate_networks() for [('a2819aec-6042-4c69-a384-343f710bd48b', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:03:10.818908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=45 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:11.002339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:03:11.002779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:03:11.003273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:03:11.003700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:03:11.004134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:03:11.015282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:11.016414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:11.017023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:11.017940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:11.018417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:11.018859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:11.041638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Getting quotas for project 6a929e159fb044c3a27420b7fa594148. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:03:11.048763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Getting quotas for user 5e08c415065c4ad58fd7cef27d70956c and project 6a929e159fb044c3a27420b7fa594148. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:03:11.062455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:03:11.065536 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:03:11.113624 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4387628f-e8e7-43b2-bf0f-3fc6465ca58f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746819 Oct 25 04:03:11.120431 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3699/7515] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:03:11.125768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e1e3df5d-265a-410c-80d8-b1cb9c09b95b tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:11.126482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e1e3df5d-265a-410c-80d8-b1cb9c09b95b tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:11.135311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=34 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:11.136090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:11.194894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e1e3df5d-265a-410c-80d8-b1cb9c09b95b tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:11.202312 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e1e3df5d-265a-410c-80d8-b1cb9c09b95b tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1217 microversion: 2.1 time: 0.080439 Oct 25 04:03:11.204827 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3817/7516] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:11 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:12.228045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:12.228681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:12.237063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:12.237564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:12.238038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:12.238749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:12.239258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:12.239710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:12.309806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:12.319064 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb42590f-ef00-49b3-90f4-ede4bfb89ce3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1269 microversion: 2.1 time: 0.095128 Oct 25 04:03:12.319764 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3700/7517] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:12 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:13.341641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:13.342219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:13.352393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:13.353115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:13.353771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:13.354691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:13.355306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:13.355890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:13.538431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:13.550099 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a73942d9-12be-44c5-87ba-96d37a3baaa7 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1317 microversion: 2.1 time: 0.211830 Oct 25 04:03:13.569525 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3818/7518] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:13 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:14.071407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-e5306875-b8d3-4c90-8cd8-9ee037a10315 req-88b48eae-c261-4958-93ef-c76156533203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ae2b6a-10a2-4eba-955d-cce1dcc61d92", "tag": "c7f71f62-207f-4d30-87ad-f241a48699a8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:14.084260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e5306875-b8d3-4c90-8cd8-9ee037a10315 req-88b48eae-c261-4958-93ef-c76156533203 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:14.084822 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e5306875-b8d3-4c90-8cd8-9ee037a10315 req-88b48eae-c261-4958-93ef-c76156533203 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:14.085273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-e5306875-b8d3-4c90-8cd8-9ee037a10315 req-88b48eae-c261-4958-93ef-c76156533203 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:14.097956 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-e5306875-b8d3-4c90-8cd8-9ee037a10315 req-88b48eae-c261-4958-93ef-c76156533203 service nova] Creating event network-changed:c7f71f62-207f-4d30-87ad-f241a48699a8 for instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 on n-h1-862355-1 Oct 25 04:03:14.103210 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-e5306875-b8d3-4c90-8cd8-9ee037a10315 req-88b48eae-c261-4958-93ef-c76156533203 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035695 Oct 25 04:03:14.103836 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3701/7519] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:03:14.574631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:14.575268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:14.582928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:14.583412 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:14.583876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:14.584593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:14.585046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:14.585474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:14.717809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:14.726083 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8de4929e-1cd9-4221-bb74-7c1a4139e863 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1317 microversion: 2.1 time: 0.155441 Oct 25 04:03:14.726663 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3819/7520] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:14 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:15.750653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:15.751398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:15.757597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:15.758137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:15.758593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:15.759308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:15.759783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:15.760225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:15.962435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:15.970329 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2258416e-caa3-4fd1-9255-c0eb78b79ed8 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1317 microversion: 2.1 time: 0.225495 Oct 25 04:03:15.971156 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3702/7521] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:15 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:16.993761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:16.994980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:17.002138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:17.002636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:17.003079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:17.003820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:17.004280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:17.004712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:17.137523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:17.145829 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5794331c-57f7-45ae-a9e6-225ce1518256 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1317 microversion: 2.1 time: 0.156200 Oct 25 04:03:17.146404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3820/7522] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:16 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:18.169428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:18.170074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:18.177385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:18.177924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:18.178370 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:18.179065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:18.179526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:18.179958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:18.316988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:18.324762 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12dfc882-3536-453f-8693-f93e3c37f32f tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1317 microversion: 2.1 time: 0.159364 Oct 25 04:03:18.325336 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3703/7523] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:18 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:18.647921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e7c782c9-e791-4748-a8b3-558c8e35e379 req-db08de4f-f382-4364-a1b1-39683916917f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ae2b6a-10a2-4eba-955d-cce1dcc61d92", "name": "network-vif-plugged", "status": "completed", "tag": "c7f71f62-207f-4d30-87ad-f241a48699a8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:18.659713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7c782c9-e791-4748-a8b3-558c8e35e379 req-db08de4f-f382-4364-a1b1-39683916917f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:18.660204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7c782c9-e791-4748-a8b3-558c8e35e379 req-db08de4f-f382-4364-a1b1-39683916917f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:18.660643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e7c782c9-e791-4748-a8b3-558c8e35e379 req-db08de4f-f382-4364-a1b1-39683916917f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:18.672765 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e7c782c9-e791-4748-a8b3-558c8e35e379 req-db08de4f-f382-4364-a1b1-39683916917f service nova] Creating event network-vif-plugged:c7f71f62-207f-4d30-87ad-f241a48699a8 for instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 on n-h1-862355-1 Oct 25 04:03:18.677785 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e7c782c9-e791-4748-a8b3-558c8e35e379 req-db08de4f-f382-4364-a1b1-39683916917f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033941 Oct 25 04:03:18.678401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3821/7524] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:03:19.348742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:19.349367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:19.356243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:19.356735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:19.357181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:19.357919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:19.358384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:19.358818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:19.494910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:19.502877 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f1ea7c96-8b70-46aa-9270-4d2becf7d906 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1317 microversion: 2.1 time: 0.158228 Oct 25 04:03:19.503483 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3704/7525] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:19 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:20.528364 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:20.529616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:20.539265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:20.539762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:20.540203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:20.540910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:20.541373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:20.541836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:20.692215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:20.701890 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d0a25af5-b3c8-4faa-b9da-9fd2a1e41fc6 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1505 microversion: 2.1 time: 0.179434 Oct 25 04:03:20.702490 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3822/7526] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:20 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:20.771105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-910537516", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "a2819aec-6042-4c69-a384-343f710bd48b"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:20.839948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] validate_networks() for [('a2819aec-6042-4c69-a384-343f710bd48b', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:03:21.026620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:21.055730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:21.241216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:03:21.241633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:03:21.242147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:03:21.242565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:03:21.242988 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:03:21.260986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:21.261478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:21.266840 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:21.267622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:21.268105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:21.268550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:21.287900 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Getting quotas for project 6a929e159fb044c3a27420b7fa594148. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:03:21.293089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Getting quotas for user 5e08c415065c4ad58fd7cef27d70956c and project 6a929e159fb044c3a27420b7fa594148. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:03:21.306582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:03:21.309196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:03:21.354870 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ae3b11ba-8e99-4c60-a6fe-3c853bb70a54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588856 Oct 25 04:03:21.355546 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3705/7527] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:03:21.366801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d2df670a-0484-4f9a-9a32-07d454b56e63 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:21.367434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d2df670a-0484-4f9a-9a32-07d454b56e63 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:21.369577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:21.424332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d2df670a-0484-4f9a-9a32-07d454b56e63 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:21.431718 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d2df670a-0484-4f9a-9a32-07d454b56e63 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1216 microversion: 2.1 time: 0.068896 Oct 25 04:03:21.432445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3823/7528] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:21 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:22.456000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:22.456692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:22.459951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:22.464780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:22.465280 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:22.465751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:22.466463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:22.466930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:22.467366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:22.797188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:22.806051 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a0bd406-b629-47a8-811e-e7b36b3f2c34 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1274 microversion: 2.1 time: 0.355171 Oct 25 04:03:22.806737 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3706/7529] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:22 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1274 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:23.767659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f07706cc-345a-468d-9d0e-e8377c7a9025 req-3da637f0-6aea-4e90-9bc7-c430fea817f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1156d257-c992-4580-9d57-c122a7b9c11a", "tag": "fd7bbbec-61e8-4637-ac3b-229e84ed2dc1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:23.779321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f07706cc-345a-468d-9d0e-e8377c7a9025 req-3da637f0-6aea-4e90-9bc7-c430fea817f1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:23.779906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f07706cc-345a-468d-9d0e-e8377c7a9025 req-3da637f0-6aea-4e90-9bc7-c430fea817f1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:23.780763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f07706cc-345a-468d-9d0e-e8377c7a9025 req-3da637f0-6aea-4e90-9bc7-c430fea817f1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:23.793787 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f07706cc-345a-468d-9d0e-e8377c7a9025 req-3da637f0-6aea-4e90-9bc7-c430fea817f1 service nova] Creating event network-changed:fd7bbbec-61e8-4637-ac3b-229e84ed2dc1 for instance 1156d257-c992-4580-9d57-c122a7b9c11a on n-h2-862355-1 Oct 25 04:03:23.799719 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f07706cc-345a-468d-9d0e-e8377c7a9025 req-3da637f0-6aea-4e90-9bc7-c430fea817f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036662 Oct 25 04:03:23.800342 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3824/7530] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:03:23.829438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:23.830257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:23.837459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:23.838102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:23.838684 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:23.839478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:23.840014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:23.840519 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:23.974598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:23.982498 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-71fdab3e-2636-452a-a0f0-41c21386cdb2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1316 microversion: 2.1 time: 0.157485 Oct 25 04:03:23.983105 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3707/7531] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:23 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:25.006046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:25.006754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:25.013036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:25.013504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:25.013968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:25.014666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:25.015205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:25.015722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:25.151528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:25.159960 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e0b8d363-8bb9-4114-92c0-1deb3a80952e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1316 microversion: 2.1 time: 0.159153 Oct 25 04:03:25.160560 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3825/7532] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:24 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:03:26.182735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:26.183639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:26.191456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:26.191955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:26.192410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:26.193122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:26.193597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:26.194070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:26.327057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:26.335775 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8436ba4f-4132-42a0-b2c1-5705ae881f30 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1316 microversion: 2.1 time: 0.156984 Oct 25 04:03:26.336350 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3708/7533] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:26 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:27.359073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:27.359870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:27.366757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:27.367246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:27.367689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:27.368384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:27.368842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:27.369273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:27.504466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:27.512435 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-308b2989-fdf5-4e44-bbff-5653a8574c82 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1316 microversion: 2.1 time: 0.157486 Oct 25 04:03:27.513010 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3826/7534] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:27 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:28.536755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:28.537364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:28.543767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:28.544259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:28.544706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:28.545403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:28.545936 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:28.546871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:28.675737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:28.683649 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-774bc65c-eb23-4d27-9852-2f69f7c8264d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1316 microversion: 2.1 time: 0.150790 Oct 25 04:03:28.684216 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3709/7535] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:28 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:29.598961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a9ae7edb-9eb2-442f-93d6-d594c2ecde1b req-83928738-7541-4935-83b4-6c4fb752d5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1156d257-c992-4580-9d57-c122a7b9c11a", "name": "network-vif-plugged", "status": "completed", "tag": "fd7bbbec-61e8-4637-ac3b-229e84ed2dc1"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:29.609593 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a9ae7edb-9eb2-442f-93d6-d594c2ecde1b req-83928738-7541-4935-83b4-6c4fb752d5bc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:29.610234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a9ae7edb-9eb2-442f-93d6-d594c2ecde1b req-83928738-7541-4935-83b4-6c4fb752d5bc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:29.610727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a9ae7edb-9eb2-442f-93d6-d594c2ecde1b req-83928738-7541-4935-83b4-6c4fb752d5bc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:29.622961 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a9ae7edb-9eb2-442f-93d6-d594c2ecde1b req-83928738-7541-4935-83b4-6c4fb752d5bc service nova] Creating event network-vif-plugged:fd7bbbec-61e8-4637-ac3b-229e84ed2dc1 for instance 1156d257-c992-4580-9d57-c122a7b9c11a on n-h2-862355-1 Oct 25 04:03:29.628329 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a9ae7edb-9eb2-442f-93d6-d594c2ecde1b req-83928738-7541-4935-83b4-6c4fb752d5bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Oct 25 04:03:29.628944 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3827/7536] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:03:29.709653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:29.710970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:29.717339 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:29.717919 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:29.718584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:29.720186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:29.720655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:29.721102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:29.860958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:29.868717 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8cc1703e-7a9e-4cd8-802f-51a791469e88 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1316 microversion: 2.1 time: 0.164716 Oct 25 04:03:29.869282 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3710/7537] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:29 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:30.893415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:30.894166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:30.902080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:30.902568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:30.903006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:30.903702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:30.904159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:30.904584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:31.050346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:31.058397 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ae3438c3-51f5-4801-a480-2e88141f5d54 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1316 microversion: 2.1 time: 0.169601 Oct 25 04:03:31.058995 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3828/7538] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:30 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:32.082967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:32.083595 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:32.086284 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:32.086965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:32.094850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:32.095079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:32.095529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:32.096231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:32.096699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:32.097137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:32.227463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:32.235278 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f46c1dc6-3b31-461d-960a-85a1db4e2549 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1505 microversion: 2.1 time: 0.156927 Oct 25 04:03:32.235858 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3711/7539] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:32 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:32.258312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:32.258826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:32.260993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:32.267387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:32.267826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:32.268260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:32.268958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:32.269413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:32.269875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:32.294793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:03:32.374248 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fbb0f35c-00b3-4c27-9995-2f6003ab97b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 204 len: 0 microversion: 2.1 time: 0.119516 Oct 25 04:03:32.374929 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3829/7540] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:03:32 2022] DELETE /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:03:32.384311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:32.384930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:32.392116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:32.392622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:32.393071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:32.393806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:32.394279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:32.394716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:32.524945 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:32.532827 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-25e83985-7cfb-4e03-af3e-3f720ef9e9b9 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1511 microversion: 2.1 time: 0.152395 Oct 25 04:03:32.533404 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3712/7541] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:32 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:33.557151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:33.558125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:33.565437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:33.565951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:33.566387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:33.567077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:33.567531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:33.567952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:33.707136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:33.714879 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-90766b86-6af7-4408-a30d-7fd9789e1639 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 200 len: 1511 microversion: 2.1 time: 0.162027 Oct 25 04:03:33.715459 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3830/7542] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:33 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:34.222719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-c8d8db0c-8b5b-4a47-83ce-82a3aa54ad30 req-271c3cc5-6a07-41e9-b023-ad04ebe23f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1156d257-c992-4580-9d57-c122a7b9c11a", "name": "network-vif-deleted", "tag": "fd7bbbec-61e8-4637-ac3b-229e84ed2dc1"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:34.237340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c8d8db0c-8b5b-4a47-83ce-82a3aa54ad30 req-271c3cc5-6a07-41e9-b023-ad04ebe23f97 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:34.237898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c8d8db0c-8b5b-4a47-83ce-82a3aa54ad30 req-271c3cc5-6a07-41e9-b023-ad04ebe23f97 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:34.238571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-c8d8db0c-8b5b-4a47-83ce-82a3aa54ad30 req-271c3cc5-6a07-41e9-b023-ad04ebe23f97 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:34.252360 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-c8d8db0c-8b5b-4a47-83ce-82a3aa54ad30 req-271c3cc5-6a07-41e9-b023-ad04ebe23f97 service nova] Creating event network-vif-deleted:fd7bbbec-61e8-4637-ac3b-229e84ed2dc1 for instance 1156d257-c992-4580-9d57-c122a7b9c11a on n-h2-862355-1 Oct 25 04:03:34.258939 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-c8d8db0c-8b5b-4a47-83ce-82a3aa54ad30 req-271c3cc5-6a07-41e9-b023-ad04ebe23f97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039801 Oct 25 04:03:34.260554 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3713/7543] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:03:34.738956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:34.739575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:34.746664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:34.747160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:34.747629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:34.748401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:34.748890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:34.749324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:34.764068 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] HTTP exception thrown: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Request method failure captured: Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a HTTP/1.1 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1_-MPHuIG6yyAaWq5ryUBv0GNcCOGoILCMlswwhq5VfezoSKzeWKMYE0FOvJMbj9JN6yGrNzlS_Mdj5tSAVBHHyDkNJ6CIStQiQ8qQ_HxaigoIlDq3omldpL7-sOmgQmDRrpcj3_cLM8qbIYBy5mwFMo9bzS_cgmnJKSXiZVOlTfdM Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a929e159fb044c3a27420b7fa594148", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a929e159fb044c3a27420b7fa594148"}]}] Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5e08c415065c4ad58fd7cef27d70956c Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '1156d257-c992-4580-9d57-c122a7b9c11a'} Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:34.765775 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Returning 404 to user: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:34.771577 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-edf40cf1-e406-4bea-8126-69ae897a6f47 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 404 len: 111 microversion: 2.1 time: 0.033210 Oct 25 04:03:34.772504 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3831/7544] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:34 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:34.777941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:34.778656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:34.786048 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:34.786560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:34.787010 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:34.787719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:34.788196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:34.788638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:34.926527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:34.934571 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a4e19ecf-3ad1-4a99-b962-edc82fe22345 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1505 microversion: 2.1 time: 0.161201 Oct 25 04:03:34.935130 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3714/7545] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:34 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:34.957594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eaea7780-2412-4c00-b5fc-ba9c02c32dbe tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:34.959910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eaea7780-2412-4c00-b5fc-ba9c02c32dbe tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 16ddebd4-eb9b-426d-a377-3255793d2c27] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:34.965327 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-eaea7780-2412-4c00-b5fc-ba9c02c32dbe tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] HTTP exception thrown: Instance 16ddebd4-eb9b-426d-a377-3255793d2c27 could not be found. Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eaea7780-2412-4c00-b5fc-ba9c02c32dbe tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Request method failure captured: Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/16ddebd4-eb9b-426d-a377-3255793d2c27/action HTTP/1.1 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 32 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1_-MPHuIG6yyAaWq5ryUBv0GNcCOGoILCMlswwhq5VfezoSKzeWKMYE0FOvJMbj9JN6yGrNzlS_Mdj5tSAVBHHyDkNJ6CIStQiQ8qQ_HxaigoIlDq3omldpL7-sOmgQmDRrpcj3_cLM8qbIYBy5mwFMo9bzS_cgmnJKSXiZVOlTfdM Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a929e159fb044c3a27420b7fa594148", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a929e159fb044c3a27420b7fa594148"}]}] Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5e08c415065c4ad58fd7cef27d70956c Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: {"resize": {"flavorRef": "452"}} Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 16ddebd4-eb9b-426d-a377-3255793d2c27 could not be found. Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '16ddebd4-eb9b-426d-a377-3255793d2c27', 'body': {'resize': {'flavorRef': '452'}}} Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ddebd4-eb9b-426d-a377-3255793d2c27 could not be found. Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:34.966920 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ddebd4-eb9b-426d-a377-3255793d2c27 could not be found. Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ddebd4-eb9b-426d-a377-3255793d2c27 could not be found. Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eaea7780-2412-4c00-b5fc-ba9c02c32dbe tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Returning 404 to user: Instance 16ddebd4-eb9b-426d-a377-3255793d2c27 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eaea7780-2412-4c00-b5fc-ba9c02c32dbe tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "POST /compute/v2.1/servers/16ddebd4-eb9b-426d-a377-3255793d2c27/action" status: 404 len: 111 microversion: 2.1 time: 0.014838 Oct 25 04:03:34.971584 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3832/7546] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:03:34 2022] POST /compute/v2.1/servers/16ddebd4-eb9b-426d-a377-3255793d2c27/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:34.976837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:34.977506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:34.983373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:34.983862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:34.984308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:34.986057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:34.986528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:34.986965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.118046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:35.126471 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-95686d1b-2a23-4808-9ac0-abe41e0579c4 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1505 microversion: 2.1 time: 0.153425 Oct 25 04:03:35.127058 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3715/7547] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:34 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:35.149352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:35.150010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:35.160904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.161394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.161877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.162573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.163035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.163465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.345952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:35.353648 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4435510b-8c30-4fae-be1b-7840ea6f6bf3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1505 microversion: 2.1 time: 0.208100 Oct 25 04:03:35.354249 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3833/7548] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:35 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:35.376372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9872f93c-a0d7-471b-8b20-a7ea616a87dd"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:35.378742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:35.385603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.386131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.386579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.387283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.387751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.388189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.427848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:35.433372 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] HTTP exception thrown: Flavor 9872f93c-a0d7-471b-8b20-a7ea616a87dd could not be found. Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Request method failure captured: Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: request: POST /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92/action HTTP/1.1 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 65 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1_-MPHuIG6yyAaWq5ryUBv0GNcCOGoILCMlswwhq5VfezoSKzeWKMYE0FOvJMbj9JN6yGrNzlS_Mdj5tSAVBHHyDkNJ6CIStQiQ8qQ_HxaigoIlDq3omldpL7-sOmgQmDRrpcj3_cLM8qbIYBy5mwFMo9bzS_cgmnJKSXiZVOlTfdM Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a929e159fb044c3a27420b7fa594148", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a929e159fb044c3a27420b7fa594148"}]}] Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5e08c415065c4ad58fd7cef27d70956c Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: {"resize": {"flavorRef": "9872f93c-a0d7-471b-8b20-a7ea616a87dd"}} Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: exception: Flavor 9872f93c-a0d7-471b-8b20-a7ea616a87dd could not be found. Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '62ae2b6a-10a2-4eba-955d-cce1dcc61d92', 'body': {'resize': {'flavorRef': '9872f93c-a0d7-471b-8b20-a7ea616a87dd'}}} Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:35.435361 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9872f93c-a0d7-471b-8b20-a7ea616a87dd could not be found. Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9872f93c-a0d7-471b-8b20-a7ea616a87dd could not be found. Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9872f93c-a0d7-471b-8b20-a7ea616a87dd could not be found. Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Returning 400 to user: Flavor 9872f93c-a0d7-471b-8b20-a7ea616a87dd could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e0139463-3413-4095-94cd-0ea9d47e020e tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "POST /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92/action" status: 400 len: 107 microversion: 2.1 time: 0.064565 Oct 25 04:03:35.439958 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3716/7549] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:03:35 2022] POST /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 04:03:35.446164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:35.446725 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:35.452790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.453275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.453929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.454622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.455080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.455503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.583914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:35.592218 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-af98eb4d-e229-48ac-8443-95e19d227244 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1505 microversion: 2.1 time: 0.150015 Oct 25 04:03:35.592801 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3834/7550] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:35 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:35.616663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:35.617330 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:35.623335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.623837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.624291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.625004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.625785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.626242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.758219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:35.766576 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4982c6cd-8024-41b2-9213-a266dfeb1e8d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1505 microversion: 2.1 time: 0.153232 Oct 25 04:03:35.767143 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3717/7551] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:35 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:35.789320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08092835-8728-4183-8a11-145cb132d80d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08092835-8728-4183-8a11-145cb132d80d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Request method failure captured: Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: request: POST /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92/action HTTP/1.1 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 29 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1_-MPHuIG6yyAaWq5ryUBv0GNcCOGoILCMlswwhq5VfezoSKzeWKMYE0FOvJMbj9JN6yGrNzlS_Mdj5tSAVBHHyDkNJ6CIStQiQ8qQ_HxaigoIlDq3omldpL7-sOmgQmDRrpcj3_cLM8qbIYBy5mwFMo9bzS_cgmnJKSXiZVOlTfdM Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a929e159fb044c3a27420b7fa594148", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a929e159fb044c3a27420b7fa594148"}]}] Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5e08c415065c4ad58fd7cef27d70956c Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: {"resize": {"flavorRef": ""}} Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '62ae2b6a-10a2-4eba-955d-cce1dcc61d92', 'body': {'resize': {'flavorRef': ''}}} Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise error Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi '' Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.793473 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08092835-8728-4183-8a11-145cb132d80d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08092835-8728-4183-8a11-145cb132d80d tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "POST /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92/action" status: 400 len: 113 microversion: 2.1 time: 0.009619 Oct 25 04:03:35.798506 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3835/7552] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:03:35 2022] POST /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 25 04:03:35.803364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:35.803995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:35.810200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.810693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.811140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.811839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.812308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.812824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.831163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=100 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:35.944731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:35.952501 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b7e24824-f07d-4f37-b42f-2d3ac95695a5 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1505 microversion: 2.1 time: 0.152935 Oct 25 04:03:35.953123 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3718/7553] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:35 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:35.979709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:35.980220 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:35.987622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.988118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.988564 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:35.989269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:35.989777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:35.990217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:36.004214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] HTTP exception thrown: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Request method failure captured: Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a HTTP/1.1 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV1_-MPHuIG6yyAaWq5ryUBv0GNcCOGoILCMlswwhq5VfezoSKzeWKMYE0FOvJMbj9JN6yGrNzlS_Mdj5tSAVBHHyDkNJ6CIStQiQ8qQ_HxaigoIlDq3omldpL7-sOmgQmDRrpcj3_cLM8qbIYBy5mwFMo9bzS_cgmnJKSXiZVOlTfdM Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a929e159fb044c3a27420b7fa594148", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a929e159fb044c3a27420b7fa594148"}]}] Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 5e08c415065c4ad58fd7cef27d70956c Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '1156d257-c992-4580-9d57-c122a7b9c11a'} Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:36.005893 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Returning 404 to user: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3bef27fd-74da-49bb-b9a3-7dd2cc18b5a2 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 404 len: 111 microversion: 2.1 time: 0.032439 Oct 25 04:03:36.010404 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3836/7554] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:03:35 2022] DELETE /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:36.016683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:36.017474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 1156d257-c992-4580-9d57-c122a7b9c11a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:36.023652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:36.024153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:36.024608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:36.025321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:36.025831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:36.026364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:36.041828 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] HTTP exception thrown: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Request method failure captured: Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a HTTP/1.1 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1_-MPHuIG6yyAaWq5ryUBv0GNcCOGoILCMlswwhq5VfezoSKzeWKMYE0FOvJMbj9JN6yGrNzlS_Mdj5tSAVBHHyDkNJ6CIStQiQ8qQ_HxaigoIlDq3omldpL7-sOmgQmDRrpcj3_cLM8qbIYBy5mwFMo9bzS_cgmnJKSXiZVOlTfdM Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a929e159fb044c3a27420b7fa594148", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a929e159fb044c3a27420b7fa594148"}]}] Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5e08c415065c4ad58fd7cef27d70956c Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1156d257-c992-4580-9d57-c122a7b9c11a'} Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:36.043405 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Returning 404 to user: Instance 1156d257-c992-4580-9d57-c122a7b9c11a could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8650a5ef-7045-414a-965f-0536110d153c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a" status: 404 len: 111 microversion: 2.1 time: 0.032629 Oct 25 04:03:36.051179 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3719/7555] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:36 2022] GET /compute/v2.1/servers/1156d257-c992-4580-9d57-c122a7b9c11a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:03:36.053582 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:36.054112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:36.060350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:36.060829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:36.061263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:36.061967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:36.062423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:36.063922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:36.089579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:03:36.136061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:03:36.170652 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6d304eae-210d-41e2-8d79-6117399cc2b3 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "DELETE /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 204 len: 0 microversion: 2.1 time: 0.120667 Oct 25 04:03:36.171188 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3837/7556] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:03:36 2022] DELETE /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:03:36.179507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:36.180136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:36.186548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:36.187045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:36.187499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:36.188767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:36.189232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:36.189688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:36.319139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:36.327090 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db4cdb7c-d6c9-4132-8066-4625632d7d33 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1511 microversion: 2.1 time: 0.151474 Oct 25 04:03:36.327664 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3720/7557] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:36 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:37.351493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:37.352118 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:37.358852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:37.359332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:37.360289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:37.360997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:37.361438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:37.361895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:37.499224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:37.507671 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-310d6610-5e8c-4a60-8adb-41d5bf412a56 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1511 microversion: 2.1 time: 0.160502 Oct 25 04:03:37.508257 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3838/7558] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:37 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:38.084234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-fc85931d-fadd-4701-adeb-6421e63c1def req-9941ede1-77a0-4bdb-b915-f863936378a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ae2b6a-10a2-4eba-955d-cce1dcc61d92", "name": "network-vif-deleted", "tag": "c7f71f62-207f-4d30-87ad-f241a48699a8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:03:38.096416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fc85931d-fadd-4701-adeb-6421e63c1def req-9941ede1-77a0-4bdb-b915-f863936378a8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:38.097479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fc85931d-fadd-4701-adeb-6421e63c1def req-9941ede1-77a0-4bdb-b915-f863936378a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:38.097962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-fc85931d-fadd-4701-adeb-6421e63c1def req-9941ede1-77a0-4bdb-b915-f863936378a8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:38.111742 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-fc85931d-fadd-4701-adeb-6421e63c1def req-9941ede1-77a0-4bdb-b915-f863936378a8 service nova] Creating event network-vif-deleted:c7f71f62-207f-4d30-87ad-f241a48699a8 for instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 on n-h1-862355-1 Oct 25 04:03:38.118076 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-fc85931d-fadd-4701-adeb-6421e63c1def req-9941ede1-77a0-4bdb-b915-f863936378a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038262 Oct 25 04:03:38.118694 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3721/7559] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:03:38.532976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:38.533505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:38.541522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:38.542136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:38.542897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:38.543467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:38.543951 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:38.544362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:38.577438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:38.577962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:38.579015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:38.579483 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lazy-loading 'fault' on Instance uuid 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:03:38.621475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e08c415065c4ad58fd7cef27d70956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a929e159fb044c3a27420b7fa594148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:03:38.630274 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-550fb948-580c-4617-86a3-9f5a6a52844c tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 200 len: 1307 microversion: 2.1 time: 0.101731 Oct 25 04:03:38.630867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3839/7560] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:38 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:03:39.656725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:03:39.658113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] [instance: 62ae2b6a-10a2-4eba-955d-cce1dcc61d92] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:03:39.665160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:39.665655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:39.666140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:39.666845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:03:39.667314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:03:39.667755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:03:39.682021 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] HTTP exception thrown: Instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 could not be found. Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Request method failure captured: Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 HTTP/1.1 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV1_-MPHuIG6yyAaWq5ryUBv0GNcCOGoILCMlswwhq5VfezoSKzeWKMYE0FOvJMbj9JN6yGrNzlS_Mdj5tSAVBHHyDkNJ6CIStQiQ8qQ_HxaigoIlDq3omldpL7-sOmgQmDRrpcj3_cLM8qbIYBy5mwFMo9bzS_cgmnJKSXiZVOlTfdM Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a929e159fb044c3a27420b7fa594148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a929e159fb044c3a27420b7fa594148", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a929e159fb044c3a27420b7fa594148"}]}] Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 6a929e159fb044c3a27420b7fa594148 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-ServersNegativeTestJSON-228592369 Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 5e08c415065c4ad58fd7cef27d70956c Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-ServersNegativeTestJSON-228592369-project Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 could not be found. Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '62ae2b6a-10a2-4eba-955d-cce1dcc61d92'} Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 could not be found. Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 could not be found. Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:03:39.683924 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 could not be found. Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] Returning 404 to user: Instance 62ae2b6a-10a2-4eba-955d-cce1dcc61d92 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0ceb4947-5593-4edb-99a8-499c152f31f1 tempest-ServersNegativeTestJSON-228592369 tempest-ServersNegativeTestJSON-228592369-project] 10.222.0.36 "GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92" status: 404 len: 111 microversion: 2.1 time: 0.033071 Oct 25 04:03:39.688673 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3722/7561] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:03:39 2022] GET /compute/v2.1/servers/62ae2b6a-10a2-4eba-955d-cce1dcc61d92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:04:12.241436 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:04:12.242276 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:04:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 25 04:04:12.243959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:12.244899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:12.424334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f307c4a6-99e1-4b97-ade1-491fd78b7c1a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: .version_select at 0x7efd38150e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1880755650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOFW/yiaF3I9/O/dMbJlshfZbtcMqoPkqXVhgTtTjoVrQfJ+0Xw+maLIqowWaO09NURa+uQBg/Hi22V8vcwnXDaB7sogzDyadgYKMuXmer7IG8oXLnNoJKc3nmtnd2oqw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:12.446378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-f307c4a6-99e1-4b97-ade1-491fd78b7c1a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:04:12.451844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-f307c4a6-99e1-4b97-ade1-491fd78b7c1a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for user 046b19a6edfa435398ff51eadcc36316 and project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:04:12.481607 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f307c4a6-99e1-4b97-ade1-491fd78b7c1a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.245283 Oct 25 04:04:12.482277 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3840/7562] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:04:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:12.534671 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-188768983", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1880755650", "networks": [{"uuid": "9fab0eb2-4517-4e2d-ada3-b6fc5da21da4"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:12.545429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=35 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:12.546654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=14 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:12.783679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] validate_networks() for [('9fab0eb2-4517-4e2d-ada3-b6fc5da21da4', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:04:13.162025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:04:13.162482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:04:13.162953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:04:13.163375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:04:13.163801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:04:13.172995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:13.173498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:13.173986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:13.174740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:13.176208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:13.176663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:13.193510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:04:13.198865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for user 046b19a6edfa435398ff51eadcc36316 and project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:04:13.211511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:04:13.213878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:04:13.262174 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ab9a97d8-fc60-4283-9da3-999995b6a56c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731710 Oct 25 04:04:13.265711 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3723/7563] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:04:13.276658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-252513f4-41ea-4ea4-814f-6eebf30b58fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:13.277287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-252513f4-41ea-4ea4-814f-6eebf30b58fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:13.357306 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-252513f4-41ea-4ea4-814f-6eebf30b58fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:13.366145 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-252513f4-41ea-4ea4-814f-6eebf30b58fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1262 microversion: 2.1 time: 0.095501 Oct 25 04:04:13.367338 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3841/7564] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:13 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:14.392839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:14.393465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:14.400205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:14.400698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:14.401147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:14.401889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:14.402356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:14.402810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:14.467225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:14.474991 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ad168527-75b7-48fa-85c9-de7e8ab423b5 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1314 microversion: 2.1 time: 0.088476 Oct 25 04:04:14.475564 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3724/7565] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:14 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1314 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:15.499953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:15.500466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:15.508044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:15.508869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:15.509517 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:15.510469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:15.511075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:15.512315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:15.695315 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:15.704406 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-51bee3cc-0ca0-44c7-90d1-d84e83b3c3a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.209695 Oct 25 04:04:15.705557 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3842/7566] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:15 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:16.444553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-aa7e9134-42a6-4d95-9184-4288b2df55b1 req-677f7078-ab01-4fab-a3a8-9dad0da970f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8", "tag": "f927350d-b098-4129-b2a9-7f4b45c7bb6a"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:16.455753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aa7e9134-42a6-4d95-9184-4288b2df55b1 req-677f7078-ab01-4fab-a3a8-9dad0da970f8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:16.456308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aa7e9134-42a6-4d95-9184-4288b2df55b1 req-677f7078-ab01-4fab-a3a8-9dad0da970f8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:16.456752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aa7e9134-42a6-4d95-9184-4288b2df55b1 req-677f7078-ab01-4fab-a3a8-9dad0da970f8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:16.469639 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-aa7e9134-42a6-4d95-9184-4288b2df55b1 req-677f7078-ab01-4fab-a3a8-9dad0da970f8 service nova] Creating event network-changed:f927350d-b098-4129-b2a9-7f4b45c7bb6a for instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 on n-h1-862355-1 Oct 25 04:04:16.475323 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-aa7e9134-42a6-4d95-9184-4288b2df55b1 req-677f7078-ab01-4fab-a3a8-9dad0da970f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115309 Oct 25 04:04:16.476403 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3725/7567] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:16.728466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:16.729094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:16.736931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:16.737429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:16.737906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:16.738611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:16.739074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:16.739504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:16.875602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:16.883523 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ed8215e1-96bc-4937-8a9b-374de90beac8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.158941 Oct 25 04:04:16.884111 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3843/7568] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:16 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:17.910155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:17.910875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:17.919987 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:17.920497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:17.921557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:17.922303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:17.922786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:17.923231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:18.162258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:18.170172 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9b6d76ed-7f1d-4c2d-b6ae-087eeaa1edf3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.265854 Oct 25 04:04:18.170961 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3726/7569] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:17 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:19.193959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:19.194515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:19.201334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:19.201899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:19.202399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:19.203093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:19.203558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:19.203994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:19.343596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:19.351479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-98079f8d-3723-4a62-9859-d902a14797cd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.161576 Oct 25 04:04:19.352060 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3844/7570] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:19 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:20.375751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:20.376413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:20.383271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:20.383768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:20.384219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:20.384967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:20.385436 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:20.385911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:20.521261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:20.529047 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07df1712-3325-4a4b-b636-3f345c81f478 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.157837 Oct 25 04:04:20.529627 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3727/7571] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:20 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:21.552210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:21.552865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:21.559984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:21.560466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:21.560909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:21.561747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:21.562213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:21.562644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:21.691820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:21.699387 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b947c64-a0a7-4cfd-8f2f-fa831f368516 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.151168 Oct 25 04:04:21.699959 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3845/7572] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:21 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:22.725795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:22.726431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:22.736755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:22.737267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:22.737911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:22.738641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:22.739111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:22.739556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:22.903540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:22.913869 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fefc28e3-ee64-4766-80bd-fcf5435bec8b tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.193677 Oct 25 04:04:22.914576 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3728/7573] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:22 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:23.005060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-befded99-6c65-4c23-9632-aeb5ac1cc0e2 req-d1515575-7d9f-4dbd-8276-e02483901dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8", "name": "network-vif-plugged", "status": "completed", "tag": "f927350d-b098-4129-b2a9-7f4b45c7bb6a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:23.017099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-befded99-6c65-4c23-9632-aeb5ac1cc0e2 req-d1515575-7d9f-4dbd-8276-e02483901dc5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:23.017599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-befded99-6c65-4c23-9632-aeb5ac1cc0e2 req-d1515575-7d9f-4dbd-8276-e02483901dc5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:23.018064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-befded99-6c65-4c23-9632-aeb5ac1cc0e2 req-d1515575-7d9f-4dbd-8276-e02483901dc5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:23.032322 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-befded99-6c65-4c23-9632-aeb5ac1cc0e2 req-d1515575-7d9f-4dbd-8276-e02483901dc5 service nova] Creating event network-vif-plugged:f927350d-b098-4129-b2a9-7f4b45c7bb6a for instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 on n-h1-862355-1 Oct 25 04:04:23.037495 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-befded99-6c65-4c23-9632-aeb5ac1cc0e2 req-d1515575-7d9f-4dbd-8276-e02483901dc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100666 Oct 25 04:04:23.038168 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3846/7574] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:23.941249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:23.941852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:23.944011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:23.944813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:23.950818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:23.951318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:23.951769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:23.952601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:23.953079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:23.953543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:24.083257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:24.090964 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a3137e8e-7e52-4668-8824-a5a049321ea1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1362 microversion: 2.1 time: 0.153704 Oct 25 04:04:24.091533 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3729/7575] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:23 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:25.111642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:25.116971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:25.117700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:25.124128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:25.124614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:25.125047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:25.125768 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:25.126232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:25.126660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:25.260348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:25.269336 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ce0682f-ff85-4b4b-b590-3dbc60d2e4a7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1553 microversion: 2.1 time: 0.158499 Oct 25 04:04:25.270268 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3847/7576] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:25 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:25.293776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:25.294402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:25.301260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:25.301791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:25.302244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:25.302944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:25.303412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:25.303853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:25.433407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:25.441767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-effc65f5-6010-4943-b902-d074b7fa7617 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1553 microversion: 2.1 time: 0.151944 Oct 25 04:04:25.442342 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3730/7577] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:25 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:27.104824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49386eb-4bac-4b57-ab60-c73c89e861d0"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:27.107222 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:27.114704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:27.115196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:27.115638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:27.116339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:27.116801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:27.117259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:27.363000 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1fef77b7-67e7-4fc2-98cf-11eeda1c9123 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262008 Oct 25 04:04:27.363706 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3848/7578] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 04:04:27 2022] POST /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:38.264366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:38.265399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:38.268021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:38.268726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=40 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:38.275257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:38.275756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:38.276209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:38.276920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:38.277391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:38.277862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:38.357504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lazy-loading 'services' on Instance uuid 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:04:38.427972 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0492276-9ec1-4d4a-9ef7-e6656c145342 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments/a49386eb-4bac-4b57-ab60-c73c89e861d0" status: 202 len: 0 microversion: 2.1 time: 0.167621 Oct 25 04:04:38.428568 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3731/7579] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:04:38 2022] DELETE /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments/a49386eb-4bac-4b57-ab60-c73c89e861d0 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:04:38.439602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:38.442148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:38.445140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:38.446017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:04:38.454860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:38.455370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:38.455823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:38.456548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:38.457017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:38.457452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:38.491724 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2a2d12c-de5d-4afd-aab8-439b2491d9e7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057197 Oct 25 04:04:38.492302 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3849/7580] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:04:38 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:39.506574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:39.508993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:39.516248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:39.517120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:39.517728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:39.518456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:39.518928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:39.519429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:39.550756 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96ea4f2c-3ba9-4f82-940c-55ffabee506c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049511 Oct 25 04:04:39.551341 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3732/7581] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:04:39 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:40.563724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:40.566076 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:40.572955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:40.573448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:40.573917 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:40.574626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:40.575084 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:40.575518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:40.606774 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f0b7b58f-788e-4d6d-96d6-cb5c16835665 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Oct 25 04:04:40.607563 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3850/7582] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:04:40 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:41.620347 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:41.622450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:41.629927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:41.630430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:41.630880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:41.631586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:41.632053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:41.632489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:41.664307 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b89d9b2-eb77-4d14-818a-2f762791b365 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 Oct 25 04:04:41.664871 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3733/7583] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:04:41 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:42.678025 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:42.680285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:42.688278 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:42.688765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:42.689205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:42.689930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:42.690382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:42.690810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:42.721692 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6759e2bb-fe51-4a6a-a504-2b16365ce2d3 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047878 Oct 25 04:04:42.722270 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3851/7584] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:04:42 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:43.733226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:43.736309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:43.743087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:43.743581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:43.744027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:43.744721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:43.745183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:43.745618 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:43.778456 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-46b6d5a6-065d-4f15-b36f-ea4b368178dc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049203 Oct 25 04:04:43.779039 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3734/7585] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:04:43 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 04:04:43.790699 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:43.791209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:43.798554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:43.799038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:43.799471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:43.800157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:43.800605 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:43.801064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:43.882858 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] HTTP exception thrown: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 is not attached to volume a49386eb-4bac-4b57-ab60-c73c89e861d0 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Request method failure captured: Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments/a49386eb-4bac-4b57-ab60-c73c89e861d0 HTTP/1.1 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2A2cxs_c0WZaGdXkHRKVOFQm20QtynWXhI-oh4nBaV3EJ-tLYn2T9xVBUHUGd0EZBffkKQD9Hs5nBJMyssM8XrtzKmSdbfy48xRVidCqL8cXIs-PSUnsYxiGWumx2FgxUxG5bRIbYvq92vCKfMNs0jCbB3-WU-u_jx-efVRNyObVQA Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ae5afddf5ca4d5387d93a35400f3a5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ae5afddf5ca4d5387d93a35400f3a5e"}]}] Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 046b19a6edfa435398ff51eadcc36316 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 is not attached to volume a49386eb-4bac-4b57-ab60-c73c89e861d0 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8', 'id': 'a49386eb-4bac-4b57-ab60-c73c89e861d0'} Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a49386eb-4bac-4b57-ab60-c73c89e861d0. Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 is not attached to volume a49386eb-4bac-4b57-ab60-c73c89e861d0 Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:04:43.908329 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:04:43.913208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:04:43.913208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:04:43.913208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 is not attached to volume a49386eb-4bac-4b57-ab60-c73c89e861d0 Oct 25 04:04:43.913208 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:43.913208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Returning 404 to user: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 is not attached to volume a49386eb-4bac-4b57-ab60-c73c89e861d0 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:04:43.913208 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45463fab-4a25-4522-ba3e-307d304cfd7a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments/a49386eb-4bac-4b57-ab60-c73c89e861d0" status: 404 len: 154 microversion: 2.1 time: 0.123248 Oct 25 04:04:43.913208 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3852/7586] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:04:43 2022] DELETE /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8/os-volume_attachments/a49386eb-4bac-4b57-ab60-c73c89e861d0 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:04:47.267291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:47.267928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:47.275291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:47.275803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:47.276263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:47.276993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:47.277467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:47.277950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:47.307413 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:04:47.389965 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c685bd5f-892b-4d7e-b5e3-26553a87f166 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 204 len: 0 microversion: 2.1 time: 0.126697 Oct 25 04:04:47.390960 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3735/7587] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:04:47 2022] DELETE /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:04:47.399569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:47.400117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:47.409472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:47.409984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:47.410610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:47.411352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:47.411809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:47.412235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:47.546686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:47.554588 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8db9cd4-0789-4176-bb81-ca9a6b88fc8c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1559 microversion: 2.1 time: 0.159376 Oct 25 04:04:47.555162 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3853/7588] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:47 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:48.578764 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:48.579546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:48.586484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:48.586990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:48.587442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:48.588150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:48.588620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:48.589066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:48.725230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:48.733080 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c6468887-09ac-483a-a679-f4e9fc7b00e2 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1559 microversion: 2.1 time: 0.158764 Oct 25 04:04:48.734307 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3736/7589] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:48 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:49.484296 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ebe56007-d22d-4b3c-a885-c838b075e24b req-052eb239-5970-402c-878b-961a93e08ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8", "name": "network-vif-deleted", "tag": "f927350d-b098-4129-b2a9-7f4b45c7bb6a"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:49.495534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ebe56007-d22d-4b3c-a885-c838b075e24b req-052eb239-5970-402c-878b-961a93e08ce8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:49.495756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ebe56007-d22d-4b3c-a885-c838b075e24b req-052eb239-5970-402c-878b-961a93e08ce8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:49.496389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ebe56007-d22d-4b3c-a885-c838b075e24b req-052eb239-5970-402c-878b-961a93e08ce8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:49.509045 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ebe56007-d22d-4b3c-a885-c838b075e24b req-052eb239-5970-402c-878b-961a93e08ce8 service nova] Creating event network-vif-deleted:f927350d-b098-4129-b2a9-7f4b45c7bb6a for instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 on n-h1-862355-1 Oct 25 04:04:49.515414 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ebe56007-d22d-4b3c-a885-c838b075e24b req-052eb239-5970-402c-878b-961a93e08ce8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Oct 25 04:04:49.516094 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3854/7590] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:49.756344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:49.756969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:49.763830 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:49.764323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:49.764785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:49.765632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:49.766139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:49.766577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:49.797008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:49.797490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:49.797962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:49.798418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lazy-loading 'fault' on Instance uuid 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:04:49.843538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:49.851503 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-72d5b31c-b248-4ca7-b6cf-cd01889f65e4 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 200 len: 1352 microversion: 2.1 time: 0.099034 Oct 25 04:04:49.852092 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3737/7591] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:49 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:50.877374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:50.878097 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:50.884393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:50.884874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:50.885309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:50.886023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:50.886476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:50.886902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:50.902416 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] HTTP exception thrown: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 could not be found. Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Request method failure captured: Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 HTTP/1.1 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2A2cxs_c0WZaGdXkHRKVOFQm20QtynWXhI-oh4nBaV3EJ-tLYn2T9xVBUHUGd0EZBffkKQD9Hs5nBJMyssM8XrtzKmSdbfy48xRVidCqL8cXIs-PSUnsYxiGWumx2FgxUxG5bRIbYvq92vCKfMNs0jCbB3-WU-u_jx-efVRNyObVQA Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ae5afddf5ca4d5387d93a35400f3a5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ae5afddf5ca4d5387d93a35400f3a5e"}]}] Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 046b19a6edfa435398ff51eadcc36316 Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 could not be found. Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8'} Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 could not be found. Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 could not be found. Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:50.904027 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 could not be found. Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Returning 404 to user: Instance 9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e780e979-47a5-4739-b6a0-b085fde7f2ee tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8" status: 404 len: 111 microversion: 2.1 time: 0.034796 Oct 25 04:04:50.909506 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3855/7592] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:50 2022] GET /compute/v2.1/servers/9a816b9c-8e16-4c5f-8f0b-1e92e6d276c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:04:50.915498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2fefe784-f6e2-4213-90ba-45f0d0e650a9 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '.version_select at 0x7efd3330d550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:50.940605 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2fefe784-f6e2-4213-90ba-45f0d0e650a9 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1880755650" status: 202 len: 0 microversion: 2.1 time: 0.029067 Oct 25 04:04:50.941209 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3738/7593] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 25 04:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1880755650 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:04:50.958446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6dac2857-fe77-40b1-800d-b1a44a374929 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: .version_select at 0x7efd33c288b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-92847493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO+1bcU9YDJHrStdEHSM1mIVJPKOCB73zPlr41k7fpLXJWEV2P6S4VP9f0LHKALcL1dfOtjivfOwtNo0Me4u9MIy95C5Ezyd5L2xXeBVHd6Ub1Dm4vOib6iVdyRqCjSmw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:50.974280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6dac2857-fe77-40b1-800d-b1a44a374929 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:04:50.979547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6dac2857-fe77-40b1-800d-b1a44a374929 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for user 046b19a6edfa435398ff51eadcc36316 and project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:04:51.003695 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6dac2857-fe77-40b1-800d-b1a44a374929 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049082 Oct 25 04:04:51.004343 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3856/7594] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:04:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:51.054681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1434552174", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-92847493", "networks": [{"uuid": "9fab0eb2-4517-4e2d-ada3-b6fc5da21da4"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:51.107123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] validate_networks() for [('9fab0eb2-4517-4e2d-ada3-b6fc5da21da4', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:04:51.480009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:04:51.480453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:04:51.480941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:04:51.481364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:04:51.481825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:04:51.491537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:51.492029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:51.492478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:51.493212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:51.493692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:51.494139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:51.511842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:04:51.517932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for user 046b19a6edfa435398ff51eadcc36316 and project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:04:51.530501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:04:51.532892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:04:51.580532 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4cbd304-dd9c-4e5a-9787-7a1aac7d193d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529794 Oct 25 04:04:51.581198 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3739/7595] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:04:51.592468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-408c8810-4694-40e6-8dbd-06e915de5df6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:51.593128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-408c8810-4694-40e6-8dbd-06e915de5df6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:51.650372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-408c8810-4694-40e6-8dbd-06e915de5df6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:51.659401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-408c8810-4694-40e6-8dbd-06e915de5df6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1261 microversion: 2.1 time: 0.070957 Oct 25 04:04:51.659980 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3857/7596] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:51 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:52.683907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:52.684481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:52.692668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:52.693167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:52.693621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:52.694353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:52.694825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:52.695266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:52.761385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:52.771049 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-57ec6d7f-0f7b-49f8-9850-192e4ea10224 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1313 microversion: 2.1 time: 0.091411 Oct 25 04:04:52.771816 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3740/7597] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:52 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1313 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:53.796300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:53.797474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:53.804942 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:53.805710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:53.806155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:53.807134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:53.807597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:53.808031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:53.961501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:53.970331 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc7817e7-af98-4154-83c4-bf5241bd3239 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.178600 Oct 25 04:04:53.970945 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3858/7598] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:53 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:54.415250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-06a6822f-b63c-41cd-8479-8e024aa56f7a req-f1fbd96c-e319-480d-a912-e7e1966800ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af", "tag": "d2b1559f-0f9b-4c1e-b93d-11fc184005f8"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:04:54.427313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06a6822f-b63c-41cd-8479-8e024aa56f7a req-f1fbd96c-e319-480d-a912-e7e1966800ce service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:54.427853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06a6822f-b63c-41cd-8479-8e024aa56f7a req-f1fbd96c-e319-480d-a912-e7e1966800ce service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:54.428302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-06a6822f-b63c-41cd-8479-8e024aa56f7a req-f1fbd96c-e319-480d-a912-e7e1966800ce service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:54.444259 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-06a6822f-b63c-41cd-8479-8e024aa56f7a req-f1fbd96c-e319-480d-a912-e7e1966800ce service nova] Creating event network-changed:d2b1559f-0f9b-4c1e-b93d-11fc184005f8 for instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af on n-h1-862355-1 Oct 25 04:04:54.449154 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-06a6822f-b63c-41cd-8479-8e024aa56f7a req-f1fbd96c-e319-480d-a912-e7e1966800ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037942 Oct 25 04:04:54.449795 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3741/7599] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:04:54.993074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:54.993718 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:55.001424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:55.001939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:55.002383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:55.003086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:55.003553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:55.003986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:55.134901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:55.143280 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8238c168-b7a2-4744-8e96-88f9a19db7dd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.154150 Oct 25 04:04:55.143853 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3859/7600] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:54 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:56.167433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:56.168291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:56.174553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:56.175060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:56.175516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:56.176236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:56.176712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:56.177158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:56.381558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:56.389263 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c3d4e017-56ee-45b0-a20a-f8fc1638cff7 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.227005 Oct 25 04:04:56.390958 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3742/7601] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:56 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:57.413696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:57.414254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:57.421650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:57.422090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:57.422554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:57.423243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:57.423692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:57.424120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:57.560457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:57.568790 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d8838f1-093a-49dd-842c-598ae057c96a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.159090 Oct 25 04:04:57.569376 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3860/7602] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:57 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:58.592664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:58.593329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:58.600092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:58.600591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:58.601045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:58.601776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:58.602250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:58.602693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:58.734768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:58.742698 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-67ec90ba-385c-4fff-9e10-c71f515481a1 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.154030 Oct 25 04:04:58.743291 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3743/7603] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:58 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:04:59.767374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:04:59.767935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:04:59.774941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:59.775437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:59.775881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:59.776584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:04:59.777047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:04:59.777481 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:04:59.908562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:04:59.916166 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fc32f669-767d-4f43-83ff-0ad084b15b04 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.153500 Oct 25 04:04:59.916738 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3861/7604] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:04:59 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:05:00.939963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:00.940581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:00.947433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:00.947922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:00.948368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:00.949063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:00.949527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:00.950064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:01.088807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:01.097458 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7df28821-86da-45ef-8f1e-6a7c5f3b8314 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.161999 Oct 25 04:05:01.098101 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3744/7605] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:00 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:01.134356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f4b4c3a6-088e-4b3f-acb8-11e4317624d9 req-3c061927-cf5d-4f96-abd8-13d0f046e88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af", "name": "network-vif-plugged", "status": "completed", "tag": "d2b1559f-0f9b-4c1e-b93d-11fc184005f8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:01.145236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f4b4c3a6-088e-4b3f-acb8-11e4317624d9 req-3c061927-cf5d-4f96-abd8-13d0f046e88c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:01.145940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f4b4c3a6-088e-4b3f-acb8-11e4317624d9 req-3c061927-cf5d-4f96-abd8-13d0f046e88c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:01.146384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f4b4c3a6-088e-4b3f-acb8-11e4317624d9 req-3c061927-cf5d-4f96-abd8-13d0f046e88c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:01.158032 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f4b4c3a6-088e-4b3f-acb8-11e4317624d9 req-3c061927-cf5d-4f96-abd8-13d0f046e88c service nova] Creating event network-vif-plugged:d2b1559f-0f9b-4c1e-b93d-11fc184005f8 for instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af on n-h1-862355-1 Oct 25 04:05:01.162919 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f4b4c3a6-088e-4b3f-acb8-11e4317624d9 req-3c061927-cf5d-4f96-abd8-13d0f046e88c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Oct 25 04:05:01.163518 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3862/7606] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:02.121570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:02.122220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:02.124697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:02.125373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:02.131946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:02.132441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:02.132887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:02.133596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:02.134092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:02.134537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:02.267530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:02.275395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e4f15a85-76aa-4cbb-b88a-16f7efc1eb77 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1361 microversion: 2.1 time: 0.157741 Oct 25 04:05:02.275979 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3745/7607] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:02 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:03.295162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:03.300712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:03.301448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:03.308181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:03.308668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:03.309112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:03.309838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:03.310302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:03.310731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:03.445806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:03.453625 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1d895790-15c6-4302-9b39-9bef75af2c13 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1553 microversion: 2.1 time: 0.159509 Oct 25 04:05:03.454249 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3863/7608] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:03 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:03.475985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:03.476612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:03.483989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:03.484486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:03.484937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:03.485644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:03.486140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:03.486583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:03.617225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:03.625043 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a854c88-1532-45de-99b2-ea978d60b6a8 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1553 microversion: 2.1 time: 0.153006 Oct 25 04:05:03.625623 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3746/7609] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:03 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:05.125624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10412ad9-c2ad-4d6c-8f17-52bcf03564f1"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:05.128021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:05.134831 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:05.135317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:05.135755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:05.136444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:05.136902 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:05.137330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:05.375173 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d941acd5-63cb-4cae-a9c5-d3c6cbf97357 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253897 Oct 25 04:05:05.375838 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3864/7610] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 04:05:05 2022] POST /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:16.114386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:16.114893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:16.117749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:16.118439 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:16.125223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:16.125735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:16.126184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:16.126888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:16.127354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:16.127794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:16.210644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lazy-loading 'services' on Instance uuid 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:05:16.283681 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-52a98dd4-19b7-4c10-8a20-cc0a60132b2f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments/10412ad9-c2ad-4d6c-8f17-52bcf03564f1" status: 202 len: 0 microversion: 2.1 time: 0.173057 Oct 25 04:05:16.284321 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3747/7611] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:05:16 2022] DELETE /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments/10412ad9-c2ad-4d6c-8f17-52bcf03564f1 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:05:16.293214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:16.294165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:16.299964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:16.303198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:16.313164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:16.313702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:16.314162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:16.314972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:16.315441 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:16.315877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:16.348438 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc441412-4320-49f4-990c-92c66a66b6de tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059370 Oct 25 04:05:16.349144 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3865/7612] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:16 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:17.363909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:17.366363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:17.372632 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:17.373131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:17.374038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:17.375111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:17.375716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:17.376204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:17.407141 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-97479cc2-c03e-4e7b-99fa-b58e3414b02e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049755 Oct 25 04:05:17.407722 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3748/7613] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:17 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:18.419788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:18.421965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:18.428788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:18.429272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:18.429728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:18.430428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:18.430877 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:18.431301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:18.463914 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e92464c0-414b-4399-a60a-d3065e42be12 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048133 Oct 25 04:05:18.464483 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3866/7614] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:18 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:19.477272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:19.479655 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:19.486760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:19.487262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:19.487714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:19.488426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:19.488896 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:19.489338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:19.520664 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37a32838-e899-4db0-85da-5e32539ed0c6 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047392 Oct 25 04:05:19.521242 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3749/7615] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:19 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:20.533872 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:20.536048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:20.543004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:20.543494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:20.543945 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:20.544649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:20.546611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:20.547078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:20.577603 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e063974e-b2db-4b53-8a35-b73ea5132f69 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048410 Oct 25 04:05:20.578183 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3867/7616] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:20 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:21.590223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:21.592974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:21.599865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:21.600364 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:21.600821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:21.601531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:21.602031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:21.602471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:21.631537 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f4758146-d2f7-4a0e-8523-7cc836c4e49e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045472 Oct 25 04:05:21.632102 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3750/7617] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:21 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 04:05:21.644000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:21.644519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:21.651400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:21.651892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:21.652368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:21.653075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:21.653536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:21.653997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:21.731862 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] HTTP exception thrown: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af is not attached to volume 10412ad9-c2ad-4d6c-8f17-52bcf03564f1 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Request method failure captured: Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments/10412ad9-c2ad-4d6c-8f17-52bcf03564f1 HTTP/1.1 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2A2cxs_c0WZaGdXkHRKVOFQm20QtynWXhI-oh4nBaV3EJ-tLYn2T9xVBUHUGd0EZBffkKQD9Hs5nBJMyssM8XrtzKmSdbfy48xRVidCqL8cXIs-PSUnsYxiGWumx2FgxUxG5bRIbYvq92vCKfMNs0jCbB3-WU-u_jx-efVRNyObVQA Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ae5afddf5ca4d5387d93a35400f3a5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ae5afddf5ca4d5387d93a35400f3a5e"}]}] Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 046b19a6edfa435398ff51eadcc36316 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af is not attached to volume 10412ad9-c2ad-4d6c-8f17-52bcf03564f1 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af', 'id': '10412ad9-c2ad-4d6c-8f17-52bcf03564f1'} Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 10412ad9-c2ad-4d6c-8f17-52bcf03564f1. Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af is not attached to volume 10412ad9-c2ad-4d6c-8f17-52bcf03564f1 Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:05:21.733964 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:05:21.738740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:05:21.738740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:05:21.738740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af is not attached to volume 10412ad9-c2ad-4d6c-8f17-52bcf03564f1 Oct 25 04:05:21.738740 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:21.738740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Returning 404 to user: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af is not attached to volume 10412ad9-c2ad-4d6c-8f17-52bcf03564f1 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:05:21.738740 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89e0d8ee-3cc0-4b32-8de7-f09ed1d8e52c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments/10412ad9-c2ad-4d6c-8f17-52bcf03564f1" status: 404 len: 154 microversion: 2.1 time: 0.096322 Oct 25 04:05:21.738740 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3868/7618] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:05:21 2022] DELETE /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af/os-volume_attachments/10412ad9-c2ad-4d6c-8f17-52bcf03564f1 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:05:25.305129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:25.305661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:25.313118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:25.313623 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:25.314103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:25.314823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:25.315296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:25.315739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:25.344207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:05:25.426815 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-99c0a41f-7bb1-4961-94aa-9a39e191dd4a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 204 len: 0 microversion: 2.1 time: 0.125360 Oct 25 04:05:25.430640 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3751/7619] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:05:25 2022] DELETE /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:05:25.437138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:25.437903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:25.446294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:25.446793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:25.447237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:25.447948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:25.448603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:25.449081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:25.596126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:25.604274 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7a58bfce-920a-4a30-8610-23f5577cce56 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1559 microversion: 2.1 time: 0.171698 Oct 25 04:05:25.604855 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3869/7620] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:25 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:26.628310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:26.629022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:26.635953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:26.636539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:26.636991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:26.637716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:26.638185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:26.638622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:26.770511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:26.778340 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2aba3112-e95c-4ff1-be8b-205495b6900f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1559 microversion: 2.1 time: 0.154394 Oct 25 04:05:26.778921 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3752/7621] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:26 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:27.524184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ccc65d5c-276c-457f-816b-37069dcfc102 req-82603468-7a04-480f-9f4b-4d9d6b2daaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af", "name": "network-vif-deleted", "tag": "d2b1559f-0f9b-4c1e-b93d-11fc184005f8"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:27.537511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ccc65d5c-276c-457f-816b-37069dcfc102 req-82603468-7a04-480f-9f4b-4d9d6b2daaee service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:27.538059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ccc65d5c-276c-457f-816b-37069dcfc102 req-82603468-7a04-480f-9f4b-4d9d6b2daaee service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:27.538622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ccc65d5c-276c-457f-816b-37069dcfc102 req-82603468-7a04-480f-9f4b-4d9d6b2daaee service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:27.553926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ccc65d5c-276c-457f-816b-37069dcfc102 req-82603468-7a04-480f-9f4b-4d9d6b2daaee service nova] Creating event network-vif-deleted:d2b1559f-0f9b-4c1e-b93d-11fc184005f8 for instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af on n-h1-862355-1 Oct 25 04:05:27.559733 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ccc65d5c-276c-457f-816b-37069dcfc102 req-82603468-7a04-480f-9f4b-4d9d6b2daaee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039514 Oct 25 04:05:27.560425 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3870/7622] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:27.802262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:27.802898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:27.809973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:27.810475 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:27.810932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:27.812135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:27.812607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:27.813053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:27.848136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:27.848636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:27.849092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:27.849560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lazy-loading 'fault' on Instance uuid 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:05:27.891009 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:27.898827 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce4feb23-acd4-49cb-8f8f-6c350076e77f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 200 len: 1351 microversion: 2.1 time: 0.100596 Oct 25 04:05:27.899415 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3753/7623] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:27 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:05:28.923677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:28.924378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:28.930574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:28.931063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:28.931758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:28.932453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:28.932913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:28.933347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:28.946675 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] HTTP exception thrown: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af could not be found. Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Request method failure captured: Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af HTTP/1.1 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2A2cxs_c0WZaGdXkHRKVOFQm20QtynWXhI-oh4nBaV3EJ-tLYn2T9xVBUHUGd0EZBffkKQD9Hs5nBJMyssM8XrtzKmSdbfy48xRVidCqL8cXIs-PSUnsYxiGWumx2FgxUxG5bRIbYvq92vCKfMNs0jCbB3-WU-u_jx-efVRNyObVQA Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ae5afddf5ca4d5387d93a35400f3a5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ae5afddf5ca4d5387d93a35400f3a5e"}]}] Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 046b19a6edfa435398ff51eadcc36316 Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af could not be found. Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af'} Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af could not be found. Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af could not be found. Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:28.948293 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af could not be found. Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Returning 404 to user: Instance 5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f23273f7-6f2b-48a2-b587-d57e905ede3f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af" status: 404 len: 111 microversion: 2.1 time: 0.031260 Oct 25 04:05:28.953181 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3871/7624] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:28 2022] GET /compute/v2.1/servers/5a895c8b-1a0c-4b3f-bd5c-7c3e5e44d6af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:05:28.959416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8cc54e58-cb83-4cec-a07f-1fb1d7707c48 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '.version_select at 0x7efd3b7b3820>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:28.979737 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8cc54e58-cb83-4cec-a07f-1fb1d7707c48 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-92847493" status: 202 len: 0 microversion: 2.1 time: 0.024473 Oct 25 04:05:28.980318 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3754/7625] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 04:05:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-92847493 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:05:28.997476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01e958be-5dfe-4648-89e3-8d4738935f09 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: .version_select at 0x7efd33736160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-327022097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCMKnQrqx7Mwx4R20rNT9aU0eXkgAtvaRLCiiR6NrTEO6/YnJdSZEkqho2WmdKkcajXiglE5hThF+V+vTWbkWqPdFHmtWSYemMORGUORqMzS7VrIYBSyzwrc52dvs/nFQ=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:29.013167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-01e958be-5dfe-4648-89e3-8d4738935f09 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:05:29.019763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-01e958be-5dfe-4648-89e3-8d4738935f09 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for user 046b19a6edfa435398ff51eadcc36316 and project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:05:29.044030 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01e958be-5dfe-4648-89e3-8d4738935f09 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.050465 Oct 25 04:05:29.044672 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3872/7626] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:05:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:05:29.095289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-370579080", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-327022097", "networks": [{"uuid": "9fab0eb2-4517-4e2d-ada3-b6fc5da21da4"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:29.148739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] validate_networks() for [('9fab0eb2-4517-4e2d-ada3-b6fc5da21da4', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:05:29.519812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:05:29.520249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:05:29.520738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:05:29.521189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:05:29.521647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:05:29.531003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:29.531497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:29.531947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:29.532679 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:29.533143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:29.533581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:29.550794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:05:29.556019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Getting quotas for user 046b19a6edfa435398ff51eadcc36316 and project 2ae5afddf5ca4d5387d93a35400f3a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:05:29.575805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:05:29.578728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:05:29.626446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dde8e723-4347-44ed-bd53-dff67027ea18 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535172 Oct 25 04:05:29.627300 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3755/7627] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:05:29.638632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77247120-85a0-4fa7-9aa1-3054f27d152c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:29.639263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-77247120-85a0-4fa7-9aa1-3054f27d152c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:29.695015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-77247120-85a0-4fa7-9aa1-3054f27d152c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:29.702958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77247120-85a0-4fa7-9aa1-3054f27d152c tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1261 microversion: 2.1 time: 0.068435 Oct 25 04:05:29.703607 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3873/7628] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:29 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:30.726234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:30.726930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:30.736066 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:30.736755 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:30.737202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:30.738167 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:30.738867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:30.739512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:30.821500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:30.830297 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dec2fbb9-24a6-4712-863d-02158ac3de40 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1331 microversion: 2.1 time: 0.108231 Oct 25 04:05:30.830877 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3756/7629] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:30 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:31.853302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:31.853950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:31.861140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:31.861646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:31.862119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:31.862897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:31.863366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:31.863803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:32.000740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:32.018302 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d867774-a259-4150-b529-fd00335b4540 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1361 microversion: 2.1 time: 0.168563 Oct 25 04:05:32.018994 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3874/7630] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:31 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:32.096908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-aa38d358-19a4-42b3-8d25-e23f5dabe7a2 req-cb65679e-2759-4ac8-b88b-a630fda032bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24faf444-df45-43d6-aa19-1c5f8225f250", "tag": "45244b08-9438-4994-a057-977188cc2a40"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:32.107954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aa38d358-19a4-42b3-8d25-e23f5dabe7a2 req-cb65679e-2759-4ac8-b88b-a630fda032bb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:32.108753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aa38d358-19a4-42b3-8d25-e23f5dabe7a2 req-cb65679e-2759-4ac8-b88b-a630fda032bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:32.109299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aa38d358-19a4-42b3-8d25-e23f5dabe7a2 req-cb65679e-2759-4ac8-b88b-a630fda032bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:32.121503 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-aa38d358-19a4-42b3-8d25-e23f5dabe7a2 req-cb65679e-2759-4ac8-b88b-a630fda032bb service nova] Creating event network-changed:45244b08-9438-4994-a057-977188cc2a40 for instance 24faf444-df45-43d6-aa19-1c5f8225f250 on n-h1-862355-1 Oct 25 04:05:32.129336 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-aa38d358-19a4-42b3-8d25-e23f5dabe7a2 req-cb65679e-2759-4ac8-b88b-a630fda032bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036579 Oct 25 04:05:32.130317 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3757/7631] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:33.043431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:33.044057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:33.051706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:33.052196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:33.052640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:33.053342 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:33.053837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:33.054277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:33.183317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:33.191017 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-73d5b486-602a-4ba4-bc3d-74b853f107df tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1361 microversion: 2.1 time: 0.151561 Oct 25 04:05:33.191607 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3875/7632] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:33 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:34.216189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:34.216946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:34.223735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:34.224227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:34.224677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:34.225375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:34.225876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:34.226317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:34.361289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:34.369069 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4386606e-a775-48a4-a59e-683f7f30735a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1361 microversion: 2.1 time: 0.158010 Oct 25 04:05:34.369664 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3758/7633] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:34 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:35.392505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:35.393847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:35.400710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:35.401198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:35.401642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:35.402362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:35.402830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:35.403263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:35.530772 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:35.538477 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-72b9f01d-6895-469b-bdcc-3a6e0cec82bb tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1361 microversion: 2.1 time: 0.149997 Oct 25 04:05:35.539062 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3876/7634] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:35 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:36.563351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:36.563980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:36.570892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:36.571389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:36.571844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:36.572553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:36.573024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:36.573468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:36.702592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:36.710462 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c4a91aae-02ec-417c-b96e-48729aed656f tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1361 microversion: 2.1 time: 0.151735 Oct 25 04:05:36.711047 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3759/7635] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:36 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:37.285032 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9e63910f-71e1-4d8a-9b3b-d90d9ae6a53c req-6e1e11cd-9e99-4b44-ba2e-c982be807894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24faf444-df45-43d6-aa19-1c5f8225f250", "name": "network-vif-plugged", "status": "completed", "tag": "45244b08-9438-4994-a057-977188cc2a40"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:37.295912 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e63910f-71e1-4d8a-9b3b-d90d9ae6a53c req-6e1e11cd-9e99-4b44-ba2e-c982be807894 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:37.296486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e63910f-71e1-4d8a-9b3b-d90d9ae6a53c req-6e1e11cd-9e99-4b44-ba2e-c982be807894 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:37.296927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9e63910f-71e1-4d8a-9b3b-d90d9ae6a53c req-6e1e11cd-9e99-4b44-ba2e-c982be807894 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:37.308427 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9e63910f-71e1-4d8a-9b3b-d90d9ae6a53c req-6e1e11cd-9e99-4b44-ba2e-c982be807894 service nova] Creating event network-vif-plugged:45244b08-9438-4994-a057-977188cc2a40 for instance 24faf444-df45-43d6-aa19-1c5f8225f250 on n-h1-862355-1 Oct 25 04:05:37.313943 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9e63910f-71e1-4d8a-9b3b-d90d9ae6a53c req-6e1e11cd-9e99-4b44-ba2e-c982be807894 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032703 Oct 25 04:05:37.314768 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3877/7636] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:37.735268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:37.735913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:37.742773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:37.743263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:37.743710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:37.744405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:37.744867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:37.745302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:37.876526 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:37.884441 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-978dfbf2-c986-42bf-8d0a-19bb4aca22ec tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1361 microversion: 2.1 time: 0.153609 Oct 25 04:05:37.885033 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3760/7637] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:37 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:38.910261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:38.910873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:38.916985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:38.917465 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:38.917933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:38.918619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:38.919072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:38.919497 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:39.054965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:39.063308 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-77ef256a-1f22-4b4b-9148-9773453949fd tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1552 microversion: 2.1 time: 0.159145 Oct 25 04:05:39.063879 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3878/7638] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:38 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:39.086140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:39.086865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:39.094264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:39.094765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:39.095224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:39.095934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:39.096405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:39.096850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:39.228120 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:05:39.236802 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3c02763b-1ef2-49c8-b0b9-995ddf04820a tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1552 microversion: 2.1 time: 0.154607 Oct 25 04:05:39.237403 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3761/7639] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:05:39 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:05:40.736438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea3fc896-5184-47ee-982b-62ad9145c898"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:05:40.738796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:40.740832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:40.746599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:40.747083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:40.747520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:40.748205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:40.748659 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:40.749085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:40.990092 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4583b37-b26a-4414-aa1f-277992a26a29 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "POST /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257625 Oct 25 04:05:40.990769 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3879/7640] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 04:05:40 2022] POST /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:51.722023 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:51.722576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:51.724472 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:51.725148 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:51.726697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:51.727344 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:51.735047 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:51.735533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:51.735981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:51.736683 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:51.737149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:51.737587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:51.820737 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lazy-loading 'services' on Instance uuid 24faf444-df45-43d6-aa19-1c5f8225f250 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:05:51.891568 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-506bae98-ebd6-46fa-906b-9c04bf08a7a0 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments/ea3fc896-5184-47ee-982b-62ad9145c898" status: 202 len: 0 microversion: 2.1 time: 0.174135 Oct 25 04:05:51.892170 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3762/7641] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:05:51 2022] DELETE /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments/ea3fc896-5184-47ee-982b-62ad9145c898 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:05:51.898918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:51.900383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:05:51.905612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:51.908261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:51.917975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:51.918467 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:51.918911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:51.919615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:51.920762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:51.921198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:51.956202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-07242b7a-f309-44a4-8d91-d282b40f5a01 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059153 Oct 25 04:05:51.956767 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3880/7642] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:51 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:52.970556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:52.972925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:52.979521 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:52.980013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:52.980460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:52.981164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:52.981628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:52.982085 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:53.017815 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2d58888f-fa22-4231-ab65-93e8ab160969 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052894 Oct 25 04:05:53.018295 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3763/7643] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:52 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:54.031890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:54.034093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:54.040428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:54.040928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:54.041376 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:54.042104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:54.042594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:54.043027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:54.074075 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-16da2dc7-cdde-4f19-a235-b59894c5bf46 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048198 Oct 25 04:05:54.074652 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3881/7644] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:54 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:55.086504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:55.088824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:55.096362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:55.096887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:55.097336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:55.098078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:55.098547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:55.098986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:55.129218 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-facd2d83-d512-46d5-a7ee-8977b2e6e7fc tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Oct 25 04:05:55.130016 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3764/7645] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:55 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:56.142045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:56.144258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:56.151125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:56.151614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:56.152057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:56.152759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:56.153217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:56.153645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:56.184695 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f2047754-3db5-4db7-95bf-4cc992b769db tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Oct 25 04:05:56.185272 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3882/7646] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:56 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:05:57.196874 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:57.199044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:57.206611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:57.207109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:57.207564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:57.208272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:57.208748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:57.209191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:57.238306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dbe9fb46-ba34-4534-b289-4c2ae77ce814 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045597 Oct 25 04:05:57.238862 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3765/7647] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:05:57 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 04:05:57.250286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:05:57.250797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:05:57.257552 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:57.258068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:57.258512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:57.259205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:05:57.259665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:05:57.260094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:05:57.335732 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] HTTP exception thrown: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 is not attached to volume ea3fc896-5184-47ee-982b-62ad9145c898 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Request method failure captured: Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: request: DELETE /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments/ea3fc896-5184-47ee-982b-62ad9145c898 HTTP/1.1 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2A2cxs_c0WZaGdXkHRKVOFQm20QtynWXhI-oh4nBaV3EJ-tLYn2T9xVBUHUGd0EZBffkKQD9Hs5nBJMyssM8XrtzKmSdbfy48xRVidCqL8cXIs-PSUnsYxiGWumx2FgxUxG5bRIbYvq92vCKfMNs0jCbB3-WU-u_jx-efVRNyObVQA Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ae5afddf5ca4d5387d93a35400f3a5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ae5afddf5ca4d5387d93a35400f3a5e"}]}] Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 046b19a6edfa435398ff51eadcc36316 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 is not attached to volume ea3fc896-5184-47ee-982b-62ad9145c898 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'server_id': '24faf444-df45-43d6-aa19-1c5f8225f250', 'id': 'ea3fc896-5184-47ee-982b-62ad9145c898'} Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea3fc896-5184-47ee-982b-62ad9145c898. Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 is not attached to volume ea3fc896-5184-47ee-982b-62ad9145c898 Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:05:57.337353 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:05:57.342282 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:05:57.342282 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:05:57.342282 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 is not attached to volume ea3fc896-5184-47ee-982b-62ad9145c898 Oct 25 04:05:57.342282 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:05:57.342282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Returning 404 to user: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 is not attached to volume ea3fc896-5184-47ee-982b-62ad9145c898 {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:05:57.342282 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-130e2dcd-0b95-4534-b144-f7f5632370af tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments/ea3fc896-5184-47ee-982b-62ad9145c898" status: 404 len: 154 microversion: 2.1 time: 0.093265 Oct 25 04:05:57.342282 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3883/7648] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:05:57 2022] DELETE /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250/os-volume_attachments/ea3fc896-5184-47ee-982b-62ad9145c898 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:06:00.688610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:00.689178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:00.695850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:00.696359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:00.696812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:00.697533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:00.698106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:00.698552 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:00.726646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:06:00.807973 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a4f12a69-dfa3-4679-b4cd-5a52bdf42e0e tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 204 len: 0 microversion: 2.1 time: 0.123896 Oct 25 04:06:00.808629 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3766/7649] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:06:00 2022] DELETE /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 25 04:06:00.817892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:00.818763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:00.826808 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:00.827331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:00.831433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:00.832305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:00.832819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:00.834554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:00.969900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:00.977820 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-91153329-afd1-45fb-ac8d-8e21449e6d3d tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1558 microversion: 2.1 time: 0.164031 Oct 25 04:06:00.978505 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3884/7650] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:00 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:06:02.002525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:02.003251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:02.010319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:02.010823 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:02.011282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:02.011990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:02.012886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:02.012886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:02.152319 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:02.161080 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a60c8a7d-2571-4efb-8c27-2f5ce2f92327 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1558 microversion: 2.1 time: 0.163417 Oct 25 04:06:02.161763 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3767/7651] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:01 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:02.949255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-9df6763c-fb80-4763-a70e-6db51e792e63 req-05e43028-8969-49b8-9507-520681fb9a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24faf444-df45-43d6-aa19-1c5f8225f250", "name": "network-vif-deleted", "tag": "45244b08-9438-4994-a057-977188cc2a40"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:06:02.963581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9df6763c-fb80-4763-a70e-6db51e792e63 req-05e43028-8969-49b8-9507-520681fb9a8c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:02.964151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9df6763c-fb80-4763-a70e-6db51e792e63 req-05e43028-8969-49b8-9507-520681fb9a8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:02.964660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-9df6763c-fb80-4763-a70e-6db51e792e63 req-05e43028-8969-49b8-9507-520681fb9a8c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:02.977543 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-9df6763c-fb80-4763-a70e-6db51e792e63 req-05e43028-8969-49b8-9507-520681fb9a8c service nova] Creating event network-vif-deleted:45244b08-9438-4994-a057-977188cc2a40 for instance 24faf444-df45-43d6-aa19-1c5f8225f250 on n-h1-862355-1 Oct 25 04:06:02.983777 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-9df6763c-fb80-4763-a70e-6db51e792e63 req-05e43028-8969-49b8-9507-520681fb9a8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038415 Oct 25 04:06:02.985838 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3885/7652] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:06:03.184760 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:03.185887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:03.192634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:03.193128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:03.193578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:03.194303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:03.194768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:03.195206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:03.226886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:03.227391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:03.227843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:03.228305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lazy-loading 'fault' on Instance uuid 24faf444-df45-43d6-aa19-1c5f8225f250 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:06:03.273341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '046b19a6edfa435398ff51eadcc36316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae5afddf5ca4d5387d93a35400f3a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:03.281350 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-795d1ee1-ade9-4ea4-ba85-fc3b610a8592 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 200 len: 1351 microversion: 2.1 time: 0.100755 Oct 25 04:06:03.281869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3768/7653] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:03 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:06:04.306320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:04.306987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] [instance: 24faf444-df45-43d6-aa19-1c5f8225f250] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:04.313962 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:04.314451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:04.314894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:04.315590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:04.316052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:04.316493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:04.332926 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] HTTP exception thrown: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 could not be found. Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Request method failure captured: Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 HTTP/1.1 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2A2cxs_c0WZaGdXkHRKVOFQm20QtynWXhI-oh4nBaV3EJ-tLYn2T9xVBUHUGd0EZBffkKQD9Hs5nBJMyssM8XrtzKmSdbfy48xRVidCqL8cXIs-PSUnsYxiGWumx2FgxUxG5bRIbYvq92vCKfMNs0jCbB3-WU-u_jx-efVRNyObVQA Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2ae5afddf5ca4d5387d93a35400f3a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2ae5afddf5ca4d5387d93a35400f3a5e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2ae5afddf5ca4d5387d93a35400f3a5e"}]}] Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 2ae5afddf5ca4d5387d93a35400f3a5e Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1216350130 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: 046b19a6edfa435398ff51eadcc36316 Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestEncryptedCinderVolumes-1216350130-project Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 could not be found. Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '24faf444-df45-43d6-aa19-1c5f8225f250'} Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 could not be found. Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 could not be found. Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:06:04.334618 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 could not be found. Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Returning 404 to user: Instance 24faf444-df45-43d6-aa19-1c5f8225f250 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-34a909d9-5c07-4193-b161-4b420ac62618 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250" status: 404 len: 111 microversion: 2.1 time: 0.035321 Oct 25 04:06:04.339320 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3886/7654] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:04 2022] GET /compute/v2.1/servers/24faf444-df45-43d6-aa19-1c5f8225f250 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:06:04.345150 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e9a8c25b-c533-4412-adb4-92e9c5ef4a51 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] Calling method '.version_select at 0x7efd3b7b3700>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:04.364531 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e9a8c25b-c533-4412-adb4-92e9c5ef4a51 tempest-TestEncryptedCinderVolumes-1216350130 tempest-TestEncryptedCinderVolumes-1216350130-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-327022097" status: 202 len: 0 microversion: 2.1 time: 0.023404 Oct 25 04:06:04.365103 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3769/7655] 10.222.0.36 () {58 vars in 1275 bytes} [Tue Oct 25 04:06:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-327022097 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:06:31.813057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a628991c-3617-4b0d-b060-37f2b443a477 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'create', calling method: .version_select at 0x7efd3b89e550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-932479543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOmNPOmj9/alid/O8N8SxACawVEfd+HLMKp2lsVSmSNVWyAsTJd9MlhQ9reCQKMSJgSfpKmfy4fdemCGz8MA1J3mcYiwUZ7BKKXrG3DicvvHzYYrczzGj+60c4C9Wgpew=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:06:31.819740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:06:31.820408 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=34 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:06:31.835049 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a628991c-3617-4b0d-b060-37f2b443a477 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:06:31.842813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a628991c-3617-4b0d-b060-37f2b443a477 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for user 95920d62d3df45b8bee5eaa095defabd and project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:06:31.870697 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a628991c-3617-4b0d-b060-37f2b443a477 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062021 Oct 25 04:06:31.872967 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3887/7656] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:06:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:06:31.927596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:06:31.928399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:06:31.932971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1571256008", "imageRef": "6ad00d2b-0edc-4214-a0c3-73cb29bc0231", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-932479543", "networks": [{"uuid": "73103de6-7a77-4189-9bbe-e04663a21570"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:06:31.987748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] validate_networks() for [('73103de6-7a77-4189-9bbe-e04663a21570', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:06:32.690184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:06:32.690645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:06:32.691131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:06:32.691556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:06:32.692013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:06:32.701645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:32.702173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:32.702629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:32.703375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:32.703848 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:32.704295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:32.722028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:06:32.727240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for user 95920d62d3df45b8bee5eaa095defabd and project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:06:32.739905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:06:32.742163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ad00d2b-0edc-4214-a0c3-73cb29bc0231',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:06:32.789388 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13f60f8f-a66d-4f76-9fd4-161973d48338 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863994 Oct 25 04:06:32.790303 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3770/7657] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:06:32.802428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-41b803f2-50f0-4920-8cfb-996a48e0d241 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:32.803175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-41b803f2-50f0-4920-8cfb-996a48e0d241 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:32.859719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-41b803f2-50f0-4920-8cfb-996a48e0d241 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:32.866902 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-41b803f2-50f0-4920-8cfb-996a48e0d241 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1258 microversion: 2.1 time: 0.068679 Oct 25 04:06:32.867514 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3888/7658] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:32 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:33.892703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:33.893515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:33.901566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:33.902121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:33.902577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:33.903579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:33.904006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:33.904613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:33.979918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:33.989737 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da42dadb-5f9a-439f-b3b4-ad07ec0a4439 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1328 microversion: 2.1 time: 0.103619 Oct 25 04:06:33.990357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3771/7659] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:33 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:35.017779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:35.018485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:35.027968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:35.028868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:35.029035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:35.029889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:35.030426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:35.030934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:35.192011 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:35.201111 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a03e3535-e2db-47b3-84d0-fa99368d271a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.191036 Oct 25 04:06:35.201759 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3889/7660] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:35 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:36.226350 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:36.227136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:36.235696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:36.236617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:36.237396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:36.238455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:36.239091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:36.239720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:36.388835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:36.396713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-302a88be-340f-4694-ba2e-75328d68cf44 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.174761 Oct 25 04:06:36.397301 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3772/7661] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:36 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:37.421255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:37.422231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:37.429291 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:37.429899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:37.430439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:37.431458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:37.432113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:37.432700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:37.577261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:37.590485 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8424ea11-0462-4c6c-b8ef-b3e0310e1f06 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.173905 Oct 25 04:06:37.593771 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3890/7662] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:37 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:38.613213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:38.613858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:38.621125 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:38.621731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:38.621731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:38.622860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:38.623336 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:38.623782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:38.801958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:38.815363 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a478c623-2ca1-4b46-878e-3bcf11a1b5f0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.205943 Oct 25 04:06:38.816155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3773/7663] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:38 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:39.843451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:39.844668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:39.859356 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:39.859857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:39.860301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:39.861018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:39.861476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:39.862115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:40.003459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:40.012808 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5b127e9e-fc2b-4c7a-9e5f-6f62438ace67 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.174902 Oct 25 04:06:40.013390 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3891/7664] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:39 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:41.035953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:41.037403 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:41.045291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:41.045832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:41.046295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:41.047027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:41.047507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:41.047958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:41.201876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:41.210271 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5ef9abdd-c3a2-47a7-adf4-974844026ab9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.178137 Oct 25 04:06:41.211110 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3774/7665] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:41 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:42.234411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:42.235094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:42.242803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:42.243349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:42.243785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:42.244488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:42.244940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:42.245401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:42.382381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:42.390596 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-050dda07-6aae-4115-a74b-23773128c9fe tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.162006 Oct 25 04:06:42.391174 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3892/7666] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:42 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:42.454511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-846a946c-9943-438f-947e-9f90fe15b150 req-7821f6f1-036d-49bc-a92f-0791aafef47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d612468-1462-421e-896f-ab59f81cda2e", "tag": "045a40e9-7f87-4378-8663-3568bb011668"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:06:42.470630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-846a946c-9943-438f-947e-9f90fe15b150 req-7821f6f1-036d-49bc-a92f-0791aafef47f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:42.471124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-846a946c-9943-438f-947e-9f90fe15b150 req-7821f6f1-036d-49bc-a92f-0791aafef47f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:42.471565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-846a946c-9943-438f-947e-9f90fe15b150 req-7821f6f1-036d-49bc-a92f-0791aafef47f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:42.484186 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-846a946c-9943-438f-947e-9f90fe15b150 req-7821f6f1-036d-49bc-a92f-0791aafef47f service nova] Creating event network-changed:045a40e9-7f87-4378-8663-3568bb011668 for instance 3d612468-1462-421e-896f-ab59f81cda2e on n-h1-862355-1 Oct 25 04:06:42.489198 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-846a946c-9943-438f-947e-9f90fe15b150 req-7821f6f1-036d-49bc-a92f-0791aafef47f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040194 Oct 25 04:06:42.489837 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3775/7667] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:06:43.414527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:43.415152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:43.417000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:06:43.423874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:43.424365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:43.424811 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:43.425510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:43.426030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:43.426504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:43.560327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:43.568122 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5696eaab-b063-4b88-a470-10deb1c20915 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.157576 Oct 25 04:06:43.568706 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3893/7668] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:43 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:44.592772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:44.593433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:44.595458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:06:44.596136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:06:44.603800 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:44.604597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:44.605054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:44.605794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:44.606267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:44.606707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:44.737841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:44.745523 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-205552bf-013b-4b62-9714-2f7f646bcd2b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.157514 Oct 25 04:06:44.746695 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3776/7669] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:44 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:45.769587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:45.770231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:45.776903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:45.777387 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:45.778920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:45.779623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:45.780083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:45.780508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:45.913393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:45.921847 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab79e6c7-b974-44e6-ab64-c8492472454d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.156137 Oct 25 04:06:45.922481 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3894/7670] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:45 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:46.945202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:46.945899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:46.953398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:46.953939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:46.954400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:46.955115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:46.955592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:46.956040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:47.090633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:47.098374 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dae3bdd4-cc95-457f-9b79-52bb8d1c4083 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.157159 Oct 25 04:06:47.098955 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3777/7671] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:46 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:47.689513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-adb6b2d6-a967-4990-847c-176b21b96a7a req-054fdf76-068b-4c33-94b4-f758b3b65a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d612468-1462-421e-896f-ab59f81cda2e", "name": "network-vif-plugged", "status": "completed", "tag": "045a40e9-7f87-4378-8663-3568bb011668"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:06:47.700094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-adb6b2d6-a967-4990-847c-176b21b96a7a req-054fdf76-068b-4c33-94b4-f758b3b65a05 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:47.700617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-adb6b2d6-a967-4990-847c-176b21b96a7a req-054fdf76-068b-4c33-94b4-f758b3b65a05 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:47.701031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-adb6b2d6-a967-4990-847c-176b21b96a7a req-054fdf76-068b-4c33-94b4-f758b3b65a05 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:47.713104 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-adb6b2d6-a967-4990-847c-176b21b96a7a req-054fdf76-068b-4c33-94b4-f758b3b65a05 service nova] Creating event network-vif-plugged:045a40e9-7f87-4378-8663-3568bb011668 for instance 3d612468-1462-421e-896f-ab59f81cda2e on n-h1-862355-1 Oct 25 04:06:47.718126 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-adb6b2d6-a967-4990-847c-176b21b96a7a req-054fdf76-068b-4c33-94b4-f758b3b65a05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Oct 25 04:06:47.718726 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3895/7672] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:06:48.121627 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:48.122227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:48.129708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:48.130229 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:48.130711 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:48.131415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:48.131882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:48.132323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:48.264659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:48.272408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f20ceae7-6661-4523-8e2b-afbec119a39b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1358 microversion: 2.1 time: 0.154816 Oct 25 04:06:48.272983 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3778/7673] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:48 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:49.297488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:49.298136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:49.304288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.304771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.305206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.306735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.306735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.307088 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.434327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:49.442204 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d09618a5-a6ef-4c64-842b-d25bdb4796cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1548 microversion: 2.1 time: 0.150590 Oct 25 04:06:49.442793 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3896/7674] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:49 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:49.465259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:49.465912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:49.473759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.474265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.474717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.475427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.475895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.476338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.604190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:49.612790 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-be9fc6c2-9d62-450a-a219-36aa7f0050ea tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1548 microversion: 2.1 time: 0.151474 Oct 25 04:06:49.613387 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3779/7675] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:49 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:06:49.635203 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:49.640429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:49.641188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Searching by: {'deleted': False, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e'} {{(pid=120562) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 04:06:49.646437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.646913 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.647345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.648058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.648509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.648933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.673711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.multi_cell_list [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 04:06:49.699993 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-980570d5-35dd-4435-9955-ee4a40d3151a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068631 Oct 25 04:06:49.700587 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3897/7676] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 04:06:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:06:49.712450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:06:49.713092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:49.719676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.720184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.720647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.721365 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:49.721888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:49.722341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:49.858908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:06:49.866675 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c60df20-c868-4bd6-a406-b5dd51d89866 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1548 microversion: 2.1 time: 0.158118 Oct 25 04:06:49.867256 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3780/7677] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:06:49 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:06:51.410693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd830020-139d-4163-bd97-81002c9b647b"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:06:51.413081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:06:51.419802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:51.420285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:51.420705 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:51.421478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:06:51.421969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:06:51.422397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:06:51.661531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0cdd6cab-41e9-4edd-8b9a-b0800028a619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254687 Oct 25 04:06:51.662243 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3898/7678] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 04:06:51 2022] POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:07:04.708437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:07:04.709062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:07:04.711258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:07:04.712063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=58 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:07:04.719060 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:04.719555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:04.720001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:04.720705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:04.721172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:04.721611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:04.862996 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:07:04.871325 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ea4213ec-6f51-423c-9a72-8439877d2d3a tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1594 microversion: 2.1 time: 0.167106 Oct 25 04:07:04.871907 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3781/7679] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:07:04 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1594 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:07:06.558761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:07:06.559696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:07:06.561069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:07:06.565965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dcde10c5-32c0-49f6-bbef-3a1995f38b0b req-1c782a6d-165b-48ce-aca4-f27dccc34ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d612468-1462-421e-896f-ab59f81cda2e", "tag": "045a40e9-7f87-4378-8663-3568bb011668"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:07:06.578045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcde10c5-32c0-49f6-bbef-3a1995f38b0b req-1c782a6d-165b-48ce-aca4-f27dccc34ee3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:06.578700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcde10c5-32c0-49f6-bbef-3a1995f38b0b req-1c782a6d-165b-48ce-aca4-f27dccc34ee3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:06.579212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcde10c5-32c0-49f6-bbef-3a1995f38b0b req-1c782a6d-165b-48ce-aca4-f27dccc34ee3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:06.595761 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dcde10c5-32c0-49f6-bbef-3a1995f38b0b req-1c782a6d-165b-48ce-aca4-f27dccc34ee3 service nova] Creating event network-changed:045a40e9-7f87-4378-8663-3568bb011668 for instance 3d612468-1462-421e-896f-ab59f81cda2e on n-h1-862355-1 Oct 25 04:07:06.602230 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dcde10c5-32c0-49f6-bbef-3a1995f38b0b req-1c782a6d-165b-48ce-aca4-f27dccc34ee3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045183 Oct 25 04:07:06.603111 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3899/7680] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:07:07.799183 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-528768353"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:07:07.800675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:07:07.809144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:07.809658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:07.811321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:07.812267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:07.812742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:07.813190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:07.956432 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.network.security_group_api [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Adding security group d6eff917-5967-463e-9ca5-69d5a0955c3c to port 045a40e9-7f87-4378-8663-3568bb011668 Oct 25 04:07:08.280590 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b310fad2-2dbf-40c3-83f3-8616f85bdd9f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/action" status: 202 len: 0 microversion: 2.1 time: 0.485926 Oct 25 04:07:08.281566 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3782/7681] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:07:07 2022] POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:07:08.290078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:07:08.290863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:07:08.298775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:08.299246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:08.299758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:08.300706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:08.301302 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:08.301869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:08.463496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:07:08.472602 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79adf915-49b8-419a-8925-dc23bf3a96ed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1758 microversion: 2.1 time: 0.186619 Oct 25 04:07:08.473203 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3900/7682] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:07:08 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:07:08.623304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-a7f26d02-0d25-4b82-b9ff-7e85f0b71148 req-e311bfe6-15f2-49e6-83b0-3277b233c23a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d612468-1462-421e-896f-ab59f81cda2e", "tag": "045a40e9-7f87-4378-8663-3568bb011668"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:07:08.633429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a7f26d02-0d25-4b82-b9ff-7e85f0b71148 req-e311bfe6-15f2-49e6-83b0-3277b233c23a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:07:08.634114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a7f26d02-0d25-4b82-b9ff-7e85f0b71148 req-e311bfe6-15f2-49e6-83b0-3277b233c23a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:07:08.634570 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-a7f26d02-0d25-4b82-b9ff-7e85f0b71148 req-e311bfe6-15f2-49e6-83b0-3277b233c23a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:07:08.646889 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-a7f26d02-0d25-4b82-b9ff-7e85f0b71148 req-e311bfe6-15f2-49e6-83b0-3277b233c23a service nova] Creating event network-changed:045a40e9-7f87-4378-8663-3568bb011668 for instance 3d612468-1462-421e-896f-ab59f81cda2e on n-h1-862355-1 Oct 25 04:07:08.652310 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-a7f26d02-0d25-4b82-b9ff-7e85f0b71148 req-e311bfe6-15f2-49e6-83b0-3277b233c23a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032969 Oct 25 04:07:08.652970 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3783/7683] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:08:47.445918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:08:47.446682 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=8 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:08:47.448258 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:08:47.448390 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/action (ip 10.222.0.36) !!! Oct 25 04:08:47.456024 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:08:47.459362 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:08:47.470819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:08:47.471304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:08:47.471740 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:08:47.473611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:08:47.474096 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:08:47.474555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:08:47.550909 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9768310f-b25d-44b5-a1d1-ff9658212cf6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/action" status: 202 len: 0 microversion: 2.1 time: 0.106768 Oct 25 04:08:47.551747 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3901/7684] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:08:47 2022] POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:08:47.558455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:08:47.559379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:08:47.564779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:08:47.565523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:08:47.573771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:08:47.574449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:08:47.574952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:08:47.575855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:08:47.576321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:08:47.576792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:08:47.814121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:08:47.823172 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d38f71d-ff01-435c-9dc3-815778701e31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1760 microversion: 2.1 time: 0.266891 Oct 25 04:08:47.823767 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3784/7685] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:08:47 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1760 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:08:48.848893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:08:48.849623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:08:48.856906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:08:48.857393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:08:48.857874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:08:48.858573 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:08:48.859033 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:08:48.859461 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:08:49.130868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:08:49.139069 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b3d8b131-fb2d-4a71-8536-fbfca6d51991 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1758 microversion: 2.1 time: 0.295307 Oct 25 04:08:49.139654 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3902/7686] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:08:48 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1758 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:03.072399 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:10:03.073257 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:10:03.073776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:03.074557 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:03.078686 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-528768353"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:03.079244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:03.086299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:03.086807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:03.087267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:03.087970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:03.088443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:03.088917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:03.308948 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.network.security_group_api [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Removing security group d6eff917-5967-463e-9ca5-69d5a0955c3c from port 045a40e9-7f87-4378-8663-3568bb011668 Oct 25 04:10:03.618505 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0184c75-4c20-4da7-8270-8c570dbd3972 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/action" status: 202 len: 0 microversion: 2.1 time: 0.547989 Oct 25 04:10:03.630287 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3785/7687] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:10:03 2022] POST /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:10:03.631860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:03.633197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:03.755946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d3740191-8183-49b6-8668-e134756d2aa3 req-c73bf226-bdc8-422d-abad-f92f5ffc641e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d612468-1462-421e-896f-ab59f81cda2e", "tag": "045a40e9-7f87-4378-8663-3568bb011668"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:03.765590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d3740191-8183-49b6-8668-e134756d2aa3 req-c73bf226-bdc8-422d-abad-f92f5ffc641e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:03.766099 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d3740191-8183-49b6-8668-e134756d2aa3 req-c73bf226-bdc8-422d-abad-f92f5ffc641e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:03.766728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d3740191-8183-49b6-8668-e134756d2aa3 req-c73bf226-bdc8-422d-abad-f92f5ffc641e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:03.779675 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d3740191-8183-49b6-8668-e134756d2aa3 req-c73bf226-bdc8-422d-abad-f92f5ffc641e service nova] Creating event network-changed:045a40e9-7f87-4378-8663-3568bb011668 for instance 3d612468-1462-421e-896f-ab59f81cda2e on n-h1-862355-1 Oct 25 04:10:03.785311 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d3740191-8183-49b6-8668-e134756d2aa3 req-c73bf226-bdc8-422d-abad-f92f5ffc641e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161182 Oct 25 04:10:03.785969 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3903/7688] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:04.989127 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44212. Oct 25 04:10:04.992165 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44210. Oct 25 04:10:05.030051 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:05.030649 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:05.038668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:05.039321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:05.039971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:05.040869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:05.041332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:05.041789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:05.057750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d612468-1462-421e-896f-ab59f81cda2e", "tag": "045a40e9-7f87-4378-8663-3568bb011668"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:05.067718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:05.069138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:05.069786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:05.084269 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] Creating event network-changed:045a40e9-7f87-4378-8663-3568bb011668 for instance 3d612468-1462-421e-896f-ab59f81cda2e on n-h1-862355-1 Oct 25 04:10:05.088122 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] [5c589735-4b38-4603-8237-783611465318] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:10:05.130040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lazy-loading 'services' on Instance uuid 3d612468-1462-421e-896f-ab59f81cda2e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:10:05.202755 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c983aa49-9ec6-4e6b-b8a5-9e4f388854b7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments/bd830020-139d-4163-bd97-81002c9b647b" status: 202 len: 0 microversion: 2.1 time: 0.176748 Oct 25 04:10:05.203360 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3904/7689] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:10:05 2022] DELETE /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments/bd830020-139d-4163-bd97-81002c9b647b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:10:05.213986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:05.217225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:05.225611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:05.226165 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:05.226618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:05.227359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:05.227819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:05.228258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:05.260211 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9e24c2d-4a27-4f66-9ea1-d0ffdf373ded tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052177 Oct 25 04:10:05.260791 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3905/7690] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:10:05 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:10:06.094463 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] [5c589735-4b38-4603-8237-783611465318] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44226. Oct 25 04:10:06.098039 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-48c38ae4-d4e6-4b31-bf86-dbdca56103ea req-0846c1e2-a526-42be-b054-f4f2ce5a6bbc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.126268 Oct 25 04:10:06.098656 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3786/7691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:06.273532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:06.275873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:06.282681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:06.283198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:06.283653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:06.284410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:06.284812 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:06.285239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:06.316876 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22e41fee-d8c4-4bc5-9663-8e0ead02e28e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048097 Oct 25 04:10:06.322380 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3906/7692] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:10:06 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:07.332839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:07.335488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:07.342925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:07.343441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:07.343903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:07.344638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:07.345115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:07.345566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:07.381817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a0dd92d9-12e4-4263-b03e-25f3dd5ce283 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054803 Oct 25 04:10:07.386604 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3787/7693] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:10:07 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:08.394384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:08.396645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:08.403519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:08.404005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:08.404442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:08.405137 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:08.405610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:08.406044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:08.436089 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fb59c279-e774-4378-b691-a0ea1b1316a6 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Oct 25 04:10:08.436548 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3907/7694] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:10:08 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:09.449164 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:09.451397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:09.458279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:09.459443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:09.459895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:09.460607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:09.461147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:09.461651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:09.491256 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1ef49306-79e7-445d-bc0c-97140fe858ac tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046105 Oct 25 04:10:09.491827 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3788/7695] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:10:09 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:10.504469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:10.507663 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:10.514042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:10.514521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:10.514959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:10.515653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:10.516103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:10.516530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:10.547403 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d3ae68bf-7279-442b-ba23-0688f919dec2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047196 Oct 25 04:10:10.547963 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3908/7696] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:10:10 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 04:10:10.559624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:10.560153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:10.567028 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:10.567529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:10.568105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:10.569644 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:10.570145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:10.570596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:10.647314 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] HTTP exception thrown: Instance 3d612468-1462-421e-896f-ab59f81cda2e is not attached to volume bd830020-139d-4163-bd97-81002c9b647b Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Request method failure captured: Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments/bd830020-139d-4163-bd97-81002c9b647b HTTP/1.1 Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2C4u49lDuAHoC-nf1YzP7mbCKbapLAG25Qk7p0IHuJECx9pISXmPu23LTFO4Fber4vXnFNsZYUDRU9PJDcP8XBSlNPUNS55SeT9WOSE56C-B-mZ0rj3RdGSgDxVvACMP6zglgZ5Xb22jwvPe4UFAfC5pcuSk5-eQqkjGLwMdju_5FU Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9e135d6dea944971a71d2d907a2cdb1e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9e135d6dea944971a71d2d907a2cdb1e"}]}] Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 95920d62d3df45b8bee5eaa095defabd Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 3d612468-1462-421e-896f-ab59f81cda2e is not attached to volume bd830020-139d-4163-bd97-81002c9b647b Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'server_id': '3d612468-1462-421e-896f-ab59f81cda2e', 'id': 'bd830020-139d-4163-bd97-81002c9b647b'} Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd830020-139d-4163-bd97-81002c9b647b. Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d612468-1462-421e-896f-ab59f81cda2e is not attached to volume bd830020-139d-4163-bd97-81002c9b647b Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:10:10.649295 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:10:10.653814 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:10:10.653814 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:10:10.653814 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d612468-1462-421e-896f-ab59f81cda2e is not attached to volume bd830020-139d-4163-bd97-81002c9b647b Oct 25 04:10:10.653814 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:10.653814 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Returning 404 to user: Instance 3d612468-1462-421e-896f-ab59f81cda2e is not attached to volume bd830020-139d-4163-bd97-81002c9b647b {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:10:10.653814 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc8be651-1909-4c0a-bbd1-44d03b9502a9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments/bd830020-139d-4163-bd97-81002c9b647b" status: 404 len: 154 microversion: 2.1 time: 0.095302 Oct 25 04:10:10.653814 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3789/7697] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:10:10 2022] DELETE /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e/os-volume_attachments/bd830020-139d-4163-bd97-81002c9b647b => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:10:13.902374 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:13.902874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:13.909789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:13.910253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:13.910684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:13.911365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:13.912615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:13.913057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:13.938953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:10:14.025726 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9ecc3724-4c0b-44c7-a24c-bb3015b55601 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 204 len: 0 microversion: 2.1 time: 0.126476 Oct 25 04:10:14.026350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3909/7698] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:10:13 2022] DELETE /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:10:14.035568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:14.037434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:14.048717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:14.049232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:14.049728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:14.050459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:14.050934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:14.051381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:14.186607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:14.194731 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d50a34ce-ea47-49f4-987b-03969c001024 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1554 microversion: 2.1 time: 0.163701 Oct 25 04:10:14.195535 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3790/7699] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:14 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:15.219493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:15.220199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:15.227629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:15.228108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:15.228546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:15.229232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:15.229715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:15.230144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:15.360064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:15.368958 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2c56ba67-22c2-449e-9467-5df69b047382 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1554 microversion: 2.1 time: 0.153969 Oct 25 04:10:15.369533 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3910/7700] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:15 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:16.243354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2887a9ba-a998-41fc-a9e4-4026bc8f8ac1 req-4b8fb9f0-6cab-47ab-b7f6-0d6126d4f040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d612468-1462-421e-896f-ab59f81cda2e", "name": "network-vif-deleted", "tag": "045a40e9-7f87-4378-8663-3568bb011668"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:16.254189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2887a9ba-a998-41fc-a9e4-4026bc8f8ac1 req-4b8fb9f0-6cab-47ab-b7f6-0d6126d4f040 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:16.254693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2887a9ba-a998-41fc-a9e4-4026bc8f8ac1 req-4b8fb9f0-6cab-47ab-b7f6-0d6126d4f040 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:16.255134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2887a9ba-a998-41fc-a9e4-4026bc8f8ac1 req-4b8fb9f0-6cab-47ab-b7f6-0d6126d4f040 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:16.268505 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2887a9ba-a998-41fc-a9e4-4026bc8f8ac1 req-4b8fb9f0-6cab-47ab-b7f6-0d6126d4f040 service nova] Creating event network-vif-deleted:045a40e9-7f87-4378-8663-3568bb011668 for instance 3d612468-1462-421e-896f-ab59f81cda2e on n-h1-862355-1 Oct 25 04:10:16.276469 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2887a9ba-a998-41fc-a9e4-4026bc8f8ac1 req-4b8fb9f0-6cab-47ab-b7f6-0d6126d4f040 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036851 Oct 25 04:10:16.289220 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3791/7701] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:16.392632 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:16.393350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:16.401106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:16.401890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:16.402537 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:16.403329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:16.403816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:16.404234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:16.438455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:16.439261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:16.439735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:16.440178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lazy-loading 'fault' on Instance uuid 3d612468-1462-421e-896f-ab59f81cda2e {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:10:16.485716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:16.498358 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e515e55b-a53b-474f-b942-91a3a7fdb711 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 200 len: 1348 microversion: 2.1 time: 0.109660 Oct 25 04:10:16.498960 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3911/7702] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:16 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:17.527531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:17.528289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: 3d612468-1462-421e-896f-ab59f81cda2e] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:17.534661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:17.535165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:17.535619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:17.536337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:17.537481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:17.537974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:17.551549 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] HTTP exception thrown: Instance 3d612468-1462-421e-896f-ab59f81cda2e could not be found. Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Request method failure captured: Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e HTTP/1.1 Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2C4u49lDuAHoC-nf1YzP7mbCKbapLAG25Qk7p0IHuJECx9pISXmPu23LTFO4Fber4vXnFNsZYUDRU9PJDcP8XBSlNPUNS55SeT9WOSE56C-B-mZ0rj3RdGSgDxVvACMP6zglgZ5Xb22jwvPe4UFAfC5pcuSk5-eQqkjGLwMdju_5FU Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9e135d6dea944971a71d2d907a2cdb1e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9e135d6dea944971a71d2d907a2cdb1e"}]}] Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 95920d62d3df45b8bee5eaa095defabd Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 3d612468-1462-421e-896f-ab59f81cda2e could not be found. Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '3d612468-1462-421e-896f-ab59f81cda2e'} Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d612468-1462-421e-896f-ab59f81cda2e could not be found. Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d612468-1462-421e-896f-ab59f81cda2e could not be found. Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:10:17.554015 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d612468-1462-421e-896f-ab59f81cda2e could not be found. Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Returning 404 to user: Instance 3d612468-1462-421e-896f-ab59f81cda2e could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6a6f7b46-7002-4a60-8776-75201f35342d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e" status: 404 len: 111 microversion: 2.1 time: 0.033386 Oct 25 04:10:17.559299 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3792/7703] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:17 2022] GET /compute/v2.1/servers/3d612468-1462-421e-896f-ab59f81cda2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:10:17.564527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3cb17b38-437a-49e4-8b7e-2efd0be93682 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '.version_select at 0x7efd3b82cd30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:17.569318 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3cb17b38-437a-49e4-8b7e-2efd0be93682 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [a953044b-09c0-478b-a7ea-489143a581d5] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:10:18.575778 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [None req-3cb17b38-437a-49e4-8b7e-2efd0be93682 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [a953044b-09c0-478b-a7ea-489143a581d5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44266. Oct 25 04:10:18.595914 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3cb17b38-437a-49e4-8b7e-2efd0be93682 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-932479543" status: 202 len: 0 microversion: 2.1 time: 1.035221 Oct 25 04:10:18.596512 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3912/7704] 10.222.0.36 () {58 vars in 1269 bytes} [Tue Oct 25 04:10:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-932479543 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:10:27.754400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d0a1a3ee-6bab-4860-ab50-b0826334e75f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'create', calling method: .version_select at 0x7efd32f29e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1586674599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt54QDKoD4jpZTnLPhMWOFSXmVbE3sL7JJFTw2Xf3fX+q6hVp8y6JJKFOmSpqPVwZdfLgdoRvB+EvPt0ey8P+kmPsSFBwyxZSSOk2zEg04YDWZz0UOnp5+b7u0vEwaBfg=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:27.762359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=16 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:27.763019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=34 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:27.763891 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:10:27.764036 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:10:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 25 04:10:27.767288 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:10:27.767408 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:10:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 25 04:10:27.788973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d0a1a3ee-6bab-4860-ab50-b0826334e75f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:10:27.794218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-d0a1a3ee-6bab-4860-ab50-b0826334e75f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for user 95920d62d3df45b8bee5eaa095defabd and project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:10:27.823281 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d0a1a3ee-6bab-4860-ab50-b0826334e75f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072935 Oct 25 04:10:27.823894 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3793/7705] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:10:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:27.872806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:27.877522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1617815125", "imageRef": "f227b784-980e-4642-8d0c-05a2bd717a8e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1586674599", "networks": [{"uuid": "73103de6-7a77-4189-9bbe-e04663a21570"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:27.932265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] validate_networks() for [('73103de6-7a77-4189-9bbe-e04663a21570', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:10:28.368294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:10:28.368717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:10:28.369188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:10:28.369626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:10:28.370065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:10:28.378798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:28.379305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:28.379743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:28.380459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:28.381557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:28.382429 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:28.399142 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:10:28.404391 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Getting quotas for user 95920d62d3df45b8bee5eaa095defabd and project 9e135d6dea944971a71d2d907a2cdb1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:10:28.416986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:10:28.419209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f227b784-980e-4642-8d0c-05a2bd717a8e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:10:28.467552 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-44b377a9-119d-4378-92d7-b5e3c0622e9e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596513 Oct 25 04:10:28.468522 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3913/7706] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:10:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:10:28.479223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c67529a1-f20d-45b7-8647-801d9f3209bb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:28.479858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c67529a1-f20d-45b7-8647-801d9f3209bb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:28.533465 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c67529a1-f20d-45b7-8647-801d9f3209bb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:28.540637 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c67529a1-f20d-45b7-8647-801d9f3209bb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1259 microversion: 2.1 time: 0.065375 Oct 25 04:10:28.541237 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3794/7707] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:28 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:29.564840 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3d14bc5d-f4c0-45b8-8069-77b075adbaf5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:29.565475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3d14bc5d-f4c0-45b8-8069-77b075adbaf5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:29.623444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3d14bc5d-f4c0-45b8-8069-77b075adbaf5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:29.630474 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3d14bc5d-f4c0-45b8-8069-77b075adbaf5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1259 microversion: 2.1 time: 0.070364 Oct 25 04:10:29.631553 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3914/7708] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:29 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:30.654361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-13f8d254-e4b3-4e3c-9d20-bd8fb17009ce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:30.654989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-13f8d254-e4b3-4e3c-9d20-bd8fb17009ce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:30.726736 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-13f8d254-e4b3-4e3c-9d20-bd8fb17009ce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:30.736657 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-13f8d254-e4b3-4e3c-9d20-bd8fb17009ce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1259 microversion: 2.1 time: 0.086165 Oct 25 04:10:30.738005 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3795/7709] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:30 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1259 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:10:31.766887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f4ac506d-2132-4b17-8bc3-48338de8f147 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:31.767498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f4ac506d-2132-4b17-8bc3-48338de8f147 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:31.826232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f4ac506d-2132-4b17-8bc3-48338de8f147 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:31.833038 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f4ac506d-2132-4b17-8bc3-48338de8f147 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1259 microversion: 2.1 time: 0.070108 Oct 25 04:10:31.833620 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3915/7710] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:31 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:32.857225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:32.857891 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:32.864970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:32.865763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:32.865997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:32.866697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:32.867163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:32.867601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:32.928567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:32.936431 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-df5265c4-7094-4d7f-8475-f561c4bc08e2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1263 microversion: 2.1 time: 0.083196 Oct 25 04:10:32.936998 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3796/7711] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:32 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:33.960046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:33.960660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:33.964852 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:33.969072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:33.969542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:33.970183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:33.970897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:33.971358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:33.971794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:34.048223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:34.057569 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-52525dd8-f057-4cc0-9b15-ac65d7803329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1317 microversion: 2.1 time: 0.101907 Oct 25 04:10:34.058485 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3916/7712] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:33 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:35.087658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:35.088682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:35.095862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:35.096710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:35.097441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:35.098538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:35.099263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:35.100810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:35.244767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:35.253492 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2827b8ef-e54f-4e10-82f7-11a6592fe07d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.170411 Oct 25 04:10:35.254131 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3797/7713] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:35 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:36.277420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:36.278989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:36.286589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:36.287403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:36.287853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:36.288568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:36.289174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:36.289644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:36.432300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:36.440696 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c485c000-50c3-4583-9d02-653cb1e01183 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.167225 Oct 25 04:10:36.441552 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3917/7714] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:36 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:37.466136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:37.466862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:37.474308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:37.474799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:37.475246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:37.476200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:37.476681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:37.477127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:37.619281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:37.628118 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-bdf57b2e-b892-4307-a762-0132e1929b48 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.166399 Oct 25 04:10:37.629061 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3798/7715] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:37 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:38.653310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:38.654021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:38.656914 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:38.662824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:38.663331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:38.663802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:38.664521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:38.664987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:38.665422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:38.805115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:38.813106 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70c5b61f-6d41-498e-b9af-27bf33555acb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.163765 Oct 25 04:10:38.813811 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3918/7716] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:38 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:39.836837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:39.837720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:39.845108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:39.845615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:39.846100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:39.847100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:39.847615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:39.848217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:39.999518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:40.007716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-da6212d0-40d2-49a7-af4f-9e1bf84cc7d7 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.175010 Oct 25 04:10:40.008518 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3799/7717] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:39 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:41.030875 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:41.031518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:41.039125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:41.039619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:41.040055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:41.040749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:41.041202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:41.041631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:41.183898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:41.192417 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7adea3a-2820-487e-ba15-a38247002f42 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.165600 Oct 25 04:10:41.193112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3919/7718] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:41 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:42.215817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:42.216449 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:42.218433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:42.226489 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:42.226993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:42.227453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:42.228170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:42.228638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:42.229111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:42.421975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e9a51dfc-32a5-46ac-9052-b3419f9fda69 req-26e25a9c-801a-417c-a594-9315550c5681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7de5146-4d66-4381-890b-8305248e0a8d", "tag": "8deeb75b-eac2-497b-b1d9-f841236c7814"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:42.429040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=10 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:10:42.436313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e9a51dfc-32a5-46ac-9052-b3419f9fda69 req-26e25a9c-801a-417c-a594-9315550c5681 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:42.436810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e9a51dfc-32a5-46ac-9052-b3419f9fda69 req-26e25a9c-801a-417c-a594-9315550c5681 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:42.437255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e9a51dfc-32a5-46ac-9052-b3419f9fda69 req-26e25a9c-801a-417c-a594-9315550c5681 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:42.441484 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:42.450460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-96171d4e-f3f6-4b95-8350-2f879cc479b4 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.238648 Oct 25 04:10:42.451050 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3800/7719] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:42 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:42.462124 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e9a51dfc-32a5-46ac-9052-b3419f9fda69 req-26e25a9c-801a-417c-a594-9315550c5681 service nova] Creating event network-changed:8deeb75b-eac2-497b-b1d9-f841236c7814 for instance a7de5146-4d66-4381-890b-8305248e0a8d on n-h1-862355-1 Oct 25 04:10:42.470264 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e9a51dfc-32a5-46ac-9052-b3419f9fda69 req-26e25a9c-801a-417c-a594-9315550c5681 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052127 Oct 25 04:10:42.470904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3920/7720] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:10:43.475898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:43.476540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:43.483637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:43.484144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:43.484599 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:43.485313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:43.485821 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:43.486271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:43.620909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:43.628712 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-332094ca-e663-400e-bdfe-50a2d4008665 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.157009 Oct 25 04:10:43.629330 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3801/7721] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:43 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:44.654052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:44.654761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:44.660977 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:44.661470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:44.662446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:44.663148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:44.663612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:44.664053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:44.797402 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:44.806818 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-656f0b9f-fa06-4ad0-a8e4-520a2dc47fec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.157997 Oct 25 04:10:44.807458 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3921/7722] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:44 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:45.829739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:45.830384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:45.837520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:45.838064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:45.838523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:45.839236 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:45.839710 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:45.840159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:45.973893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:45.982283 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-570928d6-9080-4e39-b92d-42d02764a329 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.156495 Oct 25 04:10:45.982869 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3802/7723] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:45 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:46.967543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-92407646-9a8b-4ff5-bd27-3eb80c23c6e6 req-06da3807-4535-4a2e-99b7-0d098d314b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7de5146-4d66-4381-890b-8305248e0a8d", "name": "network-vif-plugged", "status": "completed", "tag": "8deeb75b-eac2-497b-b1d9-f841236c7814"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:46.979060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-92407646-9a8b-4ff5-bd27-3eb80c23c6e6 req-06da3807-4535-4a2e-99b7-0d098d314b2c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:46.979545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-92407646-9a8b-4ff5-bd27-3eb80c23c6e6 req-06da3807-4535-4a2e-99b7-0d098d314b2c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:46.979984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-92407646-9a8b-4ff5-bd27-3eb80c23c6e6 req-06da3807-4535-4a2e-99b7-0d098d314b2c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:46.991450 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-92407646-9a8b-4ff5-bd27-3eb80c23c6e6 req-06da3807-4535-4a2e-99b7-0d098d314b2c service nova] Creating event network-vif-plugged:8deeb75b-eac2-497b-b1d9-f841236c7814 for instance a7de5146-4d66-4381-890b-8305248e0a8d on n-h1-862355-1 Oct 25 04:10:46.996842 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-92407646-9a8b-4ff5-bd27-3eb80c23c6e6 req-06da3807-4535-4a2e-99b7-0d098d314b2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108347 Oct 25 04:10:46.997445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3922/7724] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:47.006296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:47.006974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:47.014390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:47.014943 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:47.015492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:47.016228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:47.016704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:47.017191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:47.208113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:47.216437 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-948d1ae6-0f17-47e0-9f87-2e6310646ab2 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.214324 Oct 25 04:10:47.217025 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3803/7725] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:47 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:48.241422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:48.242168 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:48.249193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:48.249694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:48.250149 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:48.250849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:48.251312 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:48.251746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:48.382918 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:48.391320 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ab36d6b0-6c03-4f78-b5f0-c53527f19250 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1359 microversion: 2.1 time: 0.155031 Oct 25 04:10:48.391918 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3923/7726] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:48 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:49.415827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:49.416369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:49.423443 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.423948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.424433 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.425152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.425637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.426147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.557520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:49.565302 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b9c89a43-e971-4403-bf3b-f0cb2b1bc270 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1548 microversion: 2.1 time: 0.154046 Oct 25 04:10:49.565910 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3804/7727] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:49 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:49.589102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:49.589744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:49.596482 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.596963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.597398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.598119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.598575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.599652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.734728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:49.742956 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f75bf907-46dc-45a3-93e2-605d70953617 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1548 microversion: 2.1 time: 0.157676 Oct 25 04:10:49.743553 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3924/7728] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:49 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:49.765341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:49.770223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:49.771607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Searching by: {'deleted': False, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e'} {{(pid=120563) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 25 04:10:49.777043 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.777532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.778027 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.778763 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.779233 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.779670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.803114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.multi_cell_list [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 25 04:10:49.832912 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-028046d7-0de3-435f-b660-b792abfbe7fc tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071516 Oct 25 04:10:49.834057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3805/7729] 10.222.0.36 () {58 vars in 1125 bytes} [Tue Oct 25 04:10:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:10:49.845491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:10:49.846140 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:49.851985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.852493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.852929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.853618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:49.854098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:49.854526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:49.982575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:10:49.990277 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ca636e52-fc50-489f-9d04-ab0b793f8a25 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1548 microversion: 2.1 time: 0.148603 Oct 25 04:10:49.990863 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3925/7730] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:10:49 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:10:51.511174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95e72d96-17c0-42ae-828a-5638ee3141a9"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:10:51.513608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:10:51.520493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:51.521581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:51.522113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:51.522782 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:10:51.523257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:10:51.523705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:10:51.765911 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-758dce19-3d75-4534-bba1-d791471f50c5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258551 Oct 25 04:10:51.772019 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3806/7731] 10.222.0.36 () {60 vars in 1323 bytes} [Tue Oct 25 04:10:51 2022] POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:11:02.542719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:02.543379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:02.545982 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:11:02.546938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=19 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:02.547615 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=54 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:02.553590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:02.554443 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:02.554890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:02.555597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:02.556062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:02.556491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:02.684122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:02.692395 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7651c3a8-4e43-4ff9-84d7-f94abe8fa62c tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1594 microversion: 2.1 time: 0.153569 Oct 25 04:11:02.692990 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3926/7732] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:02 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:04.275323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-749c671b-c852-4179-bc19-73882db14a7e req-5ff25e51-d923-4705-b268-a7b5440621e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7de5146-4d66-4381-890b-8305248e0a8d", "tag": "8deeb75b-eac2-497b-b1d9-f841236c7814"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:11:04.282397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:04.283528 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:04.284266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:04.291510 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-749c671b-c852-4179-bc19-73882db14a7e req-5ff25e51-d923-4705-b268-a7b5440621e7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:04.292441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-749c671b-c852-4179-bc19-73882db14a7e req-5ff25e51-d923-4705-b268-a7b5440621e7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:04.293054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-749c671b-c852-4179-bc19-73882db14a7e req-5ff25e51-d923-4705-b268-a7b5440621e7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:04.308078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-749c671b-c852-4179-bc19-73882db14a7e req-5ff25e51-d923-4705-b268-a7b5440621e7 service nova] Creating event network-changed:8deeb75b-eac2-497b-b1d9-f841236c7814 for instance a7de5146-4d66-4381-890b-8305248e0a8d on n-h1-862355-1 Oct 25 04:11:04.314526 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-749c671b-c852-4179-bc19-73882db14a7e req-5ff25e51-d923-4705-b268-a7b5440621e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044020 Oct 25 04:11:04.315426 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3807/7733] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:11:05.492435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-206940331"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:11:05.493021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:05.500983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:05.501477 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:05.501949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:05.502651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:05.503115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:05.503548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:05.509202 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44534. Oct 25 04:11:05.634088 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.network.security_group_api [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Adding security group 452b5165-7f9a-417e-87db-3b4df6b13fcc to port 8deeb75b-eac2-497b-b1d9-f841236c7814 Oct 25 04:11:05.951768 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d11b59f-f8ee-4b88-a614-2369869efdce tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.464041 Oct 25 04:11:05.956221 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3927/7734] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:11:05 2022] POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:11:05.963907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:05.964792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:05.971558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:05.972310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:05.972753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:05.973577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:05.974175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:05.974727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:06.138021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:06.148203 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ebfab959-5ce8-452a-861f-ebd37f11edec tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1757 microversion: 2.1 time: 0.189888 Oct 25 04:11:06.148807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3808/7735] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:05 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:06.332737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-ae2e6397-c37f-4c04-a27e-9b7ff8c89582 req-93481368-f5a2-48f6-a449-d4d13938200e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7de5146-4d66-4381-890b-8305248e0a8d", "tag": "8deeb75b-eac2-497b-b1d9-f841236c7814"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:11:06.343519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ae2e6397-c37f-4c04-a27e-9b7ff8c89582 req-93481368-f5a2-48f6-a449-d4d13938200e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:06.344085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ae2e6397-c37f-4c04-a27e-9b7ff8c89582 req-93481368-f5a2-48f6-a449-d4d13938200e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:06.344584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-ae2e6397-c37f-4c04-a27e-9b7ff8c89582 req-93481368-f5a2-48f6-a449-d4d13938200e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:06.356583 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-ae2e6397-c37f-4c04-a27e-9b7ff8c89582 req-93481368-f5a2-48f6-a449-d4d13938200e service nova] Creating event network-changed:8deeb75b-eac2-497b-b1d9-f841236c7814 for instance a7de5146-4d66-4381-890b-8305248e0a8d on n-h1-862355-1 Oct 25 04:11:06.361671 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-ae2e6397-c37f-4c04-a27e-9b7ff8c89582 req-93481368-f5a2-48f6-a449-d4d13938200e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032680 Oct 25 04:11:06.362604 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3928/7736] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:11:27.858360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:27.859112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:27.905019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:11:27.907372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:27.913668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:27.914192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:27.914643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:27.915346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:27.915816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:27.916252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:27.990147 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5cbc8736-ca83-4033-b2dd-8296279a9bcb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.137094 Oct 25 04:11:27.990870 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3809/7737] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:11:27 2022] POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:11:27.999761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:28.000474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:28.003818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:28.004310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:11:28.010485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:28.010981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:28.011423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:28.012155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:28.012630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:28.013085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:28.164166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:28.172698 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-692546a9-b92f-48a4-86cb-1bfc1d2241da tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1749 microversion: 2.1 time: 0.177103 Oct 25 04:11:28.173416 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3929/7738] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:27 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1749 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:11:29.199707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:29.200450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:29.206646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:29.207144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:29.207590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:29.208384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:29.209389 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:29.209916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:29.354095 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:29.362389 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-165cf392-6fe9-4687-a3f4-709401887bd9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.168001 Oct 25 04:11:29.362965 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3810/7739] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:29 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:30.386777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:30.387324 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:30.394182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:30.394665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:30.395104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:30.395823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:30.396284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:30.396712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:30.545439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:30.554678 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c2f03df0-8e68-4d24-9568-11a16c6be26e tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.171649 Oct 25 04:11:30.555260 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3930/7740] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:30 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:31.579077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:31.579708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:31.587466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:31.587957 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:31.588404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:31.589106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:31.589574 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:31.590036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:31.741254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:31.749561 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4a43a1ba-aaad-4853-8dac-18b95bb60364 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.174435 Oct 25 04:11:31.750169 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3811/7741] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:31 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:32.774427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:32.775046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:32.782145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:32.782633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:32.783073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:32.783773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:32.784233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:32.784660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:32.954748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:32.967419 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4e6f88f-7447-4d89-b3ee-ee593e97f353 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.197498 Oct 25 04:11:32.968112 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3931/7742] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:32 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:33.992121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:33.992947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:34.003172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:34.004033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:34.004833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:34.006478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:34.007018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:34.007548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:34.152399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:34.160681 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1244b376-5dc6-4c40-8a15-f2e7fff4db8f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.172569 Oct 25 04:11:34.161297 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3812/7743] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:33 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:35.184428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:35.185078 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:35.191887 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:35.192373 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:35.193322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:35.194052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:35.194509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:35.194940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:35.344815 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:35.353577 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3ac185eb-1f42-47d1-961d-675052a50aed tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.173163 Oct 25 04:11:35.354231 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3932/7744] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:35 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:36.377321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:36.377909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:36.384866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:36.385360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:36.385850 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:36.386550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:36.387019 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:36.387479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:36.537397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:36.545842 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-51997b50-e165-477c-95f1-dc60976fa7e5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.172493 Oct 25 04:11:36.546414 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3813/7745] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:36 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:37.570920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:37.571543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:37.578164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:37.578652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:37.579107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:37.579802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:37.580265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:37.580700 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:37.722526 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:37.730827 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6c77348-88e9-44fe-bbcc-d701c4e8333d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.164527 Oct 25 04:11:37.731411 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3933/7746] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:37 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:38.753773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:38.754406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:38.762119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:38.762613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:38.763063 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:38.763799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:38.764267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:38.764708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:38.909196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:38.918173 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce8b0cba-c62d-4bac-9a11-d67eb1fa3666 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.168398 Oct 25 04:11:38.918761 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3814/7747] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:38 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:39.943394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:39.944052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:39.950646 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:39.951135 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:39.951576 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:39.952268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:39.952728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:39.953162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:40.100929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:40.109151 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-805643f7-a253-45b2-88c0-76a7984a6723 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.170594 Oct 25 04:11:40.109767 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3934/7748] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:39 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:41.133747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:41.134393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:41.141383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:41.141922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:41.142382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:41.143098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:41.143578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:41.144030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:41.289825 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:41.298233 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9f1b140b-940d-4a64-9be6-068d20420a31 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.169280 Oct 25 04:11:41.298814 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3815/7749] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:41 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:42.322604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:42.323152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:42.330103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:42.330588 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:42.331028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:42.331722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:42.332179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:42.332603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:42.475433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:42.483766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b43a21b-6e13-453d-8a82-b8f923c88619 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.165264 Oct 25 04:11:42.484392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3935/7750] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:42 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:43.508067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:43.508775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:43.515843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:43.516346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:43.516801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:43.517512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:43.518025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:43.518474 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:43.660535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:43.669586 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7066937f-53b9-4da4-8e49-b7440103d52d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1754 microversion: 2.1 time: 0.166137 Oct 25 04:11:43.670276 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3816/7751] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:43 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:11:44.694784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:11:44.695404 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:11:44.702340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:44.702829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:44.703268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:44.703964 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:11:44.704422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:11:44.704855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:11:44.867035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:11:44.875335 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c499ce9b-cc37-4b57-916d-789d6edeb4cb tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1757 microversion: 2.1 time: 0.185319 Oct 25 04:11:44.875924 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3936/7752] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:11:44 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:17.765160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-206940331"}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:17.765862 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:17.768191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=16 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:17.768889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:17.776969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:17.777470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:17.777950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:17.778652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:17.779117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:17.779560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:17.911397 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.network.security_group_api [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Removing security group 452b5165-7f9a-417e-87db-3b4df6b13fcc from port 8deeb75b-eac2-497b-b1d9-f841236c7814 Oct 25 04:12:18.213936 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-726af495-fe50-466e-9e4c-c6e265412b23 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.451532 Oct 25 04:12:18.220325 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3817/7753] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:12:17 2022] POST /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:12:18.223848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-d83b6c4a-61e2-49db-963d-d72c46841a06 req-ed5e55a6-f8d7-4d00-9c07-a3d3b6599716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7de5146-4d66-4381-890b-8305248e0a8d", "tag": "8deeb75b-eac2-497b-b1d9-f841236c7814"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:18.234283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=16 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:18.235409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=48 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:18.238634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d83b6c4a-61e2-49db-963d-d72c46841a06 req-ed5e55a6-f8d7-4d00-9c07-a3d3b6599716 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:18.239375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d83b6c4a-61e2-49db-963d-d72c46841a06 req-ed5e55a6-f8d7-4d00-9c07-a3d3b6599716 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:18.240275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-d83b6c4a-61e2-49db-963d-d72c46841a06 req-ed5e55a6-f8d7-4d00-9c07-a3d3b6599716 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:18.254120 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-d83b6c4a-61e2-49db-963d-d72c46841a06 req-ed5e55a6-f8d7-4d00-9c07-a3d3b6599716 service nova] Creating event network-changed:8deeb75b-eac2-497b-b1d9-f841236c7814 for instance a7de5146-4d66-4381-890b-8305248e0a8d on n-h1-862355-1 Oct 25 04:12:18.260093 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-d83b6c4a-61e2-49db-963d-d72c46841a06 req-ed5e55a6-f8d7-4d00-9c07-a3d3b6599716 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040274 Oct 25 04:12:18.261465 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3937/7754] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:12:19.887751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:19.888342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:19.894530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:19.895041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:19.895501 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:19.896408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:19.896893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:19.897346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:19.983806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lazy-loading 'services' on Instance uuid a7de5146-4d66-4381-890b-8305248e0a8d {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:12:20.069556 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-12af14b4-16f5-487a-bef5-64711df9e9ab tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments/95e72d96-17c0-42ae-828a-5638ee3141a9" status: 202 len: 0 microversion: 2.1 time: 0.186756 Oct 25 04:12:20.070668 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3818/7755] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:12:19 2022] DELETE /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments/95e72d96-17c0-42ae-828a-5638ee3141a9 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:12:20.080889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:20.083341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:20.090972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:20.091390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:20.091826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:20.092530 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:20.093182 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:20.093931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:20.136723 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63c0611e-636e-4c81-96c7-b4bf6ef9f4ca tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061585 Oct 25 04:12:20.137299 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3938/7756] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:12:20 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:12:20.279783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d68a92e0-4b9d-43e4-8323-6f8ad239261b req-9c02c93a-ee05-4362-88a6-174af447a5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7de5146-4d66-4381-890b-8305248e0a8d", "tag": "8deeb75b-eac2-497b-b1d9-f841236c7814"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:20.289720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d68a92e0-4b9d-43e4-8323-6f8ad239261b req-9c02c93a-ee05-4362-88a6-174af447a5e9 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:20.290220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d68a92e0-4b9d-43e4-8323-6f8ad239261b req-9c02c93a-ee05-4362-88a6-174af447a5e9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:20.290662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d68a92e0-4b9d-43e4-8323-6f8ad239261b req-9c02c93a-ee05-4362-88a6-174af447a5e9 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:20.302074 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d68a92e0-4b9d-43e4-8323-6f8ad239261b req-9c02c93a-ee05-4362-88a6-174af447a5e9 service nova] Creating event network-changed:8deeb75b-eac2-497b-b1d9-f841236c7814 for instance a7de5146-4d66-4381-890b-8305248e0a8d on n-h1-862355-1 Oct 25 04:12:20.307524 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d68a92e0-4b9d-43e4-8323-6f8ad239261b req-9c02c93a-ee05-4362-88a6-174af447a5e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031981 Oct 25 04:12:20.308130 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3819/7757] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:21.150804 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:21.153040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:21.159893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:21.160314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:21.160753 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:21.161448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:21.162676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:21.163106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:21.195827 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9477f43a-e080-4b84-b83f-066a11c0261b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049187 Oct 25 04:12:21.196416 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3939/7758] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:12:21 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:22.210934 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:22.213030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:22.221431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:22.222358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:22.222976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:22.223579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:22.224116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:22.224572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:22.257124 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a503c9d-4535-4a51-9103-2ed5de05e1cd tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052122 Oct 25 04:12:22.257776 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3820/7759] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:12:22 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:23.269603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:23.272310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:23.281470 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:23.282003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:23.282448 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:23.283157 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:23.283616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:23.284048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:23.313632 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-33f6369e-2ae8-4784-b911-8becda4c8a3b tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048196 Oct 25 04:12:23.314237 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3940/7760] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:12:23 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:24.327209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:24.329586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:24.336729 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:24.337242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:24.337717 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:24.338447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:24.338929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:24.339382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:24.371231 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9193e535-cb68-4181-9e06-8417771553a0 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048234 Oct 25 04:12:24.372047 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3821/7761] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:12:24 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:12:25.384192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:25.386476 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:25.393178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:25.393665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:25.394139 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:25.394834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:25.395293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:25.395721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:25.424243 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b0dd1fe3-1fa7-4262-99f2-089cc23e37b3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044251 Oct 25 04:12:25.424802 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3941/7762] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Oct 25 04:12:25 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 25 04:12:25.436798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:25.437325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:25.444139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:25.444637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:25.445091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:25.445831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:25.446300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:25.446741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:25.521596 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] HTTP exception thrown: Instance a7de5146-4d66-4381-890b-8305248e0a8d is not attached to volume 95e72d96-17c0-42ae-828a-5638ee3141a9 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Request method failure captured: Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: request: DELETE /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments/95e72d96-17c0-42ae-828a-5638ee3141a9 HTTP/1.1 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2C4u49lDuAHoC-nf1YzP7mbCKbapLAG25Qk7p0IHuJECx9pISXmPu23LTFO4Fber4vXnFNsZYUDRU9PJDcP8XBSlNPUNS55SeT9WOSE56C-B-mZ0rj3RdGSgDxVvACMP6zglgZ5Xb22jwvPe4UFAfC5pcuSk5-eQqkjGLwMdju_5FU Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9e135d6dea944971a71d2d907a2cdb1e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9e135d6dea944971a71d2d907a2cdb1e"}]}] Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 95920d62d3df45b8bee5eaa095defabd Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance a7de5146-4d66-4381-890b-8305248e0a8d is not attached to volume 95e72d96-17c0-42ae-828a-5638ee3141a9 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'server_id': 'a7de5146-4d66-4381-890b-8305248e0a8d', 'id': '95e72d96-17c0-42ae-828a-5638ee3141a9'} Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 95e72d96-17c0-42ae-828a-5638ee3141a9. Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7de5146-4d66-4381-890b-8305248e0a8d is not attached to volume 95e72d96-17c0-42ae-828a-5638ee3141a9 Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:12:25.523325 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:12:25.527743 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:12:25.527743 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:12:25.527743 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7de5146-4d66-4381-890b-8305248e0a8d is not attached to volume 95e72d96-17c0-42ae-828a-5638ee3141a9 Oct 25 04:12:25.527743 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:25.527743 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Returning 404 to user: Instance a7de5146-4d66-4381-890b-8305248e0a8d is not attached to volume 95e72d96-17c0-42ae-828a-5638ee3141a9 {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:12:25.527743 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3bb9be33-b99d-4d79-b2f8-85a6ea423ebf tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments/95e72d96-17c0-42ae-828a-5638ee3141a9" status: 404 len: 154 microversion: 2.1 time: 0.092299 Oct 25 04:12:25.527743 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3822/7763] 10.222.0.36 () {58 vars in 1416 bytes} [Tue Oct 25 04:12:25 2022] DELETE /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d/os-volume_attachments/95e72d96-17c0-42ae-828a-5638ee3141a9 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:12:28.780164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:28.780676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:28.788329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:28.788817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:28.789261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:28.790056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:28.790519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:28.790954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:28.816246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:12:28.903051 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-475cc962-0d22-4982-ac33-35ae66831db3 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 204 len: 0 microversion: 2.1 time: 0.126526 Oct 25 04:12:28.903760 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3942/7764] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:12:28 2022] DELETE /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:12:28.912134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:28.913512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:28.921942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:28.922447 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:28.922897 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:28.923609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:28.924074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:28.924511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:29.067430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:29.076082 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c0a1a97-f500-426b-ab9e-43934b2c7957 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1554 microversion: 2.1 time: 0.167989 Oct 25 04:12:29.076671 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3823/7765] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:28 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:30.100730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:30.101427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:30.109174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:30.109660 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:30.110119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:30.110814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:30.111263 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:30.111688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:30.242269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:30.249925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7920038-826c-438f-ac35-5f75c922dbb5 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1554 microversion: 2.1 time: 0.153516 Oct 25 04:12:30.250499 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3943/7766] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:30 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:31.184450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-308b8cf3-133a-447c-b2c4-3abbf5efa84e req-efa963d0-b13b-4f72-9708-2e3676ce34b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7de5146-4d66-4381-890b-8305248e0a8d", "name": "network-vif-deleted", "tag": "8deeb75b-eac2-497b-b1d9-f841236c7814"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:31.196276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-308b8cf3-133a-447c-b2c4-3abbf5efa84e req-efa963d0-b13b-4f72-9708-2e3676ce34b2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:31.196774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-308b8cf3-133a-447c-b2c4-3abbf5efa84e req-efa963d0-b13b-4f72-9708-2e3676ce34b2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:31.197219 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-308b8cf3-133a-447c-b2c4-3abbf5efa84e req-efa963d0-b13b-4f72-9708-2e3676ce34b2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:31.209440 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-308b8cf3-133a-447c-b2c4-3abbf5efa84e req-efa963d0-b13b-4f72-9708-2e3676ce34b2 service nova] Creating event network-vif-deleted:8deeb75b-eac2-497b-b1d9-f841236c7814 for instance a7de5146-4d66-4381-890b-8305248e0a8d on n-h1-862355-1 Oct 25 04:12:31.214994 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-308b8cf3-133a-447c-b2c4-3abbf5efa84e req-efa963d0-b13b-4f72-9708-2e3676ce34b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034247 Oct 25 04:12:31.215687 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3824/7767] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:31.274107 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:31.274656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:31.282162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:31.282697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:31.283148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:31.283865 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:31.284333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:31.284771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:31.318762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:31.319242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:31.319698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:31.320152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lazy-loading 'fault' on Instance uuid a7de5146-4d66-4381-890b-8305248e0a8d {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:12:31.364518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95920d62d3df45b8bee5eaa095defabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e135d6dea944971a71d2d907a2cdb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:31.372828 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6692167e-b399-4df0-8a87-ba5f0acada7f tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 200 len: 1349 microversion: 2.1 time: 0.102870 Oct 25 04:12:31.373407 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3944/7768] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:31 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:32.398383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:32.399017 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] [instance: a7de5146-4d66-4381-890b-8305248e0a8d] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:32.405242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:32.405768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:32.406221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:32.406930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:32.407397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:32.407839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:32.421333 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] HTTP exception thrown: Instance a7de5146-4d66-4381-890b-8305248e0a8d could not be found. Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Request method failure captured: Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d HTTP/1.1 Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2C4u49lDuAHoC-nf1YzP7mbCKbapLAG25Qk7p0IHuJECx9pISXmPu23LTFO4Fber4vXnFNsZYUDRU9PJDcP8XBSlNPUNS55SeT9WOSE56C-B-mZ0rj3RdGSgDxVvACMP6zglgZ5Xb22jwvPe4UFAfC5pcuSk5-eQqkjGLwMdju_5FU Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9e135d6dea944971a71d2d907a2cdb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9e135d6dea944971a71d2d907a2cdb1e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9e135d6dea944971a71d2d907a2cdb1e"}]}] Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 9e135d6dea944971a71d2d907a2cdb1e Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestMinimumBasicScenario-283661351 Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: 95920d62d3df45b8bee5eaa095defabd Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestMinimumBasicScenario-283661351-project Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance a7de5146-4d66-4381-890b-8305248e0a8d could not be found. Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'a7de5146-4d66-4381-890b-8305248e0a8d'} Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7de5146-4d66-4381-890b-8305248e0a8d could not be found. Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7de5146-4d66-4381-890b-8305248e0a8d could not be found. Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:12:32.422991 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7de5146-4d66-4381-890b-8305248e0a8d could not be found. Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Returning 404 to user: Instance a7de5146-4d66-4381-890b-8305248e0a8d could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dbb3e87c-31f8-408e-b3c3-ff8340d4afa9 tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d" status: 404 len: 111 microversion: 2.1 time: 0.031926 Oct 25 04:12:32.427910 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3825/7769] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:32 2022] GET /compute/v2.1/servers/a7de5146-4d66-4381-890b-8305248e0a8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:12:32.433307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e0f6dc97-069f-43e1-b747-f72b279a589d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] Calling method '.version_select at 0x7efd327e4d30>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:32.454023 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e0f6dc97-069f-43e1-b747-f72b279a589d tempest-TestMinimumBasicScenario-283661351 tempest-TestMinimumBasicScenario-283661351-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1586674599" status: 202 len: 0 microversion: 2.1 time: 0.024698 Oct 25 04:12:32.454612 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3945/7770] 10.222.0.36 () {58 vars in 1272 bytes} [Tue Oct 25 04:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1586674599 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:12:41.568908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-590bd016-6bcc-480a-bc27-9c19ab59b0e0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: .version_select at 0x7efd332f5ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-574648575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMXHRb4tR1eOSFiYd79E0/mKSe+teC7AzbrvbvfFYMH0esjlC/LznAr0fPaufuu6nBSj5tiDa6Ed3pecfg+cA4Q+cQ7f+4vbhEmBUrPG2stQfeBFxUH4PWSa1rw0LWC8Q=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:41.584477 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-590bd016-6bcc-480a-bc27-9c19ab59b0e0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:12:41.589598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-590bd016-6bcc-480a-bc27-9c19ab59b0e0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:12:41.618622 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-590bd016-6bcc-480a-bc27-9c19ab59b0e0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.215730 Oct 25 04:12:41.619251 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3826/7771] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:12:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:47.253348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1205066387", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "b32687ee-ed16-405d-b722-78ef96444baa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-574648575", "security_groups": [{"name": "tempest-secgroup-smoke-1784835582"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:47.265893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:47.266723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:47.375215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] validate_networks() for [('b32687ee-ed16-405d-b722-78ef96444baa', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:12:47.805375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:12:47.805793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:12:47.806280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:12:47.806701 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:12:47.807128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:12:47.818460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:47.818952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:47.819549 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:47.820308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:47.820773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:47.821207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:47.840277 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:12:47.846294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:12:47.861563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:12:47.864081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:12:47.917064 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [35164f68-dd1e-44af-82b1-ee7826e59925] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:12:48.924178 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [35164f68-dd1e-44af-82b1-ee7826e59925] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 44844. Oct 25 04:12:48.928663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e17a27b0-b2e4-4e5a-a357-05116e8f89ae tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.679950 Oct 25 04:12:48.929860 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3946/7772] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:12:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 04:12:48.941314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-556397aa-ecd8-4180-ab9a-08391de86ea8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:48.941925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-556397aa-ecd8-4180-ab9a-08391de86ea8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:48.945889 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:48.946681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:49.013216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-556397aa-ecd8-4180-ab9a-08391de86ea8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:49.020622 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-556397aa-ecd8-4180-ab9a-08391de86ea8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1266 microversion: 2.1 time: 0.083400 Oct 25 04:12:49.021761 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3827/7773] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:48 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:50.045592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:50.046233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:50.055120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:50.055898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:50.056464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:50.058869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:50.059468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:50.060630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:50.156064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:50.167420 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b9733f56-c3ec-49ca-beea-74fc18ee83b0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1318 microversion: 2.1 time: 0.126656 Oct 25 04:12:50.168041 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3947/7774] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:50 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:51.192153 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:51.192716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:51.200446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:51.200960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:51.201415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:51.202161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:51.202642 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:51.203089 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:51.340558 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:51.348552 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-37c32d57-aaa2-455b-ba4c-b2666c53282c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1392 microversion: 2.1 time: 0.160568 Oct 25 04:12:51.350601 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3828/7775] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:51 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:51.636454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a6e213ba-7160-4f69-8530-85b8e2014563 req-bb651b22-6b9f-4e73-b4b1-ac3ebe07ea6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b185c2-a9e6-4164-921f-b2637e48c288", "tag": "5cd1e384-721e-4d78-887b-a97351845a42"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:51.653104 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a6e213ba-7160-4f69-8530-85b8e2014563 req-bb651b22-6b9f-4e73-b4b1-ac3ebe07ea6b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:51.653939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a6e213ba-7160-4f69-8530-85b8e2014563 req-bb651b22-6b9f-4e73-b4b1-ac3ebe07ea6b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:51.654541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a6e213ba-7160-4f69-8530-85b8e2014563 req-bb651b22-6b9f-4e73-b4b1-ac3ebe07ea6b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:51.667346 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a6e213ba-7160-4f69-8530-85b8e2014563 req-bb651b22-6b9f-4e73-b4b1-ac3ebe07ea6b service nova] Creating event network-changed:5cd1e384-721e-4d78-887b-a97351845a42 for instance 19b185c2-a9e6-4164-921f-b2637e48c288 on n-h2-862355-1 Oct 25 04:12:51.673850 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a6e213ba-7160-4f69-8530-85b8e2014563 req-bb651b22-6b9f-4e73-b4b1-ac3ebe07ea6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046654 Oct 25 04:12:51.674688 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3948/7776] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:52.372786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:52.373423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:52.380815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:52.381476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:52.381970 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:52.382696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:52.383819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:52.384269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:52.843657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:52.852083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-71aeb3b0-223c-4648-bf2a-6f67229055a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1392 microversion: 2.1 time: 0.483321 Oct 25 04:12:52.852674 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3829/7777] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:52 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1392 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:53.876048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:53.876749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:53.883597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:53.884086 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:53.884525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:53.885217 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:53.885695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:53.886128 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:54.018136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:54.026378 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-12632af8-2312-4226-b5ad-d786e8030f67 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1392 microversion: 2.1 time: 0.155701 Oct 25 04:12:54.026956 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3949/7778] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:53 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:55.049792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:55.050427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:55.058254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:55.058762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:55.059218 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:55.059928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:55.060404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:55.060849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:55.193373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:55.201166 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-beebd5c0-31f6-4467-a59e-1bb05e6cb5e3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1392 microversion: 2.1 time: 0.155375 Oct 25 04:12:55.201772 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3830/7779] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:55 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:56.224023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:56.224644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:56.231449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:56.231938 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:56.232382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:56.233083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:56.233567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:56.234005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:56.379783 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:56.388185 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-745050fa-3e0c-4240-b433-f368dbd624ab tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1392 microversion: 2.1 time: 0.168075 Oct 25 04:12:56.388780 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3950/7780] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:56 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:57.412455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:57.413114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:57.420067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:57.420572 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:57.421021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:57.421751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:57.422220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:57.422661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:57.558046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:57.565933 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-332d784b-184e-4df9-86ff-d5c1c3dd2661 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1392 microversion: 2.1 time: 0.157963 Oct 25 04:12:57.566520 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3831/7781] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:57 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:12:58.349261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1e032913-778a-474c-a323-926192da5773 req-fe6e6ae0-c747-4852-a641-3b9fb2dc4d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b185c2-a9e6-4164-921f-b2637e48c288", "name": "network-vif-plugged", "status": "completed", "tag": "5cd1e384-721e-4d78-887b-a97351845a42"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:12:58.355581 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:58.356506 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:58.365189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e032913-778a-474c-a323-926192da5773 req-fe6e6ae0-c747-4852-a641-3b9fb2dc4d78 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:58.365797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e032913-778a-474c-a323-926192da5773 req-fe6e6ae0-c747-4852-a641-3b9fb2dc4d78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:58.366233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1e032913-778a-474c-a323-926192da5773 req-fe6e6ae0-c747-4852-a641-3b9fb2dc4d78 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:58.377442 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1e032913-778a-474c-a323-926192da5773 req-fe6e6ae0-c747-4852-a641-3b9fb2dc4d78 service nova] Creating event network-vif-plugged:5cd1e384-721e-4d78-887b-a97351845a42 for instance 19b185c2-a9e6-4164-921f-b2637e48c288 on n-h2-862355-1 Oct 25 04:12:58.382966 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1e032913-778a-474c-a323-926192da5773 req-fe6e6ae0-c747-4852-a641-3b9fb2dc4d78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037974 Oct 25 04:12:58.383834 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3951/7782] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:12:58.589728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:58.590283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:58.597108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:58.597594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:58.598079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:58.599786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:58.600388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:58.600838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:58.738448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:58.746358 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f5194ec3-03cb-4106-a98a-f4b813ca4ff6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1392 microversion: 2.1 time: 0.160715 Oct 25 04:12:58.746950 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3832/7783] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:58 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:59.770706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:59.771418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:59.778683 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:59.779177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:59.779620 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:59.780331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:59.780798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:59.781230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:59.916693 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:12:59.924461 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0df8b308-8fd2-4fb7-9742-a8206f8eb1d9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1565 microversion: 2.1 time: 0.158346 Oct 25 04:12:59.925037 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3952/7784] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:59 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:12:59.947425 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:12:59.948061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:12:59.949948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:12:59.955959 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:59.956459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:59.956918 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:12:59.957626 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:12:59.958132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:12:59.958619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:13:00.096913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:13:00.105388 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1915bc37-b284-448b-bdea-f0a5d5433f06 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1565 microversion: 2.1 time: 0.161840 Oct 25 04:13:00.106140 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3833/7785] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:12:59 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:13:01.694853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:13:01.696074 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:13:01.697664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-6eaad00f-bed8-496c-89ed-728fb641d62c req-3bde404e-3184-4695-9fa1-465c243c30c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b185c2-a9e6-4164-921f-b2637e48c288", "tag": "5cd1e384-721e-4d78-887b-a97351845a42"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:13:01.703133 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:13:01.703627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:13:01.704068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:13:01.704950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:13:01.705611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:13:01.706234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:13:01.710884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6eaad00f-bed8-496c-89ed-728fb641d62c req-3bde404e-3184-4695-9fa1-465c243c30c8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:13:01.711456 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6eaad00f-bed8-496c-89ed-728fb641d62c req-3bde404e-3184-4695-9fa1-465c243c30c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:13:01.712128 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-6eaad00f-bed8-496c-89ed-728fb641d62c req-3bde404e-3184-4695-9fa1-465c243c30c8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:13:01.725335 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-6eaad00f-bed8-496c-89ed-728fb641d62c req-3bde404e-3184-4695-9fa1-465c243c30c8 service nova] Creating event network-changed:5cd1e384-721e-4d78-887b-a97351845a42 for instance 19b185c2-a9e6-4164-921f-b2637e48c288 on n-h2-862355-1 Oct 25 04:13:01.731197 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-6eaad00f-bed8-496c-89ed-728fb641d62c req-3bde404e-3184-4695-9fa1-465c243c30c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037823 Oct 25 04:13:01.732293 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3834/7786] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:13:01.926491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:13:01.934933 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0a203452-3ed2-4490-ac26-12249a4f4f99 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1565 microversion: 2.1 time: 0.244104 Oct 25 04:13:01.935852 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3953/7787] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:13:01 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1565 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:13:33.280286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=17 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:13:33.280981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=38 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:13:33.285816 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:13:33.289056 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:13:33.296073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:13:33.296575 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:13:33.297035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:13:33.297779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:13:33.298259 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:13:33.298708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:13:33.350778 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a795fe1e-6cf6-445a-9adf-3042cd465a9f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action" status: 200 len: 24574 microversion: 2.1 time: 0.072001 Oct 25 04:13:33.351437 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3835/7788] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:13:33 2022] POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action => generated 24574 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:14:03.792239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:03.792836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:03.795303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:03.795965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=36 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:03.802903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:03.803390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:03.803829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:03.805282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:03.805765 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:03.806196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:03.875846 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-50b10337-abdc-43aa-a52b-331f2ac8ffbd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action" status: 202 len: 0 microversion: 2.1 time: 0.087973 Oct 25 04:14:03.876500 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3954/7789] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:14:03 2022] POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:14:03.886053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:03.886783 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:03.889434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:03.890362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:03.891626 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:14:03.891766 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 (ip 10.222.0.36) !!! Oct 25 04:14:03.900305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:03.900811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:03.901296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:03.902039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:03.902509 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:03.902948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:04.051894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:04.060812 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-59fed4eb-b039-496d-9f24-cfe0dd163fec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1688 microversion: 2.1 time: 0.179729 Oct 25 04:14:04.061400 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3836/7790] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:03 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:05.087368 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:05.088068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:05.094347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:05.094834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:05.095273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:05.095969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:05.096426 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:05.096857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:05.296800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:05.305239 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d80ba4a2-1752-4c47-8821-850a3e8754a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1668 microversion: 2.1 time: 0.223198 Oct 25 04:14:05.305845 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3955/7791] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:05 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1668 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:06.404597 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:06.406847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:06.413207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:06.413766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:06.414230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:06.414947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:06.415428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:06.415875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:06.468888 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb5d8976-ad4b-4a4a-bccd-0f3bd55e0ab0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action" status: 200 len: 32642 microversion: 2.1 time: 0.068486 Oct 25 04:14:06.469558 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3837/7792] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:14:06 2022] POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action => generated 32642 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:14:06.482281 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:06.482873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:06.489418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:06.489952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:06.490399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:06.491095 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:06.492189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:06.492630 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:06.556411 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bacbe98c-3aa4-46b5-b021-6dc65c2fbbeb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action" status: 202 len: 0 microversion: 2.1 time: 0.078091 Oct 25 04:14:06.557049 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3956/7793] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:14:06 2022] POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:14:06.565911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:06.566633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:06.574699 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:06.575185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:06.575647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:06.576452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:06.576982 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:06.577429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:06.720583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:06.738063 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0b4137ef-0c2f-4416-a944-1570cf02e333 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1675 microversion: 2.1 time: 0.176279 Oct 25 04:14:06.738829 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3838/7794] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:06 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:07.764253 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:07.764972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:07.771153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:07.771633 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:07.772069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:07.773390 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:07.773922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:07.774300 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:07.914395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:07.922398 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3e4a37b8-0556-490f-aa5e-11be6510cce2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1683 microversion: 2.1 time: 0.163304 Oct 25 04:14:07.922972 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3957/7795] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:07 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:14:08.025207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:08.027398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:08.035168 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:08.035670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:08.036127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:08.036847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:08.037318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:08.037798 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:08.089346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-551ac18f-7ace-4397-bf3f-7fb1de0151af tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action" status: 200 len: 37393 microversion: 2.1 time: 0.068149 Oct 25 04:14:08.090058 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3839/7796] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:14:08 2022] POST /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288/action => generated 37393 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:14:09.377146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:09.378247 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:09.379588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-51dfc37e-e976-46b2-bb58-99fb756dde66 req-1616da7f-487d-4c3f-a7fc-8a90da293897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b185c2-a9e6-4164-921f-b2637e48c288", "tag": "5cd1e384-721e-4d78-887b-a97351845a42"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:09.385155 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:09.385650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:09.386115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:09.386824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:09.387289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:09.387716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:09.390675 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-51dfc37e-e976-46b2-bb58-99fb756dde66 req-1616da7f-487d-4c3f-a7fc-8a90da293897 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:09.391166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-51dfc37e-e976-46b2-bb58-99fb756dde66 req-1616da7f-487d-4c3f-a7fc-8a90da293897 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:09.392914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-51dfc37e-e976-46b2-bb58-99fb756dde66 req-1616da7f-487d-4c3f-a7fc-8a90da293897 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:09.403394 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-51dfc37e-e976-46b2-bb58-99fb756dde66 req-1616da7f-487d-4c3f-a7fc-8a90da293897 service nova] Creating event network-changed:5cd1e384-721e-4d78-887b-a97351845a42 for instance 19b185c2-a9e6-4164-921f-b2637e48c288 on n-h2-862355-1 Oct 25 04:14:09.408579 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-51dfc37e-e976-46b2-bb58-99fb756dde66 req-1616da7f-487d-4c3f-a7fc-8a90da293897 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032979 Oct 25 04:14:09.409371 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3840/7797] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:14:09.415333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:14:09.504925 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-41306338-172e-40c6-8b6d-a7f5b9edd46b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 204 len: 0 microversion: 2.1 time: 0.131562 Oct 25 04:14:09.505525 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3958/7798] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:14:09 2022] DELETE /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:14:09.516262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:09.517318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:09.525594 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:09.526791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:09.527527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:09.529176 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:09.530134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:09.532064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:09.683966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:09.692108 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56dfd493-e99c-4673-bb7c-c47827b4b9aa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1689 microversion: 2.1 time: 0.181250 Oct 25 04:14:09.692736 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3841/7799] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:09 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:14:10.717143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:10.717880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:10.724323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:10.724817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:10.725261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:10.726494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:10.726955 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:10.727583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:10.928742 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:10.937199 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ba382f04-7558-436f-9e02-8f54984f5e79 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1689 microversion: 2.1 time: 0.224442 Oct 25 04:14:10.937998 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3959/7800] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:10 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:11.742137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-1f19d271-3476-49fa-a69e-b96ff673014c req-d3a7fa53-6d6d-436e-ba16-1029debcc410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b185c2-a9e6-4164-921f-b2637e48c288", "name": "network-vif-deleted", "tag": "5cd1e384-721e-4d78-887b-a97351845a42"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:11.752790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1f19d271-3476-49fa-a69e-b96ff673014c req-d3a7fa53-6d6d-436e-ba16-1029debcc410 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:11.753291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1f19d271-3476-49fa-a69e-b96ff673014c req-d3a7fa53-6d6d-436e-ba16-1029debcc410 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:11.753768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-1f19d271-3476-49fa-a69e-b96ff673014c req-d3a7fa53-6d6d-436e-ba16-1029debcc410 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:11.766430 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-1f19d271-3476-49fa-a69e-b96ff673014c req-d3a7fa53-6d6d-436e-ba16-1029debcc410 service nova] Creating event network-vif-deleted:5cd1e384-721e-4d78-887b-a97351845a42 for instance 19b185c2-a9e6-4164-921f-b2637e48c288 on n-h2-862355-1 Oct 25 04:14:11.771286 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-1f19d271-3476-49fa-a69e-b96ff673014c req-d3a7fa53-6d6d-436e-ba16-1029debcc410 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033469 Oct 25 04:14:11.771896 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3842/7801] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:14:11.961651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:11.962251 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:11.968901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:11.969386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:11.969860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:11.970554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:11.971014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:11.971444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:12.003098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:12.003590 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:12.004031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:12.004486 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lazy-loading 'fault' on Instance uuid 19b185c2-a9e6-4164-921f-b2637e48c288 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:14:12.047439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:12.056484 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-465e2c34-4523-4a0d-babe-420d599fdbee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 200 len: 1356 microversion: 2.1 time: 0.098769 Oct 25 04:14:12.057092 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3960/7802] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:11 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:13.082137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:13.082861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 19b185c2-a9e6-4164-921f-b2637e48c288] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:13.089810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:13.090309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:13.090766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:13.091476 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:13.091949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:13.092396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:13.106083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] HTTP exception thrown: Instance 19b185c2-a9e6-4164-921f-b2637e48c288 could not be found. Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Request method failure captured: Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 HTTP/1.1 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2I447aecXYTjXgh6Lvr0ahTa1gNTRnCeDKzYgTswdrWMTeAI7ceAlWq7QyrJJvPwoaC-uJWmRSidLFIOSIKRC-75a-nvnjpS86h915aQSOTKJDlm37guNsS7ji5IV2MIO3WKiRT8h-PwNdkEkHT_d6Mt8umBr2XszX1e50VVzK-WoA Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b7ecb09322401fb57927a89dec6977", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b7ecb09322401fb57927a89dec6977"}]}] Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d82424cafb7a415dbf38a89c848674f0 Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 19b185c2-a9e6-4164-921f-b2637e48c288 could not be found. Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '19b185c2-a9e6-4164-921f-b2637e48c288'} Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b185c2-a9e6-4164-921f-b2637e48c288 could not be found. Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b185c2-a9e6-4164-921f-b2637e48c288 could not be found. Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:14:13.107714 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b185c2-a9e6-4164-921f-b2637e48c288 could not be found. Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Returning 404 to user: Instance 19b185c2-a9e6-4164-921f-b2637e48c288 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c2f2ed96-341f-4f74-a020-25b0a7ed5217 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288" status: 404 len: 111 microversion: 2.1 time: 0.032252 Oct 25 04:14:13.113112 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3843/7803] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:13 2022] GET /compute/v2.1/servers/19b185c2-a9e6-4164-921f-b2637e48c288 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:14:16.491724 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-841c82aa-8f4c-4021-9ef9-5ea1f4d3f305 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '.version_select at 0x7efd336e6820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:16.512237 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-841c82aa-8f4c-4021-9ef9-5ea1f4d3f305 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-574648575" status: 202 len: 0 microversion: 2.1 time: 0.024309 Oct 25 04:14:16.516429 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3961/7804] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 25 04:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-574648575 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:14:16.542265 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e032207b-fbfe-4fed-bfe5-e695c72f50fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: .version_select at 0x7efd32937ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1745773837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPPX2RoaXwiizEYivjEXtZw2e2eNVaQMuIC3PPQyL/OG/Gfy+U5MRJ1McYab+w28Eimyhk/knb8EpS0qwbgV8ePEJRFfmPqRjx+EchxZyOUkQB0k4PlT5jPFYmf6pSQmA=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:16.559442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e032207b-fbfe-4fed-bfe5-e695c72f50fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:14:16.565482 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-e032207b-fbfe-4fed-bfe5-e695c72f50fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:14:16.589477 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e032207b-fbfe-4fed-bfe5-e695c72f50fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051947 Oct 25 04:14:16.590140 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3844/7805] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:14:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:14:22.292186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-390029060", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "ab43afb0-bb1e-4fea-be73-85af720596ce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1745773837", "security_groups": [{"name": "tempest-secgroup-smoke-739846817"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:22.308282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:22.434561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] validate_networks() for [('ab43afb0-bb1e-4fea-be73-85af720596ce', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:14:22.828022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:14:22.828447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:14:22.828920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:14:22.829333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:14:22.829791 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:14:22.838846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:22.839332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:22.839766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:22.840495 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:22.840950 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:22.841377 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:22.859274 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:14:22.864463 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:14:22.877501 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:14:22.879833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:14:22.929631 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1ca3a62e-ceb4-43f0-bb60-c57ca6bd6dc6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.641251 Oct 25 04:14:22.930819 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3962/7806] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:14:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:14:22.942980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5066fc9d-4f5c-430e-8ef7-97be8da780b9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:22.943607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5066fc9d-4f5c-430e-8ef7-97be8da780b9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:23.001767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5066fc9d-4f5c-430e-8ef7-97be8da780b9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:23.010210 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5066fc9d-4f5c-430e-8ef7-97be8da780b9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1266 microversion: 2.1 time: 0.072151 Oct 25 04:14:23.026599 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3845/7807] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:22 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:24.035420 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:24.036047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:24.051553 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:24.052058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:24.052520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:24.055562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:24.056038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:24.056555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:24.154624 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:24.162700 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b509cd68-16fc-44d2-ba96-74dcefc2e408 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1326 microversion: 2.1 time: 0.131128 Oct 25 04:14:24.164541 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3963/7808] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:24 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:25.188296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:25.188930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:25.190958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=32 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:25.198543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:25.199058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:25.199513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:25.200448 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:25.200926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:25.201371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:25.435031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:25.443164 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f5e5ae1-b2fe-4e64-aed6-3a8716011a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1391 microversion: 2.1 time: 0.258784 Oct 25 04:14:25.460150 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3846/7809] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:25 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:25.674261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-27faa1d7-4b1a-4057-a20d-e7f1e9688fa8 req-3ab1a699-ac88-4680-9a5b-61e60ab2da9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282758f5-4dc0-493b-a092-935928f3258a", "tag": "22c0db34-6eca-4383-a783-ef8910a8f332"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:25.688992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27faa1d7-4b1a-4057-a20d-e7f1e9688fa8 req-3ab1a699-ac88-4680-9a5b-61e60ab2da9d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:25.689794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27faa1d7-4b1a-4057-a20d-e7f1e9688fa8 req-3ab1a699-ac88-4680-9a5b-61e60ab2da9d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:25.690224 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-27faa1d7-4b1a-4057-a20d-e7f1e9688fa8 req-3ab1a699-ac88-4680-9a5b-61e60ab2da9d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:25.704220 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-27faa1d7-4b1a-4057-a20d-e7f1e9688fa8 req-3ab1a699-ac88-4680-9a5b-61e60ab2da9d service nova] Creating event network-changed:22c0db34-6eca-4383-a783-ef8910a8f332 for instance 282758f5-4dc0-493b-a092-935928f3258a on n-h1-862355-1 Oct 25 04:14:25.711871 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-27faa1d7-4b1a-4057-a20d-e7f1e9688fa8 req-3ab1a699-ac88-4680-9a5b-61e60ab2da9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041414 Oct 25 04:14:25.713101 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3964/7810] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:14:26.468069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:26.468704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:26.476386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:26.476922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:26.477490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:26.478249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:26.478725 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:26.479200 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:26.612395 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:26.621023 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f687e006-a780-4711-8fc7-5b6278992c01 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1391 microversion: 2.1 time: 0.156964 Oct 25 04:14:26.621602 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3847/7811] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:26 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:27.644507 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:27.645216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:27.652385 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:27.652881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:27.653327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:27.654064 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:27.654528 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:27.654963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:27.787082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:27.794766 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ad3d168-e36c-4c80-9520-b4e96f668f8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1391 microversion: 2.1 time: 0.154597 Oct 25 04:14:27.795350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3965/7812] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:27 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:28.818596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:28.819827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:28.826774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:28.827278 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:28.827740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:28.828455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:28.828935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:28.829382 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:28.962724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:28.970468 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7dcc1a8d-e47f-48e2-a044-24d70ebf1b25 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1391 microversion: 2.1 time: 0.155789 Oct 25 04:14:28.971055 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3848/7813] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:28 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:29.993474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:29.994148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:30.001201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:30.001715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:30.002161 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:30.002864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:30.003326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:30.003756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:30.145972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:30.154649 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e4648e16-d074-43f5-b542-8ce804286229 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1391 microversion: 2.1 time: 0.164936 Oct 25 04:14:30.155250 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3966/7814] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:29 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:31.178016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:31.179500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:31.186383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:31.186888 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:31.187345 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:31.188053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:31.188531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:31.188979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:31.322250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:31.330029 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-84567b7e-6379-4de2-abc6-6ef8240fb027 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1391 microversion: 2.1 time: 0.155958 Oct 25 04:14:31.330621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3849/7815] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:31 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:31.817175 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dbdab13e-759e-49cb-9838-8c6c745fdc47 req-614cd878-93ce-49f3-84e4-4fcd06eca70f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282758f5-4dc0-493b-a092-935928f3258a", "name": "network-vif-plugged", "status": "completed", "tag": "22c0db34-6eca-4383-a783-ef8910a8f332"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:31.828317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dbdab13e-759e-49cb-9838-8c6c745fdc47 req-614cd878-93ce-49f3-84e4-4fcd06eca70f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:31.828805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dbdab13e-759e-49cb-9838-8c6c745fdc47 req-614cd878-93ce-49f3-84e4-4fcd06eca70f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:31.829367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dbdab13e-759e-49cb-9838-8c6c745fdc47 req-614cd878-93ce-49f3-84e4-4fcd06eca70f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:31.844365 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dbdab13e-759e-49cb-9838-8c6c745fdc47 req-614cd878-93ce-49f3-84e4-4fcd06eca70f service nova] Creating event network-vif-plugged:22c0db34-6eca-4383-a783-ef8910a8f332 for instance 282758f5-4dc0-493b-a092-935928f3258a on n-h1-862355-1 Oct 25 04:14:31.849487 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dbdab13e-759e-49cb-9838-8c6c745fdc47 req-614cd878-93ce-49f3-84e4-4fcd06eca70f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036008 Oct 25 04:14:31.850316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3967/7816] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:14:32.353277 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:32.353947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:32.360750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:32.361250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:32.361730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:32.362444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:32.362916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:32.363361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:32.495542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:32.503439 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-554267e8-fa3a-4971-bf9e-5cfcd2c33168 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1391 microversion: 2.1 time: 0.154890 Oct 25 04:14:32.504019 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3850/7817] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:32 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:33.599866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:33.600640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:33.605208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:33.605933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:33.612879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:33.613361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:33.613825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:33.614512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:33.614965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:33.615389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:33.749827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:33.757613 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-78a30a9e-58c1-4d71-b367-5eea7dd5257f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1563 microversion: 2.1 time: 0.159524 Oct 25 04:14:33.758795 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3968/7818] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:33 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:33.780453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:33.781079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:33.782981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:33.789507 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:33.790187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:33.790587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:33.791287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:33.791754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:33.792196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:33.929390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:33.937950 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-07175214-b57f-431f-8c54-a919e085d730 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1563 microversion: 2.1 time: 0.161311 Oct 25 04:14:33.938543 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3851/7819] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:33 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:35.874489 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:14:35.875243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:35.877104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-bcbc2932-80a2-432c-9d8a-f38e84e770cc req-fbbd2e02-9ba6-4016-85da-43aa058a6fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282758f5-4dc0-493b-a092-935928f3258a", "tag": "22c0db34-6eca-4383-a783-ef8910a8f332"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:35.878984 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:35.882559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:35.884053 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:35.884823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:35.885541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:35.886229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:35.886793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:35.887664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:35.890417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bcbc2932-80a2-432c-9d8a-f38e84e770cc req-fbbd2e02-9ba6-4016-85da-43aa058a6fbd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:35.891136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bcbc2932-80a2-432c-9d8a-f38e84e770cc req-fbbd2e02-9ba6-4016-85da-43aa058a6fbd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:35.891654 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-bcbc2932-80a2-432c-9d8a-f38e84e770cc req-fbbd2e02-9ba6-4016-85da-43aa058a6fbd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:35.905663 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-bcbc2932-80a2-432c-9d8a-f38e84e770cc req-fbbd2e02-9ba6-4016-85da-43aa058a6fbd service nova] Creating event network-changed:22c0db34-6eca-4383-a783-ef8910a8f332 for instance 282758f5-4dc0-493b-a092-935928f3258a on n-h1-862355-1 Oct 25 04:14:35.910899 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-bcbc2932-80a2-432c-9d8a-f38e84e770cc req-fbbd2e02-9ba6-4016-85da-43aa058a6fbd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037632 Oct 25 04:14:35.911992 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3852/7820] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:14:36.037043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:14:36.044878 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7585a734-00da-4b2c-8df9-d91e5ffa0f3a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1563 microversion: 2.1 time: 0.174425 Oct 25 04:14:36.045744 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3969/7821] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:14:35 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:14:59.301355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=38 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:59.302070 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:14:59.307343 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:14:59.309646 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:14:59.316662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:59.317173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:59.317638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:59.318941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:14:59.319428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:14:59.320516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:14:59.374578 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7922210f-f3e7-47d1-8244-be9aa19fb5fe tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a/action" status: 200 len: 24565 microversion: 2.1 time: 0.075043 Oct 25 04:14:59.375219 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3853/7822] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:14:59 2022] POST /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a/action => generated 24565 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:15:10.387334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:15:10.389580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:10.391994 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:10.392644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=36 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:10.398665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:10.399645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:10.400091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:10.400784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:10.401244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:10.401690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:10.479438 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2b70c56a-73ab-4a87-94d7-2b8479a4968e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a/action" status: 202 len: 0 microversion: 2.1 time: 0.095891 Oct 25 04:15:10.480545 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3970/7823] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:15:10 2022] POST /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:15:10.489648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:10.490415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:10.493362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:10.494100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:10.500293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:10.500791 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:10.501250 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:10.502033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:10.502565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:10.503008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:10.789333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:10.798557 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1eaba6c5-8057-49bd-91e0-ee893d46054b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1674 microversion: 2.1 time: 0.312845 Oct 25 04:15:10.799152 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3854/7824] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:10 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1674 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:15:11.824209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:11.824845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:11.832255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:11.832747 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:11.833200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:11.833932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:11.834407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:11.834844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:11.966677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:11.974386 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2f62ed61-4f3f-4f45-be24-2bf5411951b3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.154793 Oct 25 04:15:11.974966 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3971/7825] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:11 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:13.000139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:13.000775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:13.008681 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:13.009184 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:13.009640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:13.010591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:13.011080 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:13.011524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:13.147420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:13.156346 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cb5949ae-ea8c-467c-83b5-032d8bb61afd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.161074 Oct 25 04:15:13.156922 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3855/7826] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:12 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:14.181846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:14.183116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:14.189952 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:14.190442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:14.190879 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:14.191626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:14.192079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:14.192504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:14.332580 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:14.340294 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-69818be2-9145-4e55-bf7e-819f9dc48de2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.163003 Oct 25 04:15:14.340897 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3972/7827] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:14 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:15.364341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:15.364971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:15.372420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:15.372916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:15.373372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:15.374107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:15.374582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:15.375022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:15.512944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:15.520864 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-966fd191-1880-4a19-a498-40039c88169a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.160512 Oct 25 04:15:15.521446 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3856/7828] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:15 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:16.544985 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:16.545597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:16.552474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:16.552960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:16.553396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:16.554365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:16.554819 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:16.555243 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:16.696446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:16.705198 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7616fb6b-75bd-4253-9857-3fe79dea42a4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.164716 Oct 25 04:15:16.705805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3973/7829] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:16 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:17.728541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:17.729864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:17.737170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:17.737667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:17.738146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:17.738855 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:17.739385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:17.739854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:17.877132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:17.885021 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-738e2479-593c-4954-9013-0965418f7172 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.160426 Oct 25 04:15:17.886486 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3857/7830] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:17 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:18.909904 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:18.910525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:18.917956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:18.918439 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:18.918874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:18.919563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:18.920014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:18.920444 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:19.055606 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:19.064298 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6aed7eb9-38a3-4b4b-bbd7-09e2071642db tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.158215 Oct 25 04:15:19.064897 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3974/7831] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:18 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:20.087668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:20.088366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:20.095352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:20.095859 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:20.096321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:20.097045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:20.097524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:20.098002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:20.234013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:20.241924 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c9691817-898e-4411-8ce8-7d2806448b4d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.158228 Oct 25 04:15:20.242510 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3858/7832] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:20 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:21.265824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:21.266358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:21.273370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:21.273892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:21.274331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:21.275057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:21.275651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:21.276684 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:21.415850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:21.424731 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-40fcbb96-99b1-41bd-b441-2311a91fe554 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1679 microversion: 2.1 time: 0.162870 Oct 25 04:15:21.425310 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3975/7833] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:21 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:22.450166 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:22.450748 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:22.457660 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:22.458185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:22.458638 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:22.459348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:22.459827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:22.460272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:22.594865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:22.602745 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cf9bd23-3c16-4100-a3d8-00936f22b1a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1682 microversion: 2.1 time: 0.157280 Oct 25 04:15:22.603327 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3859/7834] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:22 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:46.800056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:15:46.802347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:46.804767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:46.805430 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:46.812339 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:46.812829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:46.813270 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:46.813995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:46.814455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:46.814897 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:46.870880 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c56da641-7d55-42cd-b775-ddd5167706bb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a/action" status: 200 len: 69076 microversion: 2.1 time: 0.074864 Oct 25 04:15:46.871516 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3976/7835] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:15:46 2022] POST /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a/action => generated 69076 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:15:54.071731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:54.072464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:54.076875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:54.077553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=36 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:15:54.083635 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:54.084196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:54.084665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:54.085398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:54.085917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:54.086378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:54.114363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:15:54.148333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4eedaea0-c444-4271-934e-60149c8238aa req-db6eda65-d3d0-49bd-aa5b-6d40526cf420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282758f5-4dc0-493b-a092-935928f3258a", "tag": "22c0db34-6eca-4383-a783-ef8910a8f332"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:15:54.161561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4eedaea0-c444-4271-934e-60149c8238aa req-db6eda65-d3d0-49bd-aa5b-6d40526cf420 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:54.162223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4eedaea0-c444-4271-934e-60149c8238aa req-db6eda65-d3d0-49bd-aa5b-6d40526cf420 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:54.162728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4eedaea0-c444-4271-934e-60149c8238aa req-db6eda65-d3d0-49bd-aa5b-6d40526cf420 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:54.176057 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4eedaea0-c444-4271-934e-60149c8238aa req-db6eda65-d3d0-49bd-aa5b-6d40526cf420 service nova] Creating event network-changed:22c0db34-6eca-4383-a783-ef8910a8f332 for instance 282758f5-4dc0-493b-a092-935928f3258a on n-h1-862355-1 Oct 25 04:15:54.183954 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4eedaea0-c444-4271-934e-60149c8238aa req-db6eda65-d3d0-49bd-aa5b-6d40526cf420 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114064 Oct 25 04:15:54.185546 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3977/7836] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:15:54.199152 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42025037-50f0-4574-a514-07d746069379 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 204 len: 0 microversion: 2.1 time: 0.131224 Oct 25 04:15:54.203415 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3860/7837] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:15:54 2022] DELETE /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:15:54.213848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:54.217417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:54.224120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:54.224805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:54.225320 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:54.226126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:54.226591 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:54.227023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:54.366275 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:54.374693 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1b09cbb3-d1e4-4a6d-afcd-a138aa7c9432 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1688 microversion: 2.1 time: 0.165173 Oct 25 04:15:54.375268 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3978/7838] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:54 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:55.403672 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:55.404407 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:55.411296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:55.411804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:55.412264 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:55.412981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:55.413457 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:55.413928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:55.600955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:55.608953 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1099c968-3daa-4c8b-9221-125819759faa tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1688 microversion: 2.1 time: 0.211652 Oct 25 04:15:55.609548 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3861/7839] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:55 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:56.362351 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-e9579630-3bd4-440c-98c2-2c8a2828046f req-7df607c2-607d-420b-8cfe-c6d087ac0197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282758f5-4dc0-493b-a092-935928f3258a", "name": "network-vif-deleted", "tag": "22c0db34-6eca-4383-a783-ef8910a8f332"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:15:56.373925 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e9579630-3bd4-440c-98c2-2c8a2828046f req-7df607c2-607d-420b-8cfe-c6d087ac0197 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:56.374423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e9579630-3bd4-440c-98c2-2c8a2828046f req-7df607c2-607d-420b-8cfe-c6d087ac0197 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:56.375215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-e9579630-3bd4-440c-98c2-2c8a2828046f req-7df607c2-607d-420b-8cfe-c6d087ac0197 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:56.388831 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-e9579630-3bd4-440c-98c2-2c8a2828046f req-7df607c2-607d-420b-8cfe-c6d087ac0197 service nova] Creating event network-vif-deleted:22c0db34-6eca-4383-a783-ef8910a8f332 for instance 282758f5-4dc0-493b-a092-935928f3258a on n-h1-862355-1 Oct 25 04:15:56.393596 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-e9579630-3bd4-440c-98c2-2c8a2828046f req-7df607c2-607d-420b-8cfe-c6d087ac0197 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098538 Oct 25 04:15:56.394242 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3979/7840] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:15:56.632903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:56.633537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:56.641483 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:56.642042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:56.642502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:56.643266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:56.643741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:56.644190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:56.682159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:56.683560 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:56.684293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:56.684531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lazy-loading 'fault' on Instance uuid 282758f5-4dc0-493b-a092-935928f3258a {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:15:56.727726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:15:56.736446 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d75acd0a-9c80-43ff-979e-b11e312bd185 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 200 len: 1356 microversion: 2.1 time: 0.107549 Oct 25 04:15:56.737028 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3862/7841] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:56 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:15:57.763919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:15:57.764644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 282758f5-4dc0-493b-a092-935928f3258a] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:15:57.770971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:57.771452 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:57.771892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:57.772616 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:15:57.773113 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:15:57.773543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:15:57.787702 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] HTTP exception thrown: Instance 282758f5-4dc0-493b-a092-935928f3258a could not be found. Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Request method failure captured: Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a HTTP/1.1 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2I447aecXYTjXgh6Lvr0ahTa1gNTRnCeDKzYgTswdrWMTeAI7ceAlWq7QyrJJvPwoaC-uJWmRSidLFIOSIKRC-75a-nvnjpS86h915aQSOTKJDlm37guNsS7ji5IV2MIO3WKiRT8h-PwNdkEkHT_d6Mt8umBr2XszX1e50VVzK-WoA Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b7ecb09322401fb57927a89dec6977", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b7ecb09322401fb57927a89dec6977"}]}] Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d82424cafb7a415dbf38a89c848674f0 Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 282758f5-4dc0-493b-a092-935928f3258a could not be found. Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '282758f5-4dc0-493b-a092-935928f3258a'} Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282758f5-4dc0-493b-a092-935928f3258a could not be found. Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282758f5-4dc0-493b-a092-935928f3258a could not be found. Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:15:57.789327 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282758f5-4dc0-493b-a092-935928f3258a could not be found. Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Returning 404 to user: Instance 282758f5-4dc0-493b-a092-935928f3258a could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-08baed4b-6362-402f-9e8e-c4ce9feeb638 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a" status: 404 len: 111 microversion: 2.1 time: 0.032867 Oct 25 04:15:57.794637 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3980/7842] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:15:57 2022] GET /compute/v2.1/servers/282758f5-4dc0-493b-a092-935928f3258a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:16:00.874647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-38c4ad0b-4138-484e-becc-28811baa4288 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '.version_select at 0x7efd338718b0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:00.895923 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-38c4ad0b-4138-484e-becc-28811baa4288 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1745773837" status: 202 len: 0 microversion: 2.1 time: 0.025539 Oct 25 04:16:00.896535 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3863/7843] 10.222.0.36 () {58 vars in 1284 bytes} [Tue Oct 25 04:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1745773837 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:16:00.926669 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e5bb6993-80b2-410a-a1ba-ff109568aab8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: .version_select at 0x7efd33499550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-40015986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIk7CfNpAyOMcyFzH6kmPfrM8JzG9juob8TWEiYttYCd0+vn6cIZAJlJJj3zpHRdw110JCjru66Zj/rS6xduFDFP520QnkvPzxyvo5PfJ95DfSpjX3o+xPByAprL47dBw=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:16:00.944114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e5bb6993-80b2-410a-a1ba-ff109568aab8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:16:00.949464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-e5bb6993-80b2-410a-a1ba-ff109568aab8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:16:00.973558 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e5bb6993-80b2-410a-a1ba-ff109568aab8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050894 Oct 25 04:16:00.974274 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3981/7844] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:16:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:16:06.631122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1050089347", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "2442c6ec-f5ea-40ca-bddb-a033dd05d04f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-40015986", "security_groups": [{"name": "tempest-secgroup-smoke-1343615780"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:16:06.732924 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:06.755134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] validate_networks() for [('2442c6ec-f5ea-40ca-bddb-a033dd05d04f', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:16:07.378076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:16:07.379054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:16:07.379770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:16:07.380562 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:16:07.381247 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:16:07.396841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:07.397752 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:07.398445 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:07.399427 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:07.401074 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:07.404393 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:07.429981 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:16:07.436520 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:16:07.451387 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:16:07.453968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:16:07.507077 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a6fece09-75a9-40ae-b136-b55e427626ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.880072 Oct 25 04:16:07.514783 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3864/7845] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:16:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:16:07.523023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-05741c46-e45c-4b7d-a9d9-55bbaeea23c5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:07.525219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-05741c46-e45c-4b7d-a9d9-55bbaeea23c5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:07.624238 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-05741c46-e45c-4b7d-a9d9-55bbaeea23c5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:07.634177 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-05741c46-e45c-4b7d-a9d9-55bbaeea23c5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1265 microversion: 2.1 time: 0.116664 Oct 25 04:16:07.635050 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3982/7846] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:07 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:08.661979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:08.662701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:08.670747 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:08.671248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:08.671922 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:08.672774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:08.673459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:08.674099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:08.741515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:08.751184 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0a4957f5-a99a-4e23-881d-23e684efe48c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1317 microversion: 2.1 time: 0.094462 Oct 25 04:16:08.761718 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3865/7847] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:08 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1317 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:09.777050 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:09.778207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:09.780524 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=16 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:09.791741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:09.792383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:09.792884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:09.793662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:09.794231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:09.794731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:10.037516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:10.048022 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0dd8ff16-e679-42df-ab73-96c384d595ee tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.275763 Oct 25 04:16:10.048710 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3983/7848] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:09 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:16:10.326960 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f58ab726-8253-4bf1-89a1-745eb18b3478 req-bdf3cf2a-2598-4985-bbc8-5b94efe428a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:16:10.340946 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f58ab726-8253-4bf1-89a1-745eb18b3478 req-bdf3cf2a-2598-4985-bbc8-5b94efe428a2 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:10.341446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f58ab726-8253-4bf1-89a1-745eb18b3478 req-bdf3cf2a-2598-4985-bbc8-5b94efe428a2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:10.341925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f58ab726-8253-4bf1-89a1-745eb18b3478 req-bdf3cf2a-2598-4985-bbc8-5b94efe428a2 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:10.356418 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f58ab726-8253-4bf1-89a1-745eb18b3478 req-bdf3cf2a-2598-4985-bbc8-5b94efe428a2 service nova] Creating event network-changed:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h2-862355-1 Oct 25 04:16:10.362113 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f58ab726-8253-4bf1-89a1-745eb18b3478 req-bdf3cf2a-2598-4985-bbc8-5b94efe428a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039478 Oct 25 04:16:10.362752 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3866/7849] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:16:11.072367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:11.073007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:11.079775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:11.080255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:11.080691 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:11.081383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:11.081873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:11.082299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:11.214399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:11.222112 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4325f826-0a7c-4fe9-95a6-c658f16dbb08 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.153681 Oct 25 04:16:11.222681 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3984/7850] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:11 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:12.247741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:12.248487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:12.255600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:12.256100 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:12.256550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:12.257254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:12.257788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:12.258181 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:12.392122 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:12.399924 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e61e69da-c081-4ea8-af3e-cbdc20140d60 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.157702 Oct 25 04:16:12.400517 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3867/7851] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:12 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:13.425014 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:13.425634 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:13.433021 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:13.433509 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:13.433970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:13.435323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:13.435781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:13.436212 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:13.578094 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:13.585702 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7f348cc3-e595-4fd6-9a93-3f27f265f50d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.165827 Oct 25 04:16:13.586267 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3985/7852] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:13 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:14.608656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:14.609190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:14.616102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:14.616601 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:14.617054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:14.617788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:14.618261 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:14.618705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:14.755883 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:14.764335 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7d9aa296-e2a6-4773-b8ed-72da8d3bb9a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.159797 Oct 25 04:16:14.764921 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3868/7853] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:14 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:15.787447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:15.788041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:15.795906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:15.796395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:15.796839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:15.797546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:15.798061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:15.798491 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:15.928516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:15.936600 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cbdbf7ba-c0fa-438f-80f3-15156a780ce8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.153236 Oct 25 04:16:15.937180 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3986/7854] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:15 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:16.960133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:16.960765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:16.968104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:16.968604 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:16.969057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:16.969795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:16.970272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:16.970718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:17.109113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:17.116915 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-deacc080-f8a9-434c-802f-a836b11c954a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.160826 Oct 25 04:16:17.117492 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3869/7855] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:16 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:16:17.210784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f06f21bf-be1c-4110-b5c7-29d1400e9ac1 req-821c6003-67de-4996-ab95-fbebc68a862f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "name": "network-vif-plugged", "status": "completed", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:16:17.216440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:17.222237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f06f21bf-be1c-4110-b5c7-29d1400e9ac1 req-821c6003-67de-4996-ab95-fbebc68a862f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:17.222730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f06f21bf-be1c-4110-b5c7-29d1400e9ac1 req-821c6003-67de-4996-ab95-fbebc68a862f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:17.223170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f06f21bf-be1c-4110-b5c7-29d1400e9ac1 req-821c6003-67de-4996-ab95-fbebc68a862f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:17.235404 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f06f21bf-be1c-4110-b5c7-29d1400e9ac1 req-821c6003-67de-4996-ab95-fbebc68a862f service nova] Creating event network-vif-plugged:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h2-862355-1 Oct 25 04:16:17.240351 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f06f21bf-be1c-4110-b5c7-29d1400e9ac1 req-821c6003-67de-4996-ab95-fbebc68a862f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092419 Oct 25 04:16:17.240944 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3987/7856] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:16:18.141081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:18.141751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:18.143742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:18.144453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:18.152025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:18.152543 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:18.153003 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:18.153744 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:18.154227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:18.154676 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:18.295989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:18.303918 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-16eb9d29-e8fb-44bf-bc35-a8b1801428b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1391 microversion: 2.1 time: 0.166772 Oct 25 04:16:18.304775 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3870/7857] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:18 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:19.324708 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:19.329810 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:19.330518 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:19.336930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:19.337419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:19.337888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:19.338587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:19.339046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:19.339479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:19.475623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:19.483886 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5c883859-1300-4267-9208-8583b3ee972d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1564 microversion: 2.1 time: 0.159836 Oct 25 04:16:19.484068 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3988/7858] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:19 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:19.506392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:19.507024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:19.514578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:19.515078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:19.515538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:19.516243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:19.516715 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:19.517157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:19.648866 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:19.657288 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b0e3743-0aa3-428c-8770-4b0327f42e47 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1564 microversion: 2.1 time: 0.154799 Oct 25 04:16:19.657921 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3871/7859] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:19 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:16:21.247210 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:16:21.247836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:21.249853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-4fe48a67-051d-4069-928f-d2069b91d0eb req-8d84e0b5-4c61-42b3-a122-cc74634877da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:16:21.255226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:21.255716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:21.256151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:21.257063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:21.257520 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:21.257974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:21.260965 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4fe48a67-051d-4069-928f-d2069b91d0eb req-8d84e0b5-4c61-42b3-a122-cc74634877da service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:21.262143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4fe48a67-051d-4069-928f-d2069b91d0eb req-8d84e0b5-4c61-42b3-a122-cc74634877da service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:21.262837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-4fe48a67-051d-4069-928f-d2069b91d0eb req-8d84e0b5-4c61-42b3-a122-cc74634877da service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:21.274905 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-4fe48a67-051d-4069-928f-d2069b91d0eb req-8d84e0b5-4c61-42b3-a122-cc74634877da service nova] Creating event network-changed:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h2-862355-1 Oct 25 04:16:21.280496 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-4fe48a67-051d-4069-928f-d2069b91d0eb req-8d84e0b5-4c61-42b3-a122-cc74634877da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035101 Oct 25 04:16:21.281359 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3872/7860] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:16:21.485969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:16:21.497078 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-046cf05c-27f1-46a8-8185-7237a1fef572 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1564 microversion: 2.1 time: 0.254405 Oct 25 04:16:21.497882 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3989/7861] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:16:21 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:16:52.864273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:52.865042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=42 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:16:52.870041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:16:52.872353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:16:52.880135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:52.880733 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:52.881182 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:52.881926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:16:52.882398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:16:52.882837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:16:52.942776 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f282313a-a682-4a6d-8d4f-df968a5682d1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action" status: 200 len: 24517 microversion: 2.1 time: 0.080372 Oct 25 04:16:52.943418 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3873/7862] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:16:52 2022] POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action => generated 24517 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:17:23.409286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:17:23.410071 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=38 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:17:23.414434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:17:23.416719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:23.423454 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:23.423944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:23.424386 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:23.425083 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:23.425544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:23.426026 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:23.507331 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:23.513621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Old instance type m1.heat2, new instance type m1.heat {{(pid=120562) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 25 04:17:23.520860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:17:23.521286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:17:23.521946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:17:23.522366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:17:23.522787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:17:23.585162 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [35164f68-dd1e-44af-82b1-ee7826e59925] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:17:24.592985 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [35164f68-dd1e-44af-82b1-ee7826e59925] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45298. Oct 25 04:17:24.596848 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-075b1242-79a3-4731-ac29-6b21dc7a70c7 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action" status: 202 len: 0 microversion: 2.1 time: 1.189390 Oct 25 04:17:24.597485 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3990/7863] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:17:23 2022] POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action => generated 0 bytes in 1191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:17:24.606467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:24.607248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:24.610492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=4 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:17:24.611143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:17:24.617478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:24.618140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:24.618605 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:24.619450 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:24.619990 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:24.620464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:24.763514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:24.772330 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e769f26-0317-46ed-8e81-69852e440841 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1691 microversion: 2.1 time: 0.170304 Oct 25 04:17:24.772923 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3874/7864] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:24 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:17:25.798968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:25.799560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:25.806814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:25.807304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:25.807746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:25.808510 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:25.808967 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:25.809397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:25.949860 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:25.958330 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-108b69f4-7508-4366-b68e-d9e34a522257 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1691 microversion: 2.1 time: 0.164701 Oct 25 04:17:25.958929 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3991/7865] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:25 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:26.981624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:26.982276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:26.991586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:26.992114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:26.992565 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:26.993276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:26.993799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:26.994248 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:27.131268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:27.139283 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-40c14207-af4d-4b95-ad49-5350ce962e22 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.161579 Oct 25 04:17:27.139877 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3875/7866] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:26 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:28.163930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:28.164543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:28.172073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:28.173117 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:28.173555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:28.174271 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:28.174726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:28.175150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:28.313244 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:28.321178 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55ce8ada-5ca0-4b0f-8852-0c57436cf41a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.161153 Oct 25 04:17:28.321777 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3992/7867] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:28 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:29.345331 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:29.345906 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:29.352716 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:29.353214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:29.353663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:29.354388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:29.354854 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:29.355292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:29.489341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:29.498378 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6c80c526-c243-4242-90bb-6e80b604c313 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.157563 Oct 25 04:17:29.499048 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3876/7868] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:29 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:30.522834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:30.523458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:30.530282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:30.530770 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:30.531214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:30.532525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:30.532982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:30.533411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:30.665030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:30.673670 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-072674d3-c6c0-4701-b55c-a7249224c117 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.154738 Oct 25 04:17:30.674277 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3993/7869] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:30 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:17:31.697471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:31.698124 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:31.705110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:31.705607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:31.706086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:31.706796 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:31.707268 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:31.707712 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:31.842123 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:31.851030 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7be1c79e-4a87-4c1a-90c9-961897b859a1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.157502 Oct 25 04:17:31.851618 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3877/7870] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:31 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:32.875474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:32.876213 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:32.883040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:32.883529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:32.883971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:32.884666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:32.885123 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:32.885559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:33.020851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:33.029151 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d241fe19-3abc-40ca-ba9a-6fb6d48dd723 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.157624 Oct 25 04:17:33.029739 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3994/7871] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:32 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:34.054203 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:34.055081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:34.061954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:34.062459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:34.063608 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:34.064317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:34.064786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:34.065227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:34.202838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:34.211161 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-817d2f74-3ce5-48c9-ac07-f33541d3a8a0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.160908 Oct 25 04:17:34.211731 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3878/7872] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:34 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:35.236176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:35.236796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:35.243915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:35.244410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:35.244853 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:35.245557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:35.246052 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:35.246488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:35.380978 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:35.388873 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55798ba8-24b7-4828-88a5-8f280db1c626 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.157498 Oct 25 04:17:35.389463 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3995/7873] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:35 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:36.415951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:36.416487 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:36.423190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:36.423692 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:36.424141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:36.424844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:36.425309 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:36.425772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:36.558337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:36.566658 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6d373f30-b080-45c8-9b62-2beddc3e54b5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.154776 Oct 25 04:17:36.567236 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3879/7874] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:36 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:37.591541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:37.592200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:37.599192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:37.599680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:37.600449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:37.601160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:37.601625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:37.602085 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:37.733980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:37.741749 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70730c29-52cc-478e-88dc-a0dcdedca8ca tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.154247 Oct 25 04:17:37.742336 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3996/7875] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:37 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:38.767649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:38.768318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:38.776564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:38.776564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:38.777585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:38.778356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:38.778860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:38.779304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:38.958179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:38.966072 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7c51a9f0-b757-49cf-b8c7-aad88cc177bc tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1696 microversion: 2.1 time: 0.204282 Oct 25 04:17:38.966655 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3880/7876] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:38 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:39.317850 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c00f10ae-f67c-432d-92bc-4023f83dbbdd req-d521d55f-5c4f-41e0-a962-14312b8d43bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "name": "network-vif-unplugged", "status": "completed", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:17:39.329375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c00f10ae-f67c-432d-92bc-4023f83dbbdd req-d521d55f-5c4f-41e0-a962-14312b8d43bb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:39.330065 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c00f10ae-f67c-432d-92bc-4023f83dbbdd req-d521d55f-5c4f-41e0-a962-14312b8d43bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:39.330515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c00f10ae-f67c-432d-92bc-4023f83dbbdd req-d521d55f-5c4f-41e0-a962-14312b8d43bb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:39.343053 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c00f10ae-f67c-432d-92bc-4023f83dbbdd req-d521d55f-5c4f-41e0-a962-14312b8d43bb service nova] Creating event network-vif-unplugged:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h1-862355-1 Oct 25 04:17:39.348727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [req-c00f10ae-f67c-432d-92bc-4023f83dbbdd req-d521d55f-5c4f-41e0-a962-14312b8d43bb service nova] Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120562) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:17:39.360650 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c00f10ae-f67c-432d-92bc-4023f83dbbdd req-d521d55f-5c4f-41e0-a962-14312b8d43bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046216 Oct 25 04:17:39.361469 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3997/7877] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:17:39.991162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:39.994581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:40.005159 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:40.005662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:40.006773 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:40.006974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:40.007815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:40.008267 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:40.254661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:40.262542 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cc10f66a-e111-4118-bfc8-13d5c7c9a960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1695 microversion: 2.1 time: 0.276419 Oct 25 04:17:40.263120 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3881/7878] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:39 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1695 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:41.287186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:41.287885 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:41.294012 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:41.294499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:41.294936 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:41.295907 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:41.296116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:41.296546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:41.400354 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-becb5cce-6e3f-4673-b5b2-588e2868a58e req-03910d6c-fce0-4217-96af-0f5c7238246d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:17:41.411805 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-becb5cce-6e3f-4673-b5b2-588e2868a58e req-03910d6c-fce0-4217-96af-0f5c7238246d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:41.412299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-becb5cce-6e3f-4673-b5b2-588e2868a58e req-03910d6c-fce0-4217-96af-0f5c7238246d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:41.412749 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-becb5cce-6e3f-4673-b5b2-588e2868a58e req-03910d6c-fce0-4217-96af-0f5c7238246d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:41.424363 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-becb5cce-6e3f-4673-b5b2-588e2868a58e req-03910d6c-fce0-4217-96af-0f5c7238246d service nova] Creating event network-changed:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h1-862355-1 Oct 25 04:17:41.430217 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [req-becb5cce-6e3f-4673-b5b2-588e2868a58e req-03910d6c-fce0-4217-96af-0f5c7238246d service nova] Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862355-1', 'n-h1-862355-1'} {{(pid=120563) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 25 04:17:41.432548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:41.440960 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-f67494c3-cf8c-4a3f-b178-643e165de5ba tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1693 microversion: 2.1 time: 0.158931 Oct 25 04:17:41.441514 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3998/7879] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:41 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:41.442233 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-becb5cce-6e3f-4673-b5b2-588e2868a58e req-03910d6c-fce0-4217-96af-0f5c7238246d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045470 Oct 25 04:17:41.442840 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3882/7880] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:17:42.512856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:42.513478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:42.520293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:42.520818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:42.521260 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:42.522027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:42.522488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:42.522919 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:42.659602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:42.667365 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81529f60-df91-4503-96cb-56ac67c01d23 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1690 microversion: 2.1 time: 0.206222 Oct 25 04:17:42.667938 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 3999/7881] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:42 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1690 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:42.692210 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:17:42.692849 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:42.699857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:42.700361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:42.700810 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:42.701512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:42.702020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:42.702464 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:42.759837 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-967f0976-b1ac-48a3-82f4-f4eeb77e54a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action" status: 204 len: 0 microversion: 2.1 time: 0.072281 Oct 25 04:17:42.760395 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3883/7882] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:17:42 2022] POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:17:42.769061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:42.769702 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:42.775635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:42.776122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:42.776560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:42.777262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:42.777743 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:42.778169 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:42.986406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:42.994306 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-02e935ec-f06b-46e7-9783-f0ada73fd371 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1690 microversion: 2.1 time: 0.229690 Oct 25 04:17:43.001847 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4000/7883] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:42 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:43.019837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:43.020546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:43.026892 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:43.027390 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:43.027846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:43.028561 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:43.029033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:43.029480 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:43.169556 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:43.177650 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7564e142-8a3c-4d2e-92b4-3274a28af54e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1690 microversion: 2.1 time: 0.162583 Oct 25 04:17:43.178268 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3884/7884] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:43 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:44.202311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:17:44.202971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:17:44.210340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:44.210761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:44.211198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:44.211883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:44.212337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:44.212759 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:44.351162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:17:44.358797 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-37f7a782-cdee-47f2-ac9a-1371231e62d3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1682 microversion: 2.1 time: 0.160391 Oct 25 04:17:44.359674 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4001/7885] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:17:44 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:17:46.558458 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-30d6243f-9d7d-40f9-8769-a9318318853c req-c127d111-5a18-495d-8d02-00a2b90d97c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "name": "network-vif-plugged", "status": "completed", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:17:46.569144 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30d6243f-9d7d-40f9-8769-a9318318853c req-c127d111-5a18-495d-8d02-00a2b90d97c1 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:17:46.569643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30d6243f-9d7d-40f9-8769-a9318318853c req-c127d111-5a18-495d-8d02-00a2b90d97c1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:17:46.570134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-30d6243f-9d7d-40f9-8769-a9318318853c req-c127d111-5a18-495d-8d02-00a2b90d97c1 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:17:46.582889 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-30d6243f-9d7d-40f9-8769-a9318318853c req-c127d111-5a18-495d-8d02-00a2b90d97c1 service nova] Creating event network-vif-plugged:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h1-862355-1 Oct 25 04:17:46.588078 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-30d6243f-9d7d-40f9-8769-a9318318853c req-c127d111-5a18-495d-8d02-00a2b90d97c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033669 Oct 25 04:17:46.588680 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3885/7886] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:18:08.543577 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:08.546010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:08.548650 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=28 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:08.549308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:08.556567 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:08.557060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:08.557498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:08.558279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:08.558732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:08.559173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:08.616886 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-65b1c0fe-14c9-42b8-8e42-173b7b8a9169 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action" status: 200 len: 24567 microversion: 2.1 time: 0.077260 Oct 25 04:18:08.617542 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4002/7887] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:18:08 2022] POST /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:18:15.933335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:15.934086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:15.938038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-5bd269c3-06b9-4a6d-b62a-1d69798876e4 req-08123db4-d413-4909-aabe-f0cf006bb69d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:15.938490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=24 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:15.939005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:15.946696 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:15.947271 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:15.947808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:15.948614 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:15.949147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:15.949741 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:15.950586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5bd269c3-06b9-4a6d-b62a-1d69798876e4 req-08123db4-d413-4909-aabe-f0cf006bb69d service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:15.950749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5bd269c3-06b9-4a6d-b62a-1d69798876e4 req-08123db4-d413-4909-aabe-f0cf006bb69d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:15.951206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-5bd269c3-06b9-4a6d-b62a-1d69798876e4 req-08123db4-d413-4909-aabe-f0cf006bb69d service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:15.966041 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-5bd269c3-06b9-4a6d-b62a-1d69798876e4 req-08123db4-d413-4909-aabe-f0cf006bb69d service nova] Creating event network-changed:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h1-862355-1 Oct 25 04:18:15.971992 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-5bd269c3-06b9-4a6d-b62a-1d69798876e4 req-08123db4-d413-4909-aabe-f0cf006bb69d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038753 Oct 25 04:18:15.973209 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4003/7888] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:18:15.978630 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:18:16.069959 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-769c1256-b9ec-487e-95bb-90813e9050f4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 204 len: 0 microversion: 2.1 time: 0.140936 Oct 25 04:18:16.070777 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3886/7889] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:18:15 2022] DELETE /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:18:16.082290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:16.083723 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:16.090944 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:16.091895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:16.092735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:16.093963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:16.094647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:16.095329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:16.244394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:16.253401 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-59b37786-c862-4808-8d93-8b2205d99a0f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1688 microversion: 2.1 time: 0.177747 Oct 25 04:18:16.254035 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4004/7890] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:16 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:17.278930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:17.279648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:17.287160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:17.287663 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:17.288118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:17.288833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:17.289306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:17.289781 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:17.451645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:17.460713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e705753-b78c-4e03-a238-b40d5d592970 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 200 len: 1688 microversion: 2.1 time: 0.186066 Oct 25 04:18:17.461295 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3887/7891] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:17 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:18.014208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-60f8aa47-8f2d-4df7-b50f-5bbc68a1da16 req-23d58267-f79a-4256-a72e-926da829212f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624d4d6b-b764-4c66-931b-51ac6dc6a724", "name": "network-vif-deleted", "tag": "8973e4e3-93be-4dda-b242-7e0b072385f6"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:18.031384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-60f8aa47-8f2d-4df7-b50f-5bbc68a1da16 req-23d58267-f79a-4256-a72e-926da829212f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:18.032105 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-60f8aa47-8f2d-4df7-b50f-5bbc68a1da16 req-23d58267-f79a-4256-a72e-926da829212f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:18.032625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-60f8aa47-8f2d-4df7-b50f-5bbc68a1da16 req-23d58267-f79a-4256-a72e-926da829212f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:18.045000 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-60f8aa47-8f2d-4df7-b50f-5bbc68a1da16 req-23d58267-f79a-4256-a72e-926da829212f service nova] Creating event network-vif-deleted:8973e4e3-93be-4dda-b242-7e0b072385f6 for instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 on n-h1-862355-1 Oct 25 04:18:18.050845 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-60f8aa47-8f2d-4df7-b50f-5bbc68a1da16 req-23d58267-f79a-4256-a72e-926da829212f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046981 Oct 25 04:18:18.051456 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4005/7892] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:18:18.486230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:18.488064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 624d4d6b-b764-4c66-931b-51ac6dc6a724] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:18.494927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:18.495423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:18.495869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:18.496566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:18.497031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:18.497468 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:18.512678 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] HTTP exception thrown: Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 could not be found. Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Request method failure captured: Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 HTTP/1.1 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2I447aecXYTjXgh6Lvr0ahTa1gNTRnCeDKzYgTswdrWMTeAI7ceAlWq7QyrJJvPwoaC-uJWmRSidLFIOSIKRC-75a-nvnjpS86h915aQSOTKJDlm37guNsS7ji5IV2MIO3WKiRT8h-PwNdkEkHT_d6Mt8umBr2XszX1e50VVzK-WoA Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b7ecb09322401fb57927a89dec6977", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b7ecb09322401fb57927a89dec6977"}]}] Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d82424cafb7a415dbf38a89c848674f0 Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 could not be found. Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '624d4d6b-b764-4c66-931b-51ac6dc6a724'} Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 could not be found. Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 could not be found. Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:18:18.514335 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 could not be found. Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Returning 404 to user: Instance 624d4d6b-b764-4c66-931b-51ac6dc6a724 could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ce90328a-ae8a-452e-b040-899ef2603fd9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724" status: 404 len: 111 microversion: 2.1 time: 0.033568 Oct 25 04:18:18.519647 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3888/7893] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:18 2022] GET /compute/v2.1/servers/624d4d6b-b764-4c66-931b-51ac6dc6a724 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:18:21.569249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-79d86636-7050-4441-81b3-744c393074a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '.version_select at 0x7efd32d47b80>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:21.573660 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79d86636-7050-4441-81b3-744c393074a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [a953044b-09c0-478b-a7ea-489143a581d5] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:18:22.580827 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [None req-79d86636-7050-4441-81b3-744c393074a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [a953044b-09c0-478b-a7ea-489143a581d5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45432. Oct 25 04:18:22.601728 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-79d86636-7050-4441-81b3-744c393074a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-40015986" status: 202 len: 0 microversion: 2.1 time: 1.038764 Oct 25 04:18:22.602303 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4006/7894] 10.222.0.36 () {58 vars in 1278 bytes} [Tue Oct 25 04:18:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-40015986 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:18:22.628651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ee06571f-fe78-4721-a864-e3aeff32da44 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: .version_select at 0x7efd3358bd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-109459294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfmQy4cDVIAwo69iyPkVwE2zQN0ureHkIz02odZcqqPT4nKcwUV3fc/i6sP+egqqGsjXCUl5u3gx1NcKiRK0coCMvW2IJv7Lixs572I2suTMnm1cA0WO4cNNl4tOsXycw=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:22.646584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ee06571f-fe78-4721-a864-e3aeff32da44 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:18:22.651794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ee06571f-fe78-4721-a864-e3aeff32da44 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:18:22.676544 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ee06571f-fe78-4721-a864-e3aeff32da44 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052004 Oct 25 04:18:22.677171 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3889/7895] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:18:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:18:28.626020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:28.633077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1178653383", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "157a5d78-17d2-477c-bd0f-1abc9abde579"}], "key_name": "tempest-TestNetworkAdvancedServerOps-109459294", "security_groups": [{"name": "tempest-secgroup-smoke-14181493"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:28.761672 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] validate_networks() for [('157a5d78-17d2-477c-bd0f-1abc9abde579', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:18:29.161384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:18:29.161937 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:18:29.162422 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:18:29.162844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:18:29.163264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:18:29.172183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:29.172671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:29.173115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:29.174536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:29.175073 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:29.175652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:29.195595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:18:29.200842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:18:29.213363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:18:29.215814 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:18:29.264061 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c860bac4-f9ea-4bb7-ada6-f18e716ecd97 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.640066 Oct 25 04:18:29.265038 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4007/7896] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:18:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:18:29.274405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:29.278568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-269ef8dd-3cac-4d7b-8d77-fe2a897fddad tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:29.279207 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-269ef8dd-3cac-4d7b-8d77-fe2a897fddad tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:29.349777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-269ef8dd-3cac-4d7b-8d77-fe2a897fddad tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:29.357176 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-269ef8dd-3cac-4d7b-8d77-fe2a897fddad tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1266 microversion: 2.1 time: 0.084445 Oct 25 04:18:29.357798 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3890/7897] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:29 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:30.382603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:30.383223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:30.390545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:30.391282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:30.391928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:30.393416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:30.394063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:30.394654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:30.476442 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:30.490193 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-544b857b-be77-4b98-937d-04a999c440ff tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1318 microversion: 2.1 time: 0.112695 Oct 25 04:18:30.493792 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4008/7898] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:30 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1318 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:18:31.515598 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:31.516224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:31.524776 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:31.525375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:31.525953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:31.526948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:31.527490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:31.528171 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:31.672754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:31.686404 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-cf387f4f-cd99-46a6-8d14-725832adaeed tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1390 microversion: 2.1 time: 0.175766 Oct 25 04:18:31.687021 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3891/7899] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:31 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:32.008469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-a9b14fab-614e-4221-834b-b9eefe4ee8d1 req-99e7fc2d-030c-4de8-8004-3adb5e42218e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f52bfbd-5aa6-4c8f-a966-564d452632d1", "tag": "549b3e96-5ad1-4588-b3a1-b5eddb66746c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:32.019775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a9b14fab-614e-4221-834b-b9eefe4ee8d1 req-99e7fc2d-030c-4de8-8004-3adb5e42218e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:32.021232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a9b14fab-614e-4221-834b-b9eefe4ee8d1 req-99e7fc2d-030c-4de8-8004-3adb5e42218e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:32.021232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-a9b14fab-614e-4221-834b-b9eefe4ee8d1 req-99e7fc2d-030c-4de8-8004-3adb5e42218e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:32.037795 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-a9b14fab-614e-4221-834b-b9eefe4ee8d1 req-99e7fc2d-030c-4de8-8004-3adb5e42218e service nova] Creating event network-changed:549b3e96-5ad1-4588-b3a1-b5eddb66746c for instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 on n-h1-862355-1 Oct 25 04:18:32.042590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-a9b14fab-614e-4221-834b-b9eefe4ee8d1 req-99e7fc2d-030c-4de8-8004-3adb5e42218e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037949 Oct 25 04:18:32.043213 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4009/7900] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:18:32.710837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:32.711394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:32.718373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:32.718877 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:32.719332 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:32.720045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:32.720523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:32.720979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:32.870494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:32.879419 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-47edab25-ec56-4dfd-82a3-e98b735bdf1f tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1390 microversion: 2.1 time: 0.172637 Oct 25 04:18:32.880019 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3892/7901] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:32 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:33.903830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:33.904532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:33.911453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:33.911941 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:33.912378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:33.913293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:33.913943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:33.914540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:34.051572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:34.059496 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-30c17f4c-ba88-4f19-b9e4-7ad1ad2db960 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1390 microversion: 2.1 time: 0.160801 Oct 25 04:18:34.060074 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4010/7902] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:33 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:35.083566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:35.084221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:35.090649 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:35.091143 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:35.091591 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:35.092298 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:35.092769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:35.093208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:35.228381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:35.236827 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23344e2f-1cb0-4c10-9b35-a0a1a39cd97c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1390 microversion: 2.1 time: 0.157796 Oct 25 04:18:35.237427 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3893/7903] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:35 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:36.261108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:36.261756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:36.268971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:36.269394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:36.269880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:36.270579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:36.271044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:36.271480 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:36.412876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:36.420590 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fb9c12dd-468e-4e0c-9d71-c18840a026a6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1390 microversion: 2.1 time: 0.163612 Oct 25 04:18:36.421179 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4011/7904] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:36 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:36.762255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-49d0d4aa-1f12-4c6f-8e8f-cf72da1f506f req-8eb22eb7-e6ec-4964-8054-fe8a20146f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f52bfbd-5aa6-4c8f-a966-564d452632d1", "name": "network-vif-plugged", "status": "completed", "tag": "549b3e96-5ad1-4588-b3a1-b5eddb66746c"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:36.773082 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-49d0d4aa-1f12-4c6f-8e8f-cf72da1f506f req-8eb22eb7-e6ec-4964-8054-fe8a20146f3c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:36.773579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-49d0d4aa-1f12-4c6f-8e8f-cf72da1f506f req-8eb22eb7-e6ec-4964-8054-fe8a20146f3c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:36.774052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-49d0d4aa-1f12-4c6f-8e8f-cf72da1f506f req-8eb22eb7-e6ec-4964-8054-fe8a20146f3c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:36.786467 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-49d0d4aa-1f12-4c6f-8e8f-cf72da1f506f req-8eb22eb7-e6ec-4964-8054-fe8a20146f3c service nova] Creating event network-vif-plugged:549b3e96-5ad1-4588-b3a1-b5eddb66746c for instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 on n-h1-862355-1 Oct 25 04:18:36.791985 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-49d0d4aa-1f12-4c6f-8e8f-cf72da1f506f req-8eb22eb7-e6ec-4964-8054-fe8a20146f3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033644 Oct 25 04:18:36.792639 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3894/7905] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:18:37.444304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:37.444927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:37.451802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:37.452290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:37.452737 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:37.453433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:37.453929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:37.454367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:37.584548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:37.592260 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45fad3e7-8a75-4ed8-bead-f13746d51ea2 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1390 microversion: 2.1 time: 0.151915 Oct 25 04:18:37.592845 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4012/7906] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:37 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:38.617567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:38.618346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:38.624535 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:38.625040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:38.625498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:38.626244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:38.626720 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:38.627187 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:38.765252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:38.773359 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fca9d337-8943-47cb-884f-7365c02b917c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1563 microversion: 2.1 time: 0.160945 Oct 25 04:18:38.773998 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3895/7907] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:38 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:38.796833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:38.797479 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:38.801428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:38.807982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:38.808709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:38.809152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:38.809949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:38.810403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:38.810830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:38.955801 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:38.963529 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b12be749-dbf2-4048-be30-3910a5105e7d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1563 microversion: 2.1 time: 0.170578 Oct 25 04:18:38.964106 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4013/7908] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:38 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:18:40.594252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-4ee15802-c497-4803-aeb8-4de15527e425 req-aeb83df9-07bd-4eb8-8c8d-3937eb999a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f52bfbd-5aa6-4c8f-a966-564d452632d1", "tag": "549b3e96-5ad1-4588-b3a1-b5eddb66746c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:18:40.599361 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:18:40.599991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:18:40.602137 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:40.612045 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:40.612800 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:18:40.618838 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:40.619600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:40.620054 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:40.620778 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:40.626640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4ee15802-c497-4803-aeb8-4de15527e425 req-aeb83df9-07bd-4eb8-8c8d-3937eb999a10 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:18:40.627976 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4ee15802-c497-4803-aeb8-4de15527e425 req-aeb83df9-07bd-4eb8-8c8d-3937eb999a10 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:40.628752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-4ee15802-c497-4803-aeb8-4de15527e425 req-aeb83df9-07bd-4eb8-8c8d-3937eb999a10 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:40.634221 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:18:40.635073 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:18:40.641788 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-4ee15802-c497-4803-aeb8-4de15527e425 req-aeb83df9-07bd-4eb8-8c8d-3937eb999a10 service nova] Creating event network-changed:549b3e96-5ad1-4588-b3a1-b5eddb66746c for instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 on n-h1-862355-1 Oct 25 04:18:40.647849 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-4ee15802-c497-4803-aeb8-4de15527e425 req-aeb83df9-07bd-4eb8-8c8d-3937eb999a10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057396 Oct 25 04:18:40.649137 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4014/7909] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:18:40.801251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:18:40.810456 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e68af7c2-d695-4430-a2d0-d44b0ecb9604 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1563 microversion: 2.1 time: 0.222950 Oct 25 04:18:40.811057 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3896/7910] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:18:40 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:04.065346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:19:04.067664 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:04.070493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:04.071249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=36 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:04.076972 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:04.077453 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:04.077927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:04.078621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:04.079075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:04.080189 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:04.139299 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b9841b6-e966-420d-8096-d56e22e59128 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action" status: 200 len: 24566 microversion: 2.1 time: 0.078647 Oct 25 04:19:04.139937 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4015/7911] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:19:04 2022] POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action => generated 24566 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:19:15.109209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eda6f387-0b0d-4fe3-a72b-646314a1ffe4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:19:15.112291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:15.113038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=32 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:15.114638 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:19:15.114839 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action (ip 10.222.0.36) !!! Oct 25 04:19:15.129697 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eda6f387-0b0d-4fe3-a72b-646314a1ffe4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:15.130223 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eda6f387-0b0d-4fe3-a72b-646314a1ffe4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:15.130673 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eda6f387-0b0d-4fe3-a72b-646314a1ffe4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:15.155282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eda6f387-0b0d-4fe3-a72b-646314a1ffe4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Going to try to stop instance {{(pid=120563) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 25 04:19:15.208060 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eda6f387-0b0d-4fe3-a72b-646314a1ffe4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action" status: 202 len: 0 microversion: 2.1 time: 0.102687 Oct 25 04:19:15.209069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3897/7912] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:19:15 2022] POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:19:15.217838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:15.218572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:15.223229 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:15.224194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:15.234075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:15.234563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:15.234996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:15.236371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:15.236832 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:15.237261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:15.420433 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:15.429417 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0813d693-5425-4f85-94f8-4585ff7bc058 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.215859 Oct 25 04:19:15.430296 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4016/7913] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:15 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:16.455740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:16.456383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:16.463493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:16.463993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:16.464444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:16.465151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:16.465622 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:16.466155 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:16.604568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:16.613608 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-334a42de-4747-4eb4-877e-2be32adff189 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.162541 Oct 25 04:19:16.614228 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3898/7914] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:16 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:17.637533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:17.638254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:17.645894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:17.646382 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:17.646824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:17.647521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:17.647980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:17.648414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:17.780204 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:17.787971 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1da38475-8101-4705-85ae-05950b411c3e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.154419 Oct 25 04:19:17.788555 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4017/7915] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:17 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:18.811641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:18.812282 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:18.819400 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:18.819904 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:18.820553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:18.821357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:18.821872 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:18.822326 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:18.958739 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:18.966634 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4fc389e1-d533-4faa-9706-81501b73773a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.158985 Oct 25 04:19:18.967237 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3899/7916] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:18 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:19.991397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:19.992023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:19.998908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:19.999418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:19.999943 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:20.000652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:20.001177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:20.001637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:20.135727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:20.144101 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-49fc3294-dfd1-4608-b314-1186ef51f16c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.156661 Oct 25 04:19:20.144696 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4018/7917] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:19 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:21.168554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:21.169101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:21.176643 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:21.177149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:21.177603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:21.178341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:21.178815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:21.179258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:21.319500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:21.327445 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5455bb0a-08b6-44bf-bdee-dacc85d17705 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.162999 Oct 25 04:19:21.328040 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3900/7918] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:21 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:22.351047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:22.351648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:22.358347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:22.358827 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:22.359262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:22.359949 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:22.361534 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:22.362000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:22.497158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:22.505484 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b2b12c3c-7c21-4773-8f9a-28c59924819c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.158434 Oct 25 04:19:22.506074 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4019/7919] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:22 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:19:23.529355 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:23.530040 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:23.537847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:23.538346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:23.538802 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:23.539500 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:23.540005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:23.540444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:23.674069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:23.682252 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5b81502-87cc-4fc8-a653-b9c8028f18f3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.156893 Oct 25 04:19:23.682856 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3901/7920] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:23 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:24.705643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:24.706288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:24.713156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:24.713652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:24.714131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:24.714830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:24.715309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:24.715722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:24.846056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:24.853861 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c169362c-41a3-4074-8cf8-f2c29b64ba85 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1692 microversion: 2.1 time: 0.152186 Oct 25 04:19:24.854446 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4020/7921] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:24 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:25.879175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:25.879799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:25.886807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:25.887300 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:25.887751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:25.888459 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:25.888931 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:25.889369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:26.026952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:26.035248 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7e06b645-e1e6-4015-8c63-1e4316ec9044 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1669 microversion: 2.1 time: 0.160965 Oct 25 04:19:26.035826 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3902/7922] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:25 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:27.129313 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:19:27.131575 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:27.138511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:27.138993 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:27.139428 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:27.140115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:27.140568 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:27.141000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:27.199366 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-eaf485cd-136b-4c82-ae9b-6ea4c80f1859 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action" status: 200 len: 38399 microversion: 2.1 time: 0.073863 Oct 25 04:19:27.199997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4021/7923] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:19:27 2022] POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action => generated 38399 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:19:27.212691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-714dcfe3-e185-4245-9f3d-34811c32f24b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:19:27.220374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-714dcfe3-e185-4245-9f3d-34811c32f24b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:27.220903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-714dcfe3-e185-4245-9f3d-34811c32f24b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:27.221358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-714dcfe3-e185-4245-9f3d-34811c32f24b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:27.243925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-714dcfe3-e185-4245-9f3d-34811c32f24b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Going to try to start instance {{(pid=120563) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 25 04:19:27.286891 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-714dcfe3-e185-4245-9f3d-34811c32f24b tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action" status: 202 len: 0 microversion: 2.1 time: 0.077924 Oct 25 04:19:27.287503 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3903/7924] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:19:27 2022] POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:19:27.296638 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:27.297378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:27.305036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:27.305562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:27.306039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:27.306784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:27.307294 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:27.307732 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:27.502521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:27.510593 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-17511bb7-59cb-4de7-a489-4fddbb6b224a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1678 microversion: 2.1 time: 0.218391 Oct 25 04:19:27.511393 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4022/7925] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:27 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:28.538117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:19:28.539004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:28.546305 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:28.546772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:28.547269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:28.548075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:28.548728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:28.549258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:28.682701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:19:28.690467 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-90c58553-f687-4dd3-879b-78fcc99a7fde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1682 microversion: 2.1 time: 0.158335 Oct 25 04:19:28.691041 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3904/7926] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:19:28 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:19:54.890013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:19:54.892293 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:19:54.895138 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=14 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:54.895806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=40 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:19:54.903090 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:54.903585 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:54.904031 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:54.904735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:19:54.905200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:19:54.905637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:19:54.966901 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a3ee4b12-1d95-4722-933c-8b1745f019be tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action" status: 200 len: 62960 microversion: 2.1 time: 0.080635 Oct 25 04:19:54.967587 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4023/7927] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:19:54 2022] POST /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1/action => generated 62960 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:20:02.327103 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:02.328292 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:02.328642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-1ffec3b5-7086-4e31-939e-abe4cf2e7f2a req-7449561f-3377-4970-a3d8-b807cc7ac2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f52bfbd-5aa6-4c8f-a966-564d452632d1", "tag": "549b3e96-5ad1-4588-b3a1-b5eddb66746c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:20:02.330847 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=16 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:02.332359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:02.339071 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:02.339678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:02.340211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:02.340766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1ffec3b5-7086-4e31-939e-abe4cf2e7f2a req-7449561f-3377-4970-a3d8-b807cc7ac2c3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:02.341076 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:02.341255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1ffec3b5-7086-4e31-939e-abe4cf2e7f2a req-7449561f-3377-4970-a3d8-b807cc7ac2c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:02.341895 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:02.342030 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-1ffec3b5-7086-4e31-939e-abe4cf2e7f2a req-7449561f-3377-4970-a3d8-b807cc7ac2c3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:02.342701 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:02.358598 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-1ffec3b5-7086-4e31-939e-abe4cf2e7f2a req-7449561f-3377-4970-a3d8-b807cc7ac2c3 service nova] Creating event network-changed:549b3e96-5ad1-4588-b3a1-b5eddb66746c for instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 on n-h1-862355-1 Oct 25 04:20:02.366776 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-1ffec3b5-7086-4e31-939e-abe4cf2e7f2a req-7449561f-3377-4970-a3d8-b807cc7ac2c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041591 Oct 25 04:20:02.367004 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4024/7928] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:20:02.380110 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:20:02.474176 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f626e49-e714-4ef2-952e-188b1e3e23bd tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 204 len: 0 microversion: 2.1 time: 0.151342 Oct 25 04:20:02.478259 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3905/7929] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:20:02 2022] DELETE /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:20:02.485201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:02.486728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:02.494195 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:02.494677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:02.495310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:02.496201 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:02.496817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:02.497407 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:02.659126 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:02.667214 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-397ce9e2-2e9b-4891-9f8a-15f5330eafde tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1688 microversion: 2.1 time: 0.186484 Oct 25 04:20:02.667801 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4025/7930] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:02 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:03.695146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:03.695806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:03.702724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:03.703222 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:03.703677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:03.704386 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:03.705231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:03.706112 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:03.841087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:03.849035 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-798be558-65f0-4571-86b8-63c2bbb76483 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1688 microversion: 2.1 time: 0.158279 Oct 25 04:20:03.849621 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3906/7931] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:03 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:04.629797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-0d0a30e2-4a54-42b7-9ea0-c1507530863a req-725aa6ed-834d-49b7-a49f-042f54973aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f52bfbd-5aa6-4c8f-a966-564d452632d1", "name": "network-vif-deleted", "tag": "549b3e96-5ad1-4588-b3a1-b5eddb66746c"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:20:04.640241 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0d0a30e2-4a54-42b7-9ea0-c1507530863a req-725aa6ed-834d-49b7-a49f-042f54973aef service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:04.640721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0d0a30e2-4a54-42b7-9ea0-c1507530863a req-725aa6ed-834d-49b7-a49f-042f54973aef service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:04.641151 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-0d0a30e2-4a54-42b7-9ea0-c1507530863a req-725aa6ed-834d-49b7-a49f-042f54973aef service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:04.653359 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-0d0a30e2-4a54-42b7-9ea0-c1507530863a req-725aa6ed-834d-49b7-a49f-042f54973aef service nova] Creating event network-vif-deleted:549b3e96-5ad1-4588-b3a1-b5eddb66746c for instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 on n-h1-862355-1 Oct 25 04:20:04.659224 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-0d0a30e2-4a54-42b7-9ea0-c1507530863a req-725aa6ed-834d-49b7-a49f-042f54973aef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033386 Oct 25 04:20:04.659848 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4026/7932] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:20:04.872419 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:04.873041 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:04.880321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:04.880820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:04.881269 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:04.881999 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:04.882576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:04.886297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:04.916283 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:04.916786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:04.917235 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:04.917721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lazy-loading 'fault' on Instance uuid 9f52bfbd-5aa6-4c8f-a966-564d452632d1 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:20:04.969787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:04.977937 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4ab25fed-5160-469b-ac00-7d4f7a19214a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 200 len: 1356 microversion: 2.1 time: 0.109333 Oct 25 04:20:04.978548 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3907/7933] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:04 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:06.002980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:06.003720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 9f52bfbd-5aa6-4c8f-a966-564d452632d1] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:06.010067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:06.010565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:06.011009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:06.011714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:06.012178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:06.012612 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:06.027172 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] HTTP exception thrown: Instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 could not be found. Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Request method failure captured: Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 HTTP/1.1 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2I447aecXYTjXgh6Lvr0ahTa1gNTRnCeDKzYgTswdrWMTeAI7ceAlWq7QyrJJvPwoaC-uJWmRSidLFIOSIKRC-75a-nvnjpS86h915aQSOTKJDlm37guNsS7ji5IV2MIO3WKiRT8h-PwNdkEkHT_d6Mt8umBr2XszX1e50VVzK-WoA Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b7ecb09322401fb57927a89dec6977", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b7ecb09322401fb57927a89dec6977"}]}] Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d82424cafb7a415dbf38a89c848674f0 Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 could not be found. Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '9f52bfbd-5aa6-4c8f-a966-564d452632d1'} Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 could not be found. Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 could not be found. Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:20:06.028826 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 could not be found. Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Returning 404 to user: Instance 9f52bfbd-5aa6-4c8f-a966-564d452632d1 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e61f7e10-39ad-480f-84b2-0e92ecaf4da6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1" status: 404 len: 111 microversion: 2.1 time: 0.032666 Oct 25 04:20:06.035147 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4027/7934] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:05 2022] GET /compute/v2.1/servers/9f52bfbd-5aa6-4c8f-a966-564d452632d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:20:09.481134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-38a68395-dbfa-45fb-8772-4f908afd0919 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '.version_select at 0x7efd33871f70>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:09.505122 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-38a68395-dbfa-45fb-8772-4f908afd0919 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-109459294" status: 202 len: 0 microversion: 2.1 time: 0.027779 Oct 25 04:20:09.505779 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3908/7935] 10.222.0.36 () {58 vars in 1281 bytes} [Tue Oct 25 04:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-109459294 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:20:09.544325 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6383e295-fc02-4e1f-8084-88d929cb8220 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: .version_select at 0x7efd38e1cca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1595380580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYfNUQQyJGv/MeyoczaGPabMECNvGBR3ox6cZNqRGd2EGwEOW9d1E9Wwp+dGogsWXhnXo/TKgyXlXQCQsyESWI+GEuJB5nyv/tvXSnZ+vgm2a7uFJJDziRsT1CLxiIukg=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:20:09.561668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6383e295-fc02-4e1f-8084-88d929cb8220 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:20:09.568183 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-6383e295-fc02-4e1f-8084-88d929cb8220 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:20:09.592646 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6383e295-fc02-4e1f-8084-88d929cb8220 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052245 Oct 25 04:20:09.593256 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4028/7936] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:20:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:20:15.041864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:15.047391 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2057457573", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "networks": [{"uuid": "1fcc011e-e04a-4c3b-9291-6056fa801384"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1595380580", "security_groups": [{"name": "tempest-secgroup-smoke-1345277411"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:20:15.344192 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] validate_networks() for [('1fcc011e-e04a-4c3b-9291-6056fa801384', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:20:15.822378 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:20:15.822884 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:20:15.823452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:20:15.823947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:20:15.824453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:20:15.836569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:15.837172 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:15.837858 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:15.838677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:15.839220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:15.839728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:15.863490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:20:15.869633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Getting quotas for user d82424cafb7a415dbf38a89c848674f0 and project a8b7ecb09322401fb57927a89dec6977. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:20:15.886703 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:20:15.889537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:20:15.945979 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ba8e6710-de47-4d4a-91a6-16f129ecebb5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.905874 Oct 25 04:20:15.947242 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3909/7937] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:20:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:20:15.960735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7af6eb0c-7c2b-471b-8c21-52b68e1adfd5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:15.962001 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7af6eb0c-7c2b-471b-8c21-52b68e1adfd5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:16.019546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=16 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:16.046116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7af6eb0c-7c2b-471b-8c21-52b68e1adfd5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:16.056614 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7af6eb0c-7c2b-471b-8c21-52b68e1adfd5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1267 microversion: 2.1 time: 0.101225 Oct 25 04:20:16.070414 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4029/7938] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:15 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:17.082864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:17.085174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:17.099156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:17.099674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:17.100603 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:17.100941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:17.101416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:17.101937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:17.220554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:17.228730 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-30625696-8b84-49ba-8045-095a5b7d8100 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1337 microversion: 2.1 time: 0.151792 Oct 25 04:20:17.229339 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3910/7939] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:17 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1337 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:18.255194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:18.255835 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:18.263493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:18.264227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:18.264851 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:18.265565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:18.266227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:18.267508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:18.505975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:18.514707 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-672866f4-116c-4fa2-971e-b4cffbea405d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1393 microversion: 2.1 time: 0.264953 Oct 25 04:20:18.515669 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4030/7940] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:18 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1393 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:18.689734 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-960db32c-712b-4f95-af1d-96bc218aa8d2 req-da194858-647d-4459-bb34-4bae1963bd68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4caf18-0ebc-4cef-abbe-59a63130a415", "tag": "1eb7d4dc-1727-4efe-b3b3-b4c583d86fda"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:20:18.700119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-960db32c-712b-4f95-af1d-96bc218aa8d2 req-da194858-647d-4459-bb34-4bae1963bd68 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:18.700637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-960db32c-712b-4f95-af1d-96bc218aa8d2 req-da194858-647d-4459-bb34-4bae1963bd68 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:18.701132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-960db32c-712b-4f95-af1d-96bc218aa8d2 req-da194858-647d-4459-bb34-4bae1963bd68 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:18.713827 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-960db32c-712b-4f95-af1d-96bc218aa8d2 req-da194858-647d-4459-bb34-4bae1963bd68 service nova] Creating event network-changed:1eb7d4dc-1727-4efe-b3b3-b4c583d86fda for instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 on n-h2-862355-1 Oct 25 04:20:18.723059 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-960db32c-712b-4f95-af1d-96bc218aa8d2 req-da194858-647d-4459-bb34-4bae1963bd68 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038724 Oct 25 04:20:18.724069 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3911/7941] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:20:19.539642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:19.540363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:19.547207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:19.547697 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:19.548460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:19.548837 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:19.549304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:19.549757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:19.682719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:19.690948 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-22d8138e-d6a2-4f8e-bb8f-df600213d5a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1393 microversion: 2.1 time: 0.155241 Oct 25 04:20:19.691530 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4031/7942] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:19 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:20.715899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:20.716617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:20.723461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:20.723958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:20.724409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:20.725109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:20.725577 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:20.726107 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:20.864939 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:20.872773 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0430948f-ecc5-4964-bae0-c826f92134eb tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1393 microversion: 2.1 time: 0.162086 Oct 25 04:20:20.873356 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3912/7943] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:20 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:21.897190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:21.897736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:21.904457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:21.904935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:21.905370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:21.906080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:21.906543 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:21.906965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:22.052272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:22.060259 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6f61245d-4b67-491f-92cb-d2c54bae11f9 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1393 microversion: 2.1 time: 0.167033 Oct 25 04:20:22.060845 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4032/7944] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:21 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:20:23.084418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:23.085083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:23.092213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:23.092714 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:23.093169 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:23.093923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:23.094396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:23.094844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:23.229245 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:23.237738 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-42dd8bd0-2239-4281-bc98-5cb83c5b4e4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1393 microversion: 2.1 time: 0.157219 Oct 25 04:20:23.238342 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3913/7945] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:23 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:24.159264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-c8d1d0af-f037-435a-9075-1d2da0d1d304 req-2854d07f-41e6-4d37-b7f0-c856008fa5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4caf18-0ebc-4cef-abbe-59a63130a415", "name": "network-vif-plugged", "status": "completed", "tag": "1eb7d4dc-1727-4efe-b3b3-b4c583d86fda"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:20:24.169343 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c8d1d0af-f037-435a-9075-1d2da0d1d304 req-2854d07f-41e6-4d37-b7f0-c856008fa5a6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:24.169883 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c8d1d0af-f037-435a-9075-1d2da0d1d304 req-2854d07f-41e6-4d37-b7f0-c856008fa5a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:24.170323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-c8d1d0af-f037-435a-9075-1d2da0d1d304 req-2854d07f-41e6-4d37-b7f0-c856008fa5a6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:24.182020 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-c8d1d0af-f037-435a-9075-1d2da0d1d304 req-2854d07f-41e6-4d37-b7f0-c856008fa5a6 service nova] Creating event network-vif-plugged:1eb7d4dc-1727-4efe-b3b3-b4c583d86fda for instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 on n-h2-862355-1 Oct 25 04:20:24.187044 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-c8d1d0af-f037-435a-9075-1d2da0d1d304 req-2854d07f-41e6-4d37-b7f0-c856008fa5a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032143 Oct 25 04:20:24.187611 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4033/7946] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:20:24.260421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:24.261062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:24.268843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:24.269359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:24.269852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:24.270581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:24.271061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:24.271514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:24.408338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:24.416160 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-315acec1-189b-4cab-b9de-45611ff5012e tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1393 microversion: 2.1 time: 0.159657 Oct 25 04:20:24.416740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3914/7947] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:24 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:25.442250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:25.442956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:25.445968 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:25.450159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:25.450642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:25.451080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:25.451773 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:25.452227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:25.452652 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:25.597395 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:25.605235 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c7bd2d47-9f22-4f4c-b4e7-38ac7bd09738 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1393 microversion: 2.1 time: 0.169439 Oct 25 04:20:25.605867 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4034/7948] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:25 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:26.629951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:26.630513 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:26.633315 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:26.634021 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:26.639997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:26.640499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:26.640954 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:26.642617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:26.642762 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:26.643208 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:26.777115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:26.785618 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e65220e8-ba54-495a-87d2-b4f1d435a9f5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1566 microversion: 2.1 time: 0.160468 Oct 25 04:20:26.786231 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3915/7949] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:26 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:26.808988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:26.809611 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:26.811516 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:20:26.818102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:26.818603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:26.819036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:26.819719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:26.820172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:26.820600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:26.952754 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:26.961069 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d71f2d08-2b5f-4c3c-a93a-77af238cd6a3 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1566 microversion: 2.1 time: 0.156236 Oct 25 04:20:26.961654 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4035/7950] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:26 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:20:28.835038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:20:28.835876 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:20:28.838971 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-53059f5d-769f-4e5d-8ac2-029e7adb5e10 req-df5750bf-a7a1-4307-8d41-0d8924a9c59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4caf18-0ebc-4cef-abbe-59a63130a415", "tag": "1eb7d4dc-1727-4efe-b3b3-b4c583d86fda"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:20:28.843161 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:28.843665 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:28.844115 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:28.845550 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:28.846193 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:28.846636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:28.853855 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-53059f5d-769f-4e5d-8ac2-029e7adb5e10 req-df5750bf-a7a1-4307-8d41-0d8924a9c59a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:20:28.854403 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-53059f5d-769f-4e5d-8ac2-029e7adb5e10 req-df5750bf-a7a1-4307-8d41-0d8924a9c59a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:20:28.854863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-53059f5d-769f-4e5d-8ac2-029e7adb5e10 req-df5750bf-a7a1-4307-8d41-0d8924a9c59a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:20:28.867495 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-53059f5d-769f-4e5d-8ac2-029e7adb5e10 req-df5750bf-a7a1-4307-8d41-0d8924a9c59a service nova] Creating event network-changed:1eb7d4dc-1727-4efe-b3b3-b4c583d86fda for instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 on n-h2-862355-1 Oct 25 04:20:28.872701 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-53059f5d-769f-4e5d-8ac2-029e7adb5e10 req-df5750bf-a7a1-4307-8d41-0d8924a9c59a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039439 Oct 25 04:20:28.873542 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4036/7951] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:20:28.997721 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:20:29.008834 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d5cc85f8-aeea-4762-890d-50cf0008b2b1 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1566 microversion: 2.1 time: 0.178028 Oct 25 04:20:29.010527 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3916/7952] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:20:28 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:00.291223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=5 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:00.291895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=34 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:00.296880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:00.299193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:00.307290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:00.307777 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:00.308219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:00.308922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:00.309381 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:00.309846 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:00.360883 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-01952a6c-0cf6-4bef-816b-f6a5fb1887d6 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action" status: 200 len: 24538 microversion: 2.1 time: 0.071663 Oct 25 04:21:00.361546 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4037/7953] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:21:00 2022] POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action => generated 24538 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:21:30.784213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:30.784976 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=40 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:30.791243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:30.791795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:30.799879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:30.800372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:30.800857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:30.801569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:30.802057 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:30.802494 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:30.827659 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lazy-loading 'flavor' on Instance uuid 7f4caf18-0ebc-4cef-abbe-59a63130a415 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:21:30.893492 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d98aad44-35fc-4de9-9fe4-3ed837ac38f0 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action" status: 202 len: 0 microversion: 2.1 time: 0.110883 Oct 25 04:21:30.894360 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3917/7954] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:21:30 2022] POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:21:30.903643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:30.904498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:30.907240 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:30.908035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:30.915111 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:30.915728 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:30.916181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:30.916899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:30.917409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:30.917878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:31.055764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:31.063481 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e557804-3a41-4786-b94d-eac8ceea747c tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1693 microversion: 2.1 time: 0.164327 Oct 25 04:21:31.064056 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4038/7955] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:30 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:32.088252 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:32.088973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:32.096318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:32.096819 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:32.097276 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:32.098018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:32.098485 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:32.098925 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:32.236342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:32.244847 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7cbf241c-0420-49c3-80af-926e911edde5 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1693 microversion: 2.1 time: 0.160971 Oct 25 04:21:32.245436 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3918/7956] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:32 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:33.271469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:33.272015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:33.279734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:33.280258 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:33.280711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:33.281410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:33.281899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:33.282330 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:33.416200 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:33.423902 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7ed5402a-c20f-4419-868e-77a06670df8a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1676 microversion: 2.1 time: 0.157538 Oct 25 04:21:33.424474 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4039/7957] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:33 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:34.518352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:34.520769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:34.527768 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:34.528270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:34.528728 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:34.529441 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:34.529948 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:34.530388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:34.583946 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2ecd8a7c-9838-4515-9c99-070c78b69433 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action" status: 200 len: 37168 microversion: 2.1 time: 0.069453 Oct 25 04:21:34.584815 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3919/7958] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:21:34 2022] POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action => generated 37168 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:21:34.596393 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:34.596934 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:34.604715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:34.605196 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:34.605631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:34.606348 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:34.606799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:34.607311 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:34.676652 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3b1b46bd-0b71-4f68-b81b-6a43a22c08f8 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action" status: 202 len: 0 microversion: 2.1 time: 0.083317 Oct 25 04:21:34.677300 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4040/7959] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:21:34 2022] POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:21:34.686625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:34.687352 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:34.694674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:34.695225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:34.695639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:34.696353 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:34.696829 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:34.697288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:34.835908 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:34.844012 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c7c5c7e3-639c-431b-8938-55a77a4813b4 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1682 microversion: 2.1 time: 0.161710 Oct 25 04:21:34.844606 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3920/7960] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:34 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:35.870592 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:35.871289 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:35.877394 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:35.877915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:35.878350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:35.879798 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:35.880267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:35.880694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:36.010940 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:36.018803 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7b48e7b7-6c15-4089-8681-1375dc21ec18 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1682 microversion: 2.1 time: 0.153368 Oct 25 04:21:36.019386 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4041/7961] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:35 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:37.042499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:37.043130 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:37.049899 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:37.050399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:37.050911 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:37.051615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:37.052083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:37.052527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:37.188530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:37.197354 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23eba5e9-739b-4c31-a013-72b75ae3b506 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1685 microversion: 2.1 time: 0.158913 Oct 25 04:21:37.197974 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3921/7962] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:37 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:37.298828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:37.301551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:37.308623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:37.309109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:37.309548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:37.310276 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:37.310735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:37.311166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:37.352344 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-27d3790f-6ca8-44a7-946e-9f633bad577d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action" status: 200 len: 37168 microversion: 2.1 time: 0.057632 Oct 25 04:21:37.352985 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4042/7963] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:21:37 2022] POST /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415/action => generated 37168 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 25 04:21:38.295152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:38.301287 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:38.312263 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:38.312784 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:38.313446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:38.314216 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:38.314688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:38.315132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:38.344956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:21:38.366000 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-071b13f5-2fe9-4455-9605-f677cd55990f req-020bb0b1-05bd-414c-aeb0-2cc02e18bedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4caf18-0ebc-4cef-abbe-59a63130a415", "tag": "1eb7d4dc-1727-4efe-b3b3-b4c583d86fda"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:38.376876 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-071b13f5-2fe9-4455-9605-f677cd55990f req-020bb0b1-05bd-414c-aeb0-2cc02e18bedc service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:38.377449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-071b13f5-2fe9-4455-9605-f677cd55990f req-020bb0b1-05bd-414c-aeb0-2cc02e18bedc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:38.378029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-071b13f5-2fe9-4455-9605-f677cd55990f req-020bb0b1-05bd-414c-aeb0-2cc02e18bedc service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:38.391345 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-071b13f5-2fe9-4455-9605-f677cd55990f req-020bb0b1-05bd-414c-aeb0-2cc02e18bedc service nova] Creating event network-changed:1eb7d4dc-1727-4efe-b3b3-b4c583d86fda for instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 on n-h2-862355-1 Oct 25 04:21:38.397853 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-071b13f5-2fe9-4455-9605-f677cd55990f req-020bb0b1-05bd-414c-aeb0-2cc02e18bedc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100617 Oct 25 04:21:38.398593 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4043/7964] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:21:38.441984 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9fd33bff-01b4-4f5a-a123-022ab8f42651 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 204 len: 0 microversion: 2.1 time: 0.150319 Oct 25 04:21:38.445725 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3922/7965] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:21:38 2022] DELETE /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:21:38.453758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:38.454787 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:38.461891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:38.462388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:38.462830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:38.464523 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:38.464995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:38.465438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:38.605548 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:38.613554 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a17a4e78-52bd-4fe1-a746-0677e8c7c5ec tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1691 microversion: 2.1 time: 0.164639 Oct 25 04:21:38.614997 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4044/7966] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:38 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:21:39.640327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:39.640964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:39.649396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:39.649930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:39.650409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:39.651867 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:39.652349 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:39.652788 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:39.790385 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:39.798544 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-56378457-1f2d-4740-ab23-933fdb5bae4a tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1691 microversion: 2.1 time: 0.162876 Oct 25 04:21:39.799241 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3923/7967] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:39 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:40.645751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-eb80cf5c-bc77-4b19-b5a9-ef7478e79a18 req-40362285-0287-4125-b060-23ddfbcd78cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4caf18-0ebc-4cef-abbe-59a63130a415", "name": "network-vif-deleted", "tag": "1eb7d4dc-1727-4efe-b3b3-b4c583d86fda"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:40.656174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-eb80cf5c-bc77-4b19-b5a9-ef7478e79a18 req-40362285-0287-4125-b060-23ddfbcd78cb service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:40.656690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-eb80cf5c-bc77-4b19-b5a9-ef7478e79a18 req-40362285-0287-4125-b060-23ddfbcd78cb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:40.657148 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-eb80cf5c-bc77-4b19-b5a9-ef7478e79a18 req-40362285-0287-4125-b060-23ddfbcd78cb service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:40.669228 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-eb80cf5c-bc77-4b19-b5a9-ef7478e79a18 req-40362285-0287-4125-b060-23ddfbcd78cb service nova] Creating event network-vif-deleted:1eb7d4dc-1727-4efe-b3b3-b4c583d86fda for instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 on n-h2-862355-1 Oct 25 04:21:40.674010 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-eb80cf5c-bc77-4b19-b5a9-ef7478e79a18 req-40362285-0287-4125-b060-23ddfbcd78cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 Oct 25 04:21:40.674625 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4045/7968] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:21:40.822839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:40.823469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:40.830652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:40.831160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:40.831617 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:40.832356 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:40.832817 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:40.834163 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:40.864890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:40.865312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:40.865801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:40.866273 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lazy-loading 'fault' on Instance uuid 7f4caf18-0ebc-4cef-abbe-59a63130a415 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:21:40.907092 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82424cafb7a415dbf38a89c848674f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7ecb09322401fb57927a89dec6977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:40.915831 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed14e104-7335-4b26-9347-0e964b20fa57 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 200 len: 1357 microversion: 2.1 time: 0.096793 Oct 25 04:21:40.916684 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3924/7969] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:40 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:41.943027 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:41.943658 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] [instance: 7f4caf18-0ebc-4cef-abbe-59a63130a415] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:41.949929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:41.950421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:41.950866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:41.951560 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:41.952020 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:41.952449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:41.966360 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] HTTP exception thrown: Instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 could not be found. Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Request method failure captured: Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 HTTP/1.1 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2I447aecXYTjXgh6Lvr0ahTa1gNTRnCeDKzYgTswdrWMTeAI7ceAlWq7QyrJJvPwoaC-uJWmRSidLFIOSIKRC-75a-nvnjpS86h915aQSOTKJDlm37guNsS7ji5IV2MIO3WKiRT8h-PwNdkEkHT_d6Mt8umBr2XszX1e50VVzK-WoA Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8b7ecb09322401fb57927a89dec6977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8b7ecb09322401fb57927a89dec6977", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8b7ecb09322401fb57927a89dec6977"}]}] Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: a8b7ecb09322401fb57927a89dec6977 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1477277609 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d82424cafb7a415dbf38a89c848674f0 Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1477277609-project Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 could not be found. Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': '7f4caf18-0ebc-4cef-abbe-59a63130a415'} Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 could not be found. Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 could not be found. Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:21:41.967960 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 could not be found. Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Returning 404 to user: Instance 7f4caf18-0ebc-4cef-abbe-59a63130a415 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6bcf52c0-3c52-4562-b8f8-d499fd88270d tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415" status: 404 len: 111 microversion: 2.1 time: 0.031725 Oct 25 04:21:41.973152 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4046/7970] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:41 2022] GET /compute/v2.1/servers/7f4caf18-0ebc-4cef-abbe-59a63130a415 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:21:45.490727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fb0ed06f-cc80-4dd7-95e9-a4b48ad1b138 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] Calling method '.version_select at 0x7efd327f3dc0>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:45.515688 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fb0ed06f-cc80-4dd7-95e9-a4b48ad1b138 tempest-TestNetworkAdvancedServerOps-1477277609 tempest-TestNetworkAdvancedServerOps-1477277609-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1595380580" status: 202 len: 0 microversion: 2.1 time: 0.029672 Oct 25 04:21:45.516354 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3925/7971] 10.222.0.36 () {58 vars in 1284 bytes} [Tue Oct 25 04:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1595380580 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:21:56.874554 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=18 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:56.875297 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:57.072752 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70c85790-7187-40fc-9cb4-0aedeac005ea tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'create', calling method: .version_select at 0x7efd3205fc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-103058065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdtnKIzC7AqbzbHJ9iL58MplWcJ0TFgKlzVNTv/7DH3OEPsFYjauj7M6TckFqAEbqowpYYr4M3g7wztUPKCL0jmF7DJi/KlBFI8zd/Vo47dCdxmNHVe9BtGusuOiS/2pA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:57.090207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-70c85790-7187-40fc-9cb4-0aedeac005ea tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for project 4b85b81eb37444c78028481f155a31ae. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:21:57.095671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-70c85790-7187-40fc-9cb4-0aedeac005ea tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for user d6a10a72d1454fd59e0c8b808c8088fd and project 4b85b81eb37444c78028481f155a31ae. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:21:57.122129 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70c85790-7187-40fc-9cb4-0aedeac005ea tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.253095 Oct 25 04:21:57.123047 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4047/7972] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:21:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:21:58.158853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:58.159713 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:21:58.166991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1228359899", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-103058065", "security_groups": [{"name": "tempest-secgroup-smoke-1045669753"}], "networks": [{"uuid": "18213303-a5c3-461a-b763-eafd9da01b31"}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:21:58.286984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] validate_networks() for [('18213303-a5c3-461a-b763-eafd9da01b31', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:21:58.761079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:21:58.761527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:21:58.762053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:21:58.762518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:21:58.762977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:21:58.773357 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:58.774064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:58.774408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:58.775158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:21:58.775629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:21:58.776069 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:21:58.796887 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for project 4b85b81eb37444c78028481f155a31ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:21:58.803661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for user d6a10a72d1454fd59e0c8b808c8088fd and project 4b85b81eb37444c78028481f155a31ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:21:58.817538 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:21:58.820196 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:21:58.870016 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2f92a51c-3e79-4172-9b07-380389351027 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712967 Oct 25 04:21:58.871126 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3926/7973] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:21:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:21:58.882372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1433a2b-02a0-460d-9d78-adad104e0bee tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:58.882948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1433a2b-02a0-460d-9d78-adad104e0bee tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:21:58.944494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1433a2b-02a0-460d-9d78-adad104e0bee tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:21:58.952071 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1433a2b-02a0-460d-9d78-adad104e0bee tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1246 microversion: 2.1 time: 0.073709 Oct 25 04:21:58.952856 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4048/7974] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:58 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:21:59.978846 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:21:59.980234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:00.000415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:00.001512 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:00.002325 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:00.003415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:00.004285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:00.005508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:00.121831 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:00.130470 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-db41076a-2e4a-4893-b147-940aae0a0ced tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1306 microversion: 2.1 time: 0.157236 Oct 25 04:22:00.142289 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3927/7975] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:21:59 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:22:01.157562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:22:01.158205 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:01.169082 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:01.169572 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:01.170047 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:01.170776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:01.171228 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:01.171653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:01.317785 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:01.325585 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-240c14fc-90b9-40c7-936f-5c0cd09dd577 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1372 microversion: 2.1 time: 0.172149 Oct 25 04:22:01.326196 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4049/7976] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:22:01 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:22:01.645211 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-21db3e2e-70b3-40fa-a0e2-1e99d542cd62 req-38c4ada3-d79b-43ba-9e95-26834cb90d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:22:01.666702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-21db3e2e-70b3-40fa-a0e2-1e99d542cd62 req-38c4ada3-d79b-43ba-9e95-26834cb90d11 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:01.667206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-21db3e2e-70b3-40fa-a0e2-1e99d542cd62 req-38c4ada3-d79b-43ba-9e95-26834cb90d11 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:01.667650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-21db3e2e-70b3-40fa-a0e2-1e99d542cd62 req-38c4ada3-d79b-43ba-9e95-26834cb90d11 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:01.679589 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-21db3e2e-70b3-40fa-a0e2-1e99d542cd62 req-38c4ada3-d79b-43ba-9e95-26834cb90d11 service nova] Creating event network-changed:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h1-862355-1 Oct 25 04:22:01.684793 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-21db3e2e-70b3-40fa-a0e2-1e99d542cd62 req-38c4ada3-d79b-43ba-9e95-26834cb90d11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111767 Oct 25 04:22:01.685396 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3928/7977] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:22:02.350346 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:22:02.351055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:02.358173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:02.358670 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:02.359110 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:02.359822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:02.360285 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:02.360720 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:02.496472 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:02.504133 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d67d3226-da84-455e-bb87-906c8099c95c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1372 microversion: 2.1 time: 0.157950 Oct 25 04:22:02.504681 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4050/7978] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:22:02 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:22:03.531249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:22:03.532102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:03.539179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:03.539758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:03.540275 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:03.540991 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:03.541462 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:03.542052 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:03.689437 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:03.698271 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8aa2cec5-cc32-4eca-b471-ce20e42e8565 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1372 microversion: 2.1 time: 0.172236 Oct 25 04:22:03.698920 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3929/7979] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:22:03 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:22:04.721555 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:22:04.722215 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:04.729767 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:04.730249 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:04.730687 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:04.731372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:04.731826 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:04.732250 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:04.863750 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:04.871568 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-600067ce-a62c-4c1e-87bf-ead149260923 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1372 microversion: 2.1 time: 0.154202 Oct 25 04:22:04.872143 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4051/7980] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:22:04 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:22:05.733689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-91f491fb-014a-42ad-b233-bc59c8353b46 req-816ba4d8-92bc-4e57-91e8-a4a78c72f7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "name": "network-vif-plugged", "status": "completed", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:22:05.744420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91f491fb-014a-42ad-b233-bc59c8353b46 req-816ba4d8-92bc-4e57-91e8-a4a78c72f7de service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:05.744420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91f491fb-014a-42ad-b233-bc59c8353b46 req-816ba4d8-92bc-4e57-91e8-a4a78c72f7de service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:05.744740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-91f491fb-014a-42ad-b233-bc59c8353b46 req-816ba4d8-92bc-4e57-91e8-a4a78c72f7de service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:05.756599 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-91f491fb-014a-42ad-b233-bc59c8353b46 req-816ba4d8-92bc-4e57-91e8-a4a78c72f7de service nova] Creating event network-vif-plugged:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h1-862355-1 Oct 25 04:22:05.761493 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-91f491fb-014a-42ad-b233-bc59c8353b46 req-816ba4d8-92bc-4e57-91e8-a4a78c72f7de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090356 Oct 25 04:22:05.762120 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3930/7981] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:22:05.896388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:22:05.897198 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:05.904602 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:05.905375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:05.905866 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:05.906640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:05.907299 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:05.907730 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:06.047538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:06.056049 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8fd79441-0f6d-4178-92f6-f9e6edf686a6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1372 microversion: 2.1 time: 0.164715 Oct 25 04:22:06.056634 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4052/7982] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:22:05 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:22:07.080596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:22:07.081504 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:07.091621 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:07.092225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:07.092956 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:07.094147 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:07.094704 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:07.095327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:07.240214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:07.248716 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e7a4b28c-cd38-469e-b550-e0710bc68b9e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1556 microversion: 2.1 time: 0.173656 Oct 25 04:22:07.249313 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3931/7983] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:22:07 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:22:07.272435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:22:07.273055 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:22:07.280039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:07.280525 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:07.280963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:07.281654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:07.282136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:07.282563 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:07.419836 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:22:07.428908 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-55e72570-cc7e-49b7-8f77-8ac3c4ba2362 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1556 microversion: 2.1 time: 0.160572 Oct 25 04:22:07.429505 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4053/7984] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:22:07 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:22:09.425442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7b702a78-9d36-4e14-8643-29d813d435ed req-6cb91d56-6c4f-4b7f-859b-ef0bf2ea63e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:22:09.432308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:22:09.433237 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=6 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:22:09.439898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7b702a78-9d36-4e14-8643-29d813d435ed req-6cb91d56-6c4f-4b7f-859b-ef0bf2ea63e6 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:22:09.440394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7b702a78-9d36-4e14-8643-29d813d435ed req-6cb91d56-6c4f-4b7f-859b-ef0bf2ea63e6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:22:09.440845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7b702a78-9d36-4e14-8643-29d813d435ed req-6cb91d56-6c4f-4b7f-859b-ef0bf2ea63e6 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:22:09.453125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7b702a78-9d36-4e14-8643-29d813d435ed req-6cb91d56-6c4f-4b7f-859b-ef0bf2ea63e6 service nova] Creating event network-changed:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h1-862355-1 Oct 25 04:22:09.458634 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7b702a78-9d36-4e14-8643-29d813d435ed req-6cb91d56-6c4f-4b7f-859b-ef0bf2ea63e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036597 Oct 25 04:22:09.459248 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3932/7985] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:24:05.680302 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97c68897-50e2-44da-913f-d91cfc1c6184] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:24:05.681473 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:24:05.685214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:24:05.685788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:05.687626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:05.688405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:05.689162 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=30 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:05.691196 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 25 04:24:05.691345 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70/action (ip 10.222.0.36) !!! Oct 25 04:24:05.706261 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:05.706748 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:05.707185 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:05.707884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:05.708340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:05.708766 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:05.733077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lazy-loading 'flavor' on Instance uuid db5b9078-4d43-4b8c-84ad-955ed472fa70 {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:24:05.926038 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-21661b87-dca2-454c-85d6-1e95181e16e0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70/action" status: 202 len: 0 microversion: 2.1 time: 0.247483 Oct 25 04:24:05.926651 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4054/7986] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:24:05 2022] POST /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:24:05.933814 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:24:05.934592 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:24:05.935118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:05.935929 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=26 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:05.942240 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:05.942972 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:05.952160 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:05.952740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:05.953197 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:05.953952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:05.954426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:05.954869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:06.096431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:06.104689 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f6bb15b2-4d85-46c3-9002-9c2a1dbf7109 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.172905 Oct 25 04:24:06.105288 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3933/7987] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:05 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:24:07.130009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:07.130707 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:07.140946 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:07.141435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:07.141924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:07.142622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:07.143080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:07.143511 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:07.148369 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46024. Oct 25 04:24:07.149560 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] [97c68897-50e2-44da-913f-d91cfc1c6184] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46022. Oct 25 04:24:07.284929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:07.293806 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-85159d1d-15e1-49bd-94a7-5dab07427f7b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.169352 Oct 25 04:24:07.294495 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4055/7988] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:07 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:08.319470 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:08.320099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:08.332455 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:08.332964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:08.333426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:08.334174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:08.334652 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:08.335099 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:08.339095 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46032. Oct 25 04:24:08.342230 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46030. Oct 25 04:24:08.473573 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:08.482368 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-881f2d5e-22fe-4680-ace3-6d893b12d011 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.167167 Oct 25 04:24:08.482963 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3934/7989] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:08 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:09.506596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:09.507248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:09.514824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:09.515316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:09.515764 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:09.516460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:09.516924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:09.517357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:09.649221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:09.656897 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9673ef94-5c96-4fd9-af4c-9c72ba674164 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.154264 Oct 25 04:24:09.657473 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4056/7990] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:09 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:10.682587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:10.683224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:10.690133 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:10.690637 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:10.691096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:10.691843 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:10.692324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:10.692772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:10.824288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:10.832185 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d8edb33a-ab54-49ba-bb2a-0f9934db56c2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.155897 Oct 25 04:24:10.832774 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3935/7991] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:10 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:11.857122 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:11.857828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:11.864692 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:11.865176 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:11.865617 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:11.866341 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:11.866799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:11.867233 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:12.001884 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:12.010012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cf271fca-08c4-4b72-87a1-51114d6ef1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.156842 Oct 25 04:24:12.010600 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4057/7992] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:11 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:13.034306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:13.034937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:13.044225 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:13.044727 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:13.045178 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:13.045975 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:13.046813 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:13.047256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:13.179774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:13.187817 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1493696f-155c-411e-a11b-a2204bf56b0c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.157486 Oct 25 04:24:13.188399 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3936/7993] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:13 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:14.211782 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:14.212344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:14.219188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:14.219675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:14.220114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:14.220802 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:14.221259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:14.221695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:14.354006 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:14.361827 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e190c8a6-05f2-4fe6-a308-4cc4774a2d34 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.154262 Oct 25 04:24:14.362410 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4058/7994] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:14 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:15.387549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:15.388138 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:15.395033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:15.395524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:15.395971 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:15.396677 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:15.397142 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:15.397579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:15.538927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:15.547192 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e2b281c7-939c-4185-8a45-17c0dd299b2c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.164715 Oct 25 04:24:15.547769 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3937/7995] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:15 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:16.573015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:16.573636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:16.580640 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:16.581125 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:16.581604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:16.582326 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:16.582793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:16.583223 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:16.793963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:16.801817 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fa6f23f8-ca7e-4b94-bbb5-126b24d4cfe0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1702 microversion: 2.1 time: 0.233484 Oct 25 04:24:16.802401 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4059/7996] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:16 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1702 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:17.825774 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:17.826412 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:17.833488 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:17.834032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:17.834493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:17.835241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:17.835753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:17.836937 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:17.969648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:17.977500 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a8a6867-bdc9-415a-99cc-1bb1e63bde5d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1702 microversion: 2.1 time: 0.155735 Oct 25 04:24:17.978137 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3938/7997] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:17 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1702 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:19.005153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:19.006445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:19.017378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:19.018166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:19.018833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:19.019758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:19.020457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:19.021114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:19.173009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:19.183661 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2fe1f31b-0afb-4384-9fc9-af87f325e0bd tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.182269 Oct 25 04:24:19.197866 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4060/7998] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:19 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:20.212351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f292e22b-a16d-4735-b9cc-55495dfc2168 req-abc7d092-1270-4915-8eb3-91cdc9f09937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "name": "network-vif-plugged", "status": "completed", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:24:20.213353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:20.214231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:20.231547 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:20.234499 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f292e22b-a16d-4735-b9cc-55495dfc2168 req-abc7d092-1270-4915-8eb3-91cdc9f09937 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:20.235245 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:20.235757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:20.236538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:20.237063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:20.237795 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f292e22b-a16d-4735-b9cc-55495dfc2168 req-abc7d092-1270-4915-8eb3-91cdc9f09937 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:20.238269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:20.240610 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f292e22b-a16d-4735-b9cc-55495dfc2168 req-abc7d092-1270-4915-8eb3-91cdc9f09937 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:20.263713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f292e22b-a16d-4735-b9cc-55495dfc2168 req-abc7d092-1270-4915-8eb3-91cdc9f09937 service nova] Creating event network-vif-plugged:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h1-862355-1 Oct 25 04:24:20.274167 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f292e22b-a16d-4735-b9cc-55495dfc2168 req-abc7d092-1270-4915-8eb3-91cdc9f09937 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074913 Oct 25 04:24:20.276082 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3939/7999] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:24:20.431594 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:20.441725 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-215454d0-4fba-4497-994b-4942f2cb9585 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.236266 Oct 25 04:24:20.450730 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4061/8000] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:20 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:21.476426 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:21.477898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:21.484272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:21.484779 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:21.485234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:21.486118 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:21.486586 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:21.487031 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:21.640077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:21.648331 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5aaa8de2-0ebb-424f-9f0a-11d495cdddbc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.177012 Oct 25 04:24:21.649719 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3940/8001] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:21 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:22.673150 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:22.673981 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:22.685440 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:22.685990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:22.686425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:22.687329 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:22.687957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:22.688545 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:22.841485 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:22.850717 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-621f7182-12ae-4b0d-9746-7b2cbd5e968d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.181494 Oct 25 04:24:22.854498 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4062/8002] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:22 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:23.876868 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:23.877568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:23.886612 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:23.887126 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:23.887587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:23.888328 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:23.889515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:23.890005 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:24.040832 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:24.049083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-217dec94-1391-4b1d-a45b-40df2c99b405 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.176338 Oct 25 04:24:24.051935 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3941/8003] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:23 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:25.083075 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:25.083813 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:25.093903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:25.094392 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:25.094830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:25.095529 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:25.095986 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:25.096410 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:25.239856 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:25.248722 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-134adc9b-82a3-4542-8d78-602625a049c0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.169547 Oct 25 04:24:25.261702 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4063/8004] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:25 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:26.277096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:26.277742 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:26.285067 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:26.285606 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:26.286091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:26.286820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:26.287294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:26.287738 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:26.434234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:26.442814 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-682438cb-e72d-475b-acbb-f0ed6d4b4522 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.170222 Oct 25 04:24:26.444083 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3942/8005] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:26 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:27.467434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:27.468057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:27.475147 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:27.475636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:27.476080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:27.476894 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:27.477355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:27.477932 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:27.635063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:27.642941 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cb4ba210-8ba0-45b4-899e-c47f09a0f8b6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1697 microversion: 2.1 time: 0.179357 Oct 25 04:24:27.643453 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4064/8006] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:27 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:28.669589 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:28.671199 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:28.678256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:28.678766 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:28.679232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:28.680140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:28.680587 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:28.681478 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:28.824438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:28.833309 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-fde87310-dd2f-4204-b2ea-8c7dbff36461 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1679 microversion: 2.1 time: 0.168675 Oct 25 04:24:28.833914 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3943/8007] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:28 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:29.857457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:29.858101 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:29.865226 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:29.865729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:29.866166 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:29.866991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:29.867533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:29.867959 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:29.997625 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:30.005408 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9628ae03-e88b-40dd-8361-eea4ecc44039 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1679 microversion: 2.1 time: 0.152112 Oct 25 04:24:30.006030 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4065/8008] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:29 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:31.029974 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:31.031209 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:31.038241 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:31.038839 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:31.039381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:31.040108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:31.040578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:31.041022 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:31.174035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:31.182678 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e45d317c-f2bd-48a0-b707-dde9fb27f928 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1622 microversion: 2.1 time: 0.156867 Oct 25 04:24:31.183257 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3944/8009] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:31 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1622 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:31.205527 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:24:31.206181 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:31.212881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:31.213367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:31.213834 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:31.214531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:31.214988 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:31.215415 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:31.301719 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120562) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 25 04:24:31.369841 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-163690ab-5c7b-4e08-bc2f-a550495cfcc9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70/action" status: 202 len: 0 microversion: 2.1 time: 0.168104 Oct 25 04:24:31.370481 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4066/8010] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:24:31 2022] POST /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:24:31.378707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:31.379351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:31.385394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:31.386013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:31.386539 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:31.387323 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:31.387984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:31.388431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:31.528625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:31.536539 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-55d1e2fe-d8ca-4d6c-9761-aec9320baf65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1630 microversion: 2.1 time: 0.161730 Oct 25 04:24:31.537150 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3945/8011] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:31 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1630 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:24:32.239409 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-2b717c6f-b1d1-4068-98df-ab4b7f06f973 req-c840365d-9ba8-4a2e-8d5f-32433b98b8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "name": "network-vif-unplugged", "status": "completed", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:24:32.259266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2b717c6f-b1d1-4068-98df-ab4b7f06f973 req-c840365d-9ba8-4a2e-8d5f-32433b98b8dd service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:32.259757 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2b717c6f-b1d1-4068-98df-ab4b7f06f973 req-c840365d-9ba8-4a2e-8d5f-32433b98b8dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:32.261003 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-2b717c6f-b1d1-4068-98df-ab4b7f06f973 req-c840365d-9ba8-4a2e-8d5f-32433b98b8dd service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:32.274478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.compute.server_external_events [req-2b717c6f-b1d1-4068-98df-ab4b7f06f973 req-c840365d-9ba8-4a2e-8d5f-32433b98b8dd service nova] Unable to find a host for instance db5b9078-4d43-4b8c-84ad-955ed472fa70. Dropping event network-vif-unplugged {{(pid=120562) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 25 04:24:32.276410 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-2b717c6f-b1d1-4068-98df-ab4b7f06f973 req-c840365d-9ba8-4a2e-8d5f-32433b98b8dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044220 Oct 25 04:24:32.277373 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4067/8012] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 25 04:24:32.560662 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:32.561320 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:32.568253 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:32.568754 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:32.569205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:32.570179 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:32.570803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:32.571251 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:32.713418 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:32.721432 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-27dd2339-9fef-43e8-8788-f4b04bc41d77 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.164619 Oct 25 04:24:32.722043 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3946/8013] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:32 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:33.746519 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:33.747336 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:33.754314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:33.754809 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:33.755252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:33.755963 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:33.756423 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:33.756874 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:33.776841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:33.866495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-0a0d5a7e-ba46-4a08-93f4-b300f8e701dc req-da06ab17-fb70-4788-a761-f4559758a973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:24:33.877869 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0a0d5a7e-ba46-4a08-93f4-b300f8e701dc req-da06ab17-fb70-4788-a761-f4559758a973 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:33.878611 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0a0d5a7e-ba46-4a08-93f4-b300f8e701dc req-da06ab17-fb70-4788-a761-f4559758a973 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:33.879064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-0a0d5a7e-ba46-4a08-93f4-b300f8e701dc req-da06ab17-fb70-4788-a761-f4559758a973 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:33.891219 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-0a0d5a7e-ba46-4a08-93f4-b300f8e701dc req-da06ab17-fb70-4788-a761-f4559758a973 service nova] Creating event network-changed:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h2-862355-1 Oct 25 04:24:33.896460 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-0a0d5a7e-ba46-4a08-93f4-b300f8e701dc req-da06ab17-fb70-4788-a761-f4559758a973 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033811 Oct 25 04:24:33.897077 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3947/8014] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:24:33.960282 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:33.969477 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b31f188a-5329-44d0-9667-2b5f0c5a9227 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.226885 Oct 25 04:24:33.970221 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4068/8015] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:33 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:34.995394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:34.997368 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:35.018913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:35.019835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:35.020301 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:35.021036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:35.021516 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:35.021989 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:35.187058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:35.196001 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23697343-2c3d-4436-a6ed-b08faaf8a4b8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.206820 Oct 25 04:24:35.196913 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3948/8016] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:34 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:36.221227 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:36.222041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:36.224903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:36.231333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:36.231829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:36.232267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:36.232987 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:36.233447 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:36.233906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:36.405622 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:36.413468 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cea3027c-6e70-4a70-8000-9ccf76790ba3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.196517 Oct 25 04:24:36.414174 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4069/8017] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:36 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:37.438337 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:37.439731 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:37.447706 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=33 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:37.449966 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:37.451837 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:37.452121 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:37.453238 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:37.453811 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:37.454327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:37.457955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=89 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:24:37.608335 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:37.616183 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-dfbc9944-0ea9-43e4-9d9c-97f133cad40d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.182149 Oct 25 04:24:37.616828 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3949/8018] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:37 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:38.642173 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:38.643596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:38.651960 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:38.652868 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:38.654144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:38.655333 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:38.656040 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:38.656713 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:38.800353 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:38.809061 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d28cc333-2f74-46e7-8dab-956a074ed6ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.170976 Oct 25 04:24:38.809869 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4070/8019] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:38 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:39.834694 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:39.835296 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:39.842695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:39.843204 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:39.843668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:39.844399 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:39.844880 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:39.845327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:39.992258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:40.010630 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4e92ac85-8dab-42df-819e-f530090cc4c6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.179879 Oct 25 04:24:40.011244 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3950/8020] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:39 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:41.034786 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:41.035436 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:41.043310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:41.043833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:41.044929 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:41.045654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:41.046141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:41.046565 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:41.191327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:41.200930 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a9fde2db-b115-4ff3-8d01-c11de4096fa1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.169408 Oct 25 04:24:41.202609 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4071/8021] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:41 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:42.225140 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:42.226993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:42.237942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:42.238871 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:42.239496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:42.240396 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:42.241113 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:42.241984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:42.408607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:42.417993 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6857a715-00a5-4965-bb9c-07904576235c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.197082 Oct 25 04:24:42.426435 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3951/8022] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:42 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:43.442492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:43.443072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:43.449864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:43.450637 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:43.450780 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:43.451468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:43.451926 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:43.452352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:43.581980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:43.589704 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-93bcd766-ed52-46ca-aed2-72c855d915d0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.151232 Oct 25 04:24:43.590282 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4072/8023] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:43 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:44.613136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:44.613827 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:44.620769 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:44.621272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:44.621753 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:44.622609 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:44.623079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:44.623531 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:44.757371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:44.765756 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-335e841c-70cf-428a-b304-e914b819d0ff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.156573 Oct 25 04:24:44.766343 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3952/8024] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:44 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:45.789920 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:45.790488 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:45.798152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:45.798629 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:45.799058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:45.799744 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:45.800192 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:45.800614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:45.939494 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:45.947279 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ceffd9fc-1613-446f-9677-70e56860dee5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.161396 Oct 25 04:24:45.947862 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4073/8025] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:45 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:46.970653 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:46.971314 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:46.978567 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:46.978995 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:46.979466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:46.980188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:46.980689 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:46.981131 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:47.139726 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:47.147639 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-788506ef-88f7-4a64-a58e-5eca955965f6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.180962 Oct 25 04:24:47.148229 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3953/8026] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:46 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:48.170820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:48.171438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:48.178239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:48.178729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:48.179170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:48.179863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:48.180322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:48.180746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:48.311584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:48.319334 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4649f9f2-2e67-4bbd-8a3e-754c32cd3502 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.152570 Oct 25 04:24:48.319923 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4074/8027] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:48 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:49.343566 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:49.344111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:49.351081 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:49.351576 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:49.352025 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:49.352730 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:49.353202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:49.353641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:49.487875 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:49.495755 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2dcc5cba-8a18-49ff-a112-e3088239949b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.156303 Oct 25 04:24:49.496343 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3954/8028] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:49 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:50.520600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:50.521221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:50.528726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:50.529207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:50.529648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:50.530366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:50.530825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:50.531254 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:50.663716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:50.672261 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d76eec49-acf3-4cad-8867-0c04e242d075 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.155655 Oct 25 04:24:50.672843 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4075/8029] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:50 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:51.567383 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-2e5b1dfd-77c6-4fb4-8314-12883f31ac71 req-f3b751e3-95e2-4af5-b1c8-8ba22bf0114c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "name": "network-vif-plugged", "status": "completed", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:24:51.579317 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2e5b1dfd-77c6-4fb4-8314-12883f31ac71 req-f3b751e3-95e2-4af5-b1c8-8ba22bf0114c service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:51.579820 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2e5b1dfd-77c6-4fb4-8314-12883f31ac71 req-f3b751e3-95e2-4af5-b1c8-8ba22bf0114c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:51.580279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-2e5b1dfd-77c6-4fb4-8314-12883f31ac71 req-f3b751e3-95e2-4af5-b1c8-8ba22bf0114c service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:51.592525 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-2e5b1dfd-77c6-4fb4-8314-12883f31ac71 req-f3b751e3-95e2-4af5-b1c8-8ba22bf0114c service nova] Creating event network-vif-plugged:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h2-862355-1 Oct 25 04:24:51.597623 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-2e5b1dfd-77c6-4fb4-8314-12883f31ac71 req-f3b751e3-95e2-4af5-b1c8-8ba22bf0114c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034121 Oct 25 04:24:51.598473 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3955/8030] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:24:51.696842 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:51.697421 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:51.706569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:51.707323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:51.707760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:51.708457 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:51.708910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:51.709361 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:51.851287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:51.859132 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b9b7e5be-28bd-4c02-a95c-f0373d5cb5a1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.167047 Oct 25 04:24:51.859711 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4076/8031] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:51 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:52.885272 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:52.886014 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:52.892926 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:52.893431 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:52.893907 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:52.894616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:52.895086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:52.895532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:53.030096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:53.038395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f940edf9-5183-4145-a51f-79478ec8e889 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1688 microversion: 2.1 time: 0.158152 Oct 25 04:24:53.039271 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3956/8032] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:52 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:24:54.063559 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:24:54.064179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:24:54.071120 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:54.071596 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:54.072028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:54.072712 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:24:54.073164 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:24:54.073583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:24:54.206657 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:24:54.214328 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d92f7915-f616-43e4-b950-a30067cec9a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1675 microversion: 2.1 time: 0.154975 Oct 25 04:24:54.214904 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4077/8033] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:24:54 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:26:39.505438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:26:39.506017 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=17 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:26:39.506392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:26:39.506796 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=58 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:26:39.508451 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:26:39.508593 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=15 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:26:39.508906 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 25 04:26:39.509050 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=43 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:26:39.511034 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:26:39.511364 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 (ip 10.222.0.36) !!! Oct 25 04:26:39.513217 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:26:39.513564 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 (ip 10.222.0.36) !!! Oct 25 04:26:39.518618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-882184c7-18e4-48bc-b7ce-7178df3b6cc7 req-1dbc360a-9795-40b3-b462-e9ee45654434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:26:39.522861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:39.523452 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:39.523920 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:39.524650 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:39.525134 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:39.525580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:39.536378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-882184c7-18e4-48bc-b7ce-7178df3b6cc7 req-1dbc360a-9795-40b3-b462-e9ee45654434 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:39.537328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-882184c7-18e4-48bc-b7ce-7178df3b6cc7 req-1dbc360a-9795-40b3-b462-e9ee45654434 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:39.538158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-882184c7-18e4-48bc-b7ce-7178df3b6cc7 req-1dbc360a-9795-40b3-b462-e9ee45654434 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:39.555655 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-882184c7-18e4-48bc-b7ce-7178df3b6cc7 req-1dbc360a-9795-40b3-b462-e9ee45654434 service nova] Creating event network-changed:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h2-862355-1 Oct 25 04:26:39.556367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Going to try to terminate instance {{(pid=120563) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:26:39.563479 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-882184c7-18e4-48bc-b7ce-7178df3b6cc7 req-1dbc360a-9795-40b3-b462-e9ee45654434 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059347 Oct 25 04:26:39.564998 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4078/8034] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:26:39.636931 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-705670f5-b8af-47da-9d61-1963592f4804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 204 len: 0 microversion: 2.1 time: 0.137234 Oct 25 04:26:39.637432 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3957/8035] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:26:39 2022] DELETE /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:26:39.646760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:26:39.647504 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:26:39.654551 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:39.655190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:39.655508 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:39.656287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:39.656761 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:39.657232 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:39.813345 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:26:39.821349 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a28d1787-f98d-4727-8485-e16cc073d668 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.178890 Oct 25 04:26:39.821985 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4079/8036] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:26:39 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:26:40.847818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:26:40.848537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:26:40.855463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:40.855961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:40.856409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:40.857188 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:40.857651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:40.858111 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:41.047258 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:26:41.054998 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a589b580-1166-4ad8-9395-1fed62dfc400 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1681 microversion: 2.1 time: 0.211466 Oct 25 04:26:41.055582 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3958/8037] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:26:40 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:26:41.815191 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-3db314bd-db87-4025-9d67-464635854cc3 req-a72d9924-93d7-4308-a78b-d248f6cbaefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db5b9078-4d43-4b8c-84ad-955ed472fa70", "name": "network-vif-deleted", "tag": "80da3d95-fc5c-4486-87b2-59c1c926ccde"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:26:41.827102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3db314bd-db87-4025-9d67-464635854cc3 req-a72d9924-93d7-4308-a78b-d248f6cbaefa service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:41.827845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3db314bd-db87-4025-9d67-464635854cc3 req-a72d9924-93d7-4308-a78b-d248f6cbaefa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:41.827973 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-3db314bd-db87-4025-9d67-464635854cc3 req-a72d9924-93d7-4308-a78b-d248f6cbaefa service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:41.841281 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-3db314bd-db87-4025-9d67-464635854cc3 req-a72d9924-93d7-4308-a78b-d248f6cbaefa service nova] Creating event network-vif-deleted:80da3d95-fc5c-4486-87b2-59c1c926ccde for instance db5b9078-4d43-4b8c-84ad-955ed472fa70 on n-h2-862355-1 Oct 25 04:26:41.848181 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-3db314bd-db87-4025-9d67-464635854cc3 req-a72d9924-93d7-4308-a78b-d248f6cbaefa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112271 Oct 25 04:26:41.848799 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4080/8038] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:26:42.080132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:26:42.080765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:26:42.087890 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:42.088255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:42.088705 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:42.089429 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:42.089986 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:42.090430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:42.129108 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:42.129613 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:42.130087 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:42.130554 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.objects.instance [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lazy-loading 'fault' on Instance uuid db5b9078-4d43-4b8c-84ad-955ed472fa70 {{(pid=120563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:26:42.178359 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:26:42.189170 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4c146d43-3773-4360-ad75-46183d59fa37 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 200 len: 1336 microversion: 2.1 time: 0.113119 Oct 25 04:26:42.189802 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3959/8039] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:26:42 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:26:43.214079 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:26:43.214788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: db5b9078-4d43-4b8c-84ad-955ed472fa70] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:26:43.222558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:43.223048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:43.223493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:43.224194 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:26:43.224656 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:26:43.225115 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:26:43.238531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] HTTP exception thrown: Instance db5b9078-4d43-4b8c-84ad-955ed472fa70 could not be found. Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Request method failure captured: Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 HTTP/1.1 Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2RfBk7aiGTGQPSS_BMUBaXLVXwUqkrPZJEXE4ycKjfAnQYOTABrakKD6NWs-3a43j9GvNhMn6b9pW-wVRzF6OcdHKuY2qtB7lIhfWr_FvM4X0grCdDtQ6k92kgPf_AA3XYL2oSQ1MWUP9VVo3F-574beSyPCIgi7h6E-lNyoNUG-tk Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 4b85b81eb37444c78028481f155a31ae Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestShelveInstance-1113575788 Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b85b81eb37444c78028481f155a31ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b85b81eb37444c78028481f155a31ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b85b81eb37444c78028481f155a31ae", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b85b81eb37444c78028481f155a31ae"}]}] Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestShelveInstance-1113575788 Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 4b85b81eb37444c78028481f155a31ae Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestShelveInstance-1113575788 Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestShelveInstance-1113575788-project Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: d6a10a72d1454fd59e0c8b808c8088fd Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestShelveInstance-1113575788-project Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance db5b9078-4d43-4b8c-84ad-955ed472fa70 could not be found. Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'db5b9078-4d43-4b8c-84ad-955ed472fa70'} Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db5b9078-4d43-4b8c-84ad-955ed472fa70 could not be found. Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db5b9078-4d43-4b8c-84ad-955ed472fa70 could not be found. Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:26:43.240145 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db5b9078-4d43-4b8c-84ad-955ed472fa70 could not be found. Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Returning 404 to user: Instance db5b9078-4d43-4b8c-84ad-955ed472fa70 could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ae53a15-59cd-43b6-9063-da32b26d1615 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70" status: 404 len: 111 microversion: 2.1 time: 0.031830 Oct 25 04:26:43.245878 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4081/8040] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:26:43 2022] GET /compute/v2.1/servers/db5b9078-4d43-4b8c-84ad-955ed472fa70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:26:43.414398 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1cc1416e-398b-4d43-9653-9d91fb82ed4a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '.version_select at 0x7efd328ac280>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:26:43.440564 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1cc1416e-398b-4d43-9653-9d91fb82ed4a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-103058065" status: 202 len: 0 microversion: 2.1 time: 0.030120 Oct 25 04:26:43.441662 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3960/8041] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Oct 25 04:26:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-103058065 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:26:43.467623 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45419b54-fc92-4b22-aeff-a227b1082216 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'create', calling method: .version_select at 0x7efd32d4b430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1332401054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKVI9s3FIkDfM8yHQwPJOqzlM25476UtXcWwCMeFj92Se6jPp2SBwAwzZfRLAV0vmUXbUUfTgHw2Jd+F4Ix4nK5vbSUmh5DnQavZ53KwX9CowGlqJXsob6KHtvrkiYTRA=="}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:26:43.482953 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-45419b54-fc92-4b22-aeff-a227b1082216 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for project 4b85b81eb37444c78028481f155a31ae. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:26:43.488004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-45419b54-fc92-4b22-aeff-a227b1082216 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for user d6a10a72d1454fd59e0c8b808c8088fd and project 4b85b81eb37444c78028481f155a31ae. Resources: {'key_pairs'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:26:43.514353 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45419b54-fc92-4b22-aeff-a227b1082216 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.050618 Oct 25 04:26:43.515228 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4082/8042] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:26:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:26:59.718286 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:26:59.719053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:26:59.723260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1862639197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1332401054", "security_groups": [{"name": "tempest-secgroup-smoke-24986829"}], "networks": [{"uuid": "18213303-a5c3-461a-b763-eafd9da01b31"}], "block_device_mapping_v2": [{"uuid": "e45feb74-70de-4fa2-a1d9-4e3d83eb1ed6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:26:59.841633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.network.neutron [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] validate_networks() for [('18213303-a5c3-461a-b763-eafd9da01b31', None, None, None, None, None)] {{(pid=120563) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:27:00.257102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Flavor limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:27:00.257548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Image limits 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:27:00.258078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Flavor pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:27:00.258505 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Image pref 0:0:0 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:27:00.258933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.virt.hardware [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:27:00.267775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:00.268270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:00.268722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:00.269461 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:00.269967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:00.270406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:00.289032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for project 4b85b81eb37444c78028481f155a31ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:27:00.294293 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Getting quotas for user d6a10a72d1454fd59e0c8b808c8088fd and project 4b85b81eb37444c78028481f155a31ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:27:00.353616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Going to run 1 instances... {{(pid=120563) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:27:00.355777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e45feb74-70de-4fa2-a1d9-4e3d83eb1ed6',volume_size=None,volume_type=None)] {{(pid=120563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:27:00.483988 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-21cff314-196c-4f8d-bce1-56f525de50f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.768175 Oct 25 04:27:00.484657 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3961/8043] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:26:59 2022] POST /compute/v2.1/servers => generated 404 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:27:00.493921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:27:00.494954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:27:00.495731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:27:00.500414 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-70631c8f-cc8f-42ab-9c56-8fecce90f411 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:00.501034 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-70631c8f-cc8f-42ab-9c56-8fecce90f411 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:00.560847 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-70631c8f-cc8f-42ab-9c56-8fecce90f411 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:00.568012 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-70631c8f-cc8f-42ab-9c56-8fecce90f411 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1089 microversion: 2.1 time: 0.075877 Oct 25 04:27:00.568588 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4083/8044] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:00 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:01.592808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a5eae625-38a2-43b5-b09a-3f633408a113 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:01.593423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a5eae625-38a2-43b5-b09a-3f633408a113 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:01.653151 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a5eae625-38a2-43b5-b09a-3f633408a113 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:01.660907 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a5eae625-38a2-43b5-b09a-3f633408a113 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1089 microversion: 2.1 time: 0.073459 Oct 25 04:27:01.661485 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3962/8045] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:01 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:02.684626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7c954ce5-3fc3-4ca1-977e-43431ff9ae02 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:02.685236 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7c954ce5-3fc3-4ca1-977e-43431ff9ae02 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:02.740199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7c954ce5-3fc3-4ca1-977e-43431ff9ae02 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:02.747235 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7c954ce5-3fc3-4ca1-977e-43431ff9ae02 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1089 microversion: 2.1 time: 0.066757 Oct 25 04:27:02.747805 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4084/8046] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:02 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:03.771307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6b5b32f3-d7d5-4e62-97f4-99fb294145e2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:03.771916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6b5b32f3-d7d5-4e62-97f4-99fb294145e2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:03.826097 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6b5b32f3-d7d5-4e62-97f4-99fb294145e2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:03.833893 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6b5b32f3-d7d5-4e62-97f4-99fb294145e2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1089 microversion: 2.1 time: 0.066463 Oct 25 04:27:03.834487 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3963/8047] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:03 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:04.858063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:04.858749 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:04.866156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:04.866642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:04.867077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:04.867763 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:04.868219 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:04.868647 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:04.930054 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:04.939046 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8cf79a2-4f81-4c99-854a-8c4edad0a1ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1139 microversion: 2.1 time: 0.085516 Oct 25 04:27:04.939619 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4085/8048] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:04 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:05.963117 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:05.964016 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:05.972549 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:05.973083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:05.973735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:05.974688 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:05.975312 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:05.975878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:06.048360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:06.056156 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6629cd9d-30f0-4eca-8cac-152bc6e6f2f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1205 microversion: 2.1 time: 0.097154 Oct 25 04:27:06.056742 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3964/8049] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:05 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:07.080653 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:07.082023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:07.088676 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:07.089174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:07.089621 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:07.090365 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:07.090829 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:07.091262 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:07.255157 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ee7198c1-9c15-4e43-a8d9-b87f147cb5fa req-cd78c3cc-8a59-442f-9c7d-ea8b6d4c45c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd", "tag": "96833c76-f7a8-4a81-a37d-03a46a529782"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:27:07.267553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ee7198c1-9c15-4e43-a8d9-b87f147cb5fa req-cd78c3cc-8a59-442f-9c7d-ea8b6d4c45c7 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:07.268313 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ee7198c1-9c15-4e43-a8d9-b87f147cb5fa req-cd78c3cc-8a59-442f-9c7d-ea8b6d4c45c7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:07.268963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ee7198c1-9c15-4e43-a8d9-b87f147cb5fa req-cd78c3cc-8a59-442f-9c7d-ea8b6d4c45c7 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:07.282044 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ee7198c1-9c15-4e43-a8d9-b87f147cb5fa req-cd78c3cc-8a59-442f-9c7d-ea8b6d4c45c7 service nova] Creating event network-changed:96833c76-f7a8-4a81-a37d-03a46a529782 for instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd on n-h1-862355-1 Oct 25 04:27:07.286889 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:07.290127 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ee7198c1-9c15-4e43-a8d9-b87f147cb5fa req-cd78c3cc-8a59-442f-9c7d-ea8b6d4c45c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130917 Oct 25 04:27:07.291295 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3965/8050] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:27:07.296152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-081ef741-5f54-4119-9efa-98848a321a3d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1271 microversion: 2.1 time: 0.219399 Oct 25 04:27:07.296748 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4086/8051] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:07 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:08.324792 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:08.325533 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:08.334808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:08.335311 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:08.335992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:08.336724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:08.337198 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:08.337641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:08.484930 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:08.492861 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4f56d31f-d479-439b-8c8a-54cfb62aeda4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1271 microversion: 2.1 time: 0.175711 Oct 25 04:27:08.493529 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3966/8052] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:08 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:09.517231 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:09.517921 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:09.524795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:09.525290 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:09.525828 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:09.526532 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:09.526995 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:09.527424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:09.662208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:09.670654 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-60c8ce96-5819-4ed8-902a-bb2d324ca360 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1271 microversion: 2.1 time: 0.156830 Oct 25 04:27:09.671426 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4087/8053] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:09 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:10.694983 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:10.695620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:10.698553 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:27:10.704548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:10.705079 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:10.705540 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:10.706310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:10.706786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:10.707226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:10.849297 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:10.857142 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-71e913d6-f224-4a82-b9fa-8861b28f7a5c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1271 microversion: 2.1 time: 0.166377 Oct 25 04:27:10.858375 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3967/8054] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:10 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:11.880546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:11.881114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:11.888023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:11.889206 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:11.889807 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:11.890473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:11.890933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:11.891358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:12.027997 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:12.035712 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9b3928a4-ab1d-4cb0-9cec-f78447272879 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.159134 Oct 25 04:27:12.036316 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4088/8055] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:11 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:13.059001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:13.059640 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:13.067077 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:13.067580 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:13.068037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:13.068751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:13.069227 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:13.069670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:13.206693 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:13.214559 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e23a37a9-ec16-445a-8e52-dbb9b756ca36 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.159831 Oct 25 04:27:13.215155 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3968/8056] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:13 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:14.237550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:14.238190 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:14.240008 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=4 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:27:14.246058 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:14.246542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:14.246975 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:14.247665 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:14.248134 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:14.248542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:14.381982 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:14.390286 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd283615-10af-4284-a42e-c6cf96faa86a tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.156004 Oct 25 04:27:14.390962 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4089/8057] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:14 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:15.412740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:15.413405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:15.415377 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=10 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:27:15.421351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:15.421870 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:15.422329 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:15.423036 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:15.423511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:15.423952 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:15.560912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:15.568809 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-70f3b564-f555-4a1d-9a2d-887859d1188c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.160107 Oct 25 04:27:15.569492 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3969/8058] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:15 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:16.594961 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:16.595587 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:16.602522 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:16.603013 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:16.603459 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:16.604156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:16.604628 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:16.605061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:16.743790 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:16.751494 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-dfbcaeb0-3f3d-4c19-848f-f9b7c6950fd3 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.161219 Oct 25 04:27:16.752072 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4090/8059] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:16 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:17.774466 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:17.775024 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:17.781961 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:17.782463 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:17.782913 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:17.783620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:17.784091 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:17.784532 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:17.917226 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:17.925044 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-0bd6e74e-79db-479c-9c12-d829a8ba45b7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.154675 Oct 25 04:27:17.925629 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3970/8060] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:17 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:18.948446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:18.949068 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:18.956332 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:18.956824 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:18.957272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:18.958005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:18.958550 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:18.958983 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:19.093347 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:19.102081 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd052bdc-3033-4391-b110-520947ca900d tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.157485 Oct 25 04:27:19.102672 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4091/8061] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:18 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:20.126421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:20.127061 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:20.134141 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:20.134645 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:20.135101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:20.135851 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:20.136327 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:20.136772 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:20.272801 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:20.280668 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5a1dfa6c-1a16-42c3-aad6-061cccdec029 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.158935 Oct 25 04:27:20.281814 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3971/8062] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:20 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:21.180948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-dcc1316e-cd2a-47e5-a2d3-c2221e865779 req-bb0d1a84-32f9-4455-8788-c2771914712b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd", "name": "network-vif-plugged", "status": "completed", "tag": "96833c76-f7a8-4a81-a37d-03a46a529782"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:27:21.191651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcc1316e-cd2a-47e5-a2d3-c2221e865779 req-bb0d1a84-32f9-4455-8788-c2771914712b service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:21.192002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcc1316e-cd2a-47e5-a2d3-c2221e865779 req-bb0d1a84-32f9-4455-8788-c2771914712b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:21.192437 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-dcc1316e-cd2a-47e5-a2d3-c2221e865779 req-bb0d1a84-32f9-4455-8788-c2771914712b service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:21.204152 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-dcc1316e-cd2a-47e5-a2d3-c2221e865779 req-bb0d1a84-32f9-4455-8788-c2771914712b service nova] Creating event network-vif-plugged:96833c76-f7a8-4a81-a37d-03a46a529782 for instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd on n-h1-862355-1 Oct 25 04:27:21.209178 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-dcc1316e-cd2a-47e5-a2d3-c2221e865779 req-bb0d1a84-32f9-4455-8788-c2771914712b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085237 Oct 25 04:27:21.209798 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4092/8063] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:27:21.304583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:21.305175 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:21.312530 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:21.313156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:21.313607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:21.314373 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:21.314852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:21.315304 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:21.463879 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:21.472302 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-16df1f64-c529-4bbb-84bb-fa322375e78e tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.171784 Oct 25 04:27:21.472889 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3972/8064] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:21 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:22.496722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:22.497419 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:22.503806 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:22.504287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:22.504721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:22.505400 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:22.505891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:22.506344 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:22.642696 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:22.650523 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-abbe9268-693c-488e-8033-0fe39f5641d2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1259 microversion: 2.1 time: 0.158956 Oct 25 04:27:22.651102 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4093/8065] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:22 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:23.673993 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:23.674629 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:23.681502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:23.682303 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:23.682787 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:23.683492 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:23.683963 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:23.684404 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:23.819759 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:23.827565 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-eb4d2110-d0b8-4862-9c84-960ce7febfff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1443 microversion: 2.1 time: 0.158321 Oct 25 04:27:23.828787 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3973/8066] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:23 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:23.851007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:27:23.851627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:27:23.858492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:23.858969 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:23.860023 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:23.860716 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:23.861172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:23.861597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:23.996378 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:27:24.005278 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e7a48e99-0864-455b-a710-ad1db0864cbe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1443 microversion: 2.1 time: 0.158111 Oct 25 04:27:24.005878 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4094/8067] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:27:23 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:27:25.644114 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-089ad5f4-ed58-4da7-9ed8-6a07abc3d675 req-7787a014-ee53-459c-91e0-3af3fe125a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd", "tag": "96833c76-f7a8-4a81-a37d-03a46a529782"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:27:25.654410 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-089ad5f4-ed58-4da7-9ed8-6a07abc3d675 req-7787a014-ee53-459c-91e0-3af3fe125a4e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:27:25.654903 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-089ad5f4-ed58-4da7-9ed8-6a07abc3d675 req-7787a014-ee53-459c-91e0-3af3fe125a4e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:27:25.655348 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-089ad5f4-ed58-4da7-9ed8-6a07abc3d675 req-7787a014-ee53-459c-91e0-3af3fe125a4e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:27:25.670382 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-089ad5f4-ed58-4da7-9ed8-6a07abc3d675 req-7787a014-ee53-459c-91e0-3af3fe125a4e service nova] Creating event network-changed:96833c76-f7a8-4a81-a37d-03a46a529782 for instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd on n-h1-862355-1 Oct 25 04:27:25.676095 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-089ad5f4-ed58-4da7-9ed8-6a07abc3d675 req-7787a014-ee53-459c-91e0-3af3fe125a4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035800 Oct 25 04:27:25.676712 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3974/8068] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:29:22.767687 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:29:22.768874 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97c68897-50e2-44da-913f-d91cfc1c6184] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:29:22.769474 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=28 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:22.770264 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=56 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:22.771422 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:29:22.771559 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:29:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd/action (ip 10.222.0.36) !!! Oct 25 04:29:22.777903 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:29:22.778445 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:22.788388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:22.788905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:22.789352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:22.790100 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:22.790561 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:22.790992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:22.814911 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lazy-loading 'flavor' on Instance uuid b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:29:22.888448 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-1f194e21-1997-4afb-b2e1-f4a1f32594f9 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd/action" status: 202 len: 0 microversion: 2.1 time: 0.123193 Oct 25 04:29:22.889044 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4095/8069] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:29:22 2022] POST /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:29:22.896201 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:29:22.897049 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:29:22.897668 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:22.898467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=60 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:22.904777 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:22.905571 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:22.913758 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:22.914256 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:22.914719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:22.915469 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:22.915932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:22.916369 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:23.054375 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:23.063539 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-94747627-8c26-4f53-8c04-e177b8c580ed tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.169230 Oct 25 04:29:23.064119 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3975/8070] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:22 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:24.092308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:24.093007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:24.101413 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:24.101927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:24.102363 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:24.103046 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:24.103503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:24.103928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:24.108135 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] [97c68897-50e2-44da-913f-d91cfc1c6184] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46602. Oct 25 04:29:24.112172 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46600. Oct 25 04:29:24.285604 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:24.293405 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-4be91e7d-b021-46e8-a658-419580ad411c tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.209964 Oct 25 04:29:24.294012 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4096/8071] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:24 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:25.318394 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:25.318992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:25.329845 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:25.330346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:25.330799 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:25.331508 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:25.331977 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:25.332417 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:25.336310 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46610. Oct 25 04:29:25.337022 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46612. Oct 25 04:29:25.470270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:25.478080 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-16c5ecf1-8516-44d0-82f8-09287fd2d801 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.163714 Oct 25 04:29:25.478657 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3976/8072] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:25 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:26.501908 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:26.502562 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:26.509310 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:26.509838 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:26.510283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:26.510979 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:26.511438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:26.511869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:26.648947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:26.656933 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-62f1a054-efc7-4f34-a5c0-690df8ba1747 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.159070 Oct 25 04:29:26.657518 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4097/8073] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:26 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:27.681596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:27.682279 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:27.690511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:27.691202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:27.691657 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:27.692451 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:27.693030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:27.693927 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:27.826524 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:27.835152 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2b5fa311-e46d-4606-9bb8-c81f992f88ec tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.158090 Oct 25 04:29:27.835734 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3977/8074] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:27 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:28.859805 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:28.860462 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:28.867350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:28.867845 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:28.868288 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:28.868996 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:28.869460 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:28.869922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:29.003283 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:29.012133 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-63623e5f-a77a-4afc-9aa3-86612cacf639 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.156898 Oct 25 04:29:29.012742 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4098/8075] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:28 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:30.037416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:30.038302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:30.046980 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:30.047486 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:30.047942 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:30.048685 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:30.049249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:30.049628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:30.182607 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:30.190807 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ec02f1ef-0a14-47ed-9e15-c89e7dc73cdc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.157602 Oct 25 04:29:30.191399 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3978/8076] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:30 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:31.214144 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:31.214771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:31.222124 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:31.223760 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:31.224208 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:31.224910 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:31.225371 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:31.225839 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:31.356717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:31.364770 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5e362436-1e7d-46ea-9aec-9a4ccdaba804 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.154589 Oct 25 04:29:31.365367 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4099/8077] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:31 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:32.389053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:32.390201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:32.397189 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:32.397702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:32.398186 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:32.398893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:32.399363 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:32.399804 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:32.535808 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:32.543631 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-e3ea1a62-1740-410c-9dca-fdc16b82c1ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.158628 Oct 25 04:29:32.544215 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3979/8078] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:32 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:33.567627 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:33.568237 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:33.574799 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:33.575279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:33.575714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:33.576405 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:33.576863 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:33.577322 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:33.714067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:33.722584 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-28de775f-599c-4e6f-8027-11b9f6b37cb2 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.158860 Oct 25 04:29:33.723173 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4100/8079] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:33 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:34.746362 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:34.747002 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:34.754185 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:34.754690 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:34.755146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:34.755860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:34.756338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:34.756780 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:34.892078 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:34.899925 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3e77a546-f8e6-4122-a8a8-bec082d59887 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.157573 Oct 25 04:29:34.900513 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3980/8080] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:34 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:35.923880 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:35.924499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:35.931340 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:35.931817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:35.932252 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:35.933207 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:35.933662 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:35.934119 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:36.072379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:36.080306 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bc5f2388-f65d-42a5-83f8-5ac0471433fe tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.160398 Oct 25 04:29:36.080887 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4101/8081] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:35 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:37.105212 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:37.105882 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:37.113035 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:37.113803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:37.114281 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:37.115628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:37.116105 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:37.116555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:37.264964 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:37.274029 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-860bea9b-fc92-4e03-89eb-2d82effeca52 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.172787 Oct 25 04:29:37.274626 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3981/8082] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:37 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:37.718771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-91954402-41fb-47e0-ab23-26a63f16b3ef req-8f72ecba-6e60-414f-a201-6cf0c3ca9c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd", "name": "network-vif-unplugged", "status": "completed", "tag": "96833c76-f7a8-4a81-a37d-03a46a529782"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:29:37.730455 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-91954402-41fb-47e0-ab23-26a63f16b3ef req-8f72ecba-6e60-414f-a201-6cf0c3ca9c82 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:37.730958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-91954402-41fb-47e0-ab23-26a63f16b3ef req-8f72ecba-6e60-414f-a201-6cf0c3ca9c82 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:37.731383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-91954402-41fb-47e0-ab23-26a63f16b3ef req-8f72ecba-6e60-414f-a201-6cf0c3ca9c82 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:37.742791 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-91954402-41fb-47e0-ab23-26a63f16b3ef req-8f72ecba-6e60-414f-a201-6cf0c3ca9c82 service nova] Creating event network-vif-unplugged:96833c76-f7a8-4a81-a37d-03a46a529782 for instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd on n-h1-862355-1 Oct 25 04:29:37.747724 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-91954402-41fb-47e0-ab23-26a63f16b3ef req-8f72ecba-6e60-414f-a201-6cf0c3ca9c82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032641 Oct 25 04:29:37.749062 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4102/8083] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:29:38.298374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:38.299001 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:38.306555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:38.307046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:38.307496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:38.308446 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:38.308909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:38.309379 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:38.440529 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:38.448338 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c93afeb5-085b-4e33-9d26-d24d2e07c332 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1509 microversion: 2.1 time: 0.153963 Oct 25 04:29:38.448916 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3982/8084] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:38 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:38.471397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:29:38.472091 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:38.478779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:38.479265 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:38.479734 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:38.480425 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:38.480891 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:38.481319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:38.511256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120562) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 25 04:29:38.577886 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-304d6e53-dab3-478c-a688-3d40ee9a4bff tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "POST /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd/action" status: 202 len: 0 microversion: 2.1 time: 0.110683 Oct 25 04:29:38.578431 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4103/8085] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:29:38 2022] POST /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:29:38.597098 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:38.597955 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:38.606029 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:38.606527 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:38.606973 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:38.607682 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:38.608149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:38.608584 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:38.755498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:38.765531 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-89fedfdc-594e-4e64-a511-9ee3c5990b63 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1517 microversion: 2.1 time: 0.182733 Oct 25 04:29:38.774349 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3983/8086] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:38 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:39.791287 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:39.791915 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:39.797956 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:39.798449 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:39.798893 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:39.799595 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:39.800056 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:39.800499 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:39.937036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:39.946112 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9812fa5d-5c61-409f-a779-029237be3bb7 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1519 microversion: 2.1 time: 0.159695 Oct 25 04:29:39.946700 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4104/8087] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:39 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:40.969555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:40.970228 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:40.977402 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:40.977932 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:40.978388 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:40.979096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:40.979568 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:40.980013 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:41.119812 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:41.127767 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5933a686-60c4-43aa-b76c-b469ed4d58de tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1519 microversion: 2.1 time: 0.162179 Oct 25 04:29:41.128341 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3984/8088] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:40 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:42.152057 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:42.152677 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:42.159678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:42.160174 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:42.160619 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:42.161319 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:42.161928 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:42.162417 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:42.302721 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:42.311287 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c4e63b7d-7359-481f-b4b9-33648a09a1c1 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1519 microversion: 2.1 time: 0.163145 Oct 25 04:29:42.311890 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4105/8089] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:42 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:43.335985 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:43.336624 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:43.343633 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:43.344132 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:43.344583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:43.345294 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:43.345794 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:43.346260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:43.481583 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:43.490094 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f0524f1e-e397-4d0c-b786-b73ce854cf14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1519 microversion: 2.1 time: 0.157694 Oct 25 04:29:43.490685 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3985/8090] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:43 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:44.514280 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:44.514899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:44.522947 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:44.523424 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:44.523867 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:44.524569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:44.525029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:44.525496 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:44.659411 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:44.667663 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-8ef6ec08-c501-4b86-9041-78a85eaf60a5 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.157241 Oct 25 04:29:44.668254 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4106/8091] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:44 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:45.691592 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:45.692224 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:45.699255 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:45.699750 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:45.700201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:45.700909 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:45.701397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:45.701852 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:45.838856 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:45.846769 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b8df461c-6414-4db6-a5c7-8ede6b1a0eeb tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.159127 Oct 25 04:29:45.847351 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3986/8092] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:45 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:46.871132 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:46.871751 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:46.878618 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:46.879102 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:46.879541 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:46.880833 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:46.881239 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:46.881668 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:47.012574 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:47.020474 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45821741-d45c-43ef-a85a-4e444e5a1c03 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.153363 Oct 25 04:29:47.022028 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4107/8093] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:46 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:48.044409 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:48.045042 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:48.052062 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:48.052634 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:48.053086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:48.053833 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:48.054310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:48.054756 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:48.188291 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:48.196861 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-b0df46b2-0c38-4f48-8d9d-cb0406bcdb29 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.156428 Oct 25 04:29:48.197458 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3987/8094] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:48 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:49.220857 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:49.221473 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:49.229066 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:49.229557 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:49.230035 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:49.230726 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:49.231184 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:49.231614 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:49.368279 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:49.376096 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-437a2d27-b9ca-494e-8883-20bbb805cbd6 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.159127 Oct 25 04:29:49.376690 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4108/8095] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:49 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:50.399797 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:50.400346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:50.407340 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:50.407844 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:50.408306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:50.409020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:50.409497 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:50.409969 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:50.540616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:50.548509 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-ed72baa3-7e43-4022-ba28-853ee7b9e4d4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.152865 Oct 25 04:29:50.549099 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3988/8096] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:50 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:51.573446 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:51.574304 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:51.582225 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:51.582970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:51.583781 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:51.584536 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:51.585197 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:51.586004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:51.593018 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:51.737077 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:51.747486 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-d1ffc4fa-adb6-46bb-8e8e-3bd8dba9b61b tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.178082 Oct 25 04:29:51.748085 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4109/8097] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:51 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:52.773498 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:52.774149 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:52.780979 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:52.781471 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:52.781941 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:52.782641 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:52.783106 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:52.783542 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:52.917473 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:52.919708 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=89 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:52.926730 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c23dd4ad-78e9-4d79-a97d-7332f2e98c65 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.157789 Oct 25 04:29:52.927317 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3989/8098] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:52 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:53.859179 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [req-f1d803dc-3297-4c99-ae18-e0ca0e77589e req-4765af60-f504-442c-a6a1-a86b990cbb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd", "name": "network-vif-plugged", "status": "completed", "tag": "96833c76-f7a8-4a81-a37d-03a46a529782"}]} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:29:53.865177 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:53.871542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f1d803dc-3297-4c99-ae18-e0ca0e77589e req-4765af60-f504-442c-a6a1-a86b990cbb83 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:53.871980 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f1d803dc-3297-4c99-ae18-e0ca0e77589e req-4765af60-f504-442c-a6a1-a86b990cbb83 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:53.872416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [req-f1d803dc-3297-4c99-ae18-e0ca0e77589e req-4765af60-f504-442c-a6a1-a86b990cbb83 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:53.883840 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.compute.server_external_events [req-f1d803dc-3297-4c99-ae18-e0ca0e77589e req-4765af60-f504-442c-a6a1-a86b990cbb83 service nova] Creating event network-vif-plugged:96833c76-f7a8-4a81-a37d-03a46a529782 for instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd on n-h1-862355-1 Oct 25 04:29:53.888907 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [req-f1d803dc-3297-4c99-ae18-e0ca0e77589e req-4765af60-f504-442c-a6a1-a86b990cbb83 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033611 Oct 25 04:29:53.889706 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4110/8099] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:29:53.951481 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:53.952116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:53.955030 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=31 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:29:53.961246 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:53.961698 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:53.962165 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:53.962933 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:53.963414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:53.963865 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:54.165135 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:54.173121 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-858c267f-4e4e-4fef-80cd-105fcb05e410 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.225868 Oct 25 04:29:54.173940 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3990/8100] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:53 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:55.199093 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:55.199792 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:55.205957 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:55.206451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:55.206890 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:55.207586 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:55.208063 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:55.208471 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:55.348746 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:55.358488 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7d9f964b-e707-4fb3-a443-f82647013827 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1575 microversion: 2.1 time: 0.165360 Oct 25 04:29:55.359082 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4111/8101] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:55 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:29:56.383620 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:29:56.384152 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:29:56.390541 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:56.391044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:56.391496 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:56.392202 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:29:56.392674 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:29:56.393119 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:29:56.525290 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:29:56.533131 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2e455b3d-921d-4559-a2ab-7f33c629cd64 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1562 microversion: 2.1 time: 0.154351 Oct 25 04:29:56.533807 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3991/8102] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:29:56 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:10.516643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:10.518103 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=12 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:10.520335 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:31:10.520488 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd (ip 10.222.0.36) !!! Oct 25 04:31:10.524173 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-d8493e99-4dd1-40df-9ae4-48c0bd4a31b8 req-813605de-dedc-4891-8b14-3424d22762e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd", "tag": "96833c76-f7a8-4a81-a37d-03a46a529782"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:31:10.525892 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:10.526569 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:10.536310 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=3 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:10.537318 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=13 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:10.538528 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:31:10.539655 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 25 04:31:10.541859 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:31:10.542598 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 25 04:31:10.543330 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:31:10.543454 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 25 04:31:10.546438 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d8493e99-4dd1-40df-9ae4-48c0bd4a31b8 req-813605de-dedc-4891-8b14-3424d22762e8 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:10.547678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d8493e99-4dd1-40df-9ae4-48c0bd4a31b8 req-813605de-dedc-4891-8b14-3424d22762e8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:10.547678 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-d8493e99-4dd1-40df-9ae4-48c0bd4a31b8 req-813605de-dedc-4891-8b14-3424d22762e8 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:10.552487 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:10.552990 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:10.553431 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:10.555816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:10.558009 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:10.558933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:10.573895 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-d8493e99-4dd1-40df-9ae4-48c0bd4a31b8 req-813605de-dedc-4891-8b14-3424d22762e8 service nova] Creating event network-changed:96833c76-f7a8-4a81-a37d-03a46a529782 for instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd on n-h1-862355-1 Oct 25 04:31:10.583640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-d8493e99-4dd1-40df-9ae4-48c0bd4a31b8 req-813605de-dedc-4891-8b14-3424d22762e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066722 Oct 25 04:31:10.584885 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3992/8103] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:31:10.597432 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:31:10.692963 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-80f7868e-f829-495f-9737-5208e60de1bc tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 204 len: 0 microversion: 2.1 time: 0.178222 Oct 25 04:31:10.695696 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4112/8104] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:31:10 2022] DELETE /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:31:10.704127 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:10.705136 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:10.713068 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:10.713588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:10.714086 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:10.714863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:10.715341 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:10.715786 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:10.868818 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:10.876928 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-8e9f27a5-bf6b-4955-a57a-1bca4762966f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.178039 Oct 25 04:31:10.878317 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3993/8105] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:10 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:11.901268 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:11.902002 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:11.909741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:11.910235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:11.910671 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:11.911370 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:11.911825 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:11.912259 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:12.055797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:12.065531 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-167f82af-9d0d-41e2-bb61-8f083891f6f0 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1568 microversion: 2.1 time: 0.167941 Oct 25 04:31:12.067039 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4113/8106] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:11 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:12.898367 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-f454e70a-48c1-4213-9f0b-99995517d45c req-bc28ed3b-3300-4348-9f0d-16880fc8b1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd", "name": "network-vif-deleted", "tag": "96833c76-f7a8-4a81-a37d-03a46a529782"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:31:12.910374 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f454e70a-48c1-4213-9f0b-99995517d45c req-bc28ed3b-3300-4348-9f0d-16880fc8b1ec service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:12.911139 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f454e70a-48c1-4213-9f0b-99995517d45c req-bc28ed3b-3300-4348-9f0d-16880fc8b1ec service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:12.911590 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-f454e70a-48c1-4213-9f0b-99995517d45c req-bc28ed3b-3300-4348-9f0d-16880fc8b1ec service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:12.926666 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-f454e70a-48c1-4213-9f0b-99995517d45c req-bc28ed3b-3300-4348-9f0d-16880fc8b1ec service nova] Creating event network-vif-deleted:96833c76-f7a8-4a81-a37d-03a46a529782 for instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd on n-h1-862355-1 Oct 25 04:31:12.931730 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-f454e70a-48c1-4213-9f0b-99995517d45c req-bc28ed3b-3300-4348-9f0d-16880fc8b1ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037042 Oct 25 04:31:12.932457 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3994/8107] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:31:13.091715 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:13.092334 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:13.100048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:13.100533 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:13.100970 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:13.101695 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:13.102159 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:13.102599 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:13.171784 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:13.181322 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-b9c9921c-5336-4303-8da9-af78c084b991 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1220 microversion: 2.1 time: 0.093449 Oct 25 04:31:13.182583 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4114/8108] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:13 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:14.207129 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:14.207997 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:14.214289 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:14.214790 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:14.215242 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:14.215950 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:14.216421 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:14.216860 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:14.286321 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:14.294466 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-23787cca-d79a-450d-bcff-6e2e2e5089ac tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1220 microversion: 2.1 time: 0.092862 Oct 25 04:31:14.295478 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3995/8109] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:14 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:15.319398 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:15.320106 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:15.327256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:15.327823 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:15.328357 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:15.329116 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:15.329643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:15.330160 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:15.395043 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:15.402932 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-45d5ad72-bae1-45fe-a5c9-9098249d0da4 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1220 microversion: 2.1 time: 0.087905 Oct 25 04:31:15.403598 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4115/8110] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:15 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:31:16.428032 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:16.428581 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:16.435740 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:16.436243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:16.436695 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:16.437406 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:16.437912 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:16.438358 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:16.500806 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:16.508825 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4d336a48-9d95-4a29-821c-f85a53fa2165 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1220 microversion: 2.1 time: 0.085484 Oct 25 04:31:16.509616 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3996/8111] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:16 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:17.532335 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:17.533080 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:17.540795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:17.541272 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:17.541731 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:17.542434 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:17.543010 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:17.543631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:17.581722 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:17.582188 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:17.582821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:17.583273 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lazy-loading 'fault' on Instance uuid b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:31:17.632468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a10a72d1454fd59e0c8b808c8088fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b85b81eb37444c78028481f155a31ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:17.640268 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-46929dbc-de96-475e-ba42-35f78f9a80e8 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 200 len: 1179 microversion: 2.1 time: 0.112132 Oct 25 04:31:17.641128 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4116/8112] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:17 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 1179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:18.665547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:18.666442 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] [instance: b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:18.673372 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:18.673914 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:18.675046 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:18.675775 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:18.676249 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:18.676691 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:18.690594 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] HTTP exception thrown: Instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd could not be found. Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Request method failure captured: Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd HTTP/1.1 Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2RfBk7aiGTGQPSS_BMUBaXLVXwUqkrPZJEXE4ycKjfAnQYOTABrakKD6NWs-3a43j9GvNhMn6b9pW-wVRzF6OcdHKuY2qtB7lIhfWr_FvM4X0grCdDtQ6k92kgPf_AA3XYL2oSQ1MWUP9VVo3F-574beSyPCIgi7h6E-lNyoNUG-tk Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 4b85b81eb37444c78028481f155a31ae Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestShelveInstance-1113575788 Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b85b81eb37444c78028481f155a31ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b85b81eb37444c78028481f155a31ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b85b81eb37444c78028481f155a31ae", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b85b81eb37444c78028481f155a31ae"}]}] Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestShelveInstance-1113575788 Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 4b85b81eb37444c78028481f155a31ae Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestShelveInstance-1113575788 Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestShelveInstance-1113575788-project Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: d6a10a72d1454fd59e0c8b808c8088fd Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestShelveInstance-1113575788-project Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd could not be found. Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': 'b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd'} Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd could not be found. Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd could not be found. Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:31:18.692299 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd could not be found. Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Returning 404 to user: Instance b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-5912c96a-7a13-4228-861b-3d8d212bc96f tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd" status: 404 len: 111 microversion: 2.1 time: 0.032156 Oct 25 04:31:18.697479 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3997/8113] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:18 2022] GET /compute/v2.1/servers/b529ecb4-5806-4bb0-8aa2-e5b50d2f96dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:31:18.859762 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-3372b3a8-8175-46d8-aade-a26d8235be14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] Calling method '.version_select at 0x7efd3204d820>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:18.891566 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-3372b3a8-8175-46d8-aade-a26d8235be14 tempest-TestShelveInstance-1113575788 tempest-TestShelveInstance-1113575788-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1332401054" status: 202 len: 0 microversion: 2.1 time: 0.036781 Oct 25 04:31:18.897201 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4117/8114] 10.222.0.36 () {58 vars in 1254 bytes} [Tue Oct 25 04:31:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1332401054 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 25 04:31:36.435664 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=12 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:36.436493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=24 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:36.640563 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6106a9de-b3bd-45a5-aa66-a6a12a9e7a07 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Action: 'create', calling method: .version_select at 0x7efd3b81e5e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1482800827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDrJyLg8wGKG2cpg87xK+vE7JiW03JdJ61Azd0mBMeuO/KK0xbiwxgxyRKNlsJv62+sQvWaixZhBZZYOestkEu2PKpL2tQkgTasmozRDbSAuXA17JrJBJ80X7KKy8cYfQ=="}} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:31:36.658299 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6106a9de-b3bd-45a5-aa66-a6a12a9e7a07 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Getting quotas for project 8e03e95fb4df4869aed86b5b1de2f545. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:31:36.665360 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.quota [None req-6106a9de-b3bd-45a5-aa66-a6a12a9e7a07 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Getting quotas for user ffccdebfc41048b7a2e8027cbb9b8305 and project 8e03e95fb4df4869aed86b5b1de2f545. Resources: {'key_pairs'} {{(pid=120563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:31:36.696424 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6106a9de-b3bd-45a5-aa66-a6a12a9e7a07 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.266457 Oct 25 04:31:36.697044 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3998/8115] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Oct 25 04:31:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:31:37.679048 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-257154507", "imageRef": "aaf4b9eb-e26e-4d56-8bee-d6f868921bec", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1482800827", "security_groups": [{"name": "tempest-secgroup-smoke-1658992817"}], "networks": [{"uuid": "39640a5f-e766-43d8-bdaf-4306147d363f"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:31:37.688974 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:37.689635 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:37.792704 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] validate_networks() for [('39640a5f-e766-43d8-bdaf-4306147d363f', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:31:38.295475 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:31:38.295901 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:31:38.296379 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:31:38.296797 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:31:38.297218 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:31:38.306666 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:38.307156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:38.307600 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:38.308328 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:38.309038 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:38.309466 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:38.326645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Getting quotas for project 8e03e95fb4df4869aed86b5b1de2f545. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:31:38.333862 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Getting quotas for user ffccdebfc41048b7a2e8027cbb9b8305 and project 8e03e95fb4df4869aed86b5b1de2f545. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:31:38.346089 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:31:38.348512 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aaf4b9eb-e26e-4d56-8bee-d6f868921bec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:31:38.397118 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ad1f9fd0-0052-4a32-8462-87b4523f7779 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722059 Oct 25 04:31:38.397983 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4118/8116] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:31:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 25 04:31:38.410371 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6596b518-600d-4f8f-ab32-ee302b655340 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:38.411006 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-6596b518-600d-4f8f-ab32-ee302b655340 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:38.467191 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-6596b518-600d-4f8f-ab32-ee302b655340 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:38.474759 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6596b518-600d-4f8f-ab32-ee302b655340 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1248 microversion: 2.1 time: 0.069708 Oct 25 04:31:38.475369 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 3999/8117] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:38 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1248 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:39.499321 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-88551d3d-e508-45b5-9742-e8cbb710386b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:39.500848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-88551d3d-e508-45b5-9742-e8cbb710386b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:39.555822 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-88551d3d-e508-45b5-9742-e8cbb710386b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:39.563202 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-88551d3d-e508-45b5-9742-e8cbb710386b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1248 microversion: 2.1 time: 0.068546 Oct 25 04:31:39.563922 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4119/8118] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:39 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:40.588702 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-d79a4b5c-51a0-41ee-9555-334163fd7050 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:40.589366 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-d79a4b5c-51a0-41ee-9555-334163fd7050 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:40.743342 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-d79a4b5c-51a0-41ee-9555-334163fd7050 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:40.750314 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-d79a4b5c-51a0-41ee-9555-334163fd7050 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1248 microversion: 2.1 time: 0.166633 Oct 25 04:31:40.750885 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4000/8119] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:40 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1248 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:41.772870 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0889f709-4f4a-4354-83a7-587d8000ed64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:41.773736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0889f709-4f4a-4354-83a7-587d8000ed64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:41.838922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0889f709-4f4a-4354-83a7-587d8000ed64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:41.847231 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0889f709-4f4a-4354-83a7-587d8000ed64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1248 microversion: 2.1 time: 0.077705 Oct 25 04:31:41.847817 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4120/8120] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:41 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:42.871338 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:42.871968 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:42.879656 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:42.880162 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:42.880616 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:42.881324 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:42.881824 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:42.882270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:42.949815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:42.958204 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a240ddc4-e530-4a60-b062-7bb28b932102 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1252 microversion: 2.1 time: 0.090800 Oct 25 04:31:42.958788 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4001/8121] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:42 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1252 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:43.982323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:43.982948 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:43.990019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:43.990513 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:43.990954 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:43.991654 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:43.992112 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:43.992538 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:44.061478 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:44.070996 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-89c34bd2-1dd7-4252-8bc8-afa559633e7a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1306 microversion: 2.1 time: 0.091939 Oct 25 04:31:44.071649 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4121/8122] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:43 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:45.098172 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:45.099295 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:45.106848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:45.107349 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:45.107927 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:45.108643 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:45.109108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:45.109542 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:45.125835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-dfff4ced-5878-4944-b92a-8b326fef4f83 req-cf6506c7-9ca8-40a4-b6fe-205a9a34aa3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5558294-7938-4601-ac3c-a04490b1c8ef", "tag": "faeb767a-5c22-47fd-9d2d-866d693772b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:31:45.138490 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dfff4ced-5878-4944-b92a-8b326fef4f83 req-cf6506c7-9ca8-40a4-b6fe-205a9a34aa3a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:45.139059 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dfff4ced-5878-4944-b92a-8b326fef4f83 req-cf6506c7-9ca8-40a4-b6fe-205a9a34aa3a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:45.147636 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dfff4ced-5878-4944-b92a-8b326fef4f83 req-cf6506c7-9ca8-40a4-b6fe-205a9a34aa3a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:45.159974 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-dfff4ced-5878-4944-b92a-8b326fef4f83 req-cf6506c7-9ca8-40a4-b6fe-205a9a34aa3a service nova] Creating event network-changed:faeb767a-5c22-47fd-9d2d-866d693772b9 for instance d5558294-7938-4601-ac3c-a04490b1c8ef on n-h1-862355-1 Oct 25 04:31:45.165623 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-dfff4ced-5878-4944-b92a-8b326fef4f83 req-cf6506c7-9ca8-40a4-b6fe-205a9a34aa3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105072 Oct 25 04:31:45.166287 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4002/8123] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:31:45.337081 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:45.345036 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-9009ff51-b374-4dee-9e8d-20d26c8bcf5a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1374 microversion: 2.1 time: 0.253886 Oct 25 04:31:45.345911 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4122/8124] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:45 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1374 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:46.369815 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:46.370564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:46.377998 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:46.378502 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:46.378947 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:46.379648 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:46.380116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:46.380555 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:46.513254 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:46.521829 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4598a315-4f38-4745-9640-ad9119527dc6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1374 microversion: 2.1 time: 0.157153 Oct 25 04:31:46.522431 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4003/8125] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:46 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:47.545216 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:47.545905 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:47.553366 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:47.553888 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:47.554337 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:47.555041 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:47.555503 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:47.555933 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:47.687458 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:47.695803 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0ce67ccd-12cc-4f20-9e12-78b3bdeceb63 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1374 microversion: 2.1 time: 0.154593 Oct 25 04:31:47.696392 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4123/8126] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:47 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:48.718430 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:48.719058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:48.726288 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:48.726785 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:48.727234 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:48.727944 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:48.728415 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:48.728853 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:48.869771 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:48.878704 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-f51b81ae-20f4-45f2-b702-16eebccf738e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1374 microversion: 2.1 time: 0.164236 Oct 25 04:31:48.879313 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4004/8127] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:48 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:49.902930 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:49.903546 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:49.905383 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:49.912141 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:49.912631 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:49.913072 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:49.913795 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:49.914255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:49.914686 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:50.051022 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:50.059052 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-35aefb7f-a9ac-46c6-af63-663fe8f38797 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1374 microversion: 2.1 time: 0.159817 Oct 25 04:31:50.059635 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4124/8128] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:49 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:50.474588 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-ddcf20fa-54c3-4e45-aa55-2548f591f854 req-f204710b-3383-41d3-ae8b-20a6e0e5cb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5558294-7938-4601-ac3c-a04490b1c8ef", "name": "network-vif-plugged", "status": "completed", "tag": "faeb767a-5c22-47fd-9d2d-866d693772b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:31:50.485735 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ddcf20fa-54c3-4e45-aa55-2548f591f854 req-f204710b-3383-41d3-ae8b-20a6e0e5cb64 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:50.486547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ddcf20fa-54c3-4e45-aa55-2548f591f854 req-f204710b-3383-41d3-ae8b-20a6e0e5cb64 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:50.487020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-ddcf20fa-54c3-4e45-aa55-2548f591f854 req-f204710b-3383-41d3-ae8b-20a6e0e5cb64 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:50.498380 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-ddcf20fa-54c3-4e45-aa55-2548f591f854 req-f204710b-3383-41d3-ae8b-20a6e0e5cb64 service nova] Creating event network-vif-plugged:faeb767a-5c22-47fd-9d2d-866d693772b9 for instance d5558294-7938-4601-ac3c-a04490b1c8ef on n-h1-862355-1 Oct 25 04:31:50.503713 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-ddcf20fa-54c3-4e45-aa55-2548f591f854 req-f204710b-3383-41d3-ae8b-20a6e0e5cb64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033445 Oct 25 04:31:50.504327 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4005/8129] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:31:51.082803 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:51.083418 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:51.090451 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:51.090935 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:51.091375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:51.092060 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:51.092515 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:51.092939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:51.227844 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:51.235403 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-7c1b524c-0863-4a2c-985e-e0d5b96eb188 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1374 microversion: 2.1 time: 0.156649 Oct 25 04:31:51.235982 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4125/8130] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:51 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:52.255949 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=8 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:52.261015 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:52.261767 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:52.268423 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:52.268923 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:52.269384 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:52.270116 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:52.270596 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:52.271037 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:52.403058 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:52.411640 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-7f4545fc-ec14-49b7-85ea-44e2ddbeb4c4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1559 microversion: 2.1 time: 0.156648 Oct 25 04:31:52.412224 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4006/8131] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:52 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:52.434776 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:31:52.435396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:31:52.437234 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=10 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:31:52.443389 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:52.443873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:52.444316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:52.445007 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:52.445464 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:52.445924 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:52.577171 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:31:52.584847 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-6a7eb8e3-6a16-447e-9ad9-cc496194a002 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1559 microversion: 2.1 time: 0.154357 Oct 25 04:31:52.585434 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4126/8132] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:31:52 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:31:54.662893 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-aac0cdae-3733-48d7-a50d-58d9b3123898 req-9c54fe94-58be-4bc2-8cb8-367c6dfdc7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5558294-7938-4601-ac3c-a04490b1c8ef", "tag": "faeb767a-5c22-47fd-9d2d-866d693772b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:31:54.673170 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aac0cdae-3733-48d7-a50d-58d9b3123898 req-9c54fe94-58be-4bc2-8cb8-367c6dfdc7d0 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:31:54.674083 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aac0cdae-3733-48d7-a50d-58d9b3123898 req-9c54fe94-58be-4bc2-8cb8-367c6dfdc7d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:31:54.674525 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-aac0cdae-3733-48d7-a50d-58d9b3123898 req-9c54fe94-58be-4bc2-8cb8-367c6dfdc7d0 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:31:54.686209 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-aac0cdae-3733-48d7-a50d-58d9b3123898 req-9c54fe94-58be-4bc2-8cb8-367c6dfdc7d0 service nova] Creating event network-changed:faeb767a-5c22-47fd-9d2d-866d693772b9 for instance d5558294-7938-4601-ac3c-a04490b1c8ef on n-h1-862355-1 Oct 25 04:31:54.692181 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-aac0cdae-3733-48d7-a50d-58d9b3123898 req-9c54fe94-58be-4bc2-8cb8-367c6dfdc7d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033248 Oct 25 04:31:54.692799 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4007/8133] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:33:50.913911 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:33:50.915003 n-d-862355-1 devstack@n-api.service[120562]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97c68897-50e2-44da-913f-d91cfc1c6184] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 25 04:33:50.915556 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:33:50.916358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=38 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:33:50.917703 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 25 04:33:50.917877 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef/action (ip 10.222.0.36) !!! Oct 25 04:33:50.923158 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-902294878"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:33:50.925645 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:33:50.934248 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:33:50.934992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:33:50.935438 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:33:50.936136 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:33:50.936597 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:33:50.937028 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:33:51.134719 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-81f28d03-5f48-4d7d-9ae2-76b44c9bc9f6 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "POST /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef/action" status: 202 len: 0 microversion: 2.1 time: 0.223296 Oct 25 04:33:51.135375 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4127/8134] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:33:50 2022] POST /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 04:33:56.991924 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:33:56.992889 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 25 04:33:56.993515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:33:56.999376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=30 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:33:57.086670 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-233e737f-1ead-483e-b3ae-1c2fc1359900 req-480aa5bd-b468-4303-a8bc-9cf3925b22b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5558294-7938-4601-ac3c-a04490b1c8ef", "name": "network-vif-plugged", "status": "completed", "tag": "faeb767a-5c22-47fd-9d2d-866d693772b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:33:57.105039 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-233e737f-1ead-483e-b3ae-1c2fc1359900 req-480aa5bd-b468-4303-a8bc-9cf3925b22b5 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:33:57.105537 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-233e737f-1ead-483e-b3ae-1c2fc1359900 req-480aa5bd-b468-4303-a8bc-9cf3925b22b5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:33:57.106308 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-233e737f-1ead-483e-b3ae-1c2fc1359900 req-480aa5bd-b468-4303-a8bc-9cf3925b22b5 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:33:57.118720 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-233e737f-1ead-483e-b3ae-1c2fc1359900 req-480aa5bd-b468-4303-a8bc-9cf3925b22b5 service nova] Creating event network-vif-plugged:faeb767a-5c22-47fd-9d2d-866d693772b9 for instance d5558294-7938-4601-ac3c-a04490b1c8ef on n-h1-862355-1 Oct 25 04:33:57.124408 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-233e737f-1ead-483e-b3ae-1c2fc1359900 req-480aa5bd-b468-4303-a8bc-9cf3925b22b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135194 Oct 25 04:33:57.125750 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4008/8135] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:34:04.698931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:34:04.699755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:34:04.704756 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1852243480", "imageRef": "611f20ab-fd7c-4457-a425-b646d84c7948", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1482800827", "security_groups": [{"name": "tempest-secgroup-smoke-1658992817"}], "networks": [{"uuid": "39640a5f-e766-43d8-bdaf-4306147d363f"}]}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:34:04.732972 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] [97c68897-50e2-44da-913f-d91cfc1c6184] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47114. Oct 25 04:34:04.735423 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] [930098b1-545b-4b0b-8dcc-7fa5b0b94b37] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47112. Oct 25 04:34:04.822531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.network.neutron [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] validate_networks() for [('39640a5f-e766-43d8-bdaf-4306147d363f', None, None, None, None, None)] {{(pid=120562) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 25 04:34:05.200323 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Flavor limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 25 04:34:05.200755 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Image limits 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 25 04:34:05.201235 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Flavor pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 25 04:34:05.201651 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Image pref 0:0:0 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 25 04:34:05.202098 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.virt.hardware [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 25 04:34:05.211193 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:05.211678 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:05.212153 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:05.212886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:05.213352 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:05.213821 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:05.230882 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Getting quotas for project 8e03e95fb4df4869aed86b5b1de2f545. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 25 04:34:05.236256 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.quota [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Getting quotas for user ffccdebfc41048b7a2e8027cbb9b8305 and project 8e03e95fb4df4869aed86b5b1de2f545. Resources: {'ram', 'cores', 'instances'} {{(pid=120562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 25 04:34:05.250186 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Going to run 1 instances... {{(pid=120562) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 25 04:34:05.252681 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='611f20ab-fd7c-4457-a425-b646d84c7948',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 25 04:34:05.306838 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a8db576a-135a-411d-8d34-4b026d54987c tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.610025 Oct 25 04:34:05.307412 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4128/8136] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Oct 25 04:34:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 25 04:34:05.322807 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-788e46c8-949d-4bfa-aa29-ecd317717d46 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:05.324523 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-788e46c8-949d-4bfa-aa29-ecd317717d46 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:05.334587 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47126. Oct 25 04:34:05.342497 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47128. Oct 25 04:34:05.395841 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-788e46c8-949d-4bfa-aa29-ecd317717d46 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:05.405071 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-788e46c8-949d-4bfa-aa29-ecd317717d46 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1249 microversion: 2.1 time: 0.090065 Oct 25 04:34:05.405643 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4009/8137] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:05 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:06.428680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:06.429384 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:06.438540 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:06.439039 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:06.439492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:06.440202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:06.440690 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:06.441108 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:06.519143 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:06.532024 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c9454381-37c6-4ca3-aeb1-5934bbbafd37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1307 microversion: 2.1 time: 0.107229 Oct 25 04:34:06.532783 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4129/8138] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:06 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:07.563230 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:07.564467 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:07.573548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:34:07.580333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:07.581582 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:07.582260 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:07.583232 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:07.583967 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:07.584578 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:07.775953 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:07.784306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a70cff03-f58a-4296-8b44-0178de6f607a tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.230129 Oct 25 04:34:07.796197 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4010/8139] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:07 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:08.808642 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:08.809286 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:08.816521 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:08.817694 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:08.818502 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:08.818848 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:08.819305 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:08.819735 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:08.983881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:08.998976 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-cba7f6c3-cb9c-41d0-b11b-81ffb3293886 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.189201 Oct 25 04:34:09.003445 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4130/8140] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:08 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:09.025104 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-651484ac-b9ae-493c-886e-23d1e7dc1fbf req-65dae84a-21a1-4f67-a066-d707c08ad8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5558294-7938-4601-ac3c-a04490b1c8ef", "name": "network-vif-unplugged", "status": "completed", "tag": "faeb767a-5c22-47fd-9d2d-866d693772b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:34:09.038916 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-651484ac-b9ae-493c-886e-23d1e7dc1fbf req-65dae84a-21a1-4f67-a066-d707c08ad8f3 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:09.039493 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-651484ac-b9ae-493c-886e-23d1e7dc1fbf req-65dae84a-21a1-4f67-a066-d707c08ad8f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:09.040033 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-651484ac-b9ae-493c-886e-23d1e7dc1fbf req-65dae84a-21a1-4f67-a066-d707c08ad8f3 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:09.059306 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-651484ac-b9ae-493c-886e-23d1e7dc1fbf req-65dae84a-21a1-4f67-a066-d707c08ad8f3 service nova] Creating event network-vif-unplugged:faeb767a-5c22-47fd-9d2d-866d693772b9 for instance d5558294-7938-4601-ac3c-a04490b1c8ef on n-h1-862355-1 Oct 25 04:34:09.065515 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-651484ac-b9ae-493c-886e-23d1e7dc1fbf req-65dae84a-21a1-4f67-a066-d707c08ad8f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048250 Oct 25 04:34:09.066228 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4011/8141] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:34:10.018004 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:10.018675 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:10.027059 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:10.027717 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:10.028221 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:10.028939 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:10.029450 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:10.029909 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:10.181396 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:10.189905 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2ff93acd-a403-4296-bd65-f156e30a3750 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.175762 Oct 25 04:34:10.190507 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4131/8142] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:10 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:11.214718 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:11.215546 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:11.221905 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:11.222408 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:11.222864 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:11.223585 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:11.224244 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:11.224857 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:11.376625 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:11.385529 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-1d8a3400-805a-47d0-859e-3ade5c57f26b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.175893 Oct 25 04:34:11.386771 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4012/8143] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:11 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:12.408589 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:12.409145 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:12.416375 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:12.416864 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:12.417307 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:12.418036 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:12.419317 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:12.419758 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:12.566583 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:12.576247 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-5dd9da67-51a7-4795-8181-fa4676832603 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.171611 Oct 25 04:34:12.585887 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4132/8144] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:12 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:13.599628 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:13.600295 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:13.607243 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:13.607751 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:13.608214 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:13.608935 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:13.609414 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:13.609898 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:13.759661 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:13.767746 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-2a9b49e2-2ec4-42ce-98ef-591a98206e49 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.172015 Oct 25 04:34:13.768337 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4013/8145] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:13 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:14.793698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:14.795131 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:14.803209 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:14.803711 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:14.804266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:14.805015 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:14.805544 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:14.806016 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:14.945005 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:14.952903 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ec88ce6a-4e55-4593-b231-ea6bdbf5b8bb tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.165239 Oct 25 04:34:14.953480 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4133/8146] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:14 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:15.976863 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:15.978270 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:15.981044 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell0:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:34:15.986453 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:15.986951 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:15.987405 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:15.988109 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:15.988579 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:15.989020 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:16.122992 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:16.130771 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-4dfc9ca7-48c0-44d6-88f8-e0fb3a20223d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.157890 Oct 25 04:34:16.131357 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4014/8147] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:15 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:17.153989 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:17.154610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:17.156469 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:34:17.157156 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell0:SELECT=6 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:34:17.164255 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:17.164741 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:17.165178 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:17.165899 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:17.166380 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:17.166794 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:17.371388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:17.379111 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-a806a3f0-e413-4d4d-b86b-608fc492fe37 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.229318 Oct 25 04:34:17.379987 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4134/8148] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:17 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:17.927158 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-7cc40132-5f31-4ea8-9e5a-ed3116a7c32e req-35f5a11e-1455-49e3-bc66-34a45ba65b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d20d676-6d22-4b69-8aba-9c18b2eef24c", "tag": "9b6e0f24-66c5-4126-ad14-8143228c65c0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:34:17.938765 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7cc40132-5f31-4ea8-9e5a-ed3116a7c32e req-35f5a11e-1455-49e3-bc66-34a45ba65b26 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:17.939547 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7cc40132-5f31-4ea8-9e5a-ed3116a7c32e req-35f5a11e-1455-49e3-bc66-34a45ba65b26 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:17.940011 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-7cc40132-5f31-4ea8-9e5a-ed3116a7c32e req-35f5a11e-1455-49e3-bc66-34a45ba65b26 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:17.952188 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-7cc40132-5f31-4ea8-9e5a-ed3116a7c32e req-35f5a11e-1455-49e3-bc66-34a45ba65b26 service nova] Creating event network-changed:9b6e0f24-66c5-4126-ad14-8143228c65c0 for instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c on n-h2-862355-1 Oct 25 04:34:17.957068 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-7cc40132-5f31-4ea8-9e5a-ed3116a7c32e req-35f5a11e-1455-49e3-bc66-34a45ba65b26 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034558 Oct 25 04:34:17.957712 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4015/8149] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:34:18.402610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:18.403167 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:18.410771 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:18.411266 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:18.411710 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:18.412416 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:18.412878 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:18.413309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:18.596610 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:18.604444 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-0d94060b-e31c-4528-8551-5e5bc5569385 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.206004 Oct 25 04:34:18.605024 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4135/8150] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:18 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:19.629397 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:19.630145 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:19.637420 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:19.638008 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:19.638460 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:19.639156 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:19.639619 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:19.640053 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:19.772514 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:19.781026 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-3fdb8809-a211-4b3d-9032-5986d1369eec tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.156807 Oct 25 04:34:19.781612 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4016/8151] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:19 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:20.803900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:20.804531 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:20.812816 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:20.813314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:20.813788 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:20.814505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:20.814999 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:20.815435 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:21.190042 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:21.198745 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-c33c1234-e6c7-46b2-954c-edfd4f423d5b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.398665 Oct 25 04:34:21.199350 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4136/8152] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:20 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:22.222958 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:22.223602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:22.231569 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:22.232064 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:22.232511 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:22.233220 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:22.233707 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:22.234146 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:22.702639 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:22.710359 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-35395001-f3e6-42bb-a2b1-57e6f99de26f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.491393 Oct 25 04:34:22.710944 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4017/8153] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:22 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:23.733898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:23.734505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:23.741269 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:23.741779 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:23.742214 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:23.742900 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:23.743350 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:23.743774 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:23.940284 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:23.948464 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-bbfb5532-3e30-4786-93b0-07b9f4cf8b4b tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.219613 Oct 25 04:34:23.949041 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4137/8154] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:23 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:24.592658 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-568e6326-1d55-462b-a15c-4443fb9d4960 req-b3932192-4d8c-470b-88df-49df9b448d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d20d676-6d22-4b69-8aba-9c18b2eef24c", "name": "network-vif-plugged", "status": "completed", "tag": "9b6e0f24-66c5-4126-ad14-8143228c65c0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:34:24.603548 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-568e6326-1d55-462b-a15c-4443fb9d4960 req-b3932192-4d8c-470b-88df-49df9b448d57 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:24.604045 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-568e6326-1d55-462b-a15c-4443fb9d4960 req-b3932192-4d8c-470b-88df-49df9b448d57 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:24.604723 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-568e6326-1d55-462b-a15c-4443fb9d4960 req-b3932192-4d8c-470b-88df-49df9b448d57 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:24.616068 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-568e6326-1d55-462b-a15c-4443fb9d4960 req-b3932192-4d8c-470b-88df-49df9b448d57 service nova] Creating event network-vif-plugged:9b6e0f24-66c5-4126-ad14-8143228c65c0 for instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c on n-h2-862355-1 Oct 25 04:34:24.621535 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-568e6326-1d55-462b-a15c-4443fb9d4960 req-b3932192-4d8c-470b-88df-49df9b448d57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033138 Oct 25 04:34:24.622164 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4018/8155] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:34:24.971958 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:24.972579 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:24.979714 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:24.980202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:24.980644 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:24.981338 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:24.981869 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:24.982303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:25.126793 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:25.135346 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-fd08e392-f683-4292-bd61-6e9b1417cda7 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1375 microversion: 2.1 time: 0.166513 Oct 25 04:34:25.135751 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4138/8156] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:24 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:26.159346 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:26.160102 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:26.166940 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:26.167440 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:26.167894 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:26.168602 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:26.169075 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:26.169518 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:26.304495 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:26.313139 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-9c683f53-c382-4cd3-966b-c8b04ac19715 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1561 microversion: 2.1 time: 0.159078 Oct 25 04:34:26.313740 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4019/8157] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:26 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:26.336069 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:34:26.336688 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:34:26.344199 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:26.344689 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:26.345114 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:26.345843 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:26.346301 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:26.346729 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:26.478406 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:34:26.486175 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-06c5889e-86b8-488b-83c5-755e57278b5d tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1561 microversion: 2.1 time: 0.153939 Oct 25 04:34:26.486754 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4139/8158] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:34:26 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:34:28.073416 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-400aa163-c8a5-44ff-8cc6-f691d476ac85 req-425a4646-2fc1-4cb1-a18c-8d100a5ca6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d20d676-6d22-4b69-8aba-9c18b2eef24c", "tag": "9b6e0f24-66c5-4126-ad14-8143228c65c0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:34:28.079231 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=27 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:34:28.085065 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-400aa163-c8a5-44ff-8cc6-f691d476ac85 req-425a4646-2fc1-4cb1-a18c-8d100a5ca6db service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:34:28.085564 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-400aa163-c8a5-44ff-8cc6-f691d476ac85 req-425a4646-2fc1-4cb1-a18c-8d100a5ca6db service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:34:28.086038 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-400aa163-c8a5-44ff-8cc6-f691d476ac85 req-425a4646-2fc1-4cb1-a18c-8d100a5ca6db service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:34:28.098066 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-400aa163-c8a5-44ff-8cc6-f691d476ac85 req-425a4646-2fc1-4cb1-a18c-8d100a5ca6db service nova] Creating event network-changed:9b6e0f24-66c5-4126-ad14-8143228c65c0 for instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c on n-h2-862355-1 Oct 25 04:34:28.103301 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-400aa163-c8a5-44ff-8cc6-f691d476ac85 req-425a4646-2fc1-4cb1-a18c-8d100a5ca6db service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Oct 25 04:34:28.104451 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4020/8159] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:36:41.276849 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:41.277626 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=68 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:41.278470 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:36:41.278642 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c/action (ip 10.222.0.36) !!! Oct 25 04:36:41.280344 n-d-862355-1 devstack@n-api.service[120562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 25 04:36:41.280507 n-d-862355-1 devstack@n-api.service[120562]: Tue Oct 25 04:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c/action (ip 10.222.0.36) !!! Oct 25 04:36:41.339316 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1748533073"}} {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:36:41.342067 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:36:41.349388 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:41.349895 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:41.350355 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:41.351044 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:41.351498 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:41.351922 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:41.554746 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ffbb40f9-3bfe-4f20-a20c-47ce5c4c1c5f tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "POST /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c/action" status: 202 len: 0 microversion: 2.1 time: 0.279790 Oct 25 04:36:41.555315 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4140/8160] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Oct 25 04:36:41 2022] POST /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 25 04:36:49.190408 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 25 04:36:49.192274 n-d-862355-1 devstack@n-api.service[120563]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 25 04:36:49.193307 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=1 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:49.194174 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=50 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:49.196695 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:36:49.197588 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 25 04:36:49.198975 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 25 04:36:49.199117 n-d-862355-1 devstack@n-api.service[120563]: Tue Oct 25 04:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 25 04:36:49.206351 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-5091eaa2-cd93-4473-9117-196b1a14695d req-92b2d773-286e-4ca7-8977-ac042c48dc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d20d676-6d22-4b69-8aba-9c18b2eef24c", "name": "network-vif-plugged", "status": "completed", "tag": "9b6e0f24-66c5-4126-ad14-8143228c65c0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:36:49.221984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5091eaa2-cd93-4473-9117-196b1a14695d req-92b2d773-286e-4ca7-8977-ac042c48dc96 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:49.223018 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5091eaa2-cd93-4473-9117-196b1a14695d req-92b2d773-286e-4ca7-8977-ac042c48dc96 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:49.223917 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-5091eaa2-cd93-4473-9117-196b1a14695d req-92b2d773-286e-4ca7-8977-ac042c48dc96 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:49.240220 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-5091eaa2-cd93-4473-9117-196b1a14695d req-92b2d773-286e-4ca7-8977-ac042c48dc96 service nova] Creating event network-vif-plugged:9b6e0f24-66c5-4126-ad14-8143228c65c0 for instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c on n-h2-862355-1 Oct 25 04:36:49.245770 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-5091eaa2-cd93-4473-9117-196b1a14695d req-92b2d773-286e-4ca7-8977-ac042c48dc96 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058538 Oct 25 04:36:49.246688 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4021/8161] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:36:59.395818 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_api:SELECT=2 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:59.397308 n-d-862355-1 devstack@n-api.service[120562]: DEBUG dbcounter [-] [120562] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:59.402109 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:36:59.402992 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:36:59.405306 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_api:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:59.406096 n-d-862355-1 devstack@n-api.service[120563]: DEBUG dbcounter [-] [120563] Writing DB stats nova_cell1:SELECT=2 {{(pid=120563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 25 04:36:59.410706 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:59.411327 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:59.411873 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:59.412830 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:59.413709 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:59.414397 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:59.414634 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [d706ad2b-45ac-42ff-a27b-000f3bb12000] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47442. Oct 25 04:36:59.426160 n-d-862355-1 devstack@n-api.service[120563]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d2ef081-8141-43e4-97bb-0fe33283bca3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47440. Oct 25 04:36:59.449636 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:36:59.474205 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-009426d7-c5d8-4fd8-8a48-2d37470a9401 req-6311be63-4b57-49ec-ae67-18b05f057c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d20d676-6d22-4b69-8aba-9c18b2eef24c", "tag": "9b6e0f24-66c5-4126-ad14-8143228c65c0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:36:59.485700 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-009426d7-c5d8-4fd8-8a48-2d37470a9401 req-6311be63-4b57-49ec-ae67-18b05f057c16 service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:59.486206 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-009426d7-c5d8-4fd8-8a48-2d37470a9401 req-6311be63-4b57-49ec-ae67-18b05f057c16 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:59.486651 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-009426d7-c5d8-4fd8-8a48-2d37470a9401 req-6311be63-4b57-49ec-ae67-18b05f057c16 service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:59.499082 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-009426d7-c5d8-4fd8-8a48-2d37470a9401 req-6311be63-4b57-49ec-ae67-18b05f057c16 service nova] Creating event network-changed:9b6e0f24-66c5-4126-ad14-8143228c65c0 for instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c on n-h2-862355-1 Oct 25 04:36:59.505772 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-009426d7-c5d8-4fd8-8a48-2d37470a9401 req-6311be63-4b57-49ec-ae67-18b05f057c16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107929 Oct 25 04:36:59.506635 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4022/8162] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:36:59.549566 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-e6597e5a-6b85-4c5f-bc49-ce527f470535 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 204 len: 0 microversion: 2.1 time: 0.156023 Oct 25 04:36:59.553807 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4141/8163] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:36:59 2022] DELETE /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:36:59.561266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:36:59.562201 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:36:59.569667 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:59.570333 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:59.570878 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:59.572101 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:36:59.572861 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:36:59.573615 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:36:59.769266 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:36:59.777472 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-93cf78ae-1146-4fd7-bf9e-d217f77012ed tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1686 microversion: 2.1 time: 0.221520 Oct 25 04:36:59.778121 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4023/8164] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:36:59 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1686 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:37:00.802841 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:00.803558 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:37:00.810309 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:00.811062 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:00.811505 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:00.812202 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:00.813257 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:00.813727 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:01.012427 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:37:01.020785 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-aa5e876f-3aa9-4455-bd0f-c4a869f30eb4 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1686 microversion: 2.1 time: 0.222235 Oct 25 04:37:01.021361 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4142/8165] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:37:00 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1686 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:37:01.659428 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-dee91d2a-5742-44ab-813c-bde062f7e742 req-33cb9fd0-e4cc-41f7-8739-d6417029211f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d20d676-6d22-4b69-8aba-9c18b2eef24c", "name": "network-vif-deleted", "tag": "9b6e0f24-66c5-4126-ad14-8143228c65c0"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:37:01.669190 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dee91d2a-5742-44ab-813c-bde062f7e742 req-33cb9fd0-e4cc-41f7-8739-d6417029211f service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:01.669719 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dee91d2a-5742-44ab-813c-bde062f7e742 req-33cb9fd0-e4cc-41f7-8739-d6417029211f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:01.670195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-dee91d2a-5742-44ab-813c-bde062f7e742 req-33cb9fd0-e4cc-41f7-8739-d6417029211f service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:01.682610 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-dee91d2a-5742-44ab-813c-bde062f7e742 req-33cb9fd0-e4cc-41f7-8739-d6417029211f service nova] Creating event network-vif-deleted:9b6e0f24-66c5-4126-ad14-8143228c65c0 for instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c on n-h2-862355-1 Oct 25 04:37:01.687887 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-dee91d2a-5742-44ab-813c-bde062f7e742 req-33cb9fd0-e4cc-41f7-8739-d6417029211f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089000 Oct 25 04:37:01.688789 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4024/8166] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 25 04:37:02.044991 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:02.046146 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:37:02.053603 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:02.054152 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:02.054736 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:02.055468 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:02.055931 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:02.056358 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:02.091399 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:02.091898 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:02.092303 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:02.092789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.objects.instance [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lazy-loading 'fault' on Instance uuid 1d20d676-6d22-4b69-8aba-9c18b2eef24c {{(pid=120562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 25 04:37:02.137492 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:37:02.145374 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-2e91b456-ca92-421a-85e6-9b8227cd21d3 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 200 len: 1339 microversion: 2.1 time: 0.104582 Oct 25 04:37:02.145978 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4143/8167] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:37:02 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:37:03.171195 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:03.172000 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: 1d20d676-6d22-4b69-8aba-9c18b2eef24c] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:37:03.178302 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:03.178803 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:03.179257 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:03.179962 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:03.180435 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:03.180886 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:03.195083 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.wsgi [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] HTTP exception thrown: Instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c could not be found. Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Request method failure captured: Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: request: GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c HTTP/1.1 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: Accept: application/json Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: Accept-Encoding: identity Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: Connection: close Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: Content-Length: 0 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: Content-Type: application/json Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: Host: 10.222.0.36 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: Openstack-System-Scope: None Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: User-Agent: python-urllib3/1.26.12 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Auth-Token: gAAAAABjV2ajrrqTCTuBtR3uNYOCPwshrNebheWxofuj3rEBRfAQMnzJmiHU39LUQWGSqwvm2Ci3yh5qAbutVoUxSNvLjET2SrZ-eaJWaEJ788MeyRbX7r1-97hR-QP3IaiIsXnLcfDs8NLrW0nr44RqVSQJAKLzj0a0zM4VqcCTFAS0gzwgiXw Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Id: None Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Domain-Name: None Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Identity-Status: Confirmed Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Is-Admin-Project: True Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Id: default Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Domain-Name: Default Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Id: 8e03e95fb4df4869aed86b5b1de2f545 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Project-Name: tempest-TestSnapshotPattern-1397185327 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Role: reader,member Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Roles: reader,member Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8e03e95fb4df4869aed86b5b1de2f545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8e03e95fb4df4869aed86b5b1de2f545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8e03e95fb4df4869aed86b5b1de2f545", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8e03e95fb4df4869aed86b5b1de2f545"}]}] Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant: tempest-TestSnapshotPattern-1397185327 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Id: 8e03e95fb4df4869aed86b5b1de2f545 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-Tenant-Name: tempest-TestSnapshotPattern-1397185327 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-User: tempest-TestSnapshotPattern-1397185327-project Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Id: default Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-User-Domain-Name: Default Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-User-Id: ffccdebfc41048b7a2e8027cbb9b8305 Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: X-User-Name: tempest-TestSnapshotPattern-1397185327-project Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: method: > Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: exception: Instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c could not be found. Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: action_args: {'id': '1d20d676-6d22-4b69-8aba-9c18b2eef24c'} Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c could not be found. Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c could not be found. Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:37:03.196722 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c could not be found. Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: ERROR nova.api.openstack.wsgi Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Returning 404 to user: Instance 1d20d676-6d22-4b69-8aba-9c18b2eef24c could not be found. {{(pid=120563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-a62ac0e5-8988-4b03-bb17-9505d639384e tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c" status: 404 len: 111 microversion: 2.1 time: 0.032226 Oct 25 04:37:03.202600 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4025/8168] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:37:03 2022] GET /compute/v2.1/servers/1d20d676-6d22-4b69-8aba-9c18b2eef24c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:37:04.541061 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:04.541698 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:37:04.543444 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-431a2072-c0b0-49e6-a2af-079613da667f req-fb0b792e-4750-40db-810a-66e00b1afe7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5558294-7938-4601-ac3c-a04490b1c8ef", "tag": "faeb767a-5c22-47fd-9d2d-866d693772b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:37:04.549789 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:04.550367 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:04.551019 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:04.551820 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:04.552372 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:04.552906 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:04.554770 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-431a2072-c0b0-49e6-a2af-079613da667f req-fb0b792e-4750-40db-810a-66e00b1afe7a service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:04.555262 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-431a2072-c0b0-49e6-a2af-079613da667f req-fb0b792e-4750-40db-810a-66e00b1afe7a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:04.556376 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-431a2072-c0b0-49e6-a2af-079613da667f req-fb0b792e-4750-40db-810a-66e00b1afe7a service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:04.570036 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-431a2072-c0b0-49e6-a2af-079613da667f req-fb0b792e-4750-40db-810a-66e00b1afe7a service nova] Creating event network-changed:faeb767a-5c22-47fd-9d2d-866d693772b9 for instance d5558294-7938-4601-ac3c-a04490b1c8ef on n-h1-862355-1 Oct 25 04:37:04.575643 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-431a2072-c0b0-49e6-a2af-079613da667f req-fb0b792e-4750-40db-810a-66e00b1afe7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036050 Oct 25 04:37:04.576272 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4026/8169] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:37:04.583242 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Going to try to terminate instance {{(pid=120562) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 25 04:37:04.669823 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-15fb0900-8bdc-413e-ab1b-1584ce9231f2 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 204 len: 0 microversion: 2.1 time: 0.132514 Oct 25 04:37:04.670967 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4144/8170] 10.222.0.36 () {58 vars in 1239 bytes} [Tue Oct 25 04:37:04 2022] DELETE /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 25 04:37:04.681213 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:04.682285 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.compute.api [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120563) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:37:04.688984 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:04.689515 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:04.690004 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:04.690724 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:04.691381 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:04.691835 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:04.837928 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.policy [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120563) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:37:04.847140 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-c26a05a5-09d9-4492-a0e0-0e517d533c22 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1683 microversion: 2.1 time: 0.170618 Oct 25 04:37:04.847823 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4027/8171] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:37:04 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 25 04:37:05.871965 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:05.872680 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:37:05.879775 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:05.880267 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:05.880703 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:05.881401 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:05.881886 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:05.882314 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:05.955029 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.policy [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffccdebfc41048b7a2e8027cbb9b8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e03e95fb4df4869aed86b5b1de2f545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120562) authorize /opt/stack/nova/nova/policy.py:199}} Oct 25 04:37:05.963263 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-615a7b69-0d1a-4276-9c8c-22bf82f98a69 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 200 len: 1497 microversion: 2.1 time: 0.095643 Oct 25 04:37:05.963844 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4145/8172] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:37:05 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 1497 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 25 04:37:06.591842 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [req-918794f3-e3e3-48a6-b850-ea7ebb8cd6bf req-d8b9e64f-af1e-4478-86fd-1bc88d4eab6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5558294-7938-4601-ac3c-a04490b1c8ef", "name": "network-vif-deleted", "tag": "faeb767a-5c22-47fd-9d2d-866d693772b9"}]} {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 25 04:37:06.603506 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-918794f3-e3e3-48a6-b850-ea7ebb8cd6bf req-d8b9e64f-af1e-4478-86fd-1bc88d4eab6e service nova] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:06.603994 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-918794f3-e3e3-48a6-b850-ea7ebb8cd6bf req-d8b9e64f-af1e-4478-86fd-1bc88d4eab6e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:06.604434 n-d-862355-1 devstack@n-api.service[120563]: DEBUG oslo_concurrency.lockutils [req-918794f3-e3e3-48a6-b850-ea7ebb8cd6bf req-d8b9e64f-af1e-4478-86fd-1bc88d4eab6e service nova] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:06.616395 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.compute.server_external_events [req-918794f3-e3e3-48a6-b850-ea7ebb8cd6bf req-d8b9e64f-af1e-4478-86fd-1bc88d4eab6e service nova] Creating event network-vif-deleted:faeb767a-5c22-47fd-9d2d-866d693772b9 for instance d5558294-7938-4601-ac3c-a04490b1c8ef on n-h1-862355-1 Oct 25 04:37:06.621125 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [req-918794f3-e3e3-48a6-b850-ea7ebb8cd6bf req-d8b9e64f-af1e-4478-86fd-1bc88d4eab6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034068 Oct 25 04:37:06.622104 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4028/8173] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Oct 25 04:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 25 04:37:06.987230 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '>' {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:06.987881 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.compute.api [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] [instance: d5558294-7938-4601-ac3c-a04490b1c8ef] Fetching instance by UUID {{(pid=120562) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 25 04:37:07.001641 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:07.002170 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:07.002648 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:07.003359 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Acquiring lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 25 04:37:07.003817 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 25 04:37:07.004246 n-d-862355-1 devstack@n-api.service[120562]: DEBUG oslo_concurrency.lockutils [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Lock "10ec2fc0-f6d0-4e98-acff-735f4bcc5b70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 25 04:37:07.018888 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.wsgi [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] HTTP exception thrown: Instance d5558294-7938-4601-ac3c-a04490b1c8ef could not be found. Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Request method failure captured: Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: request: GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef HTTP/1.1 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: Accept: application/json Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: Accept-Encoding: identity Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: Connection: close Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: Content-Length: 0 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: Content-Type: application/json Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: Host: 10.222.0.36 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: Openstack-System-Scope: None Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: User-Agent: python-urllib3/1.26.12 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Auth-Token: gAAAAABjV2ajrrqTCTuBtR3uNYOCPwshrNebheWxofuj3rEBRfAQMnzJmiHU39LUQWGSqwvm2Ci3yh5qAbutVoUxSNvLjET2SrZ-eaJWaEJ788MeyRbX7r1-97hR-QP3IaiIsXnLcfDs8NLrW0nr44RqVSQJAKLzj0a0zM4VqcCTFAS0gzwgiXw Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Id: None Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Domain-Name: None Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Identity-Status: Confirmed Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Is-Admin-Project: True Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Id: default Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Domain-Name: Default Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Id: 8e03e95fb4df4869aed86b5b1de2f545 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Project-Name: tempest-TestSnapshotPattern-1397185327 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Role: reader,member Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Roles: reader,member Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8e03e95fb4df4869aed86b5b1de2f545"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8e03e95fb4df4869aed86b5b1de2f545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8e03e95fb4df4869aed86b5b1de2f545", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8e03e95fb4df4869aed86b5b1de2f545"}]}] Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant: tempest-TestSnapshotPattern-1397185327 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Id: 8e03e95fb4df4869aed86b5b1de2f545 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-Tenant-Name: tempest-TestSnapshotPattern-1397185327 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-User: tempest-TestSnapshotPattern-1397185327-project Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Id: default Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-User-Domain-Name: Default Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-User-Id: ffccdebfc41048b7a2e8027cbb9b8305 Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: X-User-Name: tempest-TestSnapshotPattern-1397185327-project Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: method: > Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: exception: Instance d5558294-7938-4601-ac3c-a04490b1c8ef could not be found. Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: action_args: {'id': 'd5558294-7938-4601-ac3c-a04490b1c8ef'} Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: {{(pid=120562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5558294-7938-4601-ac3c-a04490b1c8ef could not be found. Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5558294-7938-4601-ac3c-a04490b1c8ef could not be found. Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 25 04:37:07.020584 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5558294-7938-4601-ac3c-a04490b1c8ef could not be found. Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: ERROR nova.api.openstack.wsgi Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: DEBUG nova.api.openstack.wsgi [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Returning 404 to user: Instance d5558294-7938-4601-ac3c-a04490b1c8ef could not be found. {{(pid=120562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 25 04:37:07.026493 n-d-862355-1 devstack@n-api.service[120562]: INFO nova.api.openstack.requestlog [None req-ce0a15b2-00ca-4e12-bbf5-39b510abac64 tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef" status: 404 len: 111 microversion: 2.1 time: 0.038895 Oct 25 04:37:07.028409 n-d-862355-1 devstack@n-api.service[120562]: [pid: 120562|app: 0|req: 4146/8174] 10.222.0.36 () {58 vars in 1236 bytes} [Tue Oct 25 04:37:06 2022] GET /compute/v2.1/servers/d5558294-7938-4601-ac3c-a04490b1c8ef => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 25 04:37:07.193392 n-d-862355-1 devstack@n-api.service[120563]: DEBUG nova.api.openstack.wsgi [None req-6e4338df-be08-44b3-a43d-8ad600e8dcfe tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] Calling method '.version_select at 0x7efd30108550>' {{(pid=120563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 25 04:37:07.217966 n-d-862355-1 devstack@n-api.service[120563]: INFO nova.api.openstack.requestlog [None req-6e4338df-be08-44b3-a43d-8ad600e8dcfe tempest-TestSnapshotPattern-1397185327 tempest-TestSnapshotPattern-1397185327-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1482800827" status: 202 len: 0 microversion: 2.1 time: 0.030549 Oct 25 04:37:07.218902 n-d-862355-1 devstack@n-api.service[120563]: [pid: 120563|app: 0|req: 4029/8175] 10.222.0.36 () {58 vars in 1257 bytes} [Tue Oct 25 04:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1482800827 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)